CN111247811A

CN111247811A - Data processing method, unmanned aerial vehicle, glasses equipment and storage medium

Info

Publication number: CN111247811A
Application number: CN201880065354.0A
Authority: CN
Inventors: 吴一凡; 陈古顺; 马超
Original assignee: SZ DJI Technology Co Ltd
Current assignee: SZ DJI Technology Co Ltd
Priority date: 2018-12-24
Filing date: 2018-12-24
Publication date: 2020-06-05
Also published as: WO2020132828A1

Abstract

A data processing method, eyewear equipment (11, 12, 13), a drone (10) and a storage medium, wherein the method comprises: the method includes the steps of obtaining video data including a plurality of frames of images (S201), obtaining a target watermarking mode (S202), adding a watermark to at least one frame of image in the video data according to the target watermarking mode (S203), and sending the image in the video data after the watermark is added (S204). The method can set the watermark on the video data, and influence the watching experience of a pirate, thereby protecting the video data in live broadcast.

Description

Data processing method, unmanned aerial vehicle, glasses equipment and storage medium

Technical Field

The embodiment of the invention relates to the technical field of electronics, in particular to a data processing method, an unmanned aerial vehicle, glasses equipment and a storage medium.

Background

With the development of digital graphics technology, the demand for live broadcasting of cross-machine events is becoming more and more vigorous, and many media are beginning to live such events on platforms. For example, in a cross-machine competition, a participating cross-machine may capture video data of a First Person View (FPV) and send the video data to a flyer's or spectator's glasses device and a live device set by a live party. The glasses equipment can play video data through the display screen so that the flier and the audience can know the flight condition of the traversing machine, and the live broadcast equipment can distribute the video data again to carry out live broadcast on the network. Generally, live broadcast content is protected by copyright, only authorized live broadcast parties and devices thereof can live broadcast video data, but an unauthorized live broadcast is performed by modifying glasses devices by a pirate to illegally obtain live broadcast video data. For example, a common pirate steals video data obtained by the glasses device through a display screen Interface by connecting a third-party device to the display screen Interface of the glasses device, for example, the display screen Interface may be a serial display Interface (DSI) based on a Mobile Industry Processor Interface (MIPI) protocol; the thief uses the third-party equipment to play the stolen video data to obtain profits, and the interests of video data owners are damaged. Therefore, how to protect video data in live broadcasting is a problem to be solved urgently at present.

Disclosure of Invention

The embodiment of the invention provides a data processing method, an unmanned aerial vehicle, glasses equipment and a storage medium, which can set watermarks on video data to influence the watching experience of a pirate, thereby protecting the video data in live broadcasting.

In a first aspect, an embodiment of the present invention provides a data processing method, where the method includes:

acquiring video data, wherein the video data comprises a plurality of frames of images;

acquiring a target watermark adding mode;

adding a watermark to at least one frame of image in the video data according to the target watermark adding mode;

and sending the images in the video data after the watermarks are added.

In a second aspect, an embodiment of the present invention provides a drone, including a memory, a processor, an image capture device, and an image transmission module,

the memory to store program instructions;

the processor calls the program instructions stored in the memory to execute the following steps:

shooting by the image shooting device to obtain video data, wherein the video data comprises a plurality of frames of images;

acquiring a target watermark adding mode;

and sending the image in the video data after the watermark is added through the image transmission module.

In a third aspect, an embodiment of the present invention provides an eyewear device, including a memory, a processor, a graphics module, and a display interface,

the memory to store program instructions;

acquiring video data through the image transmission module, wherein the video data comprises a plurality of frames of images;

acquiring a target watermark adding mode;

and sending the image in the video data added with the watermark through the display screen interface.

In the embodiment of the invention, the data processing equipment can acquire video data and a target watermark adding mode, adds a watermark to at least one frame of image in the video data according to the target watermark adding mode, and sends the image in the video data after adding the watermark; when the video data added with the watermark is played, the embezzler can watch the watermark in the image and influence the watching experience of the embezzler, so that the video data in live broadcast is protected, and the rights and interests of video data owners can be maintained. In addition, the scheme does not need to modify the hardware structure of the data processing equipment, so that the cost is reduced, and the human resources are saved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

Fig. 1 is a schematic diagram of a network architecture for data processing according to an embodiment of the present invention;

FIG. 2 is a flow chart of a data processing method according to an embodiment of the present invention;

FIG. 3 is a flow chart of another data processing method provided by the embodiment of the invention;

fig. 4 is a schematic diagram of adding a watermark to an image in video data according to an embodiment of the present invention;

FIG. 5 is a flow chart illustrating a further data processing method according to an embodiment of the present invention;

fig. 6 is a schematic diagram of another example of adding a watermark to an image in video data according to an embodiment of the present invention;

fig. 7 is a schematic diagram of another method for adding a watermark to an image in video data according to an embodiment of the present invention;

fig. 8 is a schematic diagram of another method for adding a watermark to an image in video data according to an embodiment of the present invention;

fig. 9 is a schematic structural diagram of an unmanned aerial vehicle provided in an embodiment of the present invention;

fig. 10 is a schematic structural diagram of an eyeglass apparatus according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In order to better understand the data processing method, the unmanned aerial vehicle and the glasses device provided by the embodiment of the invention, a network architecture of the embodiment of the invention is described first.

Referring to fig. 1, fig. 1 is a schematic diagram of a network architecture for data processing according to an embodiment of the present invention, where the network architecture at least includes an unmanned aerial vehicle 10 and a plurality of glasses devices, and fig. 1 illustrates three glasses devices, which are, for example, a glasses device 11 of a flyer, a glasses device 12 of a viewer, and a glasses device 13 of a viewer. Optionally, the network architecture may also include a live device 14 and a third party device 15.

Wherein, unmanned aerial vehicle 10 can be rotor type unmanned aerial vehicle, for example four rotor unmanned aerial vehicle, six rotor unmanned aerial vehicle, eight rotor unmanned aerial vehicle, also can be fixed wing unmanned aerial vehicle. Unmanned aerial vehicle 10 can include driving system, cloud platform and image shooting device 101, and driving system is used for providing flight power for unmanned aerial vehicle, and wherein, driving system includes one or more in screw, motor, the electricity accent. The image capturing device 101 is mounted on the main body of the unmanned aerial vehicle 10 via a pan/tilt head. The image capturing device 101 is used for capturing images or videos in the flight process of the unmanned aerial vehicle 10, and includes, but is not limited to, a multispectral imager, a hyperspectral imager, a visible light camera, an infrared camera, and the like, the cradle head is a multi-axis transmission and stability augmentation system, and the cradle head motor compensates the capturing angle of the image capturing device by adjusting the rotation angle of the rotation shaft, and prevents or reduces the shake of the imaging device by setting a proper buffer mechanism.

The glasses device may refer to a glasses device that can live video, such as Virtual Reality (VR) or Augmented Reality (AR), and the glasses device may refer to a device that is authorized by an owner (i.e., a flyer) of video data to play the video data. In a cross-flight competition, the eyewear equipment 11 of the flier may refer to eyewear equipment controlled by the flier (i.e., the contestant), and the eyewear equipment 12 of the spectator and the eyewear equipment 13 of the spectator may refer to eyewear equipment controlled by the spectator.

The live broadcast device 14 may be a live broadcast device set by an official (i.e., a live broadcast party), that is, the live broadcast device 14 may refer to a device authorized by an owner of video data or a copyright owner (i.e., a flyer or an official host), and is used for live broadcasting video data, and the live broadcast device 14 may refer to a device capable of live broadcasting video data, such as a smart phone, a tablet computer, a laptop computer, a ground station, and a live broadcast station.

The network architecture may be used for live events in a cross-machine race, and the drone 10 may be used for a cross-machine race, i.e., the drone 10 may be a cross-machine. In the cross-machine competition, the flyer (i.e., a competitor) can control the unmanned aerial vehicle 10 to shoot video data of a first-person visual angle through the image shooting device 101, and the unmanned aerial vehicle 10 can send the video data to each glasses device and the live broadcast device 14; each glasses device and live broadcast device 14 can live broadcast the received video data, so that the flying hands and the audience can know the flight conditions such as the flight height and/or the flight position of the unmanned aerial vehicle in real time through the video data.

The third-party device 15 may refer to a device for intercepting video data without authorization by the owner or copyright owner (i.e., the flyer or official host) of the video data; the third party device 15 may be connected to the viewer's glasses device through the display screen interface of the viewer's glasses device, steal video data from the viewer's glasses device, and play the video data and/or distribute the stolen video data to a network. The third-party device may refer to at least one of a smartphone, a tablet computer, a laptop computer, or a television.

In order to prevent the third party device from stealing the video data, the watermark can be added to at least one frame of image in the video data in any one of the following two ways. In one embodiment, the drone 10 may watermark at least one frame of image in the video data and send the watermarked image in the video data to the respective glasses devices and the live device. Each eyewear device and the live broadcast device may play the image in the watermarked video data, and the eyewear device 12 of the viewer may also transmit the image in the watermarked video data. In another embodiment, the drone 10 may send video data to various eyewear devices and live devices, and the viewer's eyewear device 12 may watermark at least one frame of image in the video data and display the image in the watermarked video data. Specifically, the processor in the eyewear device 12 of the viewer may send the image in the video data added with the watermark to the display screen of the eyewear device through the display screen interface, and if the third-party device 15 is connected to the eyewear device 12 of the viewer by cracking the display screen interface, the third-party device 15 may receive the image in the video data added with the watermark. Typically, the third party device 15 may play and/or distribute the stolen watermarked video data to the network. Because the live broadcast line which is usually embezzled supports the pause function, when a user who embezzles the live broadcast pauses the playing of the video data added with the watermark, the user has the probability to see the watermark; when the number of watching users is large, the stealing broadcast effect can be damaged by that a part of users pause to the watermark frame in a large probability, thereby protecting the video data in the live broadcast. In addition, in the process of playing the video data added with the watermark by the glasses equipment of the on-site audience, the watermark is added at certain intervals, so that the audience basically can not perceive the addition of the watermark and the watching effect of normal live broadcast is not influenced, and therefore, the effect of playing the video data by the glasses equipment or the live broadcast equipment can not be damaged by adding the watermark into the video data.

Referring to fig. 2, fig. 2 is a schematic flowchart of a data processing method according to an embodiment of the present invention, where the method may be executed by a data processing device, and the data processing device may be an unmanned aerial vehicle or a glasses device. As shown in fig. 2, the data processing method may include the following steps.

S201, the data processing equipment acquires video data, wherein the video data comprises a plurality of frames of images.

In the embodiment of the invention, the video data can be the video data shot by the unmanned aerial vehicle (namely the traversing machine) at the first-person visual angle in the traversing machine competition, and the flying hands or audiences can know the flying conditions such as the flying height and/or flying position of the unmanned aerial vehicle in real time through the video data. In one embodiment, the data processing device may be a drone, and in the crossing machine competition, the drone may capture video data through an image capture device. In another embodiment, the data processing device may be a glasses device that may obtain video data from a drone. Specifically, unmanned aerial vehicle is at the in-process of shooing video data, and every shooting of unmanned aerial vehicle obtains a frame image, can send this frame image to glasses equipment can live video data.

S202, the data processing equipment acquires a target watermark adding mode.

In one embodiment, the target watermarking pattern may be a user-set watermarking pattern. For example, a plurality of watermarking patterns including a random addition pattern and a fixed addition pattern are included in the data processing apparatus. The user can click a function button of the data processing device to enter a watermarking mode setting interface. The data processing device may display a random addition mode option and a fixed addition mode option on a watermarking mode setting interface. If the user selects the random addition mode, the data processing apparatus determines the random addition mode as the target watermarking mode. If the user selects the fixed addition mode, the data processing apparatus determines the fixed addition mode as the target watermarking mode. Or, the data processing apparatus may display a watermarking mode input box on the watermarking mode setting interface, and the target watermarking mode may refer to a watermarking mode input by a user in the watermarking mode input box.

In another embodiment, the target watermarking pattern may refer to a watermarking pattern that is automatically obtained by the data processing device. For example, to prevent theft of video data, the data device processing device may take the random addition mode as a default watermarking mode, and the target watermarking mode may refer to the default watermarking mode. That is, in this embodiment, without requiring the user to manually set the target watermarking mode, the data processing apparatus may automatically acquire one watermarking mode as the target watermarking mode according to a preset rule.

Optionally, the target watermarking mode is a fixed adding mode or a random adding mode. The fixed adding mode may refer to regularly adding a watermark to an image in the video data, and the fixed adding mode may include at least one of adding according to a fixed period, adding a fixed color, adding a fixed position, and adding content of the fixed watermark. The random addition pattern may refer to a non-regular addition of a watermark to an image in the video data, and the random addition pattern includes at least one of addition according to a random period, addition of a random color, and addition of a random position. The adding period refers to the frame number interval or time interval between two adjacent watermarking frames, the adding color refers to the color of the added content, and can be monochrome or multicolor, and the adding position refers to the position of the added watermark on the image. The addition period, the addition color, and the addition position will be described later in detail. The content of the watermark may include at least one of a pattern, text, and colored patches. For example, the watermark pattern includes a personal mark or a company logo of the video data owner, the text may include the name or company name of the video data owner, and the colored block may refer to a shape of a filled color, such as a gray watermark block.

S203, the data processing device adds the watermark to at least one frame of image in the video data according to the target watermark adding mode.

In one embodiment, when the target watermarking mode is a fixed watermarking mode, the data processing device may add the watermark to at least one frame of image in the video data according to the fixed watermarking mode, which may reduce the complexity of watermarking and improve the watermarking efficiency. For example, the data processing apparatus may add a watermark to at least one frame image in the video data at a fixed period, which may refer to a fixed time interval or a fixed number of frames interval.

In another embodiment, when the target watermarking mode is a random addition mode, the data processing device may add the watermark to at least one frame of image in the video data according to the random addition mode, which may prevent the watermark in the video data from being erased, and improve the security of the video data. For example, the data processing device may add a watermark to at least one frame of image in the video data at a random period, the random period comprising a random time interval or a random number of frames interval.

And S204, the data processing equipment sends the image in the video data after the watermark is added.

In one embodiment, the data processing device may be a drone, and the drone may send the image in the video data after the watermark is added to the glasses device, so that the glasses device may send the image in the video data after the watermark is added. In another embodiment, the data processing device may be a glasses device, and the glasses device may transmit the watermarked image in the video data. Specifically, the glasses device may send the image in the video data to which the watermark is added through the display screen interface, and if the third-party device is connected to the display screen interface of the glasses device, the third-party device may receive the image in the video data to which the watermark is added from the display screen interface. Since the image received by the third-party device has the watermark, the viewing experience is affected when the third-party device plays the watermarked video data. Or, after the third-party device distributes the video data added with the watermark to the network, the viewing experience is also affected when other devices play the video data added with the watermark.

Referring to fig. 3, fig. 3 is a schematic flowchart of another data processing method according to an embodiment of the present invention, where the method can be executed by a data processing device. The embodiment of the present invention is different from the embodiment of fig. 2 in that the embodiment of the present invention adds a watermark to at least one frame of image in video data by using a fixed adding mode. In the embodiment of the present invention shown in fig. 3, the data processing method may include the following steps.

S301, the data processing equipment acquires video data, and the video data comprises a plurality of frames of images.

In the embodiment of the present invention, please refer to the corresponding description of S201 for how the data processing device acquires the video data, which is not described herein again.

S302, a target watermark adding mode is obtained, wherein the target watermark adding mode is a fixed adding mode.

In the embodiment of the present invention, please refer to the description corresponding to S202 for how the data processing device obtains the target watermark adding mode, which is not described herein again.

And S303, adding a watermark to at least one frame of image in the video data according to a fixed adding mode by the data processing equipment.

In the embodiment of the invention, in order to prevent the video data from being stolen by the third-party equipment, the data processing equipment can add the watermark to at least one frame of image in the video data according to a fixed adding mode, so that the complexity of adding the watermark can be reduced, and the efficiency of adding the watermark can be improved.

In one embodiment, step S303 includes: the data processing device may add a watermark to at least one frame of image in the video data at regular time intervals. For example, the fixed frame number interval may be 4s, and the data processing apparatus may count from the first frame image in the captured (i.e., captured or received) video data, add a watermark to the image captured at the 4 th s in the video data, add a watermark to the image captured at the 8 th s in the video data, and so on. Wherein, this fixed time interval can be that the user sets up manually, also can refer to unmanned aerial vehicle automatic setting. The fixed time interval may be less than a maximum preset time and greater than a minimum preset time, for example, the maximum preset time may be 6s, and the minimum preset time may be 2 s.

In another embodiment, step S303 includes: the data processing apparatus may add a watermark to at least one frame image in the video data at intervals of a fixed number of frames. For example, as shown in fig. 4, the fixed frame number interval may refer to 240, and the data processing apparatus may count from the first frame image acquired (i.e., captured or received) video data, add a watermark to the 240 th frame image in the video data, add a watermark to the 480 th frame image in the video data, and so on. Wherein, this fixed frame number interval can be that the user sets up manually, also can refer to unmanned aerial vehicle automatic setting. For example, the fixed frame number interval may be an integer multiple of a Group of Pictures (GOP) of the video data. The fixed frame interval may be smaller than a maximum preset frame number and larger than a minimum preset frame number, for example, the maximum preset frame number may be 300 frames, and the minimum preset frame number may be 180 frames.

In yet another embodiment, step S303 includes: the data processing device may add a watermark to the key frame images in the video data. For example, in the encoding or decoding process of video, an operation of adding a watermark is performed for a key frame (I frame) of video data. The operation of adding the watermark to the key frame can be completed before the encoding or the decoding is completed, or the operation of adding the watermark to the key frame can be completed after the encoding or the decoding is completed.

In yet another embodiment, step S303 includes: the data processing device may add a watermark to a fixed location of at least one frame of image in the video data, i.e. at the same location of each image to be watermarked. In one embodiment, the fixed location may be at any location in the target image; in another embodiment, the fixed position may be located in any one of a middle region, an upper left corner region, a lower left corner region, an upper right corner region, and a lower right corner region of a target image, the target image being any image of the video data to which the watermark is added. Wherein, this fixed position can be that the user sets up manually, also can refer to unmanned aerial vehicle automatic setting.

In yet another embodiment, step S303 includes: the data processing device may add a watermark of a fixed color to at least one frame of image in the video data, i.e. a watermark of the same color is added to each image to be watermarked. To avoid that the watermark affects the effect of the eyewear equipment, the fixed color may be a relatively light color, such as grey.

And S304, the data processing device sends the image in the video data after the watermark is added.

In the embodiment of the present invention, please refer to the description corresponding to S204 for how the data processing device sends the image in the video data after adding the watermark, which is not described herein again.

In the embodiment of the invention, a data processing device can acquire video data and acquire a target watermark adding mode, wherein the target watermark adding mode is a fixed adding mode, a watermark is added to at least one frame of image in the video data according to the fixed adding mode, and the image in the video data after the watermark is added is sent; when the video data added with the watermark is played, the embedder can view the watermark in the image and influence the viewing experience of the embedder, so that the video data in live broadcast is protected, the rights and interests of video data owners can be maintained, the complexity of adding the watermark can be reduced, and the efficiency of adding the watermark is improved. In addition, the scheme does not need to modify the hardware structure of the data processing equipment, so that the cost is reduced, and the human resources are saved.

Referring to fig. 5, fig. 5 is a flowchart illustrating another data processing method according to an embodiment of the present invention, where the method can be executed by a data processing device. The embodiment of the present invention is different from the embodiment of fig. 2 in that the embodiment of the present invention adds a watermark to at least one frame of image in video data by using a random adding mode. In the embodiment of the present invention shown in fig. 5, the data processing method may include the following steps.

S501, the data processing equipment acquires video data, and the video data comprises a plurality of frames of images.

S502, a target watermark adding mode is obtained, and the target watermark adding mode is a random adding mode.

S503, the data processing device adds the watermark to at least one frame of image in the video data according to a random adding mode.

In the embodiment of the invention, in order to prevent the video data from being stolen by third-party equipment, the data processing equipment adds the watermark to at least one frame of image in the video data according to the random adding mode, so that the watermark in the video data can be prevented from being erased, and the safety of the video data is improved.

In one embodiment, step S503 includes: the data processing equipment can add the watermark to at least one frame of image in the video data at random time intervals, so that a pirate can be prevented from erasing the watermark on the image. For example, the random time interval may include 3s, 4s, 5s, and so on, and the data processing apparatus may add a watermark to the 3 rd image in the video data, add a watermark to the 7 th image in the video data, add a watermark to the 12 th acquired image, and so on.

In another embodiment, step S503 includes: the data processing device adds a watermark to at least one frame of image in the video data at random time intervals and at fixed time intervals. For example, the fixed time interval may be 4s, and the random time interval may include 3s, 4s, 5s, and so on. The data processing device may add a watermark to the image obtained in the 3 rd step and add a watermark to the image obtained in the 4 th step; adding a watermark to the image acquired at the 7 th s, adding a watermark to the image acquired at the 8 th s, adding a watermark to the image acquired at the 12 th s, and so on. In one embodiment, if the random time interval is too large, the watermark can be added only in a few images, so that the probability that the pirate views the watermark is reduced, that is, the viewing experience of the pirate is less affected, and the effect of affecting the viewing experience of the pirate cannot be achieved; if the random time interval is too small, the watermarks need to be added into more images, the probability that the embezzler views the watermarks is increased, namely the viewing experience of the embezzler is greatly influenced, and the effect of influencing the viewing experience of the embezzler can be achieved; meanwhile, the glasses device playing device can be affected, that is, the watching experience of the authorized user can be affected. Therefore, the data processing apparatus may set the random time interval to be greater than the minimum preset time period and less than the maximum preset time period. The minimum preset time and the maximum preset time may be determined according to visual characteristics of human eyes, or the minimum preset time and the maximum preset time may be dynamically set. For example, the minimum preset time period may be 2s, and the maximum preset time period may be 6 s.

In yet another embodiment, step S503 includes: the data processing apparatus may add a watermark to at least one frame image in the video data at random frame number intervals. For example, the random number of frames interval may include 238, 239, 242, etc., and the data processing apparatus may count from the first frame image acquired (i.e., captured or received) video data, as shown in fig. 6, add a watermark to the 238 th frame (i.e., frame 238) image in the video data, add a watermark to the 477 th frame image in the video data, add a watermark to the 719 th frame image in the video data, etc.

In yet another embodiment, step S503 includes: the data processing apparatus may add a watermark to at least one frame image in the video data at random frame number intervals and fixed frame number intervals. For example, as shown in FIG. 7, the fixed frame interval may be 240, and the random frame interval may include 238, 239, and 242, and so on. The data processing device may count from the first frame image that the video data was acquired (i.e., captured or received), add a watermark to the 238 th frame image (i.e., frame 238) in the video data, add a watermark to the 240 th frame image in the video data; adding a watermark to the 477 frame image in the video data, and adding a watermark to the 480 st frame image in the video data; a watermark or the like is added to the 719 th frame image acquired in the video data.

In one embodiment, if the random frame number interval is too large, the watermark can be added only in fewer images, so that the probability that the pirate watches the watermark is reduced, namely, the watching experience of the pirate is less influenced, and the effect of influencing the watching experience of the pirate cannot be achieved; if the random frame number interval is too small, watermarks need to be added into more images, the probability that a stealer watches the watermarks is increased, namely the watching experience of the stealer is greatly influenced, and the effect of influencing the watching experience of the stealer can be achieved; meanwhile, the glasses device playing device can be influenced, namely the watching experience of the authorized user can be influenced. Therefore, the data processing apparatus can set the random frame number interval to be greater than the minimum preset frame number and less than the maximum preset frame number. The minimum preset frame number and the maximum preset frame number may be determined according to visual characteristics of human eyes, or the minimum preset frame number and the maximum preset frame number may be dynamically set according to a video code rate of video data. For example, for 60fps video data, the minimum preset frame number may be 180 frames, and the maximum preset frame number may be 300 frames.

In yet another embodiment, step S503 includes: the data processing device may add a watermark to random locations of at least one frame of image in the video data. For example, the data processing apparatus may add a watermark to a middle region of a 240 th frame image acquired in the video data, and add a watermark to a lower left corner region of a 480 th frame image acquired in the video data.

In yet another embodiment, step S503 includes: the data processing apparatus may add a watermark of a target color, which is set according to the content of a target image, to the target image, which is any image of the video data to which the watermark is added.

In order to avoid that the color of the watermark is too obvious to influence the playing effect of the glasses device, the data processing device can set the color of the watermark of the target image according to the content of the target image, and can complete automatic setting. For example, the data processing device may analyze the image, obtain a distribution of its color space (e.g., RGB color space), and adjust the color of the watermark according to the distribution. In one embodiment, the watermark may be an adjusted single color, for example, a color that is calculated by the data processing device to have minimal contrast to the entire image and added to the image as the watermark color. In another embodiment, the watermark color may also be a plurality of colors, and the data processing device performs color region segmentation on the image and determines different watermark addition colors for different color regions. For example, as shown in fig. 8, when the image acquired by the drone includes a sky and a tree, a dashed box in fig. 8 is a region to which a watermark is added, where the watermark is located in the sky region and the tree region, and at this time, the data processing device may set a color of a portion of the watermark located in the sky region to be color 1, where the color 1 is a color with a smaller contrast with sky blue; and the color of the part of the watermark located in the tree region can be set to be color 2, and the color 2 is a color with smaller contrast with the tree green. It will be appreciated that the watermark may also have more regions and more colours.

And S504, the data processing equipment sends the image in the video data after the watermark is added.

In the embodiment of the invention, a data processing device can acquire video data and acquire a target watermark adding mode, wherein the target watermark adding mode is a random adding mode, a watermark is added to at least one frame of image in the video data according to the random adding mode, and the image in the video data after the watermark is added is sent; when the video data added with the watermark is played, the embezzler can watch the watermark in the image and influence the watching experience of the embezzler, so that the video data in live broadcast is protected, and the rights and interests of video data owners can be maintained. And the watermark is added in a random adding mode, so that a pirate can be prevented from erasing the watermark on the image, and the safety of the video data is improved. In addition, the scheme does not need to modify the hardware structure of the data processing equipment, so that the cost is reduced, and the human resources are saved.

Please refer to fig. 9, fig. 9 is a schematic structural diagram of the drone provided by the embodiment of the present invention. Specifically, unmanned aerial vehicle includes: a processor 901, a memory 902, an image capture device 903, and an image transfer module 904.

The memory 902 may include a volatile memory (volatile memory); the memory 902 may also include a non-volatile memory (non-volatile memory); the memory 902 may also comprise a combination of the above-described types of memory. The processor 901 may be a Central Processing Unit (CPU). The processor 801 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a Programmable Logic Device (PLD), or a combination thereof. The PLD may be a Complex Programmable Logic Device (CPLD), a field-programmable gate array (FPGA), or any combination thereof.

The image capture device 903 may be used to capture images or video. For example, the image capturing device 903 mounted on the drone may capture images or videos of the environment around the drone during flight of the drone.

The mapping module 904 may be used to transmit video data or image data, etc. After the unmanned aerial vehicle acquires the image or video data through the image capturing device 903, the image or video data may be sent to an external device through the image transmission module 904. For example, after the drone establishes a wireless communication connection with the eyewear device, the drone may send the image or video data to the eyewear device through the image transmission module 904 and display the image or video data.

In one embodiment, the memory is to store program instructions; the processor calls the program instructions stored in the memory to execute the following steps:

video data is obtained through shooting by the image shooting device 903, and the video data comprises a plurality of frames of images;

acquiring a target watermark adding mode;

sending the image in the video data after adding the watermark through the image transmission module 904.

It can be understood that, when the unmanned aerial vehicle section adds the watermark to at least one frame of image in the video data, the watermark adding may be completed in the encoding stage, that is, the unmanned aerial vehicle encodes the video data and sends the encoded video data after adding the watermark.

In an embodiment, the target watermarking mode is a user-set watermarking mode, or the target watermarking mode is an automatically-obtained watermarking mode.

In one embodiment, the target watermarking pattern is a fixed or random addition pattern.

In one embodiment, the memory is for storing program instructions, and the processor may call the program instructions stored in the memory for performing the steps of: adding a watermark to at least one frame of image in the video data according to a fixed adding mode.

In one embodiment, the memory is for storing program instructions, and the processor may call the program instructions stored in the memory for performing the steps of: a watermark is added to at least one frame of image in the video data at fixed time intervals.

In one embodiment, the memory is for storing program instructions, and the processor may call the program instructions stored in the memory for performing the steps of: adding a watermark to at least one frame of image in the video data at intervals of a fixed number of frames.

In one embodiment, the fixed frame number interval is an integer multiple of a group of pictures, GOP, of the video data.

In one embodiment, the memory is for storing program instructions, and the processor may call the program instructions stored in the memory for performing the steps of: adding a watermark to a key frame image in the video data.

In one embodiment, the memory is for storing program instructions, and the processor may call the program instructions stored in the memory for performing the steps of: adding a watermark to a fixed location of at least one frame of image in the video data.

In one embodiment, the fixed position is located in any one of a middle region, an upper left corner region, a lower left corner region, an upper right corner region, and a lower right corner region of a target image, and the target image is any image of the video data to which a watermark is added.

In one embodiment, the memory is for storing program instructions, and the processor may call the program instructions stored in the memory for performing the steps of: adding a fixed color watermark to at least one frame of image in the video data.

In one embodiment, the memory is for storing program instructions, and the processor may call the program instructions stored in the memory for performing the steps of: adding a watermark to at least one frame of image in the video data according to a random adding mode.

In one embodiment, the memory is for storing program instructions, and the processor may call the program instructions stored in the memory for performing the steps of: a watermark is added to at least one frame of image in the video data at random time intervals.

In one embodiment, the memory is for storing program instructions, and the processor may call the program instructions stored in the memory for performing the steps of: adding a watermark to at least one frame of image in the video data at random time intervals and at fixed time intervals.

In one embodiment, the random time interval is greater than a minimum preset time period and less than a maximum preset time period.

In one embodiment, the memory is for storing program instructions, and the processor may call the program instructions stored in the memory for performing the steps of: adding a watermark to at least one frame of image in the video data at random frame number intervals.

In one embodiment, the memory is for storing program instructions, and the processor may call the program instructions stored in the memory for performing the steps of: adding a watermark to at least one frame of image in the video data at random frame number intervals and fixed frame number intervals.

In one embodiment, the random frame number interval is greater than a minimum preset frame number and less than a maximum preset frame number.

In one embodiment, the memory is for storing program instructions, and the processor may call the program instructions stored in the memory for performing the steps of: adding a watermark to a random location of at least one frame of image in the video data.

In one embodiment, the memory is for storing program instructions, and the processor may call the program instructions stored in the memory for performing the steps of: adding a watermark of a target color to a target image, wherein the target color is set according to the content of the target image, and the target image is any image added with the watermark in the video data.

In one embodiment, the colors of the watermark comprise at least two colors.

In one embodiment, the watermark is comprised of at least one of a pattern, text, and colored patches.

The steps in the above embodiments are similar to those in the data processing apparatus, and are not described herein again.

Referring to fig. 10, fig. 10 is a schematic structural diagram of glasses equipment provided in the embodiment of the present invention. Specifically, the eyewear device includes: processor 101, memory 102, image transmission module 103 and display screen interface 104.

The memory 102 may include a volatile memory (volatile memory); the memory 102 may also include a non-volatile memory (non-volatile memory); the memory 102 may also comprise a combination of the above-mentioned kinds of memories. The processor 101 may be a Central Processing Unit (CPU). The processor 101 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a Programmable Logic Device (PLD), or a combination thereof. The PLD may be a Complex Programmable Logic Device (CPLD), a field-programmable gate array (FPGA), or any combination thereof.

The image transmission module 103 may be configured to receive video data or image data transmitted by other devices. For example, after the glasses device establishes a wireless communication connection with an external drone or a pass-through machine, the image transmission module 103 of the eye device may receive image or video data sent by the drone.

The Display Interface 104 may be a Mobile Industry Processor Interface (MIPI) protocol based Serial Display Interface (DSI) Interface for transmitting video data or image data to other devices. The glasses device may further include a display screen, the display screen is connected to the display screen interface 104, and the processor 101 transmits the image or video data acquired from the image transmission module 103 to the display screen through the display screen interface 104, so as to display the image or video data on the display screen.

acquiring video data through the image transmission module 103, wherein the video data comprises a plurality of frames of images;

acquiring a target watermark adding mode;

and sending the images in the video data after the watermarking through the display screen interface 104.

It is understood that the video data acquired by the glasses device through the image transmission module 103 may be already encoded video data, and the adding of the watermark to at least one frame of image in the video data by the processor 101 may be completed in a decoding stage, that is, the glasses device decodes the video data, adds the watermark, and then sends the video data to the display screen for display. In some embodiments, the video data acquired by the eyewear device through the image transmission module 103 may be video data to which a watermark has been added, for example, video data sent out after the unmanned aerial vehicle completes the watermarking operation in the foregoing embodiments. In this case, the glasses device may continue to acquire the target watermark adding mode and complete the subsequent watermark adding operation, or may perform only decoding and playing without performing the watermark adding operation. Specifically, the user may set a position for adding the watermark, for example, the user may only select to add the watermark at the unmanned aerial vehicle end or add the watermark at the glasses device end; or, the glasses device may acquire the watermark information, and when the watermark information is available, the operation of adding the watermark is not performed any more, for example, after the unmanned aerial vehicle finishes adding the watermark, the unmanned aerial vehicle sends out the video data, and at the same time, also sends a message notification of whether the watermark has been added, and after receiving the message notification, the glasses device performs a corresponding operation.

In one embodiment, the memory is for storing program instructions, and the processor may call the program instructions stored in the memory for performing the steps of: adding a watermark of a target color to a target image, wherein the target color is set according to the content of the target image, and the target image is any image added with the watermark in the video data. In one embodiment, the colors of the watermark comprise at least two colors. In one embodiment, the watermark is comprised of at least one of a pattern, text, and colored patches.

In an embodiment of the present invention, a computer-readable storage medium is further provided, where the computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement the data processing method described in the embodiment corresponding to fig. 2, fig. 3, and fig. 5 of the present invention, and also to implement the unmanned aerial vehicle according to the embodiment of the present invention shown in fig. 9 and implement the eyewear device according to the embodiment of the present invention shown in fig. 10, which are not described herein again.

The computer readable storage medium may be an internal storage unit of the test device according to any of the foregoing embodiments, for example, a hard disk or a memory of the device. The computer-readable storage medium may also be an external storage device of the vehicle control apparatus, such as a plug-in hard disk provided on the device, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), or the like. Further, the computer-readable storage medium may also include both an internal storage unit and an external storage device of the apparatus. The computer-readable storage medium is used for storing the computer program and other programs and data required by the test equipment. The computer readable storage medium may also be used to temporarily store data that has been output or is to be output.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the computer program is executed. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like. The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.

Claims

1. Glasses equipment is characterized by comprising a memory, a processor, a picture transmission module and a display screen interface,

the memory to store program instructions;

acquiring a target watermark adding mode;

2. The eyewear apparatus of claim 1, wherein the target watermarking mode is a user-set watermarking mode, or wherein the target watermarking mode is an automatically-obtained watermarking mode.

3. The eyewear apparatus of claim 1, wherein the target watermarking pattern is a fixed-add pattern or a random-add pattern.

4. The eyewear apparatus of claim 3, wherein the target watermarking mode is a fixed-add mode, and wherein the processor is specifically configured to perform the steps of:

a watermark is added to at least one frame of image in the video data at fixed time intervals.

5. The eyewear apparatus of claim 3, wherein the target watermarking mode is a fixed-add mode, and wherein the processor is specifically configured to perform the steps of:

adding a watermark to at least one frame of image in the video data at intervals of a fixed number of frames.

6. The eyewear apparatus of claim 5, wherein the fixed frame number interval is an integer multiple of a group of pictures (GOP) of the video data.

7. The eyewear apparatus of claim 3, wherein the target watermarking mode is a fixed-add mode, and wherein the processor is specifically configured to perform the steps of:

adding a watermark to a key frame image in the video data.

8. The eyewear apparatus of claim 3, wherein the target watermarking mode is a fixed-add mode, and wherein the processor is specifically configured to perform the steps of:

adding a watermark to a fixed location of at least one frame of image in the video data.

9. The eyewear apparatus of claim 8, wherein the fixed location is in any one of a middle region, an upper left corner region, a lower left corner region, an upper right corner region, and a lower right corner region of a target image, the target image being any image of the video data to which a watermark is added.

10. The eyewear apparatus of claim 3, wherein the target watermarking mode is a fixed-add mode, and wherein the processor is specifically configured to perform the steps of: adding a fixed color watermark to at least one frame of image in the video data.

11. The eyewear apparatus of claim 3, wherein the target watermarking pattern is a random addition pattern, and wherein the processor is specifically configured to perform the steps of:

a watermark is added to at least one frame of image in the video data at random time intervals.

12. The eyewear apparatus of claim 3, wherein the target watermarking pattern is a random addition pattern, and wherein the processor is specifically configured to perform the steps of: adding a watermark to at least one frame of image in the video data at random time intervals and at fixed time intervals.

13. Eyewear apparatus in accordance with claim 11 or 12, wherein the random time interval is greater than a minimum preset duration and less than a maximum preset duration.

14. The eyewear apparatus of claim 3, wherein the target watermarking pattern is a random addition pattern, and wherein the processor is specifically configured to perform the steps of:

adding a watermark to at least one frame of image in the video data at random frame number intervals.

15. The eyewear apparatus of claim 3, wherein the target watermarking pattern is a random addition pattern, and wherein the processor is specifically configured to perform the steps of: adding a watermark to at least one frame of image in the video data at random frame number intervals and fixed frame number intervals.

16. The eyewear apparatus of claim 14 or 15, wherein the random frame number interval is greater than a minimum preset frame number and less than a maximum preset frame number.

17. The eyewear apparatus of claim 3, wherein the target watermarking pattern is a random addition pattern, and wherein the processor is specifically configured to perform the steps of: adding a watermark to a random location of at least one frame of image in the video data.

18. The eyewear apparatus of claim 3, wherein the target watermarking pattern is a random addition pattern, and wherein the processor is specifically configured to perform the steps of: adding a watermark of a target color to a target image, wherein the target color is set according to the content of the target image, and the target image is any image added with the watermark in the video data.

19. The eyewear apparatus of claim 18, wherein the colors of the watermark comprise at least two colors.

20. The eyewear apparatus of claim 1, wherein the watermark is comprised of at least one of a pattern, text, and colored color blocks.

21. An unmanned aerial vehicle is characterized by comprising a memory, a processor, an image shooting device and a picture transmission module,

the memory to store program instructions;

acquiring a target watermark adding mode;

22. The drone of claim 21, wherein the target watermarking mode is a user-set watermarking mode, or wherein the target watermarking mode is an automatically obtained watermarking mode.

23. A drone according to claim 21, wherein the target watermarking pattern is a fixed or random addition pattern.

24. The drone of claim 23, wherein the target watermarking mode is a fixed watermarking mode, the processor being configured to perform the steps of:

25. The drone of claim 23, wherein the target watermarking mode is a fixed watermarking mode, the processor being configured to perform the steps of:

26. The drone of claim 25, wherein the fixed frame number interval is an integer multiple of a group of pictures (GOP) of the video data.

27. The drone of claim 23, wherein the target watermarking mode is a fixed watermarking mode, the processor being configured to perform the steps of:

adding a watermark to a key frame image in the video data.

28. The drone of claim 23, wherein the target watermarking mode is a fixed watermarking mode, the processor being configured to perform the steps of:

29. A drone according to claim 28, wherein the fixed location is in any one of a middle region, an upper left corner region, a lower left corner region, an upper right corner region and a lower right corner region of a target image, the target image being any image of the video data to which a watermark is added.

30. The drone of claim 23, wherein the target watermarking mode is a fixed watermarking mode, the processor being configured to perform the steps of: adding a fixed color watermark to at least one frame of image in the video data.

31. A drone according to claim 23, wherein the target watermarking pattern is a random addition pattern, the processor being specifically configured to perform the steps of:

32. A drone according to claim 23, wherein the target watermarking pattern is a random addition pattern, the processor being specifically configured to perform the steps of: adding a watermark to at least one frame of image in the video data at random time intervals and at fixed time intervals.

33. A drone according to claim 31 or 32, wherein the random time interval is greater than a minimum preset duration and less than a maximum preset duration.

34. A drone according to claim 23, wherein the target watermarking pattern is a random addition pattern, the processor being specifically configured to perform the steps of:

35. A drone according to claim 23, wherein the target watermarking pattern is a random addition pattern, the processor being specifically configured to perform the steps of: adding a watermark to at least one frame of image in the video data at random frame number intervals and fixed frame number intervals.

36. A drone according to claim 34 or 35, characterised in that the random number of frames interval is greater than a minimum preset number of frames and less than a maximum preset number of frames.

37. A drone according to claim 23, wherein the target watermarking pattern is a random addition pattern, the processor being specifically configured to perform the steps of: adding a watermark to a random location of at least one frame of image in the video data.

38. A drone according to claim 23, wherein the target watermarking pattern is a random addition pattern, the processor being specifically configured to perform the steps of: adding a watermark of a target color to a target image, wherein the target color is set according to the content of the target image, and the target image is any image added with the watermark in the video data.

39. A drone according to claim 38, wherein the colours of the watermark include at least two colours.

40. A drone according to claim 21, wherein the watermark is composed of at least one of patterns, text and coloured patches.

41. A data processing method, applied to a data processing apparatus, the method comprising:

acquiring a target watermark adding mode;

and sending the images in the video data after the watermarks are added.

42. The method of claim 41, wherein the target watermarking mode is a user-set watermarking mode, or wherein the target watermarking mode is an automatically-obtained watermarking mode.

43. The method of claim 41, wherein the target watermarking pattern is a fixed-add pattern or a random-add pattern.

44. The method of claim 43, wherein the target watermarking mode is a fixed watermarking mode, and wherein the watermarking at least one image of the video data according to the target watermarking mode comprises:

45. The method of claim 43, wherein the target watermarking mode is a fixed watermarking mode, and wherein the watermarking at least one image of the video data according to the target watermarking mode comprises:

46. The method of claim 45, wherein the fixed frame number interval is an integer multiple of a group of pictures (GOP) of the video data.

47. The method of claim 43, wherein the target watermarking mode is a fixed watermarking mode, and wherein the watermarking at least one image of the video data according to the target watermarking mode comprises:

adding a watermark to a key frame image in the video data.

48. The method of claim 43, wherein the target watermarking mode is a fixed watermarking mode, and wherein the watermarking at least one image of the video data according to the target watermarking mode comprises:

49. The method of claim 48, wherein the fixed location is in any one of a middle region, an upper left corner region, a lower left corner region, an upper right corner region, and a lower right corner region of a target image, and wherein the target image is any image of the video data to which a watermark is added.

50. The method of claim 43, wherein the target watermarking mode is a fixed watermarking mode, and wherein the watermarking at least one image of the video data according to the target watermarking mode comprises:

adding a fixed color watermark to at least one frame of image in the video data.

51. The method of claim 43, wherein the target watermarking pattern is a random watermarking pattern, and wherein the watermarking at least one image of the video data according to the target watermarking pattern comprises:

52. The method of claim 43, wherein the target watermarking pattern is a random watermarking pattern, and wherein the watermarking at least one image of the video data according to the target watermarking pattern comprises:

adding a watermark to at least one frame of image in the video data at random time intervals and at fixed time intervals.

53. The method of claim 51 or 52, wherein the random time interval is greater than a minimum preset time period and less than a maximum preset time period.

54. The method of claim 43, wherein the target watermarking pattern is a random watermarking pattern, and wherein the watermarking at least one image of the video data according to the target watermarking pattern comprises:

55. The method of claim 43, wherein the target watermarking pattern is a random watermarking pattern, and wherein the watermarking at least one image of the video data according to the target watermarking pattern comprises:

adding a watermark to at least one frame of image in the video data at random frame number intervals and fixed frame number intervals.

56. A method as claimed in claim 54 or 55, wherein the random frame number interval is greater than a minimum preset frame number and less than a maximum preset frame number.

57. The method of claim 43, wherein the target watermarking pattern is a random watermarking pattern, and wherein the watermarking at least one image of the video data according to the target watermarking pattern comprises:

adding a watermark to a random location of at least one frame of image in the video data.

58. The method of claim 43, wherein the target watermarking pattern is a random watermarking pattern, and wherein the watermarking at least one image of the video data according to the target watermarking pattern comprises:

adding a watermark of a target color to a target image, wherein the target color is set according to the content of the target image, and the target image is any image added with the watermark in the video data.

59. The method of claim 58, wherein the colors of the watermark comprise at least two colors.

60. The method of claim 41, wherein the watermark is comprised of at least one of a pattern, text, and colored patches.

61. A computer-readable storage medium, comprising: the computer-readable storage medium stores a computer program which, when executed by a processor, is adapted to perform the data processing method of any one of claims 1 to 20.