CN116416111A

CN116416111A - Watermark adding method and device, storage medium and electronic equipment

Info

Publication number: CN116416111A
Application number: CN202211225218.8A
Authority: CN
Inventors: 魏志明
Original assignee: Xian Wanxiang Electronics Technology Co Ltd
Current assignee: Xian Wanxiang Electronics Technology Co Ltd
Priority date: 2022-10-09
Filing date: 2022-10-09
Publication date: 2023-07-11

Abstract

The present disclosure relates to a method, apparatus, storage medium and electronic device for watermarking. The method comprises the following steps: starting a first program, and generating a starting instruction by the first program; starting a second program in response to the starting instruction, and generating preset watermark information by the second program; the watermark information is sent to the zero terminal so as to generate a watermark image on the zero terminal, and a top setting instruction is sent so that the watermark image is set on the zero terminal; receiving desktop image information containing watermark images, and encoding the desktop image information to obtain desktop image data; and sending the desktop image data to the zero terminal. The method and the device can add the watermark to the image transmitted by the virtual terminal and the zero terminal which are remotely connected, and the watermark image is arranged at the top of the zero terminal, so that the acquired desktop image information of the zero terminal contains the watermark image, and the effect of adding the watermark can be realized without influencing the performance of the whole acquisition, coding and transmission processes.

Description

Watermark adding method and device, storage medium and electronic equipment

Technical Field

The present disclosure relates to the field of watermarking technologies, and in particular, to a method, an apparatus, a storage medium, and an electronic device for watermarking.

Background

In some scenes with high requirements on the safety of picture contents of a computer desktop, when a user shoots or captures a screen to save related image contents, the image needs to have obvious copyright marks to protect related rights and interests, and certain legal constraint is required in the transmission process of the image, one feasible method is to add watermark marks in the desktop image, so that even if the user shoots or captures a screen, the saved picture has obvious marks to be identified, and a propagator needs to carefully consider whether the use range and the mode of the picture can cause legal disputes or not during sharing, thereby playing a certain constraint role.

For the above security requirements, in our remote desktop system, the implementation manner of this scenario needs to be considered, and before we have to collect the data at the picture sending end (hereinafter referred to as S) and add watermark information to the data before sending back to the encoder to implement the watermark function, but this approach is to do a lot of memory operations, especially if the S end has capacity to hard encode, the originally collected data may be directly sent to the hardware encoder to encode without copy into the memory and then sent to the receiving end (hereinafter referred to as R) by the transmission module, but since we need to use GPU (graphics processing unit) to perform operations to add the watermark, we have to perform operations on the collected data to the memory first, so there are three parts to compare and affect the processing performance of each frame of data, firstly copy the data to the memory, and secondly copy the data after the operations back to the GPU.

In the above technical solution, after the three steps are completed, the encoding module can be sent to continue the subsequent process, so that the frame rate of the whole remote desktop system is reduced, and especially the influence on the equipment with weaker S-terminal performance is obvious, and the user may feel bad experiences such as picture blocking under certain scenes with high frame rate requirements.

Accordingly, there is a need to provide a new solution to ameliorate one or more of the problems presented in the above solutions.

It should be noted that the information disclosed in the above background section is only for enhancing understanding of the background of the present disclosure and thus may include information that does not constitute prior art known to those of ordinary skill in the art.

Disclosure of Invention

It is an object of the present disclosure to provide a watermarking method, apparatus, storage medium and electronic device, which overcome, at least in part, one or more of the problems due to the limitations and disadvantages of the related art.

According to a first aspect of embodiments of the present disclosure, there is provided a method of watermarking, the method comprising:

starting a first program, and generating a starting instruction by the first program;

starting a second program in response to the starting instruction, and generating preset watermark information by the second program;

the watermark information is sent to a zero terminal so as to generate a watermark image on the zero terminal, and a top-setting instruction is sent so that the watermark image is set on the zero terminal;

receiving desktop image information containing the watermark image, and encoding the desktop image information to obtain desktop image data;

and sending the desktop image data to the zero terminal.

In an embodiment of the disclosure, after the second program is started in response to the start instruction, the method further includes:

and receiving operation information of the first program for monitoring the operation state of the second program at intervals of preset duration, and judging whether the operation information is normal or not.

In an embodiment of the disclosure, the operation information includes:

normal state information and abnormal state information.

In the embodiment of the disclosure, if the normal state information is received, a set-top instruction is generated and sent to the zero terminal, so that the second program is in a set-top state.

In the embodiment of the disclosure, if the abnormal information is received, a restart instruction is generated and the second program is started.

In the embodiment of the disclosure, the preset duration ranges from 10ms to 50ms.

According to a second aspect of embodiments of the present disclosure, there is provided an apparatus for watermarking, the apparatus comprising:

the first starting module is used for starting a first program and generating a starting instruction by the first program;

the second starting module is used for responding to the starting instruction to start a second program, and the second program generates preset watermark information and sends the watermark information to the zero terminal;

the first sending module is used for sending the watermark information to a zero terminal so as to generate a watermark image on the zero terminal, and sending a top setting instruction so that the watermark image is set on the zero terminal;

the receiving module is used for receiving the desktop image information containing the watermark image and encoding the desktop image information to obtain desktop image data;

and the second sending module is used for sending the desktop image data to the zero terminal.

In an embodiment of the disclosure, the apparatus further comprises:

and the monitoring module is used for receiving the running information of the running state of the first program for monitoring the second program at intervals of preset time length and judging whether the running information is normal or not.

According to a third aspect of the disclosed embodiments, there is provided a computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of the watermarking method described in any of the above embodiments.

According to a fourth aspect of embodiments of the present disclosure, there is provided an electronic device, comprising:

a processor; and

a memory for storing executable instructions of the processor;

wherein the processor is configured to perform the steps of the watermarking method described in any of the embodiments above via execution of the executable instructions.

The technical scheme provided by the embodiment of the disclosure can comprise the following beneficial effects:

in one embodiment of the disclosure, by the method for adding the watermark, the watermark is added to the image transmitted by the virtual terminal and the zero terminal which are remotely connected, and the watermark image is arranged on the top of the zero terminal, so that the acquired desktop image information of the zero terminal contains the watermark image, and the effect of adding the watermark can be realized without influencing the performance of the whole acquisition, coding and transmission processes.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure. It will be apparent to those of ordinary skill in the art that the drawings in the following description are merely examples of the disclosure and that other drawings may be derived from them without undue effort.

Fig. 1 schematically illustrates a flow chart of a method of watermarking in an exemplary embodiment of the present disclosure;

fig. 2 schematically illustrates a structural diagram of an apparatus for watermarking in an exemplary embodiment of the present disclosure;

FIG. 3 schematically illustrates a desktop system block diagram in an exemplary embodiment of the present disclosure;

fig. 4 schematically illustrates an image processing and display flow from S-side to R-side in an exemplary embodiment of the present disclosure;

fig. 5 illustrates a schematic structural diagram of an electronic device in an exemplary embodiment of the present disclosure;

fig. 6 shows a schematic diagram of a program product for implementing the watermarking method in an exemplary embodiment of the present disclosure.

Detailed Description

Example embodiments will now be described more fully with reference to the accompanying drawings. However, the exemplary embodiments may be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus a repetitive description thereof will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software or in one or more hardware modules or integrated circuits or in different networks and/or processor devices and/or microcontroller devices.

In this exemplary embodiment, a method for adding a watermark is provided first, and the method may be applied to a terminal device with a display screen, for example, a mobile terminal such as a mobile phone, a personal digital assistant, a notebook computer, a tablet computer, a smart watch, or a non-mobile terminal such as a desktop computer, a smart television, etc. Referring to what is shown in fig. 1, the method may include:

step S101: starting a first program, and generating a starting instruction by the first program;

step S102: starting a second program in response to the starting instruction, and generating preset watermark information by the second program;

step S103: the watermark information is sent to a zero terminal so as to generate a watermark image on the zero terminal, and a top-setting instruction is sent so that the watermark image is set on the zero terminal;

step S104: receiving desktop image information containing the watermark image, and encoding the desktop image information to obtain desktop image data;

step S105: and sending the desktop image data to the zero terminal.

By the method for adding the watermark, the watermark is added to the image transmitted by the virtual terminal and the zero terminal which are remotely connected, the watermark image is arranged at the top of the zero terminal, so that the acquired desktop image information of the zero terminal contains the watermark image, and the effect of adding the watermark can be realized without influencing the performance of the whole acquisition, coding and transmission processes.

Next, each step of the above-described method in the present exemplary embodiment will be described in more detail with reference to fig. 1 to 6.

In step S101, a first program is started, and the first program generates a start instruction.

Specifically, after the virtual machine system is started, the first program is started along with the system, and starting information is generated after the first program is started and is sent to the virtual machine.

It is understood that the first program is a daemon or service.

In step S102, a second program is started in response to the start instruction, and the second program generates preset watermark information.

Specifically, after receiving the starting instruction, the virtual machine responds to the starting instruction and starts a second program, and after the second program is started, preset watermark information is generated. The content of the watermark information is preset content, such as company Logo, company name, and the like.

In one embodiment, after the second program is started in response to the start instruction, the method further includes: and receiving operation information of the first program for monitoring the operation state of the second program at intervals of preset duration, and judging whether the operation information is normal or not.

Specifically, the first program is configured to detect and control the second program, where the first program not only can control the second program to start, but also monitors an operation state of the second program, and sends the operation state of the second program to the virtual machine, and the virtual machine determines and analyzes the operation state of the second program.

In step S103, the watermark information is sent to a zero terminal, so as to generate a watermark image on the zero terminal, and a top-setting instruction is sent, so that the watermark image is top-set on the zero terminal.

Specifically, after the virtual machine sends watermark information to the zero terminal, generating a watermark image with preset content on the zero terminal; meanwhile, the virtual machine sends the zero terminal overhead information to enable the watermark image to be overhead on the zero terminal; at this time, the acquired desktop image information includes the desktop and watermark images.

It will be appreciated that the watermark image is a full screen transparent window with preset watermark content, the desktop window of the zero terminal is covered by the watermark image, and the window is set to not handle any input events. The transparent window can be colorless or colored.

In one embodiment, the operation information includes: normal state information and abnormal state information.

Specifically, the first program detects whether the second program runs normally, namely whether the second program is closed and killed, if so, normal state information is generated and sent to the virtual terminal; if the virtual terminal is abnormal, abnormal state information is generated and sent to the virtual terminal.

In one embodiment, if the normal state information is received, the set-top instruction is generated and sent to the zero terminal, so that the watermark image is in a set-top state on the zero terminal.

Specifically, after the virtual machine receives the normal state information, a top setting instruction is generated, so that the watermark image is always in a top setting state on the window of the zero terminal.

In one embodiment, if the abnormal state information is received, a restart instruction is generated and the second program is started.

Specifically, after the virtual machine receives the abnormal state information, a restart instruction is generated, so that the second program is restarted, and the second program is always in a normal running state, so that the watermark image always exists and is in a top-set state on a window of the zero terminal.

In one embodiment, the preset duration ranges from 10ms to 50ms.

Specifically, the preset duration ranges from 10ms, 20ms, 30ms or 50ms, and is not limited in any way; the running state of the second program can be timely detected, so that the second program is always in a normal running state, and the watermark image is always in a top-setting state on a window of a zero terminal.

In step S104, desktop image information including the watermark image is received, and the desktop image information is encoded to obtain desktop image data.

Specifically, the acquired desktop image information of the zero terminal includes information including the watermark and the desktop information of the zero terminal, that is, the watermark image is covered on the desktop of the zero terminal, and the acquired desktop image information acquires the desktop of the zero terminal together with the watermark image. The virtual machine receives the desktop image information and encodes the desktop image information to generate desktop image data.

In step S105, the desktop image data is transmitted to the zero terminal.

Specifically, the virtual machine sends the encoded desktop image data to a zero terminal for use.

After receiving the desktop image data, the zero terminal decodes, renders and displays the desktop image with watermark information.

Further, in this example embodiment, an apparatus for adding a watermark is also provided. Referring to fig. 2, the apparatus 100 may include. Wherein: a first start module 101, a second start module 102, a first transmit module 103, a receive module 104, and a second transmit module 105.

Specifically, the first starting module 101 is configured to start a first program, and the first program generates a starting instruction; the second starting module 102 is configured to start a second program in response to the starting instruction, and the second program generates preset watermark information, and is configured to send the watermark information to a zero terminal; the first sending module 103 is configured to send the watermark information to a zero terminal, so as to generate a watermark image on the zero terminal, and send a top-setting instruction, so that the watermark image is top-set on the zero terminal; the receiving module 104 is configured to receive desktop image information including the watermark image, and encode the desktop image information to obtain desktop image data; the second sending module 105 is configured to send the desktop image data to the zero terminal.

As shown in fig. 3 and 4, after the S-side system is started, a daemon or service a is started along with the system; the watermark program B is started immediately after the A is started and is responsible for monitoring the normal operation of the B (the watermark program B can be started again in time after the watermark program B is killed); at this time, the screen at the S-side is covered by a transparent window with the full screen of watermark information, and the window is set so as not to process any input event; in order to avoid that the watermark effect is lost after the other window programs preempt the top-setting right, B sets a timer to detect whether the window is at the topmost window or not after being started, if not, sets the top-setting once to set the watermark window of the window; meanwhile, the desktop image acquired by the desktop image acquisition module at the S end contains watermark information, acquired image data is sent to the encoding module according to the image processing flow at the S end, and the encoded data is sent to the transmission module for being sent to the R end for use; after the R-side receives the image data, decoding, rendering and displaying, the user can see the desktop image with watermark information.

It should be noted that although the steps of the methods of the present disclosure are illustrated in the accompanying drawings in a particular order, this does not require or imply that the steps must be performed in that particular order or that all of the illustrated steps be performed in order to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step to perform, and/or one step decomposed into multiple steps to perform, etc. In addition, it is also readily understood that these steps may be performed synchronously or asynchronously, for example, in a plurality of modules/processes/threads.

The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein.

It should be noted that although in the above detailed description several modules or units of a device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit in accordance with embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into a plurality of modules or units to be embodied. The components shown as modules or units may or may not be physical units, may be located in one place, or may be distributed across multiple network elements. Some or all of the modules can be selected according to actual needs to achieve the purpose of the wood disclosure scheme. Those of ordinary skill in the art will understand and implement the present invention without undue burden.

In an exemplary embodiment of the present disclosure, a computer readable storage medium is also provided, on which a computer program is stored, which program, when being executed by, for example, a processor, may implement the steps of the watermarking method as described in any of the above embodiments. In some possible embodiments, the aspects of the invention may also be implemented in the form of a program product comprising program code for causing a terminal device to carry out the steps according to the various exemplary embodiments of the invention as described in the above-mentioned watermarking method section of this specification, when said program product is run on a terminal device.

Referring to fig. 5, a program product 300 for implementing the above-described method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The computer readable storage medium may include a data signal propagated in baseband or as part of a carrier wave, with readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A readable storage medium may also be any readable medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).

In an exemplary embodiment of the present disclosure, an electronic device is also provided, which may include a processor, and a memory for storing executable instructions of the processor. Wherein the processor is configured to perform the steps of the watermarking method described in any of the embodiments above via execution of the executable instructions.

Those skilled in the art will appreciate that the various aspects of the invention may be implemented as a system, method, or program product. Accordingly, aspects of the invention may be embodied in the following forms, namely: an entirely hardware embodiment, an entirely software embodiment (including firmware, micro-code, etc.) or an embodiment combining hardware and software aspects may be referred to herein as a "circuit," module "or" system.

An electronic device 600 according to this embodiment of the invention is described below with reference to fig. 6. The electronic device 600 shown in fig. 6 is merely an example, and should not be construed as limiting the functionality and scope of use of embodiments of the present invention.

As shown in fig. 6, the electronic device 600 is in the form of a general purpose computing device. Components of electronic device 600 may include, but are not limited to: at least one processing unit 610, at least one memory unit 620, a bus 630 connecting the different system components (including the memory unit 620 and the processing unit 610), a display unit 640, etc.

Wherein the storage unit stores program code that is executable by the processing unit 610 such that the processing unit 610 performs the steps according to various exemplary embodiments of the present invention described in the above-described watermarking method section of this specification. For example, the processing unit 610 may perform the steps as shown in fig. 1.

The memory unit 620 may include readable media in the form of volatile memory units, such as Random Access Memory (RAM) 6201 and/or cache memory unit 6202, and may further include Read Only Memory (ROM) 6203.

The storage unit 620 may also include a program/utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment.

Bus 630 may be a local bus representing one or more of several types of bus structures including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or using any of a variety of bus architectures.

The electronic device 600 may also communicate with one or more external devices 700 (e.g., keyboard, pointing device, bluetooth device, etc.), one or more devices that enable a user to interact with the electronic device 600, and/or any device (e.g., router, modem, etc.) that enables the electronic device 600 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 650. Also, electronic device 600 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet, through network adapter 660. The network adapter 660 may communicate with other modules of the electronic device 600 over the bus 630. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with electronic device 600, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.

From the above description of embodiments, those skilled in the art will readily appreciate that the example embodiments described herein may be implemented in software, or may be implemented in software in combination with the necessary hardware. Thus, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (may be a CD-ROM, a U-disk, a mobile hard disk, etc.) or on a network, including several instructions to cause a computing device (may be a personal computer, a server, or a network device, etc.) to perform the watermarking method according to the embodiments of the present disclosure.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

Claims

1. A method of watermarking, the method comprising:

and sending the desktop image data to the zero terminal.

2. The watermarking method according to claim 1, wherein after starting the second program in response to the start-up instruction further comprises:

3. The watermarking method according to claim 2, wherein the running information comprises:

normal state information and abnormal state information.

4. A method of watermarking according to claim 3, wherein if the normal state information is received, the topping command is generated and sent to the zero terminal so that the watermark image is in a topping state on the zero terminal.

5. A method of watermarking as claimed in claim 3, wherein if the abnormal state information is received, a restart instruction is generated and the second program is started.

6. A method of watermarking as claimed in claim 3, wherein the predetermined duration is in the range 10ms to 50ms.

7. An apparatus for watermarking, the apparatus comprising:

8. The watermarking apparatus according to claim 7, wherein the apparatus further comprises:

9. A computer readable storage medium having stored thereon a computer program, characterized in that the program when executed by a processor realizes the steps of the watermarking method according to any of claims 1 to 7.

10. An electronic device, comprising:

a processor; and

a memory for storing executable instructions of the processor;

wherein the processor is configured to perform the steps of the watermarking method of any of claims 1 to 7 via execution of the executable instructions.