CN108427545B - Screenshot data processing method, device and system, storage medium and processor - Google Patents
Screenshot data processing method, device and system, storage medium and processor Download PDFInfo
- Publication number
- CN108427545B CN108427545B CN201810102441.0A CN201810102441A CN108427545B CN 108427545 B CN108427545 B CN 108427545B CN 201810102441 A CN201810102441 A CN 201810102441A CN 108427545 B CN108427545 B CN 108427545B
- Authority
- CN
- China
- Prior art keywords
- screen capture
- capture data
- request message
- association component
- encoded
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims description 8
- 238000012545 processing Methods 0.000 claims abstract description 47
- 238000000034 method Methods 0.000 claims abstract description 39
- 238000012795 verification Methods 0.000 claims description 8
- 238000005516 engineering process Methods 0.000 abstract description 3
- 238000004891 communication Methods 0.000 description 15
- 230000006870 function Effects 0.000 description 11
- 238000004590 computer program Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 9
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 230000009977 dual effect Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005034 decoration Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000007667 floating Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a method, a device and a system for processing screenshot data, a storage medium and a processor. The method comprises the following steps: receiving a request message from an association component, wherein a terminal device accessed by the association component is configured with a first system, the association component is configured with a second system, and the request message is at least used for requesting the first system to perform screen capture processing on display content in a screen of the terminal device; and acquiring screen capture data according to the request message. The invention solves the technical problem that the desktop sharing mode provided in the related technology can not effectively acquire the view elements in the whole display screen.
Description
Technical Field
The invention relates to the field of computers, in particular to a method, a device and a system for processing screen capture data, a storage medium and a processor.
Background
Currently, the desktop sharing scheme provided in the related art is generally implemented by continuously capturing screens. The sending end obtains the screen image data, then codes and compresses the screen image data, and then sends the processed image data to the receiving end. And the receiving end decompresses the processed image data and then plays the decompressed screen image data.
However, the desktop sharing scheme described above has drawbacks: the screen capture function software can only capture the display picture of the current system. For a device running a dual system (for example, a first system with Android set to be used more frequently and a second system with Windows set to be used less frequently), the screen capture software on the first system cannot capture interface elements on the second system. And if the screen capturing software is installed on the second system, the first system cannot effectively control the screen capturing operation.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
At least some embodiments of the present invention provide a method, an apparatus, a system, a storage medium, and a processor for processing screenshot data, so as to at least solve the technical problem that a desktop sharing method provided in the related art cannot effectively obtain view elements in a whole display screen.
According to an embodiment of the present invention, a method for processing screenshot data is provided, including:
receiving a request message from an association component, wherein a terminal device accessed by the association component is configured with a first system, the association component is configured with a second system, and the request message is at least used for requesting the first system to perform screen capture processing on display content in a screen of the terminal device; and acquiring screen capture data according to the request message.
Optionally, the association component accesses the terminal device in one of the following ways: the association component is connected with the terminal equipment in a pluggable manner; the association component is embedded into the terminal device.
Optionally, the display interface corresponding to the first system is suspended above the display interface corresponding to the second system.
Optionally, after acquiring the screen capture data according to the request message, the method further includes: coding the screen capture data in the first system according to a preset coding format according to the request message, wherein the request message is also used for requesting the first system to code the screen capture data; and sending the encoded screen capture data to a remote device, wherein the remote device is used for decoding the encoded screen capture data to obtain the screen capture data and displaying the screen capture data.
Optionally, the sending the encoded screenshot data to the remote device includes: and sending the encoded screen capture data to the remote equipment through the server, wherein the server is used for transmitting the encoded screen capture data after passing through the security verification of the terminal equipment and the remote equipment in advance.
Optionally, after acquiring the screen capture data according to the request message, the method further includes: and the remote equipment is used for decoding the encoded screen capture data to obtain the screen capture data and displaying the screen capture data.
Optionally, before receiving the request message from the association component, the method further includes: and responding to the control operation received by the corresponding display interface on the second system, and generating a control instruction, wherein the control instruction is used for triggering the terminal equipment to acquire the screen capture data.
According to an embodiment of the present invention, there is also provided a device for processing screenshot data, including:
the device comprises a first receiving module, a second receiving module and a display module, wherein the first receiving module is used for receiving a request message from an association component, the terminal equipment accessed by the association component is configured with a first system, the association component is configured with a second system, and the request message is at least used for requesting the first system to perform screen capture processing on display content in a screen of the terminal equipment; and the acquisition module is used for acquiring the screen capture data according to the request message.
Optionally, the association component accesses the terminal device in one of the following ways: the association component is connected with the terminal equipment in a pluggable manner; the association component is embedded into the terminal device.
Optionally, the display interface corresponding to the first system is suspended above the display interface corresponding to the second system.
Optionally, the apparatus further comprises: the encoding module is used for encoding the screen capture data in the first system according to a preset encoding format according to the request message, wherein the request message is also used for requesting the first system to encode the screen capture data; the first sending module is used for sending the encoded screen capture data to the remote device, wherein the remote device is used for decoding the encoded screen capture data to obtain the screen capture data and displaying the screen capture data.
Optionally, the first sending module is configured to send the encoded screenshot data to the remote device via a server, where the server is configured to transparently transmit the encoded screenshot data after passing security verification of the terminal device and the remote device in advance.
Optionally, the apparatus further comprises: and the second sending module is used for sending the encoded screen capture data to the remote equipment through the association component, wherein the encoded screen capture data is obtained by encoding the screen capture data in a second system according to a preset encoding format through the association component, and the remote equipment is used for decoding the encoded screen capture data to obtain the screen capture data and displaying the screen capture data.
Optionally, the apparatus further comprises: and the second receiving module is used for responding to the control operation received by the corresponding display interface on the second system and generating a control instruction, wherein the control instruction is used for triggering the terminal equipment to acquire the screen capture data.
According to an embodiment of the present invention, there is further provided a storage medium, where the storage medium includes a stored program, and when the program runs, the apparatus where the storage medium is located is controlled to execute the processing method of the screen capture data.
According to an embodiment of the present invention, there is further provided a processor, where the processor is configured to execute a program, where the program executes the processing method of the screen capture data.
According to an embodiment of the present invention, there is also provided a terminal device, including: the display device comprises one or more processors, a memory, a display device and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are used for executing the screen capture data processing method.
In at least some embodiments of the present invention, a terminal device to which an association component is accessed is configured with a first system, and the association component is configured with a second system, and a request message for requesting the first system to perform screen capture processing on display content in a screen of the terminal device is sent to the terminal device through the association component, and the terminal device acquires screen capture data according to the request message, so as to achieve a purpose of performing desktop sharing on view elements in a whole display screen in the screen of the terminal device, thereby achieving a technical effect of ensuring integrity of the screen capture data, reducing development cost of a desktop sharing function, and improving user interaction experience, and further solving a technical problem that a desktop sharing mode provided in related technologies cannot effectively acquire the view elements in the whole display screen.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a block diagram of a hardware configuration of a system for processing screen shot data according to an embodiment of the present invention;
FIG. 2 is a flow diagram of a method of processing screenshot data according to one embodiment of the invention;
FIG. 3 is a schematic diagram of a single system to dual system handover process in accordance with a preferred embodiment of the present invention;
fig. 4 is a block diagram of a processing apparatus of screen shot data according to an embodiment of the present invention;
fig. 5 is a block diagram of a device for processing screen shot data according to a preferred embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
The method provided by the embodiment 1 of the invention can be executed in a screen capture data processing system. Fig. 1 is a block diagram of a hardware configuration of a system for processing screen shot data according to an embodiment of the present invention. As shown in fig. 1, the system for processing screen shot data may include: a terminal device 10, an association component 20 for accessing the terminal device, and a remote device 30 associated with the terminal. Terminal device 10 may include one or more processors 102 (including: processor 102a, processors 102b, …, processor 102n), where processor 102 may include, but is not limited to: a processing device such as a Microprocessor (MCU) or programmable logic device (FPGA), a memory 104 for storing data, and a network communication component 106 for communication functions. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the electronic device. For example, terminal device 10 may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.
The memory 104 may be used to store a computer program, for example, a software program and a module of application software, such as a computer program corresponding to the processing method of the screenshot data in the embodiment, and the processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, implements the processing method of the screenshot data. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, memory 104 may further include memory located remotely from processor 102, which may be connected to terminal device 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The network communication component 106 is operable to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the terminal device 10. In one example, the Network communication component 106 includes a Network adapter (NIC) that can be connected to other Network devices via a base station to communicate with the internet. In one example, the network communication component 106 can be a Radio Frequency (RF) module, which is used to communicate with the internet in a wireless manner.
In the embodiment, a method for processing screen capture data of the processing system running on the screen capture data is provided. It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than presented herein.
Fig. 2 is a flowchart of a method for processing screenshot data according to an embodiment of the present invention, as shown in fig. 2, the method includes the following steps:
step S22, receiving a request message from an association component, wherein a terminal device accessed by the association component is configured with a first system, the association component is configured with a second system, and the request message is at least used for requesting the first system to perform screen capture processing on display content in a screen of the terminal device;
and step S24, acquiring screen capture data according to the request message.
Through the steps, the terminal equipment accessed by the association component can be used for configuring the first system, the association component is configured with the second system, the association component sends a request message for requesting the first system to perform screen capture processing on the display content in the screen of the terminal equipment to the terminal equipment, and the terminal equipment acquires screen capture data according to the request message, so that the purpose of performing desktop sharing on view elements in the whole display screen in the screen of the terminal equipment is achieved, the completeness of the screen capture data is ensured, the development cost of the desktop sharing function is reduced, the technical effect of user interaction experience is improved, and the technical problem that the view elements in the whole display screen cannot be effectively acquired by the desktop sharing mode provided in the related technology is solved.
Fig. 3 is a schematic diagram of a switching process from a single system to a dual system according to a preferred embodiment of the present invention, and as shown in fig. 3, a first processing chip is installed on a terminal device (e.g., a tablet computer) and is configured with a first system, where the first system may be a system in which the terminal device is initially solidified at the time of factory shipment or a system in which the terminal device is reinstalled during use. In the first system, application 1 (indicated by a dashed box) cannot be normally applied. And a second processing chip is installed on the associated component and is configured with a second system, wherein the second system can be a system in which the associated component is initially solidified in the factory or a system in which the associated component is reinstalled in the using process. In addition, the display interface corresponding to the first system is suspended above the display interface corresponding to the second system.
The association component may access the terminal device in one of the following ways:
in the first mode, the associated component is connected with the terminal equipment in a pluggable mode;
and secondly, embedding the related assembly into the terminal equipment.
The first and second modes are different mainly in that: in the first mode, if the second system configured on the associated component needs to be replaced, the associated component is directly replaced without disassembling the terminal equipment; in the second mode, if the second system configured on the associated component needs to be replaced, the terminal device needs to be detached first and then the associated component needs to be replaced. In order to reduce the complexity of the operation, the following description will take the above-mentioned manner as an example of the pluggable connection of the associated component and the terminal device.
Before the association component is plugged into the terminal device, the display interface of the first system is the interface in the upper half of fig. 3. After the association component is plugged into the terminal device, the display interface of the first system is the interface in the lower half of fig. 3. At this time, the display interface of the first system is suspended above the display interface of the second system. When the first system and the second system are not operated simultaneously, the first system has limited performance, and mainly provides some global functions. At this point, application 1 is disabled. When the first system and the second system operate simultaneously, the display interface presented by the first system is mainly represented by a plurality of editing icons represented in the dashed box at the lower half part in fig. 3. At this time, the application 1 is adjusted from the disabled state to the enabled state.
Optionally, before receiving the request message from the association component in step S22, the following steps may be further included:
and step S21, responding to the control operation received by the corresponding display interface on the second system, and generating a control instruction, wherein the control instruction is used for triggering the terminal device to acquire the screen capture data.
And a virtual floating button for triggering the first system to execute screen capture operation can be arranged in a corresponding display interface on the second system. The user can enable the processor of the terminal device to generate a control instruction by performing touch operation on the virtual hover button, and then trigger the second system to send a request message for requesting the first system to perform screen capture processing on display content in a screen of the terminal device to the first system. Of course, a voice or gesture control floating button for triggering the first system to execute screen capture operation can be further arranged in the corresponding display interface on the second system. The user can touch the voice or gesture floating button to enable the processor of the terminal device to generate a control instruction, and then the second system is triggered to send a request message for requesting the first system to perform screen capture processing on display content in a screen of the terminal device to the first system.
Optionally, in step S24, after acquiring the screenshot data according to the request message, the method may further include the following steps:
step S25, according to the request message, encoding the screen capture data in the first system according to a preset encoding format, wherein the request message is also used for requesting the first system to encode the screen capture data;
and step S26, sending the encoded screen capture data to a remote device, wherein the remote device is used for decoding the encoded screen capture data to obtain the screen capture data and displaying the screen capture data.
On a terminal device which simultaneously operates a first system and a second system (for example, the Android system is set as the first system and the Windows system is set as the second system), the first system and the second system can realize inter-system communication through a specific data transmission channel. Specifically, a pre-specified communication protocol may be adopted to perform custom specification on the communication content. After the second system receives a control instruction of desktop sharing initiated by a user, a request message is sent to the first system according to a pre-specified communication protocol. The request message can be used for requesting the first system to perform screen capture processing on display content in a screen of the terminal equipment, and can also be used for requesting the first system to perform encoding processing on screen capture data.
After the first system receives the request message from the second system, the screen capture application is started to obtain all current display contents in the screen of the terminal equipment. In the practical application process, the following three screen capturing modes can be adopted:
in the first mode, screenshot is carried out based on a mediaproject framework of an Android system, and the scheme is developed and put into use in the Android5.0 system. The advantages of this approach are: the universality is stronger.
And in the second mode, the picture data is directly read from a frame buffer area of the Android system. The advantages of this approach are: the speed of screen capture is fast.
And a third mode is to integrate the screen capture function in a processing chip provided by a chip manufacturer, and because the screen capture function is directly connected to a hardware chip, the mode has the advantages that: among the above three modes, the screen capture efficiency is optimal.
In a preferred implementation process, the terminal device acquires the screen capture data in the first system in the third mode.
Then, the acquired screenshot data can be directly encoded according to a preset encoding format (for example, H264 encoding) in the first system, so as to obtain an H264 data stream. Specifically, the following three encoding methods may be adopted in the first system:
the first mode is to use the Android MediaCodec framework for soft coding.
And secondly, carrying out hard coding by using a MediaCodec framework of Android and realizing the hard coding by depending on hardware.
And thirdly, integrating image coding and decoding functions in a processing chip provided by a chip manufacturer.
In a preferred implementation process, the terminal device encodes the acquired screenshot data in the first system by adopting the third mode.
Optionally, in step S26, the sending of the encoded screenshot data to the remote device may be implemented by: and sending the encoded screen capture data to the remote equipment through the server, wherein the server is used for transmitting the encoded screen capture data after passing through the security verification of the terminal equipment and the remote equipment in advance.
The encoded H264 data stream will be sent to the network communication component. The network communication component may send the H264 data stream to the server. Because the terminal device and the remote device can perform security verification on the server in advance, after the server passes the security verification, both the terminal device and the remote device can list the server as a trusted server. Therefore, the server does not perform any processing on the encoded screen capture data sent by the terminal device, but is responsible for directly transmitting the encoded screen capture data to other receiving ends (including the remote devices) located in the same virtual room. For example: the terminal device may be located in a first conference room of enterprise a and the remote device may be located in a second conference room of enterprise B. To this end, a virtual conference room (e.g., a third conference room) may be created for the terminal device and the remote device. Considering that data transmission between different enterprises can be prevented or isolated by an enterprise content firewall, the terminal device can firstly send the encoded screen capture data to the server, and then the encoded screen capture data is transmitted to the remote device through the server.
Optionally, in step S24, after acquiring the screenshot data according to the request message, the method may further include the following steps:
and step S27, sending the encoded screen capture data to the remote device through the association component, wherein the encoded screen capture data is obtained by encoding the screen capture data in the second system according to a preset encoding format through the association component, and the remote device is used for decoding the encoded screen capture data to obtain the screen capture data and displaying the screen capture data.
After receiving the encoded screen capture data, the remote device may decode the encoded screen capture data according to a decoding format corresponding to a preset encoding format to obtain the screen capture data sent by the terminal device, and play the screen capture data on a specific view.
Through the implementation scheme, the user interacts with the second system with stronger processing performance, and the interaction experience of the user is ensured. By arranging the screen capture application on the first system with a higher view level and relatively lower processing performance, the screen capture application is ensured to capture the complete display content in the screen of the terminal equipment without influencing other operations performed by the user on the second system.
Considering that the screen capture application is set on the first system, the operating system type of the second system may have multiple options, that is, no matter the second system is an Android system or a Windows system, as long as the second system can know the communication protocol between the second system and the first system, all display contents in the screen of the terminal device can be shared to the remote device. The operating system of the remote device can display the shared picture of the other terminal device as long as it can realize the basic decoding function (e.g., H264 decoding process) and the playing function. The development cost of desktop sharing functionality is greatly reduced for the associated components using the second system.
Example 2
In this embodiment, a device for processing screenshot data is further provided, and the device is used to implement the foregoing embodiments and preferred embodiments, which have already been described and are not described again. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 4 is a block diagram of a device for processing screen capture data according to an embodiment of the present invention, as shown in fig. 4, the device includes: a first receiving module 10, configured to receive a request message from an association component, where a terminal device to which the association component is connected is configured with a first system, the association component is configured with a second system, and the request message is at least used to request the first system to perform screen capture processing on display content in a screen of the terminal device; and the obtaining module 20 is configured to obtain the screenshot data according to the request message.
Optionally, the association component accesses the terminal device in one of the following ways: the association component is connected with the terminal equipment in a pluggable manner; the association component is embedded into the terminal device.
Optionally, the display interface corresponding to the first system is suspended above the display interface corresponding to the second system.
Alternatively, fig. 5 is a block diagram of a device for processing screen capture data according to a preferred embodiment of the present invention, and as shown in fig. 5, the device includes, in addition to all modules shown in fig. 4: the encoding module 30 is configured to encode the screenshot data in the first system according to a preset encoding format according to the request message, where the request message is further configured to request the first system to encode the screenshot data; and the first sending module 40 is configured to send the encoded screenshot data to a remote device, where the remote device is configured to decode the encoded screenshot data to obtain the screenshot data, and display the screenshot data.
Optionally, the first sending module 40 is configured to send the encoded screenshot data to the remote device via a server, where the server is configured to transparently transmit the encoded screenshot data after passing through security verification of the terminal device and the remote device in advance.
Optionally, as shown in fig. 5, the apparatus further includes: and a second sending module 50, configured to send the encoded screenshot data to a remote device via the association component, where the encoded screenshot data is obtained by encoding the screenshot data in a preset encoding format in the second system through the association component, and the remote device is configured to decode the encoded screenshot data to obtain the screenshot data and display the screenshot data.
Optionally, as shown in fig. 5, the apparatus further includes: and a second receiving module 60, configured to generate a control instruction in response to a control operation received by a corresponding display interface on the second system, where the control instruction is used to trigger the terminal device to acquire the screen capture data.
It should be noted that, the above modules may be implemented by software or hardware, and for the latter, the following may be implemented, but not limited to: the modules are all positioned in the same processor; alternatively, the modules are respectively located in different processors in any combination.
Example 3
The present embodiment also provides a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of the above-described method embodiments when executed.
Alternatively, in the present embodiment, the storage medium may be configured to store a computer program for executing the steps of:
s1, receiving a request message from an association component, wherein the terminal device accessed by the association component is configured with a first system, the association component is configured with a second system, and the request message is at least used for requesting the first system to perform screen capture processing on display content in a screen of the terminal device;
and S2, acquiring the screen capture data according to the request message.
Optionally, in this embodiment, the storage medium may include, but is not limited to: various media capable of storing computer programs, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
Example 4
Embodiments of the present invention also provide a terminal device, which includes a memory and one or more processors, where the memory stores a computer program, and the processors are configured to execute the steps in the above method embodiments through the computer program.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, receiving a request message from an association component, wherein the terminal device accessed by the association component is configured with a first system, the association component is configured with a second system, and the request message is at least used for requesting the first system to perform screen capture processing on display content in a screen of the terminal device;
and S2, acquiring the screen capture data according to the request message.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present invention, it should be understood that the disclosed technical contents can be implemented in other manners. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (15)
1. A method for processing screenshot data is characterized by comprising the following steps:
receiving a request message from an association component, wherein a terminal device accessed by the association component is configured with a first system, the association component is configured with a second system, and the request message is at least used for requesting the first system to perform screen capture processing on display content in a screen of the terminal device;
acquiring screen capture data according to the request message;
when the first system and the second system are not operated simultaneously, part of the application displayed in the display interface corresponding to the first system is in a forbidden state, and when the first system and the second system are operated simultaneously, the part of the application is displayed in the display interface corresponding to the second system, and the part of the application is adjusted to be in an enabled state from the forbidden state.
2. The method of claim 1, wherein the association component accesses the terminal device by one of:
the association component is connected with the terminal equipment in a pluggable mode;
the association component is embedded in the terminal equipment.
3. The method of claim 1, further comprising, after obtaining the screen capture data according to the request message:
coding the screen capture data in the first system according to a preset coding format according to the request message, wherein the request message is also used for requesting the first system to code the screen capture data;
and sending the encoded screen capture data to a remote device, wherein the remote device is used for decoding the encoded screen capture data to obtain the screen capture data and displaying the screen capture data.
4. The method of claim 3, wherein sending the encoded screenshot data to the remote device comprises:
and sending the encoded screen capture data to the remote equipment through a server, wherein the server is used for transmitting the encoded screen capture data after passing through the security verification of the terminal equipment and the remote equipment in advance.
5. The method of claim 1, further comprising, after obtaining the screen capture data according to the request message:
and sending the encoded screen capture data to a remote device through the association component, wherein the encoded screen capture data is obtained by encoding the screen capture data in the second system according to a preset encoding format through the association component, and the remote device is used for decoding the encoded screen capture data to obtain the screen capture data and displaying the screen capture data.
6. The method of claim 1, prior to receiving the request message from the association component, further comprising:
and responding to a control operation received by a display interface corresponding to the second system, and generating a control instruction, wherein the control instruction is used for triggering the terminal equipment to acquire the screen capture data.
7. A device for processing screen shot data, comprising:
the device comprises a first receiving module, a second receiving module and a display module, wherein the first receiving module is used for receiving a request message from an association component, a terminal device accessed by the association component is configured with a first system, the association component is configured with a second system, and the request message is at least used for requesting the first system to perform screen capture processing on display content in a screen of the terminal device;
the acquisition module is used for acquiring screen capture data according to the request message;
when the first system and the second system are not operated simultaneously, part of the application displayed in the display interface corresponding to the first system is in a forbidden state, and when the first system and the second system are operated simultaneously, the part of the application is displayed in the display interface corresponding to the second system, and the part of the application is adjusted to be in an enabled state from the forbidden state.
8. The apparatus of claim 7, wherein the association component accesses the terminal device by one of:
the association component is connected with the terminal equipment in a pluggable mode;
the association component is embedded in the terminal equipment.
9. The apparatus of claim 7, further comprising:
the encoding module is used for encoding the screen capture data in the first system according to a preset encoding format according to the request message, wherein the request message is also used for requesting the first system to encode the screen capture data;
the first sending module is used for sending the encoded screen capture data to a remote device, wherein the remote device is used for decoding the encoded screen capture data to obtain the screen capture data and displaying the screen capture data.
10. The apparatus according to claim 9, wherein the first sending module is configured to send the encoded screenshot data to a remote device via a server, and wherein the server is configured to pass through the encoded screenshot data after passing security verification of the terminal device and the remote device in advance.
11. The apparatus of claim 7, further comprising:
and the second sending module is used for sending the encoded screen capture data to the remote equipment through the association component, wherein the encoded screen capture data is obtained by encoding the screen capture data in the second system according to a preset encoding format through the association component, and the remote equipment is used for decoding the encoded screen capture data to obtain the screen capture data and displaying the screen capture data.
12. The apparatus of claim 7, further comprising:
and the second receiving module is used for responding to the control operation received by the corresponding display interface on the second system and generating a control instruction, wherein the control instruction is used for triggering the terminal equipment to acquire the screen capture data.
13. A storage medium, characterized in that the storage medium comprises a stored program, wherein when the program runs, a device where the storage medium is located is controlled to execute the screen capture data processing method of any one of claims 1 to 6.
14. A processor, characterized in that the processor is configured to execute a program, wherein the program executes the method for processing screen capture data according to any one of claims 1 to 6.
15. A terminal device, comprising: one or more processors, a memory, a display device, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs for performing the method of processing screen capture data of any of claims 1-6.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810102441.0A CN108427545B (en) | 2018-02-01 | 2018-02-01 | Screenshot data processing method, device and system, storage medium and processor |
| PCT/CN2018/117615 WO2019148949A1 (en) | 2018-02-01 | 2018-11-27 | Processing method, apparatus and system for screen shot data, storage medium and processor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810102441.0A CN108427545B (en) | 2018-02-01 | 2018-02-01 | Screenshot data processing method, device and system, storage medium and processor |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108427545A CN108427545A (en) | 2018-08-21 |
| CN108427545B true CN108427545B (en) | 2021-07-09 |
Family
ID=63156337
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810102441.0A Active CN108427545B (en) | 2018-02-01 | 2018-02-01 | Screenshot data processing method, device and system, storage medium and processor |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108427545B (en) |
| WO (1) | WO2019148949A1 (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108427545B (en) * | 2018-02-01 | 2021-07-09 | 广州视源电子科技股份有限公司 | Screenshot data processing method, device and system, storage medium and processor |
| CN109450902B (en) * | 2018-11-12 | 2021-03-19 | 东信和平科技股份有限公司 | Mobile terminal screen capture authentication method and system |
| CN113556584B (en) * | 2021-07-21 | 2023-07-28 | 北京百度网讯科技有限公司 | Screenshot transmission method and device of cloud mobile phone, electronic equipment and storage medium |
| CN114741044B (en) * | 2022-06-13 | 2022-09-30 | 北京麟卓信息科技有限公司 | Cross-operation environment display output sharing method based on heterogeneous rendering |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102571840A (en) * | 2010-12-16 | 2012-07-11 | 卓望数码技术（深圳）有限公司 | Remote terminal test method, system and proxy server |
| CN104123113A (en) * | 2014-07-31 | 2014-10-29 | 深圳市中兴移动通信有限公司 | Mobile terminal and multi-system split screen display method and device thereof |
| CN105242920A (en) * | 2015-09-21 | 2016-01-13 | 联想(北京)有限公司 | Image capture system, image capture method and electronic device |
| CN105550002A (en) * | 2015-12-28 | 2016-05-04 | 北京元心科技有限公司 | interface display method based on system switching and intelligent terminal |
| CN105677315A (en) * | 2015-12-28 | 2016-06-15 | 北京元心科技有限公司 | interface display method of multiple operating systems and intelligent terminal |
| CN105718311A (en) * | 2015-07-09 | 2016-06-29 | 北京海誉动想科技股份有限公司 | Intelligent system and implementing method thereof, peripheral applied to intelligent device |
| CN106371858A (en) * | 2015-07-22 | 2017-02-01 | 鸿合科技有限公司 | Method and apparatus for starting windows program by android |
| CN106454153A (en) * | 2016-09-08 | 2017-02-22 | 青岛海信电器股份有限公司 | Touch terminal and display method thereof |
| CN106598342A (en) * | 2016-12-30 | 2017-04-26 | 厦门厦华科技有限公司 | Design method for simultaneously using touch frame by multiple systems of intelligent whiteboard television |
| CN206863661U (en) * | 2017-06-21 | 2018-01-09 | 研擎（深圳）科技有限公司 | A kind of " general OPS " main board systems |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9047102B2 (en) * | 2010-10-01 | 2015-06-02 | Z124 | Instant remote rendering |
| JP5445578B2 (en) * | 2009-02-19 | 2014-03-19 | 日本電気株式会社 | Information processing apparatus, information processing system, information processing method, and program recording medium |
| CN103049232B (en) * | 2011-10-17 | 2016-04-27 | 联想(北京)有限公司 | Display packing and terminal device |
| CN103136157A (en) * | 2011-11-22 | 2013-06-05 | 联想(北京)有限公司 | Dual-system display method and electronic equipment |
| JP6357760B2 (en) * | 2013-11-27 | 2018-07-18 | 株式会社リコー | Terminal device, program, screen sharing method, and screen sharing system |
| US20170097743A1 (en) * | 2015-10-05 | 2017-04-06 | Quixey, Inc. | Recommending Applications |
| CN105653336A (en) * | 2015-12-30 | 2016-06-08 | 惠州市德赛西威汽车电子股份有限公司 | Method for integrating application under double operating systems |
| CN106535194B (en) * | 2016-12-20 | 2019-11-01 | 北京小米移动软件有限公司 | Screen content sharing method, apparatus and system |
| CN106843796A (en) * | 2017-03-01 | 2017-06-13 | 北京海杭通讯科技有限公司 | A kind of single-screen shows the display methods of dual system picture |
| CN108427545B (en) * | 2018-02-01 | 2021-07-09 | 广州视源电子科技股份有限公司 | Screenshot data processing method, device and system, storage medium and processor |
-
2018
- 2018-02-01 CN CN201810102441.0A patent/CN108427545B/en active Active
- 2018-11-27 WO PCT/CN2018/117615 patent/WO2019148949A1/en active Application Filing
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102571840A (en) * | 2010-12-16 | 2012-07-11 | 卓望数码技术（深圳）有限公司 | Remote terminal test method, system and proxy server |
| CN104123113A (en) * | 2014-07-31 | 2014-10-29 | 深圳市中兴移动通信有限公司 | Mobile terminal and multi-system split screen display method and device thereof |
| CN105718311A (en) * | 2015-07-09 | 2016-06-29 | 北京海誉动想科技股份有限公司 | Intelligent system and implementing method thereof, peripheral applied to intelligent device |
| CN106371858A (en) * | 2015-07-22 | 2017-02-01 | 鸿合科技有限公司 | Method and apparatus for starting windows program by android |
| CN105242920A (en) * | 2015-09-21 | 2016-01-13 | 联想(北京)有限公司 | Image capture system, image capture method and electronic device |
| CN105550002A (en) * | 2015-12-28 | 2016-05-04 | 北京元心科技有限公司 | interface display method based on system switching and intelligent terminal |
| CN105677315A (en) * | 2015-12-28 | 2016-06-15 | 北京元心科技有限公司 | interface display method of multiple operating systems and intelligent terminal |
| CN106454153A (en) * | 2016-09-08 | 2017-02-22 | 青岛海信电器股份有限公司 | Touch terminal and display method thereof |
| CN106598342A (en) * | 2016-12-30 | 2017-04-26 | 厦门厦华科技有限公司 | Design method for simultaneously using touch frame by multiple systems of intelligent whiteboard television |
| CN206863661U (en) * | 2017-06-21 | 2018-01-09 | 研擎（深圳）科技有限公司 | A kind of " general OPS " main board systems |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108427545A (en) | 2018-08-21 |
| WO2019148949A1 (en) | 2019-08-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108427545B (en) | Screenshot data processing method, device and system, storage medium and processor | |
| EP2989848B1 (en) | Electronic device and method of registering personal cloud apparatus in user portal server thereof | |
| KR102157634B1 (en) | Image capturing method and local endpoint host device | |
| CN105592364B (en) | Cross-terminal screenshot picture acquisition method and device | |
| US10034057B2 (en) | Message processing method, device, gateway, STB and IPTV | |
| WO2015035767A1 (en) | Media control method and device based on desktop cloud | |
| CN111954051B (en) | Method and system for transmitting video and audio data, cloud server and storage medium | |
| CN102685597B (en) | Device, mobile terminal and method of content reappearing | |
| CN108932948B (en) | Audio data processing method and device, computer equipment and computer readable storage medium | |
| EP3185545A1 (en) | Video conference control method and system | |
| CN104685873B (en) | Encoding controller and coding control method | |
| WO2018049892A1 (en) | Data transmission method and apparatus, and terminal | |
| US9143940B2 (en) | Wireless communication system, portable terminal, digital camera, communication method, and computer-readable storage device | |
| US20160286172A1 (en) | Network communication system and method thereof | |
| CN108055595B (en) | Video image redirection method and computer-readable storage medium | |
| CN105141567A (en) | Interactive data processing method and system of terminal application and service end and interaction method | |
| CN111131909A (en) | Method, device, equipment and medium for sharing terminal desktop | |
| WO2021057697A1 (en) | Video encoding and decoding methods and apparatuses, storage medium, and electronic device | |
| CN110868560A (en) | Video recording method based on binocular camera and terminal equipment | |
| CN104837048A (en) | Screen mirror implementation method and system | |
| CN111064976B (en) | Method for sending live broadcast information and server | |
| CN204031363U (en) | A kind of multifunction wireless personal portable digital device | |
| US20150382054A1 (en) | Multimedia playing control method, apparatus for the same and system | |
| CN108337555B (en) | Data display method and system and wearable device | |
| CN113596583A (en) | Video stream bullet time data processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |