CN110719502A - Remote picture synchronization method, device, equipment and system - Google Patents
Remote picture synchronization method, device, equipment and system Download PDFInfo
- Publication number
- CN110719502A CN110719502A CN201910881397.2A CN201910881397A CN110719502A CN 110719502 A CN110719502 A CN 110719502A CN 201910881397 A CN201910881397 A CN 201910881397A CN 110719502 A CN110719502 A CN 110719502A
- Authority
- CN
- China
- Prior art keywords
- picture
- data
- server
- client
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/254—Management at additional data server, e.g. shopping server, rights management server
- H04N21/2541—Rights Management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25866—Management of end-user data
- H04N21/25875—Management of end-user data involving end-user authentication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26291—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for providing content or additional data updates, e.g. updating software modules, stored at the client
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
Abstract
The application relates to a remote picture synchronization method, a device, equipment and a system. The remote picture synchronization method comprises the following steps: receiving a picture establishing request sent by a client; determining a picture to be synchronized corresponding to the picture establishing request; converting the picture to be synchronized into picture analysis data which accords with a preset picture construction rule based on a preset picture analysis rule; and sending the picture analysis data to the client so that the client reconstructs and displays the picture to be synchronized based on the picture analysis data and a preset picture construction rule. Therefore, the picture to be synchronized is converted into picture analysis data which accords with the preset picture construction rule, only the picture analysis data is transmitted, and then the picture to be synchronized is reconstructed by the client based on the picture analysis data. The data that needs to be transmitted is reduced. The requirements on the network environment in the picture synchronization process are reduced, and the problems of serious picture delay, poor user experience and the like caused by low network transmission speed are avoided.
Description
Technical Field
The present application relates to the field of remote interaction technology, and in particular, to a method, an apparatus, a device, and a system for synchronizing a remote screen.
Background
Currently, vnc software is mainly used in industrial control equipment to realize remote control. Conventional vnc achieves picture synchronization by transmitting picture image data in real time.
The mode for realizing the picture synchronization adopts the real-time frame-by-frame transmission of the picture image data to realize the picture synchronization, and the network burden of the vnc server equipment is increased because the picture image of each frame needs to be transmitted, the data transmission quantity is large. And the data volume can be further increased under the condition of high resolution, so that the remote control picture is unsmooth and the interface operation response is slow. Especially, when the network environment is not good, the picture can be delayed seriously, and the user experience is poor.
Disclosure of Invention
The application aims to provide a remote picture synchronization method, a device, equipment and a system, so as to solve the problems that in the related technology, when a remote picture is displayed, the data transmission quantity is large, the network load is heavy, the remote control picture is unsmooth and unsmooth in clamping, and the interface operation response is slow. Especially when the network environment is not good, the picture can be delayed seriously, and the user experience is poor.
The purpose of the application is realized by the following technical scheme:
in a first aspect, the present application provides a remote picture synchronization method, including:
receiving a picture establishing request sent by a client;
determining a picture to be synchronized corresponding to the picture establishing request;
converting the picture to be synchronized into picture analysis data which accords with a preset picture construction rule based on a preset picture analysis rule;
and sending the picture analysis data to the client so that the client reconstructs and displays the picture to be synchronized based on the picture analysis data and a preset picture construction rule.
Optionally, the converting, based on a preset picture parsing rule, the picture to be synchronized into picture parsing data conforming to a preset picture construction rule includes:
dividing the picture to be synchronized into at least one sub-picture based on a preset picture analysis rule;
respectively converting the sub-pictures into sub-picture analysis data which accord with the picture construction rules based on the preset picture analysis rules;
and integrating the sub-picture analysis data to obtain picture analysis data.
Optionally, the sub-picture parsing data includes: and the main name, the length, the width and the display character of the sub-picture conform to at least one of the coordinates.
Optionally, before sending the picture analysis data to the client, the method further includes:
encrypting the picture analysis data;
the sending the picture analysis data to the client includes:
and sending the encrypted picture analysis data to the client.
Optionally, the method further includes:
receiving a data synchronization request in a data unit sent by a client;
if the data unit of the server corresponding to the data synchronization request is updated, sending the update data of the data unit to a client so that the client updates the data in the data unit of the client;
the data unit is pre-constructed based on a preset data unit establishing rule.
Optionally, the method further includes:
the data unit is built locally according to a preset data unit building rule, and the preset data unit building rule is sent to the client side, so that the client side can build the data unit based on the preset data unit building rule.
Optionally, the method further includes:
acquiring identity authentication information sent by a client;
if the identity authentication information is the same as the preset identity information, establishing connection with the client;
and the preset identity information is stored in the server in advance.
Optionally, the authentication information includes: a user name, a password, and a device ID.
Optionally, the method further includes:
and sending server parameter information to a client so that the client sends the picture establishing request to the server if the client determines that the server parameter information meets the requirements.
Optionally, the parameter information includes: server version, server device display, and/or pixel parameters.
In a second aspect, a method for remote picture synchronization, the method comprising:
sending a request for establishing a picture to a server;
receiving picture analysis data sent by the server; the picture analysis data is obtained by converting a picture to be synchronized into picture analysis data which accords with a preset picture construction rule by the server based on a preset picture analysis rule;
constructing the picture to be synchronized based on the preset picture construction rule and the picture analysis data;
and displaying the picture to be synchronized.
Optionally, the constructing the picture to be synchronized based on the preset picture construction rule and the picture analysis data includes:
dividing the picture analysis data into at least one sub-picture analysis data;
respectively constructing sub-pictures based on preset picture construction rules and the sub-picture analysis data;
and integrating the sub-pictures to form the picture to be synchronized.
Optionally, the sub-picture parsing data includes: the subject name, length, width, and display word conform to at least one of the coordinates.
Optionally, the receiving of the picture analysis data sent by the preset server includes:
receiving encrypted picture analysis data sent by a preset server;
and decrypting the encrypted picture analysis data to obtain unencrypted picture analysis data.
Optionally, the method further includes:
sending a data synchronization request in a data unit to the server; the data unit client is established based on a preset data unit establishing rule; the preset data unit establishing rule is sent to the client by the server;
receiving the updating data of the data unit sent by the server;
when the data unit of the server corresponding to the data synchronization request stores data updating, the server sends the data updating data to the client;
updating data within data units of the client based on the update data.
Optionally, the method further includes:
determining a data picture object in the picture to be synchronized;
and binding the data picture object and the corresponding data unit so that the data picture object synchronously displays the data in the corresponding data unit.
Optionally, the method further includes:
and the authentication information is sent to the server for the server to confirm whether to establish connection.
Optionally, the authentication information includes: a user name, a password, and a device ID.
Optionally, before sending the request for establishing the screen to the server, the method further includes:
receiving parameter information sent by the server;
the sending of the request for establishing the picture to the server comprises:
judging whether the server parameter information meets the requirements or not to obtain a yes or no judgment result;
and if so, sending a picture establishing request to the server.
Optionally, the method further includes:
and interacting with the user through the interface interaction function module.
Optionally, the interface interaction function module includes: the display label sub-module, the image curve sub-module, the list recording sub-module, and/or the key sub-module and the keyboard sub-module.
In a third aspect, a remote screen synchronization apparatus is provided in a server, and the remote screen synchronization apparatus includes:
the first receiving module is used for receiving a picture establishing request sent by a client;
the determining module is used for determining the picture to be synchronized corresponding to the picture establishing request;
the conversion module is used for converting the picture to be synchronized into picture analysis data which accords with the picture construction rule based on a preset picture analysis rule;
and the first sending module is used for sending the picture analysis data to the client so that the client reconstructs and displays a picture to be synchronized based on the picture analysis data and the preset picture construction rule.
In a fourth aspect, a remote image synchronization apparatus, disposed at a client, includes:
the second sending module is used for sending a picture establishing request to the server;
the second receiving module is used for receiving the picture analysis data sent by the server; the picture analysis data is obtained by converting a picture to be synchronized into picture analysis data which accords with a preset picture construction rule by the server based on a preset picture analysis rule;
the construction module is used for constructing the picture to be synchronized based on the preset picture construction rule and the picture analysis data;
and the display module is used for displaying the picture to be synchronized.
In a fifth aspect, a server comprises: a processor, and a memory coupled to the processor;
the memory is used for storing a computer program;
the processor is configured to invoke and execute the computer program in the memory to perform the method of any of the first aspects.
In a sixth aspect, a client comprises: a processor, and a memory coupled to the processor;
the memory is used for storing a computer program;
the processor is configured to invoke and execute the computer program in the memory to perform the method according to any of the second aspects.
In a seventh aspect, a remote picture synchronization system includes: a server as claimed in the fifth aspect and a client as claimed in the sixth aspect.
This application adopts above technical scheme, has following beneficial effect:
in the scheme provided by the application, a server receives a picture establishing request sent by a client; then determining a picture to be synchronized corresponding to the picture establishing request; converting the picture to be synchronized into picture analysis data which accords with a preset picture construction rule based on a preset picture analysis rule; and sending the picture analysis data to the client so that the client reconstructs and displays the picture to be synchronized based on the picture analysis data and a preset picture construction rule. Therefore, the picture to be synchronized is converted into picture analysis data which accords with the preset picture construction rule, the whole picture is not directly transmitted as in the prior art, but only the picture analysis data is transmitted, and then the picture to be synchronized is reconstructed by the client based on the picture analysis data. This reduces the data that needs to be transmitted. Furthermore, in some industrial control systems, the picture to be synchronized is often composed of several simple and clear elements, and correspondingly, picture analysis data used for constructing the picture to be synchronized is relatively simple, so that data required to be transmitted through a network are further reduced. According to the scheme, data needing to be transmitted through the network during picture synchronization is reduced, the requirement for the network environment in the picture synchronization process is reduced, and the problems that picture delay is serious and user experience is poor due to the fact that the network transmission speed is low are avoided.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a remote picture synchronization method according to an embodiment of the present application;
fig. 2 is a flowchart of a remote picture synchronization method according to another embodiment of the present application;
fig. 3 is a flowchart of a remote picture synchronization method according to another embodiment of the present application;
fig. 4 is a flowchart of a remote picture synchronization method according to another embodiment of the present application;
fig. 5 is a schematic structural diagram of a remote image synchronization apparatus according to an embodiment of the present application
Fig. 6 is a schematic structural diagram of a remote picture synchronization apparatus according to an embodiment of the present application,
fig. 7 is a schematic structural diagram of a server according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a client according to an embodiment of the present application;
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail below. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the examples given herein without making any creative effort, shall fall within the protection scope of the present application.
In order to make the solution provided by the present application better understood, the solution in the prior art is first explained:
currently, vnc software is mainly used in industrial control equipment to realize remote control. Conventional vnc achieves picture synchronization by transmitting picture image data in real time. Transmitting the picture images in real time greatly increases the network burden of the device acting as a vnc server. And the data volume can be greatly increased under the condition of high resolution, so that the remote control picture is unsmooth to be blocked and the interface operation response is slow. For example, for a 1080P resolution device, if 24-bit true color display is adopted, and image data is transmitted without compression, one frame of picture is transmitted by about 6M, while a remote control picture is to be displayed smoothly, 24 frames are refreshed at least every second, if the picture is changed all the time, the data transmitted every second is as high as 144M, and usually becomes several M after compression, depending on the compression algorithm, but the data amount transmitted every second is still very high, and when the network environment is not good, the picture is delayed seriously, and the experience is very poor.
Examples
Fig. 1 is a flowchart of a remote picture synchronization method according to an embodiment of the present application. Referring to fig. 1, the remote screen synchronization method provided in the present embodiment is applied to a server. The remote picture synchronization method includes:
s101, receiving a picture establishing request sent by a client;
when remote picture synchronization is performed, at least two devices are required, one is a device for generating a picture to be synchronized, and the other is a device for synchronously displaying a picture generated by the other device. For the sake of convenience of distinction, the device generating the picture to be synchronized is named device a herein; the device used to synchronize the generation of the pictures by display device a is referred to as device B. When screen synchronization between the device a and the device B is performed, the device a may directly serve as a server side, and the device B may serve as a client side. Of course, a server may be additionally built, the server is connected to the device a and the device B, and the server, the device a, and the device B as the client together complete the synchronization of the screen.
It should be noted that, the device a and the device B are used as a server and a client to synchronize the pictures, so that the intervention of a third party in the picture synchronization process is reduced, and the synchronized pictures can be kept secret better.
In this embodiment, each step is written by taking the server as an execution subject, and in step S101, the server receives a screen establishment request sent by the client.
S102, determining a picture to be synchronized corresponding to the picture establishing request;
it should be noted that, when the server is the device a which generates the picture to be synchronized, in step 102, determining the picture to be synchronized corresponding to the picture establishment request refers to calling the picture to be synchronized by the server, i.e., a module in the device a which executes step S103.
When the server is not the device a but a server built separately, in step 102, it is determined that the screen to be synchronized corresponding to the screen building request is the screen to be synchronized generated in the device a acquired by the server.
S103, converting the picture to be synchronized into picture analysis data which accords with a preset picture construction rule based on a preset picture analysis rule;
in the scheme provided by the application, a preset picture analysis rule is stored in the server, and a preset picture construction rule is stored in the client. The preset picture parsing rule and the preset picture construction rule correspond to each other. The picture analysis data obtained by converting the picture to be synchronized based on the preset picture analysis rule can be reconstructed through the preset picture construction rule to obtain a complete picture to be synchronized.
It should be noted that, in general, a picture to be synchronized is composed of a plurality of elements. In the scheme provided by the application:
firstly, dividing a picture to be synchronized into at least one sub-picture based on a preset picture analysis rule; for pictures with more elements, a picture to be synchronized can be divided into a plurality of sub-pictures. The specific dividing process may be: the sub-pictures are distinguished on the basis of the elements contained in the picture to be synchronized itself. Specifically, for example: the pictures to be synchronized in the industrial control system generally include: a plurality of keys and a plurality of status display bars. Then, during the division, the picture to be synchronized can be divided according to each case and each status display column, each key is divided into a sub-picture, and each status display column is divided into a sub-picture.
Respectively converting the sub-pictures into sub-picture analysis data in accordance with picture construction rules based on preset picture analysis rules
Specifically, the sub-picture analysis data includes: and one or more of the main body name, the length, the width, the display character and the coordinate of the sub-picture. The following description is made with a sprite divided according to a single key: describing the sub-picture based on a preset picture analysis rule, wherein the obtained sub-picture analysis data is as follows:
the frame resolution data here describes a key, positioned at (200 ), width 100, height 30, displaying a "hello" character. The client can generate the sub-picture based on the preset picture construction rule through the description.
It should be noted that the above description is only a simple example, and in a specific application scenario, the types of the keys may be various, such as a square key, a round key, and an oval key. Specifically, the key may be classified into a type 1 square key and a type 2 square key. Therefore, the preset picture analysis rule and the preset picture construction rule in the application are updated and optimized in a targeted manner according to the picture to be synchronized. So as to better convert and construct the picture to be synchronized.
And integrating the sub-picture analysis data to obtain picture analysis data.
By the method, one picture to be synchronized can be converted into picture analysis data.
And S104, sending the picture analysis data to the client so that the client reconstructs and displays the picture to be synchronized based on the picture analysis data and a preset picture construction rule.
In practical application, the picture analysis data needs to be encrypted in order to ensure that the data cannot be leaked. Firstly, encrypting picture analysis data; and then sending the encrypted picture analysis data to the client. Therefore, the setting can better protect the picture analysis data and avoid data leakage.
In the scheme provided by the application, a server receives a picture establishing request sent by a client; then determining a picture to be synchronized corresponding to the picture establishing request; converting the picture to be synchronized into picture analysis data which accords with a preset picture construction rule based on a preset picture analysis rule; and sending the picture analysis data to the client so that the client reconstructs and displays the picture to be synchronized based on the picture analysis data and a preset picture construction rule. Therefore, the picture to be synchronized is converted into picture analysis data which accords with the preset picture construction rule, the whole picture is not directly transmitted as in the prior art, but only the picture analysis data is transmitted, and then the picture to be synchronized is reconstructed by the client based on the picture analysis data. This reduces the data that needs to be transmitted. Furthermore, in some industrial control systems, the picture to be synchronized is often composed of several simple and clear elements, and correspondingly, picture analysis data used for constructing the picture to be synchronized is relatively simple, so that data required to be transmitted through a network are further reduced. According to the scheme, data needing to be transmitted when the pictures are synchronized are reduced, the requirement for a network environment in the picture synchronization process is reduced, and the problems that picture delay is serious and user experience is poor due to low network transmission speed are avoided.
Further, in practical applications, the picture to be synchronized includes data that is partially updated at any time. For better data transfer. The scheme provided by the embodiment further comprises the following steps:
s105, sending communication data unit establishing rule data to the client, so that the client establishes the rule data based on the communication data unit and establishes a data unit;
it should be noted that, the communication data unit establishment rule data is exemplified here: the communication data unit establishment rule data may be: 100 8-bit data elements, 100 16-bit data elements, and 100 32-bit data elements; of course, the above example only describes the general contents of the format of the contents in the communication data unit establishing rule data, and the 8-bit data unit is not limited to 100. The specific information of the communication data unit establishing rule data needs to be adjusted according to actual conditions.
After the client receives the communication data unit establishment rule data, the client establishes a rule data establishment data unit based on the communication data unit, and after the establishment is completed, the client sends a data synchronization request to the server.
S106, receiving a data synchronization request in a data unit sent by a client;
it is to be noted that; the data unit is pre-constructed based on a preset data unit establishing rule. The server builds a data unit locally according to a preset data unit building rule, and sends the preset data unit building rule to the client side, so that the client side builds the data unit based on the preset data unit building rule. And the client sends a data synchronization request in the data unit to the client after the data unit is established.
S107, if the data unit of the server corresponding to the data synchronization request is updated, sending the updated data of the data unit to the client so that the client updates the data in the data unit of the client;
therefore, the data updating is completed through the mode, the data updating in real time is avoided, and the data volume needing to be transmitted between the server and the client is reduced.
Fig. 2 is a flowchart of a remote picture synchronization method according to another embodiment of the present application. Referring to fig. 2, the remote screen synchronization method provided in this embodiment further includes:
s201, acquiring identity authentication information sent by a client;
in practical application, before data synchronization is carried out between a server and a client, authentication of identity information is required, and when the identity information is authenticated, the authentication is initiated by the client, and the client sends the authentication information to the server.
S202, if the identity authentication information is the same as the preset identity information, establishing connection with the client;
the preset identity information is stored in the server in advance.
After receiving the authentication information sent by the client, the server compares the received authentication information with preset authentication information, and if the received authentication information is the same as the preset authentication information, connection is established with the client;
specifically, the authentication information includes: a user name, a password, and a device ID. Correspondingly, the preset identity information includes: a username of the client, a password of the client, and a device ID of the client.
And S203, sending the server parameter information to the client, so that the client sends a picture establishing request to the server if the client determines that the server parameter information meets the requirement.
Further, in order to ensure that the server and the client can synchronize the pictures, further verification of parameters of the server and the client is required. In step S203, the server sends server parameter information to the client, so that the preset target server can determine whether the server parameter information meets the requirement, and when the server parameter information meets the requirement, the client sends a screen establishment request to the server.
Specifically, the parameter information includes: server version, server device display, and/or pixel parameters. It should be noted that, when the scheme provided by the present application is used to perform remote data transmission, matching between a preset picture construction rule and a preset picture analysis rule is firstly ensured. In general, the client can determine whether the server version, the server device display, and/or the pixel parameter can perform remote screen synchronization.
Fig. 3 is a flowchart of a remote picture synchronization method according to another embodiment of the present application. Referring to fig. 3, the remote screen synchronization method provided in this embodiment is applied to a client. The remote picture synchronization method provided by the embodiment comprises the following steps:
s301, sending a picture establishing request to a server;
s302, receiving picture analysis data sent by a server; the picture analysis data is obtained by converting the picture to be synchronized into picture analysis data which accords with a preset picture construction rule by the server based on a preset picture analysis rule;
specifically, the detailed description of this step can refer to the related description in step S103. And will not be described in detail herein. When the screen analysis data transmitted by the server is encrypted screen analysis data, step S302 includes: receiving encrypted picture analysis data sent by a preset server; and decrypting the encrypted picture analysis data to obtain unencrypted picture analysis data.
S303, constructing a picture to be synchronized based on a preset picture construction rule and picture analysis data;
it should be noted that, in general, a picture to be synchronized is composed of a plurality of elements. In the scheme provided by the application: when the picture analysis data sent by the server is obtained by integrating a plurality of sub-picture analysis data. The scheme in step S303 is specifically as follows:
firstly, dividing picture analysis data into at least one piece of sub-picture analysis data;
then respectively constructing sub-pictures based on preset picture construction rules and the sub-picture analysis data; in the scheme provided by the application, a preset picture analysis rule is stored in the server, and a preset picture construction rule is stored in the client. The preset picture parsing rule and the preset picture construction rule correspond to each other. The picture analysis data obtained by converting the picture to be synchronized based on the preset picture analysis rule can be reconstructed through the preset picture construction rule to obtain a complete picture to be synchronized.
And integrating the sub-pictures to form a picture to be synchronized.
Specifically, the sub-picture analysis data includes: the subject name, length, width, and display word conform to at least one of the coordinates.
S304, displaying the picture to be synchronized.
In the scheme provided by the application, a client sends a picture establishing request to a server; then receiving picture analysis data sent by a server; the picture analysis data is obtained by converting the picture to be synchronized into picture analysis data which accords with a preset picture construction rule by the server based on a preset picture analysis rule; constructing a picture to be synchronized based on a preset picture construction rule and picture analysis data; and displaying the picture to be synchronized. Therefore, the data received by the client is converted picture analysis data, and the picture analysis data is only transmitted when the data is transmitted for the whole picture instead of receiving the whole picture as in the prior art, and then the picture to be synchronized is reconstructed by the client based on the picture analysis data. This reduces the data that needs to be transmitted. Furthermore, in some industrial control systems, the picture to be synchronized is often composed of several simple and clear elements, and correspondingly, picture analysis data used for constructing the picture to be synchronized is relatively simple, so that data required to be transmitted through a network are further reduced. According to the scheme, data needing to be transmitted when the pictures are synchronized are reduced, the requirement for a network environment in the picture synchronization process is reduced, and the problems that picture delay is serious and user experience is poor due to low network transmission speed are avoided.
Further, the remote screen synchronization method provided in this embodiment further includes:
s305, sending a data synchronization request in the data unit to the server;
it should be noted that, in the process of picture synchronization, the server needs to build a data unit locally according to a preset data unit building rule, and send the preset data unit building rule to the client, so that the client builds the data unit based on the preset data unit building rule. And the client sends a data synchronization request in the data unit to the client after the data unit is established.
S306, receiving the updating data of the data unit sent by the server;
the server sends the update data to the client when the data unit of the server corresponding to the data synchronization request stores data update;
s307, updating the data in the data unit of the client based on the update data.
Therefore, the data updating is completed through the mode, the data updating in real time is avoided, and the data volume needing to be transmitted between the server and the client is reduced.
S308, determining a data picture object in the picture to be synchronized;
s309, binding the data picture object and the corresponding data unit, so that the data picture object synchronously displays the data in the corresponding data unit.
In steps S308 and S309, the data picture object and the corresponding data unit are directly bound, so that when the data picture object in the picture is updated, only the corresponding update data needs to be transmitted to update the corresponding data unit, and the value in the data picture object in the picture is also updated along with the update data, thereby completing the synchronization of the remote picture.
Fig. 4 is a flowchart of a remote picture synchronization method according to another embodiment of the present application. Referring to fig. 4, the remote screen synchronization method provided in this embodiment further includes:
s401, the server confirms whether to establish connection or not through the identity authentication information sent to the server.
In practical application, before data synchronization is carried out between a server and a client, authentication of identity information is required, and when the identity information is authenticated, the authentication is initiated by the client, and the client sends the authentication information to the server.
Specifically, the authentication information includes: a user name, a password, and a device ID. Correspondingly, the preset identity information includes: a username of the client, a password of the client, and a device ID of the client.
S402, receiving parameter information sent by a server;
after the server passes the verification, the server establishes connection with the client, and at the moment, the server sends parameter information to the client. In step S402, the client receives the parameter information sent by the server.
S403, judging whether the server parameter information meets the requirements, and obtaining a yes or no judgment result;
s404, if the judgment result is yes, sending a picture establishing request to the server.
Specifically, please refer to the description of the corresponding steps in fig. 3, which is not repeated herein.
Further, the scheme provided by the application further comprises: and interacting with the user through the interface interaction function module. Specifically, the interface interaction function module includes: the display label sub-module, the image curve sub-module, the list recording sub-module, and/or the key sub-module and the keyboard sub-module. A user can interact with a synchronous picture on a client through each module, so that some operations can be performed on a remote picture in this embodiment, and specifically, a method in remote control can be implemented with reference to vnc software. Of course, the image curve sub-module and the list recording sub-module may perform some processing on the data in the local data unit to obtain the image curve or the list record.
Fig. 5 is a schematic structural diagram of a remote screen synchronization apparatus according to an embodiment of the present application, where the remote screen synchronization apparatus is disposed in a server. Referring to fig. 5, the present application provides a remote screen synchronization apparatus including:
a first receiving module 501, configured to receive a screen establishment request sent by a client;
a determining module 502, configured to determine a to-be-synchronized picture corresponding to the picture establishing request;
the conversion module 503 is configured to convert the picture to be synchronized into picture analysis data meeting the picture construction rule based on a preset picture analysis rule;
the first sending module 504 is configured to send the picture analysis data to the client, so that the client reconstructs and displays a picture to be synchronized based on the picture analysis data and a preset picture construction rule.
The specific implementation of the remote picture synchronization apparatus provided in this embodiment of the present application may refer to the implementation of the method of the remote picture synchronization apparatus in the above related embodiments, and details are not described here.
Fig. 6 is a schematic structural diagram of a remote screen synchronization apparatus according to an embodiment of the present application, where the remote screen synchronization apparatus is disposed in a client. Referring to fig. 6, the present application provides a remote screen synchronization apparatus including:
a second sending module 601, configured to send a request for establishing a picture to a server;
a second receiving module 602, configured to receive picture analysis data sent by a server; the picture analysis data is obtained by converting the picture to be synchronized into picture analysis data which accords with a preset picture construction rule by the server based on a preset picture analysis rule;
a building module 603, configured to build a to-be-synchronized picture based on a preset picture building rule and picture analysis data;
the display module 604 is configured to display a picture to be synchronized.
The specific implementation of the remote picture synchronization apparatus provided in this embodiment of the present application may refer to the implementation of the method of the remote picture synchronization apparatus in the above related embodiments, and details are not described here.
Fig. 7 is a schematic structural diagram of a server according to an embodiment of the present application, and referring to fig. 7, the server provided in the present application includes:
a processor 701, and a memory 702 coupled to the processor 701;
the memory 701 is used for storing a computer program;
the processor 701 is used to call and execute a computer program in the memory 702 to perform the remote screen synchronization method in the above related embodiment.
For a specific implementation of the server provided in this embodiment, reference may be made to the implementation of the method of the remote picture synchronization apparatus in the foregoing related embodiments, and details are not described here.
Fig. 8 is a schematic structural diagram of a client according to an embodiment of the present application, and referring to fig. 8, the client according to the present application includes:
a processor 801, and a memory 802 connected to the processor 801;
the memory 801 is used to store computer programs;
the processor is used to call and execute the computer program in the memory to execute the remote picture synchronization method in the above related embodiments.
The specific implementation of the client according to the embodiment of the present application may refer to the implementation of the method of the remote picture synchronization apparatus in the above related embodiments, and details are not described here.
The present application further provides a remote picture synchronization system, which includes: the client provided in the above-described related embodiment and the server provided in the above-described related embodiment.
In the scheme provided by the application, a server receives a picture establishing request sent by a client; then the server determines a picture to be synchronized corresponding to the picture establishing request; converting the picture to be synchronized into picture analysis data which accords with a preset picture construction rule based on a preset picture analysis rule; and sending the picture analysis data to the client so that the client reconstructs and displays the picture to be synchronized based on the picture analysis data and a preset picture construction rule. Therefore, the picture to be synchronized is converted into picture analysis data which accords with the preset picture construction rule, the whole picture is not directly transmitted as in the prior art, but only the picture analysis data is transmitted, and then the picture to be synchronized is reconstructed by the client based on the picture analysis data. This reduces the data that needs to be transmitted. Furthermore, in some industrial control systems, the picture to be synchronized is often composed of several simple and clear elements, and correspondingly, picture analysis data used for constructing the picture to be synchronized is relatively simple, so that data required to be transmitted through a network are further reduced. According to the scheme, data needing to be transmitted when the pictures are synchronized are reduced, the requirement for a network environment in the picture synchronization process is reduced, and the problems that picture delay is serious and user experience is poor due to low network transmission speed are avoided.
For a specific implementation of the remote picture synchronization system provided in the embodiment of the present application, reference may be made to the related embodiments of any of the above embodiments, and details are not described here.
It is understood that the same or similar parts in the above embodiments may be mutually referred to, and the same or similar parts in other embodiments may be referred to for the content which is not described in detail in some embodiments.
It should be noted that, in the description of the present application, the terms "first", "second", etc. are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In addition, in this document
In the description of the application, the meaning of "plurality" means at least two unless otherwise indicated.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware that is related to instructions of a program, and the program may be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a separate product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.
Claims (26)
1. A method for remote picture synchronization, the method comprising:
receiving a picture establishing request sent by a client;
determining a picture to be synchronized corresponding to the picture establishing request;
converting the picture to be synchronized into picture analysis data which accords with a preset picture construction rule based on a preset picture analysis rule;
and sending the picture analysis data to the client so that the client reconstructs and displays the picture to be synchronized based on the picture analysis data and a preset picture construction rule.
2. The method according to claim 1, wherein the converting the picture to be synchronized into picture parsing data conforming to a preset picture construction rule based on a preset picture parsing rule comprises:
dividing the picture to be synchronized into at least one sub-picture based on a preset picture analysis rule;
respectively converting the sub-pictures into sub-picture analysis data which accord with the picture construction rules based on the preset picture analysis rules;
and integrating the sub-picture analysis data to obtain picture analysis data.
3. The remote picture synchronization method according to claim 2, wherein the sub-picture parsing data comprises: and the main name, the length, the width and the display character of the sub-picture conform to at least one of the coordinates.
4. The remote picture synchronization method according to claim 1, wherein said sending the picture resolution data to the client further comprises:
encrypting the picture analysis data;
the sending the picture analysis data to the client includes:
and sending the encrypted picture analysis data to the client.
5. The remote picture synchronization method according to claim 1, further comprising:
receiving a data synchronization request in a data unit sent by a client;
if the data unit of the server corresponding to the data synchronization request is updated, sending the update data of the data unit to a client so that the client updates the data in the data unit of the client;
the data unit is pre-constructed based on a preset data unit establishing rule.
6. The remote picture synchronization method according to claim 5, further comprising:
the data unit is built locally according to a preset data unit building rule, and the preset data unit building rule is sent to the client side, so that the client side can build the data unit based on the preset data unit building rule.
7. The remote picture synchronization method according to claim 1, further comprising:
acquiring identity authentication information sent by a client;
if the identity authentication information is the same as the preset identity information, establishing connection with the client;
and the preset identity information is stored in the server in advance.
8. The remote screen synchronization method according to claim 7, wherein the authentication information includes: a user name, a password, and a device ID.
9. The remote picture synchronization method according to claim 1, further comprising:
and sending server parameter information to a client so that the client sends the picture establishing request to the server if the client determines that the server parameter information meets the requirements.
10. The remote picture synchronization method according to claim 9, wherein the parameter information includes: server version, server device display, and/or pixel parameters.
11. A method for remote picture synchronization, the method comprising:
sending a request for establishing a picture to a server;
receiving picture analysis data sent by the server; the picture analysis data is obtained by converting a picture to be synchronized into picture analysis data which accords with a preset picture construction rule by the server based on a preset picture analysis rule;
constructing the picture to be synchronized based on the preset picture construction rule and the picture analysis data;
and displaying the picture to be synchronized.
12. The method according to claim 11, wherein the constructing the picture to be synchronized based on the preset picture construction rule and the picture parsing data comprises:
dividing the picture analysis data into at least one sub-picture analysis data;
respectively constructing sub-pictures based on preset picture construction rules and the sub-picture analysis data;
and integrating the sub-pictures to form the picture to be synchronized.
13. The remote picture synchronization method according to claim 12, wherein the sub-picture parsing data comprises: the subject name, length, width, and display word conform to at least one of the coordinates.
14. The method according to claim 11, wherein the receiving picture analysis data sent by a preset server comprises:
receiving encrypted picture analysis data sent by a preset server;
and decrypting the encrypted picture analysis data to obtain unencrypted picture analysis data.
15. The remote picture synchronization method according to claim 11, further comprising:
sending a data synchronization request in a data unit to the server; the data unit client is established based on a preset data unit establishing rule; the preset data unit establishing rule is sent to the client by the server;
receiving the updating data of the data unit sent by the server;
when the data unit of the server corresponding to the data synchronization request stores data updating, the server sends the data updating data to the client;
updating data within data units of the client based on the update data.
16. The remote picture synchronization method according to claim 15, further comprising:
determining a data picture object in the picture to be synchronized;
and binding the data picture object and the corresponding data unit so that the data picture object synchronously displays the data in the corresponding data unit.
17. The remote picture synchronization method according to claim 11, further comprising:
and the authentication information is sent to the server for the server to confirm whether to establish connection.
18. The remote screen synchronization method according to claim 17, wherein the authentication information includes: a user name, a password, and a device ID.
19. The remote picture synchronization method according to claim 11, wherein before sending the create picture request to the server, further comprising:
receiving parameter information sent by the server;
the sending of the request for establishing the picture to the server comprises:
judging whether the server parameter information meets the requirements or not to obtain a yes or no judgment result;
and if so, sending a picture establishing request to the server.
20. The remote picture synchronization method according to claim 11, further comprising:
and interacting with the user through the interface interaction function module.
21. The remote screen synchronization method according to claim 20, wherein the interface interaction function module comprises: the display label sub-module, the image curve sub-module, the list recording sub-module, and/or the key sub-module and the keyboard sub-module.
22. A remote picture synchronization device installed in a server, the remote picture synchronization device comprising:
the first receiving module is used for receiving a picture establishing request sent by a client;
the determining module is used for determining the picture to be synchronized corresponding to the picture establishing request;
the conversion module is used for converting the picture to be synchronized into picture analysis data which accords with the picture construction rule based on a preset picture analysis rule;
and the first sending module is used for sending the picture analysis data to the client so that the client reconstructs and displays a picture to be synchronized based on the picture analysis data and the preset picture construction rule.
23. A remote picture synchronization device arranged at a client side comprises:
the second sending module is used for sending a picture establishing request to the server;
the second receiving module is used for receiving the picture analysis data sent by the server; the picture analysis data is obtained by converting a picture to be synchronized into picture analysis data which accords with a preset picture construction rule by the server based on a preset picture analysis rule;
the construction module is used for constructing the picture to be synchronized based on the preset picture construction rule and the picture analysis data;
and the display module is used for displaying the picture to be synchronized.
24. A server, comprising: a processor, and a memory coupled to the processor;
the memory is used for storing a computer program;
the processor is configured to invoke and execute the computer program in the memory to perform the method of any of claims 1-10.
25. A client, comprising: a processor, and a memory coupled to the processor;
the memory is used for storing a computer program;
the processor is configured to invoke and execute the computer program in the memory to perform the method of any one of claims 11-21.
26. A remote picture synchronization system, comprising: a server according to claim 24 and a client according to claim 25.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910881397.2A CN110719502A (en) | 2019-09-18 | 2019-09-18 | Remote picture synchronization method, device, equipment and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910881397.2A CN110719502A (en) | 2019-09-18 | 2019-09-18 | Remote picture synchronization method, device, equipment and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110719502A true CN110719502A (en) | 2020-01-21 |
Family
ID=69210580
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910881397.2A Pending CN110719502A (en) | 2019-09-18 | 2019-09-18 | Remote picture synchronization method, device, equipment and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110719502A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112181341A (en) * | 2020-10-10 | 2021-01-05 | 珠海格力电器股份有限公司 | Remote synchronization method for display picture |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102185852A (en) * | 2011-04-26 | 2011-09-14 | 苏州阔地网络科技有限公司 | Electronic whiteboard synchronization method and system based on webpage |
| CN102883134A (en) * | 2012-11-01 | 2013-01-16 | 成都飞视美视频技术有限公司 | Screen sharing and controlling method for video conference system |
| US20140067558A1 (en) * | 2012-08-29 | 2014-03-06 | Panasonic Corporation | Image display apparatus, image display method, and recording medium |
| CN103646574A (en) * | 2013-12-18 | 2014-03-19 | 闫健 | Panoramic learning system platform based interactive teaching method between teachers and students |
| CN104980326A (en) * | 2014-04-03 | 2015-10-14 | 联想移动通信软件（武汉）有限公司 | Method and device for sharing application content between terminal equipment |
| CN106162043A (en) * | 2015-04-14 | 2016-11-23 | 杭州施强网络科技有限公司 | Multimedia file demenstration method in a kind of video conferencing system |
| CN107872471A (en) * | 2016-09-23 | 2018-04-03 | 深圳市傲冠软件股份有限公司 | Remote desktop image command processing method and system |
| CN108021347A (en) * | 2017-12-29 | 2018-05-11 | 航天科工智慧产业发展有限公司 | A kind of method of Android terminal Screen sharing |
| CN109874100A (en) * | 2019-02-20 | 2019-06-11 | 视联动力信息技术股份有限公司 | A kind of emergency command information labeling method and apparatus |
-
2019
- 2019-09-18 CN CN201910881397.2A patent/CN110719502A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102185852A (en) * | 2011-04-26 | 2011-09-14 | 苏州阔地网络科技有限公司 | Electronic whiteboard synchronization method and system based on webpage |
| US20140067558A1 (en) * | 2012-08-29 | 2014-03-06 | Panasonic Corporation | Image display apparatus, image display method, and recording medium |
| CN102883134A (en) * | 2012-11-01 | 2013-01-16 | 成都飞视美视频技术有限公司 | Screen sharing and controlling method for video conference system |
| CN103646574A (en) * | 2013-12-18 | 2014-03-19 | 闫健 | Panoramic learning system platform based interactive teaching method between teachers and students |
| CN104980326A (en) * | 2014-04-03 | 2015-10-14 | 联想移动通信软件（武汉）有限公司 | Method and device for sharing application content between terminal equipment |
| CN106162043A (en) * | 2015-04-14 | 2016-11-23 | 杭州施强网络科技有限公司 | Multimedia file demenstration method in a kind of video conferencing system |
| CN107872471A (en) * | 2016-09-23 | 2018-04-03 | 深圳市傲冠软件股份有限公司 | Remote desktop image command processing method and system |
| CN108021347A (en) * | 2017-12-29 | 2018-05-11 | 航天科工智慧产业发展有限公司 | A kind of method of Android terminal Screen sharing |
| CN109874100A (en) * | 2019-02-20 | 2019-06-11 | 视联动力信息技术股份有限公司 | A kind of emergency command information labeling method and apparatus |
Non-Patent Citations (1)
| Title |
|---|
| 黄锦惠: "基于智能机顶盒的信息采集与发布终端的设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112181341A (en) * | 2020-10-10 | 2021-01-05 | 珠海格力电器股份有限公司 | Remote synchronization method for display picture |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR100957942B1 (en) | Systems and methods for providing color management | |
| WO2022062623A1 (en) | Remote control method and apparatus, and device, and storage medium, and system | |
| US9621627B2 (en) | Dynamically launching a server-based application on a mobile device | |
| EP2914040B1 (en) | Terminal and synchronization control method thereof | |
| US20130050271A1 (en) | Mobile terminal, image display device mounted on vehicle and data processing method using the same | |
| US10620903B2 (en) | Method and device for processing display data | |
| JP5305894B2 (en) | Screen sharing system, setting change method, client device, and program | |
| JP2016065939A (en) | Image display program, image display method, and image display system | |
| US9392315B1 (en) | Remote display graphics | |
| CN110149537B (en) | Split screen playing control method and device for advertising player | |
| CN112989325A (en) | Service calling method and device, storage medium and electronic equipment | |
| CN110719502A (en) | Remote picture synchronization method, device, equipment and system | |
| US20150186095A1 (en) | Inter-terminal image sharing method, terminal device, and communications system | |
| WO2023273084A1 (en) | Method and apparatus for transmitting picture data, device, and storage medium | |
| CN115988265A (en) | Rendering method and device of display picture and terminal equipment | |
| CN112995322B (en) | Information transmission channel establishment method, device, storage medium and terminal | |
| JP2002512470A (en) | Method and apparatus for supporting a video protocol in a network environment | |
| CN107995524A (en) | A kind of FTP client FTP and its design, data processing method for connecting network video server | |
| CN107315970B (en) | Sensitive data interaction method and device | |
| CN110990109B (en) | Spliced screen back display method, terminal, system and storage medium | |
| CN103777993A (en) | Multiuser computer system | |
| CN113961156A (en) | Multi-screen display method, device and system, electronic equipment and computer medium | |
| CN108243293B (en) | Image display method and system based on virtual reality equipment | |
| CN111787117A (en) | Data transmission method and display device | |
| WO2024020896A1 (en) | Field-device control method, field device, mobile device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200121 |