WO2020034652A1

WO2020034652A1 - System and method for synchronizing user interface, terminal, and server

Info

Publication number: WO2020034652A1
Application number: PCT/CN2019/082702
Authority: WO
Inventors: 时永欣
Original assignee: 北京大米科技有限公司
Priority date: 2018-08-14
Filing date: 2019-04-15
Publication date: 2020-02-20

Abstract

The present invention relates to the field of multimedia technology capable of solving the problem in which service performance degrades in a process of operating a user interface. Disclosed are a system and method for synchronizing a user interface, a terminal, and a server. The system for synchronizing a user interface comprises a first terminal, a second terminal and a server. The first terminal transmits an operation event generated on the basis of an operation performed on a user interface. The operation event comprises an operation message and an operation type. The server receives the operation event, and broadcasts, or stores and broadcasts, the operation message according to the operation type. The second terminal synchronizes the broadcasted operation message. The present invention mitigates the problem of service performance degradation caused by a high concurrent write operation.

Description

User interface synchronization system, method, terminal and server

This application requires the application number 201810924811.9 filed on August 14, 2018, the invention name as "Remote Operation Content Synchronization System and Method", and the application number 201810924645.2, and the invention name filed on August 14, 2018 Operating Content Synchronization System and Method ", filed on August 14, 2018, with application number 201810924814.2, and the invention name is" Audio Operating Content Synchronization System and Method, "and filed on August 14, 2018, with application number 201810924813.8, invention The name is "Remote drag operation content synchronization system, method, device and storage medium", which was filed on August 14, 2018, with application number 201810924815.7, and the invention name is "Remote selection operation synchronization system, method, device and storage medium" , Filed on August 14, 2018, with application number 201810924812.3, and the invention name is "matching and selecting operation content synchronization system and method", and filed on August 14, 2018, with application number 201810925386.5, and the invention name is "page operation content Synchronization System and Method "and application number 201810925387.X and invention name" Qing Synchronization systems and methods, "the Chinese Priority Patent Application, the entire content of which is incorporated by reference in the present application.

Technical field

The present invention relates to the field of multimedia technology, and in particular, to a user interface synchronization system, method, terminal, and server.

Background technique

The description of the background technology of the present invention belongs to the related technology related to the present invention, and is only used to explain and facilitate the understanding of the inventive content of the present invention. It should not be understood that the applicant explicitly thinks or presumes that the applicant thinks that the present invention is the first application Prior art at the filing date.

With the development of the Internet, great convenience has been provided for meetings and lectures. Events such as meetings or lectures require interaction, so operations at either end need to be synchronized. However, in the existing synchronization of user interface operations, service performance will be lost due to high concurrent write operations to the database.

Summary of the Invention

In view of this, embodiments of the present invention provide a user interface synchronization system, method, terminal, and server, the main purpose of which is to reduce the problems caused by high concurrent writing.

To achieve the above object, the present invention mainly provides the following technical solutions:

In a first aspect, an embodiment of the present invention provides a user interface synchronization system, including a first terminal, a second terminal, and a server, where

A first terminal for sending an operation event generated based on an operation acting on a user interface, the operation event including an operation message and an operation type;

A server for receiving the operation event, broadcasting the operation message or storing and broadcasting the operation message according to the operation type;

A second terminal, configured to synchronize the operation message broadcasted.

In a second aspect, an embodiment of the present invention provides a user interface synchronization method, including the following steps:

The first terminal sends an operation event generated based on an operation acting on a user interface, where the operation event includes an operation message and an operation type;

The server receives the operation event, and broadcasts the operation message or stores and broadcasts the operation message according to the operation type;

The second terminal synchronously broadcasts the operation message.

According to a third aspect, an embodiment of the present invention provides a user interface synchronization terminal. The terminal includes:

Monitoring unit for monitoring operations acting on the user interface;

A response unit, configured to respond to the operation;

An operation event generating unit, configured to generate an operation event based on a response to the operation, where the operation event includes an operation message and an operation type;

The sending unit is configured to send the operation event, so as to broadcast the operation message or store and broadcast the operation message according to the operation type.

In a fourth aspect, an embodiment of the present invention provides a user interface synchronization method, including the following steps:

Monitor operations on the user interface;

In response to said operation;

Generating an operation event based on the operation, the operation event including an operation message and an operation type;

And sending the operation event so as to broadcast the operation message or store and broadcast the operation message according to the operation type.

In a fifth aspect, an embodiment of the present invention provides a user interface synchronization server, where the server includes:

A receiving unit, configured to receive an operation event, where the operation event includes an operation message and an operation type;

Operation type judging unit, for judging the operation type;

A broadcasting unit for broadcasting operation messages for synchronization;

The storage unit is configured to store corresponding operation messages when the operation type is a write operation.

According to a sixth aspect, an embodiment of the present invention provides a user interface synchronization method, including the following steps:

Receiving an operation event, the operation event including an operation message and an operation type;

Broadcasting the operation message or storing and broadcasting the operation message according to the operation type.

According to a seventh aspect, an embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of the foregoing method are implemented.

According to an eighth aspect, an embodiment of the present invention provides a computer device including a memory, a processor, and a computer program stored on the memory and executable on the processor. The processor implements the foregoing method when the program is executed. step.

Compared with the prior art, the beneficial effects of the embodiments of the present invention are:

The user interface synchronization system provided by the embodiment of the present invention classifies operations and processes operation messages differently according to different operation types. For example, for some operation types, only operation messages are broadcast without being written to the database, and for other operation types, For some operation types, the operation message is written to the database and the message is broadcast, which reduces the pressure on the server and greatly improves the service performance loss caused by the high concurrent write data.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram of an embodiment of a user interface synchronization system according to the present invention.

FIG. 2 is a schematic diagram of an embodiment of a user interface synchronization terminal according to the present invention.

3 is a flowchart of an embodiment of a user interface synchronization terminal according to the present invention.

FIG. 4 shows a flowchart of an embodiment of a user interface synchronization method according to the present invention.

FIG. 5 shows a flowchart of an embodiment of a user interface synchronization server according to the present invention.

detailed description

The present invention is described in further detail below with reference to specific embodiments, but is not intended to limit the present invention. In the following description, different "one embodiment" or "an embodiment" does not necessarily mean the same embodiment. Furthermore, the particular features, structures, or characteristics in one or more embodiments may be combined in any suitable form.

An embodiment of the present invention provides a user interface synchronization system. FIG. 1 shows a schematic diagram of an embodiment of the user interface synchronization system of the present invention. Referring to FIG. 1, a user interface synchronization system according to an embodiment of the present invention includes a first terminal 10, a second terminal 20, and a server 30.

The first terminal 10 is configured to send an operation event generated based on an operation acting on a user interface, and the operation event includes an operation message and an operation type;

The server 30 is configured to receive an operation event, and broadcast or store and broadcast an operation message according to an operation type;

The second terminal 20 synchronizes the broadcast operation message.

The user interface synchronization system provided by the embodiment of the present invention classifies operations and processes operation messages differently according to different operation types. For example, for some operation types, only operation messages are broadcast without being written to a database, and other For some operation types, the operation message is written to the database and broadcast the message, which reduces the pressure on the server and greatly improves the service performance loss caused by the high concurrent write data.

In the embodiment of the present invention, the operation type may be divided into two types. For example, the operation type includes a first operation type and a second operation type. The server 30 broadcasts an operation message of an operation event of the first operation type, and the server 30 stores and broadcasts a second operation type. Operation message for operation event of operation type. In the embodiment of the present invention, a part of operations are classified into the first operation type. The operation messages of this type are only broadcast and do not exist. This reduces data writing, reduces server pressure, and greatly improves service performance loss caused by high concurrent writing. .

In the embodiment of the present invention, which operations can be classified into the first operation type and which operations are classified into the second operation type according to actual conditions. For example, the first operation type may include a process operation of an operation event; the second operation type may include a result operation of the operation event. The data generated during the operation process may not be stored, and only the result data may be stored. For example, when dragging a file, it is only necessary to record the final position, and the process from the original position to the final position does not need to be stored, so that data writing can be reduced. The second operation type may further include a delete operation (del), a clear screen operation (clear), and the like.

In the embodiment of the present invention, the specific operations are not limited, and they can be synchronized according to the presence or absence of data writing. The first terminal determines the operation type, and the operation of the user interface includes, but is not limited to:

Operation of the selection interface of the first terminal interface, or operation of the first terminal's operation interface, or operation of the first terminal's gallery interface, or operation of the first terminal's audio interface, or operation of the first terminal's matching selection interface , Or the page operation interface of the first terminal acts on the operation of its interface, or the operation of the first terminal with the clear page button interface.

Specifically, the operation of the user interface includes any one or more of clearing the screen, drawing a line, creating, moving, stopping moving, clicking, page turning, page jumping, deleting, and floating. The first operation type includes drawing a line. , Create, move and hover any one or more, the second operation type includes any one or more of page turning, page jumping, clearing the screen, clicking, stopping moving and deleting.

Optionally, if the operation is to clear the screen, after the operation event of clicking the clear page button is completed, the first terminal clears all data on the page, restores the page to the initial state, and sends the clear page operation.

If the operation is mobile, the coordinates of the operation object are set locally according to the mouse position. The operation message in the operation event sent includes the movement, and the operation type is the first operation type. If the operation is suspended, an animation display is performed. It is temporarily enlarged.

If the operation is to stop the movement, determine whether the position where the movement is stopped is correct. If it is correct, the coordinate setting of the operation object is performed locally according to the stop position. The operation message in the operation event sent includes the stop movement, the operation type is the second operation type, Detect the coordinates of the moved element. If the coordinates of the moved element are within the trash bin, delete the element; if it is not correct, the operation object returns to the original coordinate position. The operation message in the operation event sent includes the return, operation type. Is the first operation type.

If the operation is clicking, the option prompt is displayed, and the option prompt is to display the judgment result.

If the operation is page turning, the local operation is page turning. The operation message in the operation event sent includes page turning, and the operation type is the second operation type.

If the operation is a page jump, the local operation is to jump to the input page number, and the operation message of the operation event sent includes the jump to the input page number; the operation type is the second operation type.

If the operation is floating, an animation is displayed, and the animation is temporarily enlarged.

For example, the operation is to drag the operation object, and the first terminal determines the operation type. If the operation is hovering, the animation is displayed locally. The operation message in the operation event sent includes hovering, and the operation type is the first operation. Type; if the operation is a movement, the coordinates of the operation object are set locally according to the mouse position. The operation message in the operation event sent includes movement, and the operation type is the first operation type. If the operation is the end of the movement, the operation event is sent. The operation message includes the end of the movement, and the operation type is the second operation type.

In this embodiment, the specific operation of the user interface is divided into different operation types, and operation messages are broadcasted or stored and broadcast according to different operation types for synchronization. For example, when dragging an image, only the operation of stopping the movement (drop operation) will affect the final display position of the image. Therefore, the operation of stopping the movement is set to the second type of operation and can be written into the database. For the dragging process (moving operation), you only need to synchronize without writing to the database (broadcast only, not writing). The specific actions of the above operations are not limited. For example, "Delete" can be a click on the delete button on the interface, or it can be triggered by other operations. In one embodiment, when the operation on the gallery interface of the first terminal is to stop moving, the first terminal detects the coordinates of the moved element, and if the coordinates of the moved element are within the range of the trash can, the element is deleted. In this embodiment, "Delete" is triggered through detection and judgment. When the file is dragged, the final position of the moved element is detected, that is, when the movement is stopped, if the coordinates of the moved element are within the range of the trash can, the element is deleted . For example, during a hover operation, the element can be animated. At this time, only broadcasting is required for synchronization without writing to the database.

Optionally, in the embodiments of the present disclosure, it is considered that certain operations may be continuous (such as click confirmation, etc.) or high frequency (such as frequent clicks, etc.) or, at this time, data needs to be continuously transmitted to affect services performance. Considering this factor, in an embodiment of the present disclosure, when the operation is a click confirmation, the time interval between the first terminal sending two adjacent operation events is greater than a set threshold. This embodiment sets the threshold for sending click operation events. Only when the time interval between the currently generated operation event and the last operation event sent is greater than the set threshold, the currently generated operation event is sent. This prevents users from clicking frequently. Consumption of service resources and useless message synchronization brought by the same option reduce the frequency of sending operational events, achieve throttling, and further avoid the problem of service performance loss.

Further, the setting of the threshold value should consider the synchronization effect, and it is appropriate not to affect the continuity of vision. In one embodiment, the threshold may be about 100 ms. Discard operation events within a time interval of 100ms, without transmission and broadcast, and will not affect the user's perception. Left and right in the embodiments of the present disclosure may be within a certain percentage range. For example, it fluctuates between 1%, 2%, 3%, 4%, 5%, or 10%. Of course, the specific setting of the threshold can also be other time values, such as 40ms, 50ms, 60ms, 70ms, 80ms, 85ms, 90ms, and so on.

The first terminal in the embodiment of the present invention may be a terminal controlled by a teacher or a terminal controlled by a student.

An embodiment of the present invention provides a user interface synchronization method. The method in this embodiment can be implemented by the foregoing system. Therefore, the description of the above system embodiment can be used to understand the method of the present invention. The user interface synchronization method according to the embodiment of the present invention includes the following steps:

The first terminal sends an operation event generated based on an operation acting on its operation interface, and the operation event includes an operation message and an operation type;

The server receives the operation event and broadcasts the operation message or stores and broadcasts the operation message according to the operation type;

The second terminal synchronously broadcasts the operation message.

The user interface synchronization method provided by the embodiment of the present invention categorizes operations and processes different response operation messages according to different operation types. For example, for the first operation type, only operation messages are broadcast without being written to the database. The second operation type writes to the database and broadcasts the message, thereby reducing the pressure on the server and greatly improving the service performance loss caused by the high concurrent write data.

In the embodiment of the present invention, which operations can be classified into the first operation type and which operations are classified into the second operation type according to actual conditions. For example, the first operation type includes a process operation of an operation event; the second operation type includes a result operation of the operation event. The data generated during the operation process may not be stored, and only the result data may be stored. For example, when dragging a file, it is only necessary to record the final position, and the process from the original position to the final position does not need to be stored, so that data writing can be reduced. The second operation type may further include a delete operation (del), a clear screen operation (clear), and the like.

In the embodiment of the present invention, the specific operations are not limited, and they can be synchronized according to the presence or absence of data writing. User interface operations include, but are not limited to:

An embodiment of the present invention provides a user interface synchronization terminal. FIG. 2 shows a schematic diagram of an embodiment of the user interface synchronization terminal of the present invention. Referring to FIG. 2, the user interface synchronization terminal of the embodiment of the present invention includes:

A monitoring unit 11 configured to monitor operations of an operation interface acting on the terminal;

A response unit 12 for responding to an operation;

An operation event generating unit 13 is configured to generate an operation event based on a response operation, and the operation event includes an operation message and an operation type;

The sending unit 14 is configured to send an operation event, so as to broadcast the operation message or store and broadcast the operation message according to the operation type.

The user interface synchronization terminal provided by the embodiment of the present invention categorizes operations, and the operation events sent include operation type information, so as to perform different processing on corresponding operation messages according to different operation types, for example, only broadcast operation messages. Does not write to the database, writes the operation message to the database and broadcasts the message, because some operation types are not written, which reduces the pressure on the server and greatly improves the service performance loss caused by the high concurrent write data .

In the embodiment of the present invention, operation types may be divided into two types. For example, operation types include a first operation type and a second operation type, an operation message that broadcasts an operation event of the first operation type, and an operation that stores and broadcasts a second operation type. Action message for the event. In the embodiment of the present invention, a part of operations are divided into the first operation type, so that only operation messages of this type are broadcast but not exist, reducing data writing, reducing server pressure, and greatly improving services brought by high concurrent writing. Performance loss.

In the embodiment of the present invention, the specific operations are not limited, and they can be synchronized according to the presence or absence of writing. User interface operations include, but are not limited to:

Optionally, in the embodiments of the present disclosure, it is considered that certain operations may be continuous (such as click confirmation, etc.) or high frequency (such as frequent clicks, etc.) or, at this time, data needs to be continuously transmitted to affect services performance. 3 is a flowchart of an embodiment of a user interface synchronization terminal according to the present invention. Referring to FIG. 3, in an embodiment of the present invention, the terminal further includes an interval judging unit 15, which determines whether the time interval of the operation event generated based on the mobile operation is greater than a set threshold. If the time interval between the last generated operation event and the generated threshold is greater than the set threshold, the currently generated operation event is sent. This embodiment sets the threshold for sending click operation events. Only when the time interval between the currently generated operation event and the last operation event sent is greater than the set threshold, the currently generated operation event is sent. This prevents users from clicking frequently. Consumption of service resources and useless message synchronization brought by the same option reduce the frequency of sending operational events, achieve throttling, and further avoid the problem of service performance loss.

An embodiment of the present invention provides a user interface synchronization method. The method in this embodiment may be implemented by using the foregoing terminal. Therefore, the description of the foregoing terminal embodiment can be used to understand the method of the embodiment of the present invention. FIG. 4 shows a flowchart of an embodiment of the user interface synchronization method of the present invention. Referring to FIG. 4, the user interface synchronization of the embodiment of the present invention The method includes the following steps:

Monitor operations on the operation interface;

Responding to monitored operations;

Generate operation events based on the operations monitored in response. Operation events include operation messages and operation types.

Send operation events to facilitate broadcasting or storing and broadcasting operation messages based on the type of operation.

Change the current playback state, that is, when the current is playing, click to make it pause, and when the current is paused, click to make it play. After receiving the corresponding operation event, the server stores the playback status of the audio and broadcasts the message, so that the second terminal can perform synchronization.

An embodiment of the present invention provides a user interface synchronization server. FIG. 5 shows a flowchart of an embodiment of the user interface synchronization server of the present invention. Referring to FIG. 5, the server according to the embodiment of the present invention includes:

The receiving unit 31 receives an operation event, and the operation event includes an operation message and an operation type;

Operation type judgment unit 32, which judges the operation type;

A broadcasting unit 33 for broadcasting an operation message for synchronization;

The storage unit 34 stores an operation message when the operation type is a write operation.

The user interface synchronization server provided by the embodiment of the present invention performs different processing on the corresponding operation message according to different operation types, such as broadcasting only the operation message without writing to the database, and writing the operation message to the database and broadcasting the message. Partial operation types are not written, which reduces the pressure on the server and greatly improves the service performance loss caused by the high concurrent write data.

The devices, functions, and method steps that are not described in detail in this embodiment, and the corresponding technical effects that can be achieved are the same as the corresponding contents in the above embodiments, and are not described herein again.

An embodiment of the present invention provides a user interface synchronization method. The method in this embodiment can be implemented by the server in the foregoing embodiment. Therefore, the description of the foregoing server embodiment can be used to understand that the method of the embodiment of the present invention includes the following steps:

Receive operation events, operation events include operation messages and operation types;

Broadcast operation messages or store and broadcast operation messages according to the operation type.

The present invention is further described below in combination with different specific operation interfaces.

In some embodiments of the present invention, the operation interface may be an audio operation interface, and the specific operation may be clicking audio, which specifically includes: judging an audio type, where

If it is long audio, the audio playback status is judged. When the audio is in the playback state, the audio is paused. The operation message in the operation event sent includes the pause of the playback. The operation type is the second operation type. Audio, the operation message in the operation event sent includes playback, and the operation type is the second operation type;

If it is short audio, judge the audio playing status, continue playing when the audio is playing, and play the audio when the audio is not playing. The operation message in the operation event sent includes playback, and the operation type is the second operation type.

In this embodiment, different operation events are generated according to the click operation. For example, when the audio is long audio, the click operation is to change the current playback state, that is, when the current operation is playing, the click operation is used to pause, and when the current operation is paused, the click operation is used to cause Its playing. After receiving the corresponding operation event, the server stores the playback status of the audio and broadcasts the message, so that the second terminal can perform synchronization.

In other embodiments of the present invention, the operation may specifically be dragging an element (for example, a picture, etc.), and the operation process of the dragging may specifically include hovering the cursor on the element, clicking to move, or stopping the movement ( (That is, the end of dragging) specifically includes: if the operation is hovering, the animation is displayed locally, and the operation message in the operation event sent may include the specific operation (hovering), and the operation type is the first operation type; if the operation is moving , The coordinates of the element are set locally according to the mouse position. The operation message in the operation event sent includes the movement (the coordinate of the element). The operation type is the first operation type. There is no need to write the coordinate data of the element during the movement. It is the end of dragging, and the operation message in the operation event sent includes the end of dragging (element coordinates), the operation type is the second operation type, and the coordinate data of the element at the end of dragging needs to be written.

In other embodiments of the present invention, the specific operation interface is a multiple choice operation interface. The specific operation may be hovering or clicking on an option, where the hovering is the first operation type and the click is the second operation type. The operation is to perform an animation display when hovering over the option. For example, the animation display may be temporarily enlarged, that is, when the mouse is hovering over the option, the option is animated to temporarily display the enlarged display effect. For example, the page displays an option prompt that determines whether the result is right or wrong. Select the correct one to recount.

In some embodiments of the present invention, the operation interface may be a matching operation interface, and the matching operation may specifically be moving or stopping moving. When the matching operation is to stop moving, it is judged whether it is the correct option. If it is the correct option, the correct option prompt is executed. If it is not the correct option, the move operation is executed. After the correct option prompt is executed, it is determined whether all the matching selections are completed correctly, and if all the matching selections are completed correctly, a prompt is given for answering. Specifically, in some embodiments of the present invention, the movement operation is to move a word or a word to a corresponding position in the picture. If the word or the word corresponds to the picture, it is prompted that the answer is correct, and the word or word is parked at the corresponding position in the picture; if If the word or word does not correspond to the picture, the word or word returns to its original position. In some embodiments of the present invention, the number of pictures may be three, and the number of words may be three. If all three words correspond to the corresponding picture If the match is correct, the prompt is completely correct and ends. What needs to be explained here: the correct way to prompt the answer can be to display the prompt, such as displaying √, the text "correct", "yes", "good", etc., it can also be a voice prompt, or an animation prompt, here The method of prompting is not specifically limited, as long as the prompt can be answered correctly; for the matching object, it is not limited to the matching of pictures and words, but also animation matching; the number of words and pictures can be equal or different. The number of pictures and words is not specifically limited in the present invention, as long as the learner can learn by comparing words with pictures.

In other embodiments of the present invention, the operation interface may be a scribing interface, and the specific operation may be drawing a line. After the operation event of drawing a line is completed, the first terminal obtains the drawn line data, and performs the line data processing. Compression, delete the original drawing lines, generate lines based on the compressed line data and send the lines. Drawing lines is continuous, and at this time, data needs to be continuously transmitted, affecting service performance. This embodiment sets the operating event sending conditions. Only the currently generated operating event and the previous sent operating event are completed, the currently generated operating event is sent, the operating event sending frequency is reduced, throttling is achieved, and service performance is further avoided. The problem of attrition. In one embodiment of the present invention, after the currently generated operation event is completed, the drawn line data is obtained, and the line data is compressed, the original drawn line is deleted, the line is generated based on the compressed line data, and the line is sent. The compression of the line data reduces the amount of data written during interactive transmission, thereby reducing the pressure on the server and greatly improving the service performance loss caused by the high concurrent writing data.

In other embodiments of the present invention, the operation interface may be an interface for operating a page, and the specific operation may be clicking a page to turn or entering a page to jump. When the operation is to click to turn the page, the local operation is to turn the page. The operation message in the operation event sent includes page turning, and the operation type is the second operation type. When the operation is to enter the page jump, the local operation is to jump to Enter the page number, and the operation message of the operation event sent includes jumping to the input page number; the operation type is the second operation type. If the teacher-controlled terminal input jumps to page 10, the student-controlled terminal jumps to page 10. Similarly, in this embodiment, throttling can also be performed. If it is in throttling control, the click operation will not generate a page turning or input page jump event, but will end the operation directly; if it is not in throttling control, click The operation is to jump to the specified page number. After receiving the corresponding operation event, the server stores the page number information after the jump and broadcasts the message.

In other embodiments of the present invention, the operation interface may be an interface with a clear page button, and the specific operation may be clicking a clear page button. After the operation event of clicking the clear page button is completed, all data on the page is cleared, the page is restored to the initial state, and the clear page operation is sent. This embodiment also involves a click operation, so throttling control may be performed to avoid transmitting operation events generated by meaningless frequent operations.

Messages may be lost due to instability related to the network status. In order to reduce such statuses leading to out-of-sync, in one embodiment of the invention, the network connection status is monitored. When the network between the terminal and the server is disconnected, For example, when the message feedback is that the socket is disconnected or the listen event disconnect is triggered, a retry mechanism is started, and when the cumulative number of failures reaches a set value (for example, 3 times), it prompts to re-enter the operation interface.

In order to synchronize disconnected operation messages so that they are not lost, you can use the user's localstorage cache strategy for data merge, and synchronize the lost messages when you enter the classroom again.

An embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of the foregoing method are implemented.

An embodiment of the present invention provides a computer device including a memory, a processor, and a computer program stored on the memory and executable on the processor. The processor implements the steps of the foregoing method when the program is executed.

Those skilled in the art can clearly understand that the technical solutions of the embodiments of the present invention can be implemented by software and / or hardware. The “unit” or “module” in this specification refers to software and / or hardware capable of completing specific functions independently or in cooperation with other components, where the hardware may be, for example, FPGA (Field-Programmable Gate Array). , IC (Integrated Circuit), etc.

An embodiment of the present invention also provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of the method of any of the foregoing embodiments are implemented. The computer-readable storage medium may include, but is not limited to, any type of disk, including floppy disks, optical disks, DVDs, CD-ROMs, micro-drives, and magneto-optical disks, ROM, RAM, EPROM, EEPROM, DRAM, VRAM, and flash memory devices. , Magnetic or optical cards, nanosystems (including molecular memory ICs), or any type of medium or device suitable for storing instructions and / or data.

An embodiment of the present invention further provides a computer device including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the steps of the method of any of the foregoing embodiments are implemented. In the embodiment of the present invention, the processor is a control center of a computer system, and may be a processor of a physical machine or a processor of a virtual machine.

In the present invention, the terms "first", "second", etc. are used for descriptive purposes only, and cannot be understood to indicate or imply relative importance or order; the term "plurality" means two or more, Unless otherwise clearly defined. The terms "installation", "connected", "connected", "fixed" and the like should be understood in a broad sense. For example, "connected" can be a fixed connection, a detachable connection, or an integral connection; "connected" can It is directly connected or indirectly connected through an intermediate medium. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific situations.

In the description of the present invention, it should be understood that the orientations or positional relationships indicated by the terms “up” and “down” are based on the orientations or positional relationships shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description. It is not an indication or implied that the device or unit referred to must have a specific direction, be constructed and operate in a specific orientation, and therefore cannot be understood as a limitation on the present invention.

The above are only specific embodiments of the present invention, but the scope of protection of the present invention is not limited to this. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed by the present invention. It should be covered by the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

A user interface synchronization system, comprising a first terminal, a second terminal, and a server, wherein

A first terminal for sending an operation event generated based on an operation acting on a user interface, the operation event including an operation message and an operation type;

A server for receiving the operation event, broadcasting the operation message and / or storing and broadcasting the operation message according to the operation type;

A second terminal, configured to synchronize the operation message broadcasted.
The system according to claim 1, wherein the operation type includes a first operation type and a second operation type, the server broadcasts an operation message of an operation event of the first operation type, and the server stores and Broadcasting an operation message of the operation event of the second operation type.
The system according to claim 2, wherein the first operation type includes a process operation of the operation event; and the second operation type includes a result operation of the operation event.
The system according to claim 2, wherein the operations acting on the user interface include any one of screen clearing, line drawing, creating, moving, stopping moving, clicking, page turning, page jumping, deleting, and floating Or more, wherein the first operation type includes any one or more of the line drawing, the creation, the movement, and the suspension, and the second operation type includes the page turning , Any one or more of the page jump, the clear screen, the click, the stop moving, and the delete.
The system according to claim 4, wherein:

If the operation is to clear the screen, after the operation event of clicking the clear page button is completed, the first terminal clears all data on the page, restores the page to the initial state, and sends the clear page operation;

If the operation is moving, coordinate setting is performed locally on the operation object according to the mouse position, and the operation message in the operation event sent includes movement, and the operation type is the first operation type;

If the operation is to stop the movement, determine whether the position where the movement is stopped is correct. If it is correct, the coordinates of the operation object are set locally according to the stop position. The operation message in the operation event sent includes the movement stop, and the operation type is the second operation type. And, the coordinates of the moved element are detected. If the coordinates of the moved element are within the range of the trash can, the element is deleted; if it is not correct, the operation object returns to the original coordinate position. The operation message in the operation event sent includes the return, Operation type is the first operation type;

If the operation is clicking, an option prompt is displayed, and the option prompt is to display a judgment result;

If the operation is a page turning, the local operation is a page turning operation, and the operation message in the operation event sent includes page turning, and the operation type is the second operation type;

If the operation is a page jump, the local operation is to jump to the input page number, and the operation message of the operation event sent includes the jump to the input page number; the operation type is the second operation type;

If the operation is a floating type, an animation display is performed, and the animation display is temporarily enlarged.
The system according to claim 5, wherein if the operation is an operation generated by a click or a movement operation, a time interval between the first terminal sending two adjacent operation events is greater than a set threshold.
A user interface synchronization method includes the following steps:

The first terminal sends an operation event generated based on an operation acting on a user interface, where the operation event includes an operation message and an operation type;

The server receives the operation event, and broadcasts the operation message and / or stores and broadcasts the operation message according to the operation type;

The second terminal synchronously broadcasts the operation message.
The method according to claim 7, wherein the operation type includes a first operation type and a second operation type, the server broadcasts an operation message of an operation event of the first operation type, and the server stores and Broadcasting an operation message of the operation event of the second operation type.
The method according to claim 8, wherein the operation of the first operation type includes a process operation of the operation event; and the second operation type includes a result operation of the operation event.
The method according to claim 8, wherein the operations acting on the user interface include any one of screen clearing, line drawing, creating, moving, stopping moving, clicking, page turning, page jumping, deleting, and floating Or more, wherein the first operation type includes any one or more of the line drawing, the creation, the movement, and the suspension, and the second operation type includes the page turning , Any one or more of the page jump, the clear screen, the click, the stop moving, and the delete.
The method according to claim 10, wherein:

If the operation is to clear the screen, after the operation event of clicking the clear page button is completed, the first terminal clears all data on the page, restores the page to the initial state, and sends the clear page operation;

If the operation is moving, coordinate setting is performed locally on the operation object according to the mouse position, and the operation message in the operation event sent includes movement, and the operation type is the first operation type;

If the operation is to stop the movement, determine whether the position where the movement is stopped is correct. If it is correct, the coordinates of the operation object are set locally according to the stop position. The operation message in the operation event sent includes the movement stop, and the operation type is the second operation type. And, the coordinates of the moved element are detected. If the coordinates of the moved element are within the range of the trash can, the element is deleted; if it is not correct, the operation object returns to the original coordinate position. The operation message in the operation event sent includes the return, Operation type is the first operation type;

If the operation is clicking, an option prompt is displayed, and the option prompt is to display a judgment result;

If the operation is a page turning, the local operation is a page turning operation, and the operation message in the operation event sent includes page turning, and the operation type is the second operation type;

If the operation is a page jump, the local operation is to jump to the input page number, and the operation message of the operation event sent includes the jump to the input page number; the operation type is the second operation type;

If the operation is a floating type, an animation display is performed, and the animation display is temporarily enlarged.
The method according to claim 11, wherein if the operation is an operation generated by a click or a movement operation, a time interval at which the first terminal sends two adjacent operation events is greater than a set threshold.
A user interface synchronization terminal is characterized in that the terminal includes:

Monitoring unit for monitoring operations acting on the user interface;

A response unit, configured to respond to the operation;

An operation event generating unit, configured to generate an operation event based on a response to the operation, where the operation event includes an operation message and an operation type;

The sending unit is configured to send the operation event, so as to broadcast the operation message and / or store and broadcast the operation message according to the operation type.
The terminal according to claim 13, wherein the operation type comprises a first operation type and a second operation type, an operation message broadcasting an operation event of the first operation type, and storing and broadcasting the second operation An action message of type action event.
The terminal according to claim 14, wherein the operation of the first operation type includes a process operation of the operation event; and the second operation type includes a result operation of the operation event.
A user interface synchronization method includes the following steps:

Monitor operations on the user interface;

In response to said operation;

Generating an operation event based on the operation, the operation event including an operation message and an operation type;

And sending the operation event so as to broadcast the operation message and / or store and broadcast the operation message according to the operation type.
The method according to claim 16, wherein the operation type includes a first operation type and a second operation type, the server broadcasts an operation message of an operation event of the first operation type, and the server stores and Broadcasting an operation message of the operation event of the second operation type.
The method according to claim 17, wherein the operation of the first operation type includes a process operation of the operation event; and the second operation type includes a result operation of the operation event.
The method according to claim 17, wherein the operations acting on the user interface include any one of screen clearing, line drawing, creating, moving, stopping moving, clicking, page turning, page jumping, deleting, and floating Or more, wherein the first operation type includes any one or more of the line drawing, the creation, the movement, and the suspension, and the second operation type includes the page turning , Any one or more of the page jump, the clear screen, the click, the stop moving, and the delete.
The method according to claim 19, wherein:

If the operation is to clear the screen, after the operation event of clicking the clear page button is completed, the first terminal clears all data on the page, restores the page to the initial state, and sends the clear page operation;

If the operation is moving, coordinate setting is performed locally on the operation object according to the mouse position, and the operation message in the operation event sent includes movement, and the operation type is the first operation type;

If the operation is to stop the movement, determine whether the position where the movement is stopped is correct. If it is correct, the coordinates of the operation object are set locally according to the stop position. The operation message in the operation event sent includes the movement stop, and the operation type is the second operation type. And, the coordinates of the moved element are detected. If the coordinates of the moved element are within the range of the trash can, the element is deleted; if it is not correct, the operation object returns to the original coordinate position. The operation message in the operation event sent includes the return Operation type is the first operation type;

If the operation is clicking, an option prompt is displayed, and the option prompt is to display a judgment result;

If the operation is a page turning, the local operation is a page turning operation, and the operation message in the operation event sent includes page turning, and the operation type is the second operation type;

If the operation is a page jump, the local operation is to jump to the input page number, and the operation message of the operation event sent includes the jump to the input page number; the operation type is the second operation type;

If the operation is a floating type, an animation display is performed, and the animation display is temporarily enlarged.
The method according to claim 20, wherein if the operation is an operation generated by a click or a movement operation, a time interval at which the first terminal sends two adjacent operation events is greater than a set threshold.
A user interface synchronization server includes:

A receiving unit, configured to receive an operation event, where the operation event includes an operation message and an operation type;

Operation type judging unit, for judging the operation type;

A broadcasting unit for broadcasting operation messages for synchronization;

The storage unit is configured to store corresponding operation messages when the operation type is a write operation.
The server according to claim 22, wherein the operation type includes a first operation type and a second operation type, the server broadcasts an operation message of an operation event of the first operation type, and the server stores and Broadcasting an operation message of the operation event of the second operation type.
The server according to claim 23, wherein the operation of the first operation type includes a process operation of the operation event; and the second operation type includes a result operation of the operation event.
A user interface synchronization method includes the following steps:

Receiving an operation event, the operation event including an operation message and an operation type;

Broadcasting the operation message and / or storing and broadcasting the operation message according to the operation type.
The method according to claim 25, wherein the operation type includes a first operation type and a second operation type, the server broadcasts an operation message of an operation event of the first operation type, and the server stores and Broadcasting an operation message of the operation event of the second operation type.
The method according to claim 26, wherein the operation of the first operation type includes a process operation of the operation event; and the second operation type includes a result operation of the operation event.
A computer-readable storage medium, characterized in that a computer program is stored thereon, and when the program is executed by a processor, the steps of the method according to any one of claims 7-12, 16-21, 25-27 are implemented.
A computer device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, claims 7-12, 16-21, Steps of the method of any of 25-27.