WO2020034652A1 - Système et procédé de synchronisation d'interface utilisateur, terminal et serveur - Google Patents

Système et procédé de synchronisation d'interface utilisateur, terminal et serveur Download PDF

Info

Publication number
WO2020034652A1
WO2020034652A1 PCT/CN2019/082702 CN2019082702W WO2020034652A1 WO 2020034652 A1 WO2020034652 A1 WO 2020034652A1 CN 2019082702 W CN2019082702 W CN 2019082702W WO 2020034652 A1 WO2020034652 A1 WO 2020034652A1
Authority
WO
WIPO (PCT)
Prior art keywords
type
event
message
operation type
page
Prior art date
Application number
PCT/CN2019/082702
Other languages
English (en)
Chinese (zh)
Inventor
时永欣
Original Assignee
北京大米科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201810924814.2A external-priority patent/CN109240780A/zh
Priority claimed from CN201810925386.5A external-priority patent/CN109032452A/zh
Priority claimed from CN201810924811.9A external-priority patent/CN109246196A/zh
Priority claimed from CN201810924815.7A external-priority patent/CN109286658A/zh
Priority claimed from CN201810924813.8A external-priority patent/CN109284158A/zh
Priority claimed from CN201810924645.2A external-priority patent/CN109032451A/zh
Priority claimed from CN201810925387.XA external-priority patent/CN109257414A/zh
Priority claimed from CN201810924812.3A external-priority patent/CN109117287A/zh
Application filed by 北京大米科技有限公司 filed Critical 北京大米科技有限公司
Publication of WO2020034652A1 publication Critical patent/WO2020034652A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Definitions

  • the present invention relates to the field of multimedia technology, and in particular, to a user interface synchronization system, method, terminal, and server.
  • embodiments of the present invention provide a user interface synchronization system, method, terminal, and server, the main purpose of which is to reduce the problems caused by high concurrent writing.
  • the present invention mainly provides the following technical solutions:
  • an embodiment of the present invention provides a user interface synchronization system, including a first terminal, a second terminal, and a server, where
  • a second terminal configured to synchronize the operation message broadcasted.
  • an embodiment of the present invention provides a user interface synchronization method, including the following steps:
  • the first terminal sends an operation event generated based on an operation acting on a user interface, where the operation event includes an operation message and an operation type;
  • the server receives the operation event, and broadcasts the operation message or stores and broadcasts the operation message according to the operation type;
  • the second terminal synchronously broadcasts the operation message.
  • an embodiment of the present invention provides a user interface synchronization terminal.
  • the terminal includes:
  • Monitoring unit for monitoring operations acting on the user interface
  • a response unit configured to respond to the operation
  • An operation event generating unit configured to generate an operation event based on a response to the operation, where the operation event includes an operation message and an operation type;
  • the sending unit is configured to send the operation event, so as to broadcast the operation message or store and broadcast the operation message according to the operation type.
  • an embodiment of the present invention provides a user interface synchronization method, including the following steps:
  • the operation event including an operation message and an operation type
  • an embodiment of the present invention provides a user interface synchronization server, where the server includes:
  • a receiving unit configured to receive an operation event, where the operation event includes an operation message and an operation type
  • Operation type judging unit for judging the operation type
  • the storage unit is configured to store corresponding operation messages when the operation type is a write operation.
  • an embodiment of the present invention provides a user interface synchronization method, including the following steps:
  • the operation event including an operation message and an operation type
  • an embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored.
  • the program is executed by a processor, the steps of the foregoing method are implemented.
  • an embodiment of the present invention provides a computer device including a memory, a processor, and a computer program stored on the memory and executable on the processor.
  • the processor implements the foregoing method when the program is executed. step.
  • the user interface synchronization system provided by the embodiment of the present invention classifies operations and processes operation messages differently according to different operation types. For example, for some operation types, only operation messages are broadcast without being written to the database, and for other operation types, For some operation types, the operation message is written to the database and the message is broadcast, which reduces the pressure on the server and greatly improves the service performance loss caused by the high concurrent write data.
  • FIG. 1 is a schematic diagram of an embodiment of a user interface synchronization system according to the present invention.
  • FIG. 2 is a schematic diagram of an embodiment of a user interface synchronization terminal according to the present invention.
  • FIG. 3 is a flowchart of an embodiment of a user interface synchronization terminal according to the present invention.
  • FIG. 4 shows a flowchart of an embodiment of a user interface synchronization method according to the present invention.
  • FIG. 5 shows a flowchart of an embodiment of a user interface synchronization server according to the present invention.
  • FIG. 1 shows a schematic diagram of an embodiment of the user interface synchronization system of the present invention.
  • a user interface synchronization system according to an embodiment of the present invention includes a first terminal 10, a second terminal 20, and a server 30.
  • the first terminal 10 is configured to send an operation event generated based on an operation acting on a user interface, and the operation event includes an operation message and an operation type;
  • the server 30 is configured to receive an operation event, and broadcast or store and broadcast an operation message according to an operation type
  • the second terminal 20 synchronizes the broadcast operation message.
  • the user interface synchronization system provided by the embodiment of the present invention classifies operations and processes operation messages differently according to different operation types. For example, for some operation types, only operation messages are broadcast without being written to a database, and other For some operation types, the operation message is written to the database and broadcast the message, which reduces the pressure on the server and greatly improves the service performance loss caused by the high concurrent write data.
  • the operation type may be divided into two types.
  • the operation type includes a first operation type and a second operation type.
  • the server 30 broadcasts an operation message of an operation event of the first operation type, and the server 30 stores and broadcasts a second operation type. Operation message for operation event of operation type.
  • a part of operations are classified into the first operation type.
  • the operation messages of this type are only broadcast and do not exist. This reduces data writing, reduces server pressure, and greatly improves service performance loss caused by high concurrent writing. .
  • the first operation type may include a process operation of an operation event
  • the second operation type may include a result operation of the operation event.
  • the data generated during the operation process may not be stored, and only the result data may be stored. For example, when dragging a file, it is only necessary to record the final position, and the process from the original position to the final position does not need to be stored, so that data writing can be reduced.
  • the second operation type may further include a delete operation (del), a clear screen operation (clear), and the like.
  • the first terminal determines the operation type, and the operation of the user interface includes, but is not limited to:
  • the operation of the user interface includes any one or more of clearing the screen, drawing a line, creating, moving, stopping moving, clicking, page turning, page jumping, deleting, and floating.
  • the first operation type includes drawing a line.
  • the second operation type includes any one or more of page turning, page jumping, clearing the screen, clicking, stopping moving and deleting.
  • the first terminal clears all data on the page, restores the page to the initial state, and sends the clear page operation.
  • the operation is mobile, the coordinates of the operation object are set locally according to the mouse position.
  • the operation message in the operation event sent includes the movement, and the operation type is the first operation type. If the operation is suspended, an animation display is performed. It is temporarily enlarged.
  • the operation message in the operation event sent includes the stop movement, the operation type is the second operation type, Detect the coordinates of the moved element. If the coordinates of the moved element are within the trash bin, delete the element; if it is not correct, the operation object returns to the original coordinate position.
  • the operation message in the operation event sent includes the return, operation type. Is the first operation type.
  • the option prompt is displayed, and the option prompt is to display the judgment result.
  • the operation message in the operation event sent includes page turning, and the operation type is the second operation type.
  • the local operation is to jump to the input page number, and the operation message of the operation event sent includes the jump to the input page number; the operation type is the second operation type.
  • the operation is to drag the operation object, and the first terminal determines the operation type. If the operation is hovering, the animation is displayed locally.
  • the operation message in the operation event sent includes hovering, and the operation type is the first operation. Type; if the operation is a movement, the coordinates of the operation object are set locally according to the mouse position.
  • the operation message in the operation event sent includes movement, and the operation type is the first operation type. If the operation is the end of the movement, the operation event is sent.
  • the operation message includes the end of the movement, and the operation type is the second operation type.
  • the specific operation of the user interface is divided into different operation types, and operation messages are broadcasted or stored and broadcast according to different operation types for synchronization.
  • operation messages are broadcasted or stored and broadcast according to different operation types for synchronization.
  • the operation of stopping the movement is set to the second type of operation and can be written into the database.
  • the dragging process moving operation
  • the specific actions of the above operations are not limited. For example, "Delete" can be a click on the delete button on the interface, or it can be triggered by other operations.
  • the first terminal when the operation on the gallery interface of the first terminal is to stop moving, the first terminal detects the coordinates of the moved element, and if the coordinates of the moved element are within the range of the trash can, the element is deleted.
  • "Delete" is triggered through detection and judgment.
  • the file is dragged, the final position of the moved element is detected, that is, when the movement is stopped, if the coordinates of the moved element are within the range of the trash can, the element is deleted .
  • the element can be animated. At this time, only broadcasting is required for synchronization without writing to the database.
  • certain operations may be continuous (such as click confirmation, etc.) or high frequency (such as frequent clicks, etc.) or, at this time, data needs to be continuously transmitted to affect services performance.
  • the operation when the operation is a click confirmation, the time interval between the first terminal sending two adjacent operation events is greater than a set threshold.
  • This embodiment sets the threshold for sending click operation events. Only when the time interval between the currently generated operation event and the last operation event sent is greater than the set threshold, the currently generated operation event is sent. This prevents users from clicking frequently. Consumption of service resources and useless message synchronization brought by the same option reduce the frequency of sending operational events, achieve throttling, and further avoid the problem of service performance loss.
  • the setting of the threshold value should consider the synchronization effect, and it is appropriate not to affect the continuity of vision.
  • the threshold may be about 100 ms. Discard operation events within a time interval of 100ms, without transmission and broadcast, and will not affect the user's perception. Left and right in the embodiments of the present disclosure may be within a certain percentage range. For example, it fluctuates between 1%, 2%, 3%, 4%, 5%, or 10%.
  • the specific setting of the threshold can also be other time values, such as 40ms, 50ms, 60ms, 70ms, 80ms, 85ms, 90ms, and so on.
  • the first terminal in the embodiment of the present invention may be a terminal controlled by a teacher or a terminal controlled by a student.
  • An embodiment of the present invention provides a user interface synchronization method.
  • the method in this embodiment can be implemented by the foregoing system. Therefore, the description of the above system embodiment can be used to understand the method of the present invention.
  • the user interface synchronization method according to the embodiment of the present invention includes the following steps:
  • the first terminal sends an operation event generated based on an operation acting on its operation interface, and the operation event includes an operation message and an operation type;
  • the server receives the operation event and broadcasts the operation message or stores and broadcasts the operation message according to the operation type;
  • the second terminal synchronously broadcasts the operation message.
  • the user interface synchronization method categorizes operations and processes different response operation messages according to different operation types. For example, for the first operation type, only operation messages are broadcast without being written to the database.
  • the second operation type writes to the database and broadcasts the message, thereby reducing the pressure on the server and greatly improving the service performance loss caused by the high concurrent write data.
  • the operation type may be divided into two types.
  • the operation type includes a first operation type and a second operation type.
  • the server 30 broadcasts an operation message of an operation event of the first operation type, and the server 30 stores and broadcasts a second operation type. Operation message for operation event of operation type.
  • a part of operations are classified into the first operation type.
  • the operation messages of this type are only broadcast and do not exist. This reduces data writing, reduces server pressure, and greatly improves service performance loss caused by high concurrent writing. .
  • the first operation type includes a process operation of an operation event
  • the second operation type includes a result operation of the operation event.
  • the data generated during the operation process may not be stored, and only the result data may be stored. For example, when dragging a file, it is only necessary to record the final position, and the process from the original position to the final position does not need to be stored, so that data writing can be reduced.
  • the second operation type may further include a delete operation (del), a clear screen operation (clear), and the like.
  • User interface operations include, but are not limited to:
  • the operation of the user interface includes any one or more of clearing the screen, drawing a line, creating, moving, stopping moving, clicking, page turning, page jumping, deleting, and floating.
  • the first operation type includes drawing a line.
  • the second operation type includes any one or more of page turning, page jumping, clearing the screen, clicking, stopping moving and deleting.
  • the first terminal clears all data on the page, restores the page to the initial state, and sends the clear page operation.
  • the operation is mobile, the coordinates of the operation object are set locally according to the mouse position.
  • the operation message in the operation event sent includes the movement, and the operation type is the first operation type. If the operation is suspended, an animation display is performed. It is temporarily enlarged.
  • the operation message in the operation event sent includes the stop movement, the operation type is the second operation type, Detect the coordinates of the moved element. If the coordinates of the moved element are within the trash bin, delete the element; if it is not correct, the operation object returns to the original coordinate position.
  • the operation message in the operation event sent includes the return, operation type. Is the first operation type.
  • the option prompt is displayed, and the option prompt is to display the judgment result.
  • the operation message in the operation event sent includes page turning, and the operation type is the second operation type.
  • the local operation is to jump to the input page number, and the operation message of the operation event sent includes the jump to the input page number; the operation type is the second operation type.
  • the operation is to drag the operation object, and the first terminal determines the operation type. If the operation is hovering, the animation is displayed locally.
  • the operation message in the operation event sent includes hovering, and the operation type is the first operation. Type; if the operation is a movement, the coordinates of the operation object are set locally according to the mouse position.
  • the operation message in the operation event sent includes movement, and the operation type is the first operation type. If the operation is the end of the movement, the operation event is sent.
  • the operation message includes the end of the movement, and the operation type is the second operation type.
  • the specific operation of the user interface is divided into different operation types, and operation messages are broadcasted or stored and broadcast according to different operation types for synchronization.
  • operation messages are broadcasted or stored and broadcast according to different operation types for synchronization.
  • the operation of stopping the movement is set to the second type of operation and can be written into the database.
  • the dragging process moving operation
  • the specific actions of the above operations are not limited. For example, "Delete" can be a click on the delete button on the interface, or it can be triggered by other operations.
  • the first terminal when the operation on the gallery interface of the first terminal is to stop moving, the first terminal detects the coordinates of the moved element, and if the coordinates of the moved element are within the range of the trash can, the element is deleted.
  • "Delete" is triggered through detection and judgment.
  • the file is dragged, the final position of the moved element is detected, that is, when the movement is stopped, if the coordinates of the moved element are within the range of the trash can, the element is deleted .
  • the element can be animated. At this time, only broadcasting is required for synchronization without writing to the database.
  • certain operations may be continuous (such as click confirmation, etc.) or high frequency (such as frequent clicks, etc.) or, at this time, data needs to be continuously transmitted to affect services performance.
  • the operation when the operation is a click confirmation, the time interval between the first terminal sending two adjacent operation events is greater than a set threshold.
  • This embodiment sets the threshold for sending click operation events. Only when the time interval between the currently generated operation event and the last operation event sent is greater than the set threshold, the currently generated operation event is sent. This prevents users from clicking frequently. Consumption of service resources and useless message synchronization brought by the same option reduce the frequency of sending operational events, achieve throttling, and further avoid the problem of service performance loss.
  • the setting of the threshold value should consider the synchronization effect, and it is appropriate not to affect the continuity of vision.
  • the threshold may be about 100 ms. Discard operation events within a time interval of 100ms, without transmission and broadcast, and will not affect the user's perception. Left and right in the embodiments of the present disclosure may be within a certain percentage range. For example, it fluctuates between 1%, 2%, 3%, 4%, 5%, or 10%.
  • the specific setting of the threshold can also be other time values, such as 40ms, 50ms, 60ms, 70ms, 80ms, 85ms, 90ms, and so on.
  • the first terminal in the embodiment of the present invention may be a terminal controlled by a teacher or a terminal controlled by a student.
  • FIG. 2 shows a schematic diagram of an embodiment of the user interface synchronization terminal of the present invention.
  • the user interface synchronization terminal of the embodiment of the present invention includes:
  • a monitoring unit 11 configured to monitor operations of an operation interface acting on the terminal
  • An operation event generating unit 13 is configured to generate an operation event based on a response operation, and the operation event includes an operation message and an operation type;
  • the sending unit 14 is configured to send an operation event, so as to broadcast the operation message or store and broadcast the operation message according to the operation type.
  • the user interface synchronization terminal categorizes operations, and the operation events sent include operation type information, so as to perform different processing on corresponding operation messages according to different operation types, for example, only broadcast operation messages. Does not write to the database, writes the operation message to the database and broadcasts the message, because some operation types are not written, which reduces the pressure on the server and greatly improves the service performance loss caused by the high concurrent write data .
  • operation types may be divided into two types.
  • operation types include a first operation type and a second operation type, an operation message that broadcasts an operation event of the first operation type, and an operation that stores and broadcasts a second operation type.
  • Action message for the event In the embodiment of the present invention, a part of operations are divided into the first operation type, so that only operation messages of this type are broadcast but not exist, reducing data writing, reducing server pressure, and greatly improving services brought by high concurrent writing. Performance loss.
  • the first operation type may include a process operation of an operation event
  • the second operation type may include a result operation of the operation event.
  • the data generated during the operation process may not be stored, and only the result data may be stored. For example, when dragging a file, it is only necessary to record the final position, and the process from the original position to the final position does not need to be stored, so that data writing can be reduced.
  • the second operation type may further include a delete operation (del), a clear screen operation (clear), and the like.
  • User interface operations include, but are not limited to:
  • the operation of the user interface includes any one or more of clearing the screen, drawing a line, creating, moving, stopping moving, clicking, page turning, page jumping, deleting, and floating.
  • the first operation type includes drawing a line.
  • the second operation type includes any one or more of page turning, page jumping, clearing the screen, clicking, stopping moving and deleting.
  • the first terminal clears all data on the page, restores the page to the initial state, and sends the clear page operation.
  • the operation is mobile, the coordinates of the operation object are set locally according to the mouse position.
  • the operation message in the operation event sent includes the movement, and the operation type is the first operation type. If the operation is suspended, an animation display is performed. It is temporarily enlarged.
  • the operation message in the operation event sent includes the stop movement, the operation type is the second operation type, Detect the coordinates of the moved element. If the coordinates of the moved element are within the trash bin, delete the element; if it is not correct, the operation object returns to the original coordinate position.
  • the operation message in the operation event sent includes the return, operation type. Is the first operation type.
  • the option prompt is displayed, and the option prompt is to display the judgment result.
  • the operation message in the operation event sent includes page turning, and the operation type is the second operation type.
  • the local operation is to jump to the input page number, and the operation message of the operation event sent includes the jump to the input page number; the operation type is the second operation type.
  • the operation is to drag the operation object, and the first terminal determines the operation type. If the operation is hovering, the animation is displayed locally.
  • the operation message in the operation event sent includes hovering, and the operation type is the first operation. Type; if the operation is a movement, the coordinates of the operation object are set locally according to the mouse position.
  • the operation message in the operation event sent includes movement, and the operation type is the first operation type. If the operation is the end of the movement, the operation event is sent.
  • the operation message includes the end of the movement, and the operation type is the second operation type.
  • the specific operation of the user interface is divided into different operation types, and operation messages are broadcasted or stored and broadcast according to different operation types for synchronization.
  • operation messages are broadcasted or stored and broadcast according to different operation types for synchronization.
  • the operation of stopping the movement is set to the second type of operation and can be written into the database.
  • the dragging process moving operation
  • the specific actions of the above operations are not limited. For example, "Delete" can be a click on the delete button on the interface, or it can be triggered by other operations.
  • the first terminal when the operation on the gallery interface of the first terminal is to stop moving, the first terminal detects the coordinates of the moved element, and if the coordinates of the moved element are within the range of the trash can, the element is deleted.
  • "Delete" is triggered through detection and judgment.
  • the file is dragged, the final position of the moved element is detected, that is, when the movement is stopped, if the coordinates of the moved element are within the range of the trash can, the element is deleted .
  • the element can be animated. At this time, only broadcasting is required for synchronization without writing to the database.
  • the terminal further includes an interval judging unit 15, which determines whether the time interval of the operation event generated based on the mobile operation is greater than a set threshold. If the time interval between the last generated operation event and the generated threshold is greater than the set threshold, the currently generated operation event is sent. This embodiment sets the threshold for sending click operation events.
  • the setting of the threshold value should consider the synchronization effect, and it is appropriate not to affect the continuity of vision.
  • the threshold may be about 100 ms. Discard operation events within a time interval of 100ms, without transmission and broadcast, and will not affect the user's perception. Left and right in the embodiments of the present disclosure may be within a certain percentage range. For example, it fluctuates between 1%, 2%, 3%, 4%, 5%, or 10%.
  • the specific setting of the threshold can also be other time values, such as 40ms, 50ms, 60ms, 70ms, 80ms, 85ms, 90ms, and so on.
  • the first terminal in the embodiment of the present invention may be a terminal controlled by a teacher or a terminal controlled by a student.
  • FIG. 4 shows a flowchart of an embodiment of the user interface synchronization method of the present invention.
  • the user interface synchronization of the embodiment of the present invention The method includes the following steps:
  • Operation events include operation messages and operation types.
  • the user interface synchronization terminal categorizes operations, and the operation events sent include operation type information, so as to perform different processing on corresponding operation messages according to different operation types, for example, only broadcast operation messages. Does not write to the database, writes the operation message to the database and broadcasts the message, because some operation types are not written, which reduces the pressure on the server and greatly improves the service performance loss caused by the high concurrent write data .
  • operation types may be divided into two types.
  • operation types include a first operation type and a second operation type, an operation message that broadcasts an operation event of the first operation type, and an operation that stores and broadcasts a second operation type.
  • Action message for the event In the embodiment of the present invention, a part of operations are divided into the first operation type, so that only operation messages of this type are broadcast but not exist, reducing data writing, reducing server pressure, and greatly improving services brought by high concurrent writing. Performance loss.
  • the first operation type may include a process operation of an operation event
  • the second operation type may include a result operation of the operation event.
  • the data generated during the operation process may not be stored, and only the result data may be stored. For example, when dragging a file, it is only necessary to record the final position, and the process from the original position to the final position does not need to be stored, so that data writing can be reduced.
  • the second operation type may further include a delete operation (del), a clear screen operation (clear), and the like.
  • User interface operations include, but are not limited to:
  • the operation of the user interface includes any one or more of clearing the screen, drawing a line, creating, moving, stopping moving, clicking, page turning, page jumping, deleting, and floating.
  • the first operation type includes drawing a line.
  • the second operation type includes any one or more of page turning, page jumping, clearing the screen, clicking, stopping moving and deleting.
  • the first terminal clears all data on the page, restores the page to the initial state, and sends the clear page operation.
  • the operation is mobile, the coordinates of the operation object are set locally according to the mouse position.
  • the operation message in the operation event sent includes the movement, and the operation type is the first operation type. If the operation is suspended, an animation display is performed. It is temporarily enlarged.
  • the operation message in the operation event sent includes the stop movement, the operation type is the second operation type, Detect the coordinates of the moved element. If the coordinates of the moved element are within the trash bin, delete the element; if it is not correct, the operation object returns to the original coordinate position.
  • the operation message in the operation event sent includes the return, operation type. Is the first operation type.
  • the option prompt is displayed, and the option prompt is to display the judgment result.
  • the operation message in the operation event sent includes page turning, and the operation type is the second operation type.
  • the local operation is to jump to the input page number, and the operation message of the operation event sent includes the jump to the input page number; the operation type is the second operation type.
  • the operation is to drag the operation object, and the first terminal determines the operation type. If the operation is hovering, the animation is displayed locally.
  • the operation message in the operation event sent includes hovering, and the operation type is the first operation. Type; if the operation is a movement, the coordinates of the operation object are set locally according to the mouse position.
  • the operation message in the operation event sent includes movement, and the operation type is the first operation type. If the operation is the end of the movement, the operation event is sent.
  • the operation message includes the end of the movement, and the operation type is the second operation type.
  • the specific operation of the user interface is divided into different operation types, and operation messages are broadcasted or stored and broadcast according to different operation types for synchronization.
  • operation messages are broadcasted or stored and broadcast according to different operation types for synchronization.
  • the operation of stopping the movement is set to the second type of operation and can be written into the database.
  • the dragging process moving operation
  • the specific actions of the above operations are not limited. For example, "Delete" can be a click on the delete button on the interface, or it can be triggered by other operations.
  • the first terminal when the operation on the gallery interface of the first terminal is to stop moving, the first terminal detects the coordinates of the moved element, and if the coordinates of the moved element are within the range of the trash can, the element is deleted.
  • "Delete" is triggered through detection and judgment.
  • the file is dragged, the final position of the moved element is detected, that is, when the movement is stopped, if the coordinates of the moved element are within the range of the trash can, the element is deleted .
  • the element can be animated. At this time, only broadcasting is required for synchronization without writing to the database.
  • the server After receiving the corresponding operation event, the server stores the playback status of the audio and broadcasts the message, so that the second terminal can perform synchronization.
  • certain operations may be continuous (such as click confirmation, etc.) or high frequency (such as frequent clicks, etc.) or, at this time, data needs to be continuously transmitted to affect services performance.
  • the operation when the operation is a click confirmation, the time interval between the first terminal sending two adjacent operation events is greater than a set threshold.
  • This embodiment sets the threshold for sending click operation events. Only when the time interval between the currently generated operation event and the last operation event sent is greater than the set threshold, the currently generated operation event is sent. This prevents users from clicking frequently. Consumption of service resources and useless message synchronization brought by the same option reduce the frequency of sending operational events, achieve throttling, and further avoid the problem of service performance loss.
  • the setting of the threshold value should consider the synchronization effect, and it is appropriate not to affect the continuity of vision.
  • the threshold may be about 100 ms. Discard operation events within a time interval of 100ms, without transmission and broadcast, and will not affect the user's perception. Left and right in the embodiments of the present disclosure may be within a certain percentage range. For example, it fluctuates between 1%, 2%, 3%, 4%, 5%, or 10%.
  • the specific setting of the threshold can also be other time values, such as 40ms, 50ms, 60ms, 70ms, 80ms, 85ms, 90ms, and so on.
  • the first terminal in the embodiment of the present invention may be a terminal controlled by a teacher or a terminal controlled by a student.
  • FIG. 5 shows a flowchart of an embodiment of the user interface synchronization server of the present invention.
  • the server according to the embodiment of the present invention includes:
  • the receiving unit 31 receives an operation event, and the operation event includes an operation message and an operation type;
  • Operation type judgment unit 32 which judges the operation type
  • the storage unit 34 stores an operation message when the operation type is a write operation.
  • the user interface synchronization server provided by the embodiment of the present invention performs different processing on the corresponding operation message according to different operation types, such as broadcasting only the operation message without writing to the database, and writing the operation message to the database and broadcasting the message. Partial operation types are not written, which reduces the pressure on the server and greatly improves the service performance loss caused by the high concurrent write data.
  • the operation type may be divided into two types.
  • the operation type includes a first operation type and a second operation type.
  • the server 30 broadcasts an operation message of an operation event of the first operation type, and the server 30 stores and broadcasts a second operation type. Operation message for operation event of operation type.
  • a part of operations are classified into the first operation type.
  • the operation messages of this type are only broadcast and do not exist. This reduces data writing, reduces server pressure, and greatly improves service performance loss caused by high concurrent writing. .
  • the first operation type may include a process operation of an operation event
  • the second operation type may include a result operation of the operation event.
  • the data generated during the operation process may not be stored, and only the result data may be stored. For example, when dragging a file, it is only necessary to record the final position, and the process from the original position to the final position does not need to be stored, so that data writing can be reduced.
  • the second operation type may further include a delete operation (del), a clear screen operation (clear), and the like.
  • User interface operations include, but are not limited to:
  • the operation of the user interface includes any one or more of clearing the screen, drawing a line, creating, moving, stopping moving, clicking, page turning, page jumping, deleting, and floating.
  • the first operation type includes drawing a line.
  • the second operation type includes any one or more of page turning, page jumping, clearing the screen, clicking, stopping moving and deleting.
  • An embodiment of the present invention provides a user interface synchronization method.
  • the method in this embodiment can be implemented by the server in the foregoing embodiment. Therefore, the description of the foregoing server embodiment can be used to understand that the method of the embodiment of the present invention includes the following steps:
  • Receive operation events, operation events include operation messages and operation types
  • Broadcast operation messages or store and broadcast operation messages according to the operation type are broadcast operation messages or store and broadcast operation messages according to the operation type.
  • the user interface synchronization server provided by the embodiment of the present invention performs different processing on the corresponding operation message according to different operation types, such as broadcasting only the operation message without writing to the database, and writing the operation message to the database and broadcasting the message. Partial operation types are not written, which reduces the pressure on the server and greatly improves the service performance loss caused by the high concurrent write data.
  • the operation type may be divided into two types.
  • the operation type includes a first operation type and a second operation type.
  • the server 30 broadcasts an operation message of an operation event of the first operation type, and the server 30 stores and broadcasts a second operation type. Operation message for operation event of operation type.
  • a part of operations are classified into the first operation type.
  • the operation messages of this type are only broadcast and do not exist. This reduces data writing, reduces server pressure, and greatly improves service performance loss caused by high concurrent writing. .
  • the first operation type includes a process operation of an operation event
  • the second operation type includes a result operation of the operation event.
  • the data generated during the operation process may not be stored, and only the result data may be stored. For example, when dragging a file, it is only necessary to record the final position, and the process from the original position to the final position does not need to be stored, so that data writing can be reduced.
  • the second operation type may further include a delete operation (del), a clear screen operation (clear), and the like.
  • User interface operations include, but are not limited to:
  • the operation of the user interface includes any one or more of clearing the screen, drawing a line, creating, moving, stopping moving, clicking, page turning, page jumping, deleting, and floating.
  • the first operation type includes drawing a line.
  • the second operation type includes any one or more of page turning, page jumping, clearing the screen, clicking, stopping moving and deleting.
  • the operation interface may be an audio operation interface, and the specific operation may be clicking audio, which specifically includes: judging an audio type, where
  • the audio playback status is judged.
  • the audio is in the playback state, the audio is paused.
  • the operation message in the operation event sent includes the pause of the playback.
  • the operation type is the second operation type. Audio, the operation message in the operation event sent includes playback, and the operation type is the second operation type;
  • the operation message in the operation event sent includes playback, and the operation type is the second operation type.
  • different operation events are generated according to the click operation.
  • the click operation is to change the current playback state, that is, when the current operation is playing, the click operation is used to pause, and when the current operation is paused, the click operation is used to cause Its playing.
  • the server After receiving the corresponding operation event, the server stores the playback status of the audio and broadcasts the message, so that the second terminal can perform synchronization.
  • the operation may specifically be dragging an element (for example, a picture, etc.), and the operation process of the dragging may specifically include hovering the cursor on the element, clicking to move, or stopping the movement ( (That is, the end of dragging) specifically includes: if the operation is hovering, the animation is displayed locally, and the operation message in the operation event sent may include the specific operation (hovering), and the operation type is the first operation type; if the operation is moving , The coordinates of the element are set locally according to the mouse position.
  • the operation message in the operation event sent includes the movement (the coordinate of the element).
  • the operation type is the first operation type. There is no need to write the coordinate data of the element during the movement. It is the end of dragging, and the operation message in the operation event sent includes the end of dragging (element coordinates), the operation type is the second operation type, and the coordinate data of the element at the end of dragging needs to be written.
  • the specific operation interface is a multiple choice operation interface.
  • the specific operation may be hovering or clicking on an option, where the hovering is the first operation type and the click is the second operation type.
  • the operation is to perform an animation display when hovering over the option.
  • the animation display may be temporarily enlarged, that is, when the mouse is hovering over the option, the option is animated to temporarily display the enlarged display effect.
  • the page displays an option prompt that determines whether the result is right or wrong. Select the correct one to recount.
  • the operation interface may be a matching operation interface, and the matching operation may specifically be moving or stopping moving.
  • the matching operation is to stop moving, it is judged whether it is the correct option. If it is the correct option, the correct option prompt is executed. If it is not the correct option, the move operation is executed. After the correct option prompt is executed, it is determined whether all the matching selections are completed correctly, and if all the matching selections are completed correctly, a prompt is given for answering.
  • the movement operation is to move a word or a word to a corresponding position in the picture.
  • the word or the word corresponds to the picture, it is prompted that the answer is correct, and the word or word is parked at the corresponding position in the picture; if If the word or word does not correspond to the picture, the word or word returns to its original position.
  • the number of pictures may be three, and the number of words may be three. If all three words correspond to the corresponding picture If the match is correct, the prompt is completely correct and ends.
  • the correct way to prompt the answer can be to display the prompt, such as displaying ⁇ , the text "correct”, “yes”, “good”, etc., it can also be a voice prompt, or an animation prompt, here
  • the method of prompting is not specifically limited, as long as the prompt can be answered correctly; for the matching object, it is not limited to the matching of pictures and words, but also animation matching; the number of words and pictures can be equal or different.
  • the number of pictures and words is not specifically limited in the present invention, as long as the learner can learn by comparing words with pictures.
  • the operation interface may be a scribing interface, and the specific operation may be drawing a line.
  • the first terminal obtains the drawn line data, and performs the line data processing. Compression, delete the original drawing lines, generate lines based on the compressed line data and send the lines. Drawing lines is continuous, and at this time, data needs to be continuously transmitted, affecting service performance.
  • This embodiment sets the operating event sending conditions. Only the currently generated operating event and the previous sent operating event are completed, the currently generated operating event is sent, the operating event sending frequency is reduced, throttling is achieved, and service performance is further avoided. The problem of attrition.
  • the drawn line data is obtained, and the line data is compressed, the original drawn line is deleted, the line is generated based on the compressed line data, and the line is sent.
  • the compression of the line data reduces the amount of data written during interactive transmission, thereby reducing the pressure on the server and greatly improving the service performance loss caused by the high concurrent writing data.
  • the operation interface may be an interface for operating a page, and the specific operation may be clicking a page to turn or entering a page to jump.
  • the operation is to click to turn the page
  • the local operation is to turn the page.
  • the operation message in the operation event sent includes page turning, and the operation type is the second operation type.
  • the operation is to enter the page jump
  • the local operation is to jump to Enter the page number
  • the operation message of the operation event sent includes jumping to the input page number; the operation type is the second operation type. If the teacher-controlled terminal input jumps to page 10, the student-controlled terminal jumps to page 10. Similarly, in this embodiment, throttling can also be performed.
  • the click operation will not generate a page turning or input page jump event, but will end the operation directly; if it is not in throttling control, click The operation is to jump to the specified page number.
  • the server After receiving the corresponding operation event, the server stores the page number information after the jump and broadcasts the message.
  • the operation interface may be an interface with a clear page button, and the specific operation may be clicking a clear page button. After the operation event of clicking the clear page button is completed, all data on the page is cleared, the page is restored to the initial state, and the clear page operation is sent.
  • This embodiment also involves a click operation, so throttling control may be performed to avoid transmitting operation events generated by meaningless frequent operations.
  • the network connection status is monitored.
  • the network between the terminal and the server is disconnected, For example, when the message feedback is that the socket is disconnected or the listen event disconnect is triggered, a retry mechanism is started, and when the cumulative number of failures reaches a set value (for example, 3 times), it prompts to re-enter the operation interface.
  • An embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of the foregoing method are implemented.
  • An embodiment of the present invention provides a computer device including a memory, a processor, and a computer program stored on the memory and executable on the processor.
  • the processor implements the steps of the foregoing method when the program is executed.
  • the “unit” or “module” in this specification refers to software and / or hardware capable of completing specific functions independently or in cooperation with other components, where the hardware may be, for example, FPGA (Field-Programmable Gate Array). , IC (Integrated Circuit), etc.
  • An embodiment of the present invention also provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of the method of any of the foregoing embodiments are implemented.
  • the computer-readable storage medium may include, but is not limited to, any type of disk, including floppy disks, optical disks, DVDs, CD-ROMs, micro-drives, and magneto-optical disks, ROM, RAM, EPROM, EEPROM, DRAM, VRAM, and flash memory devices. , Magnetic or optical cards, nanosystems (including molecular memory ICs), or any type of medium or device suitable for storing instructions and / or data.
  • An embodiment of the present invention further provides a computer device including a memory, a processor, and a computer program stored on the memory and executable on the processor.
  • the processor executes the program, the steps of the method of any of the foregoing embodiments are implemented.
  • the processor is a control center of a computer system, and may be a processor of a physical machine or a processor of a virtual machine.
  • the terms “first”, “second”, etc. are used for descriptive purposes only, and cannot be understood to indicate or imply relative importance or order; the term “plurality” means two or more, Unless otherwise clearly defined.
  • the terms “installation”, “connected”, “connected”, “fixed” and the like should be understood in a broad sense. For example, “connected” can be a fixed connection, a detachable connection, or an integral connection; “connected” can It is directly connected or indirectly connected through an intermediate medium.
  • the specific meanings of the above terms in the present invention can be understood according to specific situations.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

La présente invention concerne le domaine de la technologie multimédia apte à résoudre le problème selon lequel la performance de service se dégrade dans un processus d'utilisation d'une interface utilisateur. L'invention porte sur un système et un procédé de synchronisation d'une interface utilisateur, un terminal et un serveur. Le système de synchronisation d'une interface utilisateur comprend un premier terminal, un second terminal et un serveur. Le premier terminal transmet un événement d'opération généré sur la base d'une opération effectuée sur une interface utilisateur. L'événement d'opération comprend un message d'opération et un type d'opération. Le serveur reçoit l'événement d'opération, et diffuse, ou stocke et diffuse, le message d'opération selon le type d'opération. Le second terminal synchronise le message d'opération diffusé. La présente invention atténue le problème de dégradation de performance de service provoquée par une opération d'écritures simultanées nombreuses.
PCT/CN2019/082702 2018-08-14 2019-04-15 Système et procédé de synchronisation d'interface utilisateur, terminal et serveur WO2020034652A1 (fr)

Applications Claiming Priority (16)

Application Number Priority Date Filing Date Title
CN201810925387.X 2018-08-14
CN201810924814.2A CN109240780A (zh) 2018-08-14 2018-08-14 音频操作内容同步系统及方法
CN201810925386.5A CN109032452A (zh) 2018-08-14 2018-08-14 页面操作内容同步系统及方法
CN201810924814.2 2018-08-14
CN201810924811.9A CN109246196A (zh) 2018-08-14 2018-08-14 远程操作内容同步系统及方法
CN201810924813.8 2018-08-14
CN201810924815.7A CN109286658A (zh) 2018-08-14 2018-08-14 远程选择操作同步系统、方法、设备及存储介质
CN201810924812.3 2018-08-14
CN201810924813.8A CN109284158A (zh) 2018-08-14 2018-08-14 远程拖动操作内容同步系统、方法、设备及存储介质
CN201810924645.2A CN109032451A (zh) 2018-08-14 2018-08-14 图库操作内容同步系统及方法
CN201810924645.2 2018-08-14
CN201810924811.9 2018-08-14
CN201810925386.5 2018-08-14
CN201810925387.XA CN109257414A (zh) 2018-08-14 2018-08-14 清屏同步系统及方法
CN201810924812.3A CN109117287A (zh) 2018-08-14 2018-08-14 匹配选择操作内容同步系统及方法
CN201810924815.7 2018-08-14

Publications (1)

Publication Number Publication Date
WO2020034652A1 true WO2020034652A1 (fr) 2020-02-20

Family

ID=69524819

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/082702 WO2020034652A1 (fr) 2018-08-14 2019-04-15 Système et procédé de synchronisation d'interface utilisateur, terminal et serveur

Country Status (1)

Country Link
WO (1) WO2020034652A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114816188A (zh) * 2022-05-05 2022-07-29 Oppo广东移动通信有限公司 页面控制方法、装置、电子设备、芯片及可读存储介质

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103164256A (zh) * 2011-12-08 2013-06-19 深圳市快播科技有限公司 一种实现单机支持高并发处理方法及系统
US20140300537A1 (en) * 2013-04-08 2014-10-09 Jani Turkia Device Relay Control System and Method
CN104158901A (zh) * 2014-08-26 2014-11-19 天脉聚源（北京）教育科技有限公司 一种同步翻页方法、装置及系统
CN106375296A (zh) * 2016-08-30 2017-02-01 杭州施强教育科技有限公司 一种多媒体课件教学直播方法
CN108197329A (zh) * 2011-11-01 2018-06-22 微软技术许可有限责任公司 通过通用服务的实时文档演示数据同步
CN109032452A (zh) * 2018-08-14 2018-12-18 北京大米科技有限公司 页面操作内容同步系统及方法
CN109032451A (zh) * 2018-08-14 2018-12-18 北京大米科技有限公司 图库操作内容同步系统及方法
CN109067885A (zh) * 2018-08-14 2018-12-21 北京大米科技有限公司 绘画线条同步系统及方法
CN109117287A (zh) * 2018-08-14 2019-01-01 北京大米科技有限公司 匹配选择操作内容同步系统及方法
CN109167821A (zh) * 2018-08-14 2019-01-08 北京大米科技有限公司 一种远程操作内容同步的系统及方法
CN109240780A (zh) * 2018-08-14 2019-01-18 北京大米科技有限公司 音频操作内容同步系统及方法
CN109246196A (zh) * 2018-08-14 2019-01-18 北京大米科技有限公司 远程操作内容同步系统及方法
CN109257414A (zh) * 2018-08-14 2019-01-22 北京大米科技有限公司 清屏同步系统及方法
CN109284158A (zh) * 2018-08-14 2019-01-29 北京大米科技有限公司 远程拖动操作内容同步系统、方法、设备及存储介质
CN109286658A (zh) * 2018-08-14 2019-01-29 北京大米科技有限公司 远程选择操作同步系统、方法、设备及存储介质

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108197329A (zh) * 2011-11-01 2018-06-22 微软技术许可有限责任公司 通过通用服务的实时文档演示数据同步
CN103164256A (zh) * 2011-12-08 2013-06-19 深圳市快播科技有限公司 一种实现单机支持高并发处理方法及系统
US20140300537A1 (en) * 2013-04-08 2014-10-09 Jani Turkia Device Relay Control System and Method
CN104158901A (zh) * 2014-08-26 2014-11-19 天脉聚源（北京）教育科技有限公司 一种同步翻页方法、装置及系统
CN106375296A (zh) * 2016-08-30 2017-02-01 杭州施强教育科技有限公司 一种多媒体课件教学直播方法
CN109032451A (zh) * 2018-08-14 2018-12-18 北京大米科技有限公司 图库操作内容同步系统及方法
CN109032452A (zh) * 2018-08-14 2018-12-18 北京大米科技有限公司 页面操作内容同步系统及方法
CN109067885A (zh) * 2018-08-14 2018-12-21 北京大米科技有限公司 绘画线条同步系统及方法
CN109117287A (zh) * 2018-08-14 2019-01-01 北京大米科技有限公司 匹配选择操作内容同步系统及方法
CN109167821A (zh) * 2018-08-14 2019-01-08 北京大米科技有限公司 一种远程操作内容同步的系统及方法
CN109240780A (zh) * 2018-08-14 2019-01-18 北京大米科技有限公司 音频操作内容同步系统及方法
CN109246196A (zh) * 2018-08-14 2019-01-18 北京大米科技有限公司 远程操作内容同步系统及方法
CN109257414A (zh) * 2018-08-14 2019-01-22 北京大米科技有限公司 清屏同步系统及方法
CN109284158A (zh) * 2018-08-14 2019-01-29 北京大米科技有限公司 远程拖动操作内容同步系统、方法、设备及存储介质
CN109286658A (zh) * 2018-08-14 2019-01-29 北京大米科技有限公司 远程选择操作同步系统、方法、设备及存储介质

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114816188A (zh) * 2022-05-05 2022-07-29 Oppo广东移动通信有限公司 页面控制方法、装置、电子设备、芯片及可读存储介质

Similar Documents

Publication Publication Date Title
US10872535B2 (en) Facilitating facial recognition, augmented reality, and virtual reality in online teaching groups
CN103413471B (zh) 一种网络同步课堂控制方法及系统
US10444955B2 (en) Selectable interaction elements in a video stream
US20040143630A1 (en) Method and system for sending questions, answers and files synchronously and asynchronously in a system for enhancing collaboration using computers and networking
US20040153504A1 (en) Method and system for enhancing collaboration using computers and networking
US20090259711A1 (en) Synchronization of Media State Across Multiple Devices
US20040143603A1 (en) Method and system for synchronous and asynchronous note timing in a system for enhancing collaboration using computers and networking
WO2018166173A1 (fr) Procédé et système de cooperation à distance
US11750541B2 (en) Method for transmitting live message, apparatus, electronic device and medium
US10462531B2 (en) Methods, systems, and media for presenting an advertisement while buffering a video
WO2020034652A1 (fr) Système et procédé de synchronisation d'interface utilisateur, terminal et serveur
WO2023109404A1 (fr) Procédé d'affichage de terminal et appareil d'affichage de terminal
CN113676761B (zh) 一种多媒体资源播放方法、装置及主控设备
WO2020034651A1 (fr) Système et procédé de synchronisation de contenu d'opération à distance
WO2022089131A1 (fr) Procédé et appareil de réponse automatique à un message pour terminal intelligent, dispositif informatique et support d'enregistrement
JP6083245B2 (ja) 情報処理システム、情報処理装置およびプログラム
CN114237482A (zh) 书写笔迹显示处理方法、装置、系统、设备和存储介质
JP2013201623A (ja) 通信制御装置、通信システム、通信制御装置を制御するための方法、通信制御装置を制御するための方法をコンピュータに実行させるプログラム、および、通信装置
US10148708B2 (en) Electronic information terminal, image processing apparatus, and information processing method
CN109246196A (zh) 远程操作内容同步系统及方法
WO2021159645A1 (fr) Procédés et systèmes de déclenchement et de synchronisation pour agencement dynamique de multiples fenêtres vidéo
CN109067885B (zh) 绘画线条同步系统及方法
CN108174268A (zh) 基于电视的数据拷贝方法、设备、系统及可读存储介质
KR20230120668A (ko) 영상통화 방법 및 장치
CN109286658A (zh) 远程选择操作同步系统、方法、设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19850294

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19850294

Country of ref document: EP

Kind code of ref document: A1