WO2023230765A1 - Screen information synchronization method and system - Google Patents

Screen information synchronization method and system Download PDF

Info

Publication number
WO2023230765A1
WO2023230765A1 PCT/CN2022/095979 CN2022095979W WO2023230765A1 WO 2023230765 A1 WO2023230765 A1 WO 2023230765A1 CN 2022095979 W CN2022095979 W CN 2022095979W WO 2023230765 A1 WO2023230765 A1 WO 2023230765A1
Authority
WO
WIPO (PCT)
Prior art keywords
display device
description information
target
display
media file
Prior art date
Application number
PCT/CN2022/095979
Other languages
French (fr)
Chinese (zh)
Inventor
冯峰
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Priority to PCT/CN2022/095979 priority Critical patent/WO2023230765A1/en
Priority to CN202280001573.9A priority patent/CN117480487A/en
Publication of WO2023230765A1 publication Critical patent/WO2023230765A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/178Techniques for file synchronisation in file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Definitions

  • the present disclosure relates to the field of display technology, and in particular, to a screen information synchronization method and system.
  • Some scenarios require the use of two or more display devices together. In this case, the content of different display devices needs to be shared and cross-device operations are required. In related technologies, multiple display devices are connected through hardware, but additional hardware devices are required and physical wiring is required, which results in relatively high implementation costs.
  • the technical problem to be solved by this disclosure is to provide a screen information synchronization method and system, which can easily realize the cooperation of multiple display devices.
  • a screen information synchronization system including a first display device and a second display device, and the first display device and the first display device are communicatively connected,
  • the second display device is configured to send description information of the target event to the first display device
  • the first display device is configured to receive the description information of the target event sent by the second display device, and perform a synchronization operation according to the description information.
  • the first display device is connected to the second display device through wireless communication.
  • the first display device is further configured to send a subscription request to the second display device, indicating to obtain the description information of the target event;
  • the second display device is also configured to receive the subscription request.
  • the second display device is further configured to send a list of target events to the first display device, where the list of target events includes an identification of at least one target event;
  • the first display device is also configured to receive the list.
  • the description information of the target event includes at least one of the following:
  • the source display device indicates the sender of the description information
  • the target display device indicates the recipient of the description information
  • the display description information includes data type and data priority
  • the first display device is used to arrange the description information according to data type, obtain multiple data queues, and sort the multiple data queues according to the priority of the data type; in each of the data queues , sort the description information according to the priority of data; perform synchronization operations according to the description information in the order of the description information in the data queue.
  • the target event includes a user triggering a click operation on an application icon of the first display device
  • the second display device is specifically configured to display the application icon of the first display device on a display interface, receive a user's click operation instruction for the application icon, generate the description information according to the click operation instruction, and convert the The description information is sent to the first display device;
  • the first display device is specifically configured to open an interface of an application corresponding to the application icon according to the description information;
  • the first display device is also configured to feed back the status information of the application to the second display device;
  • the second display device is further configured to mark the application icon as opened according to the status information.
  • the target event includes a user triggering an input operation on the second display device, and the description information of the target event includes the content input by the input operation;
  • the second display device is specifically configured to display the content input by the input operation on its own display interface, generate the description information according to the input content, and send the description information to the first display device;
  • the first display device is specifically configured to receive the description information and synchronously display the content input by the input operation on its own display interface.
  • the content input by the input operation is the user's handwriting.
  • the target event includes the user triggering a playback operation on the first target media file of the first display device
  • the second display device is specifically configured to display the first target media file on a display interface, receive a user's playback operation instruction for the first target media file, and update the first target media file according to the playback operation instruction.
  • the playback status of the first target media file is used to generate the description information according to the playback status of the first target media file;
  • the first display device is specifically configured to control the playback state of the first target media file according to the description information.
  • the target event includes a user triggering a playback operation on a second target media file.
  • the second target media file is split into multiple sub-target media files, and different sub-target media files include media in different sub-picture areas. Data, multiple sub-picture areas are spliced into a completed display screen,
  • the second display device is specifically configured to play a second sub-target media file among the plurality of sub-target media files, receive a user's playback operation instruction for the second sub-target media file, and update the playback operation instruction according to the playback operation instruction.
  • the playback status of the second sub-target media file is generated according to the playback status of the second sub-target media file;
  • the first display device is specifically configured to play a first sub-target media file among the plurality of sub-target media files, and control the play status of the first sub-target media file according to the description information.
  • the size of the sub-picture display area of the sub-target media file corresponding to each display device is proportional to the size of the display screen of the display device.
  • the display device set composed of the first display device and the second display device includes a master display device and at least one slave display device, and the master display device communicates with the network and the slave display device through wireless communication.
  • the display device is communicatively connected, and the slave display device is communicatively connected with the master display device through wireless communication.
  • the screen information synchronization system is a blackboard system.
  • Embodiments of the present disclosure also provide a screen information synchronization method, which is applied to the screen information synchronization system as described above.
  • the method includes:
  • the second display device sends description information of the target event to the first display device
  • the first display device receives the description information of the target event sent by the second display device, and performs a synchronization operation according to the description information.
  • the method further includes:
  • the first display device sends a subscription request to the second display device, indicating to obtain the description information of the target event;
  • the second display device receives the subscription request.
  • the method further includes:
  • the second display device sends a list of target events to the first display device, where the list of target events includes an identification of at least one target event;
  • the first display device receives the list.
  • the description information of the target event includes at least one of the following:
  • the source display device indicates the sender of the description information
  • the target display device indicates the recipient of the description information
  • the display description information includes data type and data priority
  • the method further includes:
  • the first display device arranges the description information according to data type to obtain multiple data queues, and sorts the multiple data queues according to the priority of the data type; in each of the data queues, according to The description information is sorted by the priority of the data; a synchronization operation is performed according to the description information in the order of the description information in the data queue.
  • the target event includes the user triggering a click operation on the application icon of the first display device, and the method specifically includes:
  • the second display device displays the application icon of the first display device on the display interface, receives the user's click operation instruction for the application icon, generates the description information according to the click operation instruction, and sends the description information to the first display device;
  • the first display device opens an interface of the application corresponding to the application icon according to the description information
  • the method also includes:
  • the first display device feeds back the status information of the application to the second display device;
  • the second display device marks the application icon as opened according to the status information.
  • the target event includes a user triggering an input operation on the second display device, and the description information of the target event includes the content input by the input operation; the method specifically includes:
  • the second display device displays the content input by the input operation on its own display interface, generates the description information based on the input content, and sends the description information to the first display device;
  • the first display device receives the description information and synchronously displays the content input by the input operation on its own display interface.
  • the target event includes the user triggering a play operation on the first target media file of the first display device, and the method specifically includes:
  • the second display device displays the first target media file on a display interface, receives a user's playback operation instruction for the first target media file, and updates the playback status of the first target media file according to the playback operation instruction. , generate the description information according to the playback status of the first target media file;
  • the first display device controls the playback state of the first target media file according to the description information.
  • the target event includes a user triggering a playback operation on a second target media file.
  • the second target media file is split into multiple sub-target media files, and different sub-target media files include media in different sub-picture areas. Data, multiple sub-picture areas are spliced into a completed display picture, and the method specifically includes:
  • the second display device plays a second sub-target media file among the plurality of sub-target media files, receives a user's playback operation instruction for the second sub-target media file, and updates the second sub-target media file according to the playback operation instruction.
  • the playback status of the sub-target media file generating the description information according to the playback status of the second sub-target media file;
  • the first display device plays a first sub-target media file among the plurality of sub-target media files, and controls the play status of the first sub-target media file according to the description information.
  • An embodiment of the present disclosure also provides a display device, including a processor and a memory.
  • the memory stores programs or instructions that can be run on the processor. When the program or instructions are executed by the processor, the above is implemented. The steps of the screen information synchronization method.
  • Embodiments of the present disclosure also provide a readable storage medium on which programs or instructions are stored. When the programs or instructions are executed by a processor, the steps of the screen information synchronization method as described above are implemented.
  • the second display device can synchronize the description information of the target event to the first display device, and the first display device can perform corresponding operations according to the description information of the target event, so that multiple display devices Collaboration can be achieved between them, including but not limited to application synchronization, collaborative control, and joint playback of media files.
  • Figure 1 is a schematic structural diagram of a screen information synchronization system according to an embodiment of the present disclosure
  • Figure 2 is a schematic diagram of the connection between the master display device and the slave display device according to the embodiment of the present disclosure
  • Figure 3 is a schematic diagram of multiple display screens spliced according to an embodiment of the present disclosure
  • Figure 4 is a schematic diagram of multiple data queues according to an embodiment of the present disclosure.
  • Figure 5 is a schematic diagram of a first display device displaying an application icon of a second display device according to an embodiment of the present disclosure
  • Figure 6 is a schematic diagram of a first display device and a second display device synchronously displaying user input content according to an embodiment of the present disclosure
  • Figure 7 is a schematic diagram of the first display device controlling the playback progress of the target media file on the second display device side according to an embodiment of the present disclosure
  • Figure 8 is a schematic diagram of multiple display screens playing target media files according to an embodiment of the present disclosure.
  • Figure 9 is a schematic flowchart of a screen information synchronization method according to an embodiment of the present disclosure.
  • Figure 10 is a schematic diagram of the composition of a screen information synchronization device according to an embodiment of the present disclosure.
  • Embodiments of the present disclosure provide a screen information synchronization method and system, which can facilitate cooperation between multiple display devices.
  • Embodiments of the present disclosure provide a screen information synchronization system, as shown in Figure 1, including a first display device 11 and a second display device 12.
  • the first display device 11 and the first display device 12 are communicatively connected.
  • the second display device 12 is configured to send the description information of the target event to the first display device 11;
  • the first display device 11 is configured to receive the description information of the target event sent by the second display device 12 and perform a synchronization operation according to the description information.
  • the second display device can synchronize the description information of the target event to the first display device, and the first display device can perform corresponding operations according to the description information of the target event, so that multiple Collaboration can be achieved between display devices, including but not limited to application synchronization, collaborative control, and joint playback of media files.
  • the first display device and the second display device are connected through wireless communication without the need to connect through hardware interfaces and physical wiring, which does not increase the hardware cost, and this embodiment does not require the first display device and the second display device to be connected.
  • this embodiment does not require the first display device and the second display device to be connected.
  • the first display device and the second display device cooperate together.
  • the first display device and the second display device are electronic devices with display screens, including but not limited to mobile phones (such as Android mobile phones, iOS mobile phones, etc.), Laptops, tablets, handheld computers, MID (Mobile Internet Devices, mobile Internet devices), PAD, desktop computers, smart TVs, smart blackboards, etc.
  • Wireless communication includes: Bluetooth, WIFI and other technologies that implement wireless communication.
  • the first display device and the second display device can be connected through WIFI.
  • the "first" in the first display device and the “second” in the second display device are only to distinguish the display devices.
  • the first display device it is the first display device, and other display devices
  • the device is a second display device.
  • the first display device and the second display device form a display device set.
  • a master display device can be set as the main controlled display device, and other display devices can be set as slave display devices.
  • the master display device can be the first display device. device, or it can be a second display device.
  • a display device can be agreed upon in advance as the main display device, or a display device can be re-selected as the main display device later based on the actual application.
  • the master display device can communicate with the network and the slave display device through wireless communication, and the slave display device can communicate with the master display device through wireless communication.
  • the master display device When the master display device is connected to the slave display device and the network through WIFI, the master display device works in station (STA, station) mode, and the slave display device works in access point (AP, Access Point) mode. All display devices are connected via WIFI, without the need for additional hardware interfaces and cables. And even if the WIFI connection is occupied between display devices, it will not affect the connection between the main display device and the network.
  • STA station
  • AP Access Point
  • the master display device has a primary display screen
  • the slave display device has a secondary display screen.
  • the primary display screen and the secondary display screen can be displayed independently, and can display the same content or different content, such as the secondary display
  • the main display screen displays the user's writing, and the main display screen displays the displayed PPT or video; or both the main display screen and the secondary display screen display the user's handwriting; or the main display screen and the secondary display screen play media files simultaneously; or the main display screen
  • the main screen and secondary display screen are spliced to display a complete picture.
  • the second display device is also used to broadcast the list of target events to be synchronized or collaborated to the first display device, or to send it to a specific first display device.
  • the first display device may receive a list of target events to be synchronized or collaborated sent or broadcast by the second display device, where the list of target events includes an identification of at least one target event.
  • the first display device can subscribe to the required target events, send a subscription request to the second display device, indicating to obtain the description information of the target event, and the second display device is also used to receive all the target events. Describe the subscription request, so that after the target event is triggered, the second display device will send the description information of the target event to the first display device.
  • the first display device is also used to send a list of target events to the second display device.
  • the list of target events includes the identification of at least one target event. It can also receive a subscription request from the second display device and trigger the target event. After the event, the first display device will send the description information of the target event to the first display device.
  • the operations performed by the second display device will also be performed by the first display device.
  • the first display device generates description information of the target event and sends the description information to the second display device for other second display devices.
  • the device performs corresponding operations based on the description information.
  • this embodiment takes the first display device or the second display device as an example to introduce the operations that the display device needs to perform.
  • the operations performed by the first display device can also be performed by the second display device.
  • Execution, the operation performed by the second display device can also be performed by the first display device.
  • the description information of the target event may be sent between the first display device and the second display device in a broadcast manner, or in an end-to-end manner.
  • the description information of the target event includes at least one of the following:
  • the source display device indicates the sender of the description information, that is, which display device sends the description information of the target event;
  • the target display device indicates the recipient of the description information, that is, the display device to which the description information of the target event is sent;
  • Data type data types include but are not limited to four types: File, Event, Notify, and Object;
  • Data length the length of the data payload
  • the description information of the target event may include one item of the above information, or may include several items of the above information.
  • the first display device will receive the description information of the target event. , to determine whether it is a target display device. If it is not a target display device, the description information of the target event can be ignored; if it is a target display device, the corresponding synchronization operation is performed based on the description information of the target event.
  • the display description information includes data type and data priority; the first display device is used to arrange the description information according to the data type to obtain multiple data queues, and arrange the description information according to the priority of the data type. Sorting the plurality of data queues; in each data queue, sorting the description information according to the priority of data; according to the order of the description information in the data queue, according to the description information Perform synchronization operations.
  • the data types include File, Event, Notify, and Object
  • four data queues are maintained on each display device side: File queue, Event queue, Notify queue, and Object queue. If receiving The data type of the description information of the target event received is File queue, then the description information of the target event is stored in the File queue; if the data type of the description information of the target event received is Event queue, the description information of the target event is stored in the File queue. Stored in the Event queue; if the data type of the description information of the received target event is Notify queue, then the description information of the target event is stored in the Notify queue; if the data type of the description information of the received target event is Object queue , the description information of the target event is stored in the Object queue.
  • Each data queue adopts a first-in, first-out method.
  • Each data queue has a different priority.
  • the priority value can be configured for each data queue, such as in the priority The larger the value, the higher the priority.
  • the priority of the Object queue is higher than the priority of the Event queue
  • the priority of the Event queue is higher than the priority of the Notify queue
  • the priority of the Notify queue is higher than the priority of the File queue. priority.
  • each data queue there may be description information for multiple target events.
  • the description information for multiple target events will also be processed according to the priority. For example, in the Object queue, high-level data will be processed first. Priority data, if the data have the same priority, the data will be processed in a first-in, first-out manner. Through priority policy scheduling, data called by certain emergency programs can be processed first, and some file transfer data can be processed with low priority to meet user needs and improve user experience.
  • the target events include but are not limited to the user triggering a click operation on the application icon of the display device (including the first display device and the second display device), the user triggering an input operation on the display device, and the user triggering an input operation on the display device.
  • the display devices in the display device collection collaborate to achieve application synchronization, collaborative control, and/or media playback.
  • the target event includes a user triggering a click operation on an application icon of the first display device
  • the second display device is specifically configured to display the application icon of the first display device on a display interface, receive a user's click operation instruction for the application icon, generate the description information according to the click operation instruction, and convert the The description information is sent to the first display device;
  • the first display device is specifically configured to open an interface of an application corresponding to the application icon according to the description information;
  • the first display device is also configured to feed back the status information of the application to the second display device;
  • the second display device is further configured to mark the application icon as opened according to the status information.
  • the second display device can read all applications of the first display device, and can display the application icons of the first display device on its own display interface.
  • the second display device can delineate the application icons on the display interface. Part of the area, such as the area circled in the dotted box, displays the application icon of the first display device to distinguish it from the application icon of the second display device itself; of course, the second display device can also use the application icon in all areas of the display interface. to display the application icon of the first display device.
  • the second display device may be a master display device
  • the first display device may be a slave display device.
  • the communication between the first display device and the second display device adopts the data type of Object and is transmitted in the form of a list.
  • the second display device obtains the list, it displays it as a general icon on the list specifically for the first display device.
  • application icons 1, 2, 3, 4, 5 and 6 of the first display device are displayed on the display interface of the second display device.
  • the click operation instruction of the icon generates description information according to the click operation instruction, and notifies the first display device of the description information.
  • the description information indicates that the corresponding application needs to be opened.
  • the first display device opens the application corresponding to the application icon. interface, and can feed back a status to the second display device in the form of a notification message.
  • the second display device marks the application icon as open, or the second display device can directly receive the user's
  • the click operation instruction of the application icon is executed, the corresponding application icon is marked as opened.
  • the second display device can send the description information of the target event to other display devices to achieve application synchronization between display devices.
  • the second display device can display application icons of multiple first display devices.
  • the second display device communicates with N first display devices, and the display interface of the second display device can be divided into N display areas.
  • the application icon of the first first display device is displayed in the first display area
  • the application icon of the second first display device is displayed in the second display area
  • N is an integer greater than or equal to 2.
  • the application icons of one or more first display devices can be operated, thereby realizing application synchronization between multiple display devices.
  • the target event includes a user triggering an input operation on the second display device
  • the description information of the target event includes the content input by the input operation
  • the second display device is specifically used to perform an input operation on the second display device. Display the content input by the input operation on its own display interface, generate the description information based on the input content, and send the description information to the first display device;
  • the first display device is specifically configured to receive the description information and synchronously display the content input by the input operation on its own display interface.
  • the display device can interact with the user, and the display devices can synchronize interaction events with the user. For example, when the user triggers an input operation on the second display device, the second display device receives the content input by the user, displays the content input by the user on its own display interface, and sends the content input by the user as the description information of the target event to The first display device, after receiving the description information of the target event, displays the content input by the input operation on its own display interface.
  • the content input by the input operation is the user's handwriting.
  • the user's handwriting can be synchronized in real time through the technical solution of this embodiment.
  • the handwriting whiteboard software is started on the second display device.
  • the user writes through the touch screen, and the whiteboard software draws the handwriting to the corresponding area.
  • the second display device can use the content input by the user as the description information of the target event.
  • the input event is sent to the first display device through the input event.
  • the first display device simulates a uinput device, and the whiteboard software running on the first display device draws it in the relevant area of the display interface of the first display device.
  • the first display device can delimit a portion of the display interface to display the content input by the user on the second display device to distinguish it from the display content of the first display device itself.
  • the first display device can also All areas of the display interface can be used to display content input by the user on the second display device.
  • the first display device can display the input content of multiple second display devices.
  • the first display device communicates with N second display devices, and the display interface of the first display device can be divided into N display areas.
  • the input content of the first second display device is displayed in the first display area
  • the input content of the second second display device is displayed in the second display area
  • N is an integer greater than or equal to 2.
  • the input content of one or more second display devices can be displayed through the display interface of the first display device, thereby achieving synchronization of display content between multiple display devices.
  • the first display device may be a master display device in the display device set
  • the second display device may be a slave display device in the display device set; of course, the first display device may also be a slave display device in the display device set.
  • the second display device may be the main display device in the display device set.
  • the screen information synchronization system is a blackboard system
  • the technical solution of the present disclosure can realize synchronization of writing operations on multiple blackboards in the blackboard system.
  • the target event includes the user triggering a playback operation on the first target media file of the first display device
  • the second display device is specifically configured to display the first target media file on a display interface, receive a user's playback operation instruction for the first target media file, and update the first target media file according to the playback operation instruction.
  • the playback status of the first target media file is used to generate the description information according to the playback status of the first target media file;
  • the first display device is specifically configured to control the playback state of the first target media file according to the description information.
  • file lists and files can be shared between the first display device and the second display device, thereby enabling cross-device playback of media files, where the media files include but are not limited to audio, video, and pictures.
  • the list of media files on any first display device can be viewed on the second display device.
  • the user can control the first display device to play a certain target media file on the second display device. , in order to distinguish, it is called the first target media file.
  • the second display device can control the playback, stop, pause, and fast forward of the first target media file.
  • the description information may be implemented by sending a Notify event from the second display device to the first display device.
  • the playback status of the first target media file is displayed on the second display device. This status information is sent by the first display device to the second display device.
  • Notify event is implemented, as shown in Figure 7.
  • the playback status of the first target media file can be sent to the second display device, including but not limited to: whether the first target media file is in play, stop, fast forward, Fast rewind and other states, the playback duration when in the playback state, the corresponding playback duration when in the stop state, the fast forward magnification when in the fast forward state and the corresponding playback duration, and the fast rewind magnification when in the fast rewind state And the corresponding playback duration, etc.
  • the second display device updates the playback status of the first target media file according to the playback operation instruction input by the user, such as the initial status of the first target media file. is in the playback state.
  • the second display device updates the playback state of the first target media file to fast-forward, determines the corresponding playback duration, and uses the fast-forward state and the corresponding playback duration as descriptions.
  • the information is sent to the first display device, and the first display device can control the playback state of the first target media file according to the description information.
  • the initial state of the first target media file is in a paused state.
  • the second display device updates the playback status of the first target media file to play, determines the corresponding playback duration, and plays the file.
  • the status and corresponding playback duration are sent to the first display device as description information, and the first display device can control the playback status of the first target media file based on the description information.
  • the second display device can delimit a portion of the display interface to display the playback control interface (including pause, play, fast forward, rewind, etc. buttons) of the first target media file to communicate with the second display device itself.
  • the second display device can also be used to display the playback control interface of the first target media file in all areas of the display interface.
  • the second display device can display the playback control interface of the first target media file of multiple first display devices.
  • the second display device communicates with N first display devices, and the display interface of the second display device can Divided into N display areas, the first display area displays the playback control interface of the first target media file of the first first display device, and the second display area displays the first target of the second first display device.
  • the playback control interface of media files, and so on, N is an integer greater than or equal to 2. In this way, through the display interface of the second display device, the playback status of the first target media file of one or more first display devices can be controlled, and the sharing, collaborative control and playback of media files can be realized between multiple display devices.
  • the second display device may be a master display device in the display device set
  • the first display device may be a slave display device in the display device set.
  • the target event includes a user triggering a playback operation on a second target media file.
  • the second target media file is split into multiple sub-target media files, and different sub-target media files include media in different sub-picture areas. Data, multiple sub-picture areas are spliced into a completed display screen,
  • the second display device is specifically configured to play a second sub-target media file among the plurality of sub-target media files, receive a user's playback operation instruction for the second sub-target media file, and update the playback operation instruction according to the playback operation instruction.
  • the playback status of the second sub-target media file is generated according to the playback status of the second sub-target media file;
  • the first display device is specifically configured to play a first sub-target media file among the plurality of sub-target media files, and control the play status of the first sub-target media file according to the description information.
  • the display device set includes a first display device and two second display devices.
  • the display screen of the first display device can As the main display screen, the display screen of the second display device can be used as the secondary display screen.
  • Each display screen displays a part of the picture and is spliced to display a large picture.
  • the data of the second target media file can be split according to the size ratio of the display screen of the display device, so that the sub-screen of the sub-target media file corresponding to each display device
  • the size of the display area is proportional to the size of the display screen of the display device. The larger the size of the display screen of the display device, the larger the size of the displayed sub-picture display area.
  • the playback state of the sub-target media file is controlled according to the playback operation instruction input by the user, including but not limited to: whether the second target media file is in play, stop, fast forward, fast Rewind state, the playback duration when in the playback state, the corresponding playback duration when in the stop state, the fast forward magnification and corresponding playback duration when in the fast forward state, the fast rewind magnification when in the fast rewind state, and The corresponding playback duration, etc., and the description information is generated according to the playback status of the sub-target media file, and the description information is sent to the first display device through an Event message.
  • the first display device controls the playback of the corresponding sub-target media file based on the description information. status to achieve playback synchronization between multiple display devices.
  • the second display device may be a master display device in the display device set, and the first display device may be a slave display device in the display device set.
  • the first display device may be a master display device in the display device set, and the second display device may be a slave display device in the display device set.
  • Embodiments of the present disclosure also provide a screen information synchronization method, which is applied to the screen information synchronization system as described above. As shown in Figure 9, the method includes:
  • Step 101 The second display device sends the description information of the target event to the first display device
  • Step 102 The first display device receives the description information of the target event sent by the second display device, and performs a synchronization operation based on the description information.
  • the second display device can synchronize the description information of the target event to the first display device, and the first display device can perform corresponding operations according to the description information of the target event, so that multiple Collaboration can be achieved between display devices, including but not limited to application synchronization, collaborative control, and joint playback of media files.
  • the first display device and the second display device are connected through wireless communication without the need to connect through hardware interfaces and physical wiring, which does not increase the hardware cost, and this embodiment does not require the first display device and the second display device to be connected.
  • this embodiment does not require the first display device and the second display device to be connected.
  • the first display device and the second display device cooperate together.
  • the first display device and the second display device are electronic devices with display screens, including but not limited to mobile phones (such as Android mobile phones, iOS mobile phones, etc.), Laptops, tablets, handheld computers, MID (Mobile Internet Devices, mobile Internet devices), PAD, desktop computers, smart TVs, smart blackboards, etc.
  • Wireless communication includes: Bluetooth, WIFI and other technologies that implement wireless communication.
  • the first display device and the second display device can be connected through WIFI.
  • the "first" in the first display device and the “second” in the second display device are only to distinguish the display devices.
  • the first display device it is the first display device, and other display devices
  • the device is a second display device.
  • the first display device and the second display device form a display device set.
  • a master display device can be set as the main controlled display device, and other display devices can be set as slave display devices.
  • the master display device can be the first display device. device, or it can be a second display device.
  • a display device can be agreed upon in advance as the main display device, or a display device can be re-selected as the main display device later based on the actual application.
  • the master display device can communicate with the network and the slave display device through wireless communication, and the slave display device can communicate with the master display device through wireless communication.
  • the master display device When the master display device is connected to the slave display device and the network through WIFI, the master display device works in station (STA, station) mode, and the slave display device works in access point (AP, Access Point) mode. All display devices are connected via WIFI, without the need for additional hardware interfaces and cables. And even if the WIFI connection is occupied between display devices, it will not affect the connection between the main display device and the network.
  • STA station
  • AP Access Point
  • the master display device has a primary display screen
  • the slave display device has a secondary display screen.
  • the primary display screen and the secondary display screen can be displayed independently, and can display the same content or different content, such as the secondary display
  • the main display screen displays the user's writing, and the main display screen displays the displayed PPT or video; or both the main display screen and the secondary display screen display the user's handwriting; or the main display screen and the secondary display screen play media files simultaneously; or the main display screen
  • the main screen and secondary display screen are spliced to display a complete picture.
  • the second display device is also used to broadcast the list of target events to be synchronized or collaborated to the first display device, or to send it to a specific first display device.
  • the first display device may receive a list of target events to be synchronized or collaborated sent or broadcast by the second display device, where the list of target events includes an identification of at least one target event.
  • the first display device can subscribe to the required target events, send a subscription request to the second display device, indicating to obtain the description information of the target event, and the second display device is also used to receive all the target events. Describe the subscription request, so that after the target event is triggered, the second display device will send the description information of the target event to the first display device.
  • the first display device is also used to send a list of target events to the second display device.
  • the list of target events includes the identification of at least one target event. It can also receive a subscription request from the second display device and trigger the target event. After the event, the first display device will send the description information of the target event to the first display device.
  • the operations performed by the second display device will also be performed by the first display device.
  • the first display device generates description information of the target event and sends the description information to the second display device for other second display devices.
  • the device performs corresponding operations based on the description information.
  • this embodiment takes the first display device or the second display device as an example to introduce the operations that the display device needs to perform.
  • the operations performed by the first display device can also be performed by the second display device.
  • Execution, the operation performed by the second display device can also be performed by the first display device.
  • the description information of the target event may be sent between the first display device and the second display device in a broadcast manner, or in an end-to-end manner.
  • the description information of the target event includes at least one of the following:
  • the source display device indicates the sender of the description information, that is, which display device sends the description information of the target event;
  • the target display device indicates the recipient of the description information, that is, the display device to which the description information of the target event is sent;
  • Data type data types include but are not limited to four types: File, Event, Notify, and Object;
  • Data length the length of the data payload
  • the description information of the target event may include one item of the above information, or may include several items of the above information.
  • the first display device will receive the description information of the target event. , determine whether it is a target display device. If it is not a target display device, you can ignore the description information of the target event; if it is a target display device, perform corresponding synchronization operations based on the description information of the target event.
  • the display description information includes data type and data priority; the first display device is used to arrange the description information according to the data type to obtain multiple data queues, and arrange the description information according to the priority of the data type. Sorting the plurality of data queues; in each data queue, sorting the description information according to the priority of data; according to the order of the description information in the data queue, according to the description information Perform synchronization operations.
  • the data types include File, Event, Notify, and Object
  • four data queues are maintained on each display device side: File queue, Event queue, Notify queue, and Object queue. If receiving The data type of the description information of the target event received is File queue, then the description information of the target event is stored in the File queue; if the data type of the description information of the target event received is Event queue, the description information of the target event is stored in the File queue. Stored in the Event queue; if the data type of the description information of the received target event is Notify queue, then the description information of the target event is stored in the Notify queue; if the data type of the description information of the received target event is Object queue , the description information of the target event is stored in the Object queue.
  • Each data queue adopts a first-in, first-out method.
  • Each data queue has a different priority.
  • the priority value can be configured for each data queue, such as in the priority The larger the value, the higher the priority.
  • the priority of the Object queue is higher than the priority of the Event queue
  • the priority of the Event queue is higher than the priority of the Notify queue
  • the priority of the Notify queue is higher than the priority of the File queue. priority.
  • each data queue there may be description information for multiple target events.
  • the description information for multiple target events will also be processed according to the priority. For example, in the Object queue, high-level data will be processed first. Priority data, if the data have the same priority, the data will be processed in a first-in, first-out manner. Through priority policy scheduling, data called by certain emergency programs can be processed first, and some file transfer data can be processed with low priority to meet user needs and improve user experience.
  • the target events include but are not limited to the user triggering a click operation on the application icon of the display device (including the first display device and the second display device), the user triggering an input operation on the display device, and the user triggering an input operation on the display device.
  • the display devices in the display device collection collaborate to achieve application synchronization, collaborative control, and/or media playback.
  • the target event includes a user triggering a click operation on an application icon of the first display device
  • the second display device is specifically configured to display the application icon of the first display device on a display interface, receive a user's click operation instruction for the application icon, generate the description information according to the click operation instruction, and convert the The description information is sent to the first display device;
  • the first display device is specifically configured to open an interface of an application corresponding to the application icon according to the description information;
  • the first display device is also configured to feed back the status information of the application to the second display device;
  • the second display device is further configured to mark the application icon as opened according to the status information.
  • the second display device can read all applications of the first display device, and can display the application icons of the first display device on its own display interface.
  • the second display device can delineate the application icons on the display interface. Part of the area, such as the area circled in the dotted box, displays the application icon of the first display device to distinguish it from the application icon of the second display device itself; of course, the second display device can also use the application icon in all areas of the display interface. to display the application icon of the first display device.
  • the second display device may be a master display device
  • the first display device may be a slave display device.
  • the communication between the first display device and the second display device adopts the data type of Object and is transmitted in the form of a list.
  • the second display device obtains the list, it displays it as a general icon on the list specifically for the first display device.
  • application icons 1, 2, 3, 4, 5 and 6 of the first display device are displayed on the display interface of the second display device.
  • the click operation instruction of the icon generates description information according to the click operation instruction, and notifies the first display device of the description information.
  • the description information indicates that the corresponding application needs to be opened.
  • the first display device opens the application corresponding to the application icon. interface, and can feed back a status to the second display device in the form of a notification message.
  • the second display device marks the application icon as open, or the second display device can directly receive the user's
  • the click operation instruction of the application icon is executed, the corresponding application icon is marked as opened.
  • the second display device can send the description information of the target event to other display devices to achieve application synchronization between display devices.
  • the second display device can display application icons of multiple first display devices.
  • the second display device communicates with N first display devices, and the display interface of the second display device can be divided into N display areas.
  • the application icon of the first first display device is displayed in the first display area
  • the application icon of the second first display device is displayed in the second display area
  • N is an integer greater than or equal to 2.
  • the application icons of one or more first display devices can be operated, thereby realizing application synchronization between multiple display devices.
  • the target event includes a user triggering an input operation on the second display device
  • the description information of the target event includes the content input by the input operation
  • the second display device is specifically used to perform an input operation on the second display device. Display the content input by the input operation on its own display interface, generate the description information based on the input content, and send the description information to the first display device;
  • the first display device is specifically configured to receive the description information and synchronously display the content input by the input operation on its own display interface.
  • the display device can interact with the user, and the display devices can synchronize interaction events with the user. For example, when the user triggers an input operation on the second display device, the second display device receives the content input by the user, displays the content input by the user on its own display interface, and sends the content input by the user as the description information of the target event to The first display device, after receiving the description information of the target event, displays the content input by the input operation on its own display interface.
  • the content input by the input operation is the user's handwriting.
  • the user's handwriting can be synchronized in real time through the technical solution of this embodiment.
  • the handwriting whiteboard software is started on the second display device.
  • the user writes through the touch screen, and the whiteboard software draws the handwriting to the corresponding area.
  • the second display device can use the content input by the user as the description information of the target event.
  • the input event is sent to the first display device through the input event.
  • the first display device simulates a uinput device, and the whiteboard software running on the first display device draws it in the relevant area of the display interface of the first display device.
  • the first display device can delimit a portion of the display interface to display the content input by the user on the second display device to distinguish it from the display content of the first display device itself.
  • the first display device can also All areas of the display interface can be used to display content input by the user on the second display device.
  • the first display device can display the input content of multiple second display devices.
  • the first display device communicates with N second display devices, and the display interface of the first display device can be divided into N display areas.
  • the input content of the first second display device is displayed in the first display area
  • the input content of the second second display device is displayed in the second display area
  • N is an integer greater than or equal to 2.
  • the input content of one or more second display devices can be displayed through the display interface of the first display device, thereby achieving synchronization of display content between multiple display devices.
  • the first display device may be a master display device in the display device set
  • the second display device may be a slave display device in the display device set; of course, the first display device may also be a slave display device in the display device set.
  • the second display device may be the main display device in the display device set.
  • the screen information synchronization system is a blackboard system
  • the technical solution of the present disclosure can realize synchronization of writing operations on multiple blackboards in the blackboard system.
  • the target event includes the user triggering a playback operation on the first target media file of the first display device
  • the second display device is specifically configured to display the first target media file on a display interface, receive a user's playback operation instruction for the first target media file, and update the first target media file according to the playback operation instruction.
  • the playback status of the first target media file is used to generate the description information according to the playback status of the first target media file;
  • the first display device is specifically configured to control the playback state of the first target media file according to the description information.
  • file lists and files can be shared between the first display device and the second display device, thereby enabling cross-device playback of media files, where the media files include but are not limited to audio, video, and pictures.
  • the list of media files on any first display device can be viewed on the second display device.
  • the user can control the first display device to play a certain target media file on the second display device. , in order to distinguish, it is called the first target media file.
  • the second display device can control the playback, stop, pause, and fast forward of the first target media file.
  • the description information may be implemented by sending a Notify event from the second display device to the first display device.
  • the playback status of the first target media file is displayed on the second display device. This status information is sent by the first display device to the second display device.
  • Notify event is implemented, as shown in Figure 7.
  • the playback status of the first target media file can be sent to the second display device, including but not limited to: whether the first target media file is in play, stop, fast forward, Fast rewind and other states, the playback duration when in the playback state, the corresponding playback duration when in the stop state, the fast forward magnification when in the fast forward state and the corresponding playback duration, and the fast rewind magnification when in the fast rewind state And the corresponding playback duration, etc.
  • the second display device updates the playback status of the first target media file according to the playback operation instruction input by the user, such as the initial status of the first target media file. is in the playback state.
  • the second display device updates the playback state of the first target media file to fast-forward, determines the corresponding playback duration, and uses the fast-forward state and the corresponding playback duration as descriptions.
  • the information is sent to the first display device, and the first display device can control the playback state of the first target media file according to the description information.
  • the initial state of the first target media file is in a paused state.
  • the second display device updates the playback status of the first target media file to play, determines the corresponding playback duration, and plays the file.
  • the status and corresponding playback duration are sent to the first display device as description information, and the first display device can control the playback status of the first target media file based on the description information.
  • the second display device can delimit a portion of the display interface to display the playback control interface (including pause, play, fast forward, rewind, etc. buttons) of the first target media file to communicate with the second display device itself.
  • the second display device can also be used to display the playback control interface of the first target media file in all areas of the display interface.
  • the second display device can display the playback control interface of the first target media file of multiple first display devices.
  • the second display device communicates with N first display devices, and the display interface of the second display device can Divided into N display areas, the first display area displays the playback control interface of the first target media file of the first first display device, and the second display area displays the first target of the second first display device.
  • the playback control interface of media files, and so on, N is an integer greater than or equal to 2. In this way, through the display interface of the second display device, the playback status of the first target media file of one or more first display devices can be controlled, and the sharing, collaborative control and playback of media files can be realized between multiple display devices.
  • the second display device may be a master display device in the display device set
  • the first display device may be a slave display device in the display device set.
  • the target event includes a user triggering a playback operation on a second target media file.
  • the second target media file is split into multiple sub-target media files, and different sub-target media files include media in different sub-picture areas. Data, multiple sub-picture areas are spliced into a completed display screen,
  • the second display device is specifically configured to play a second sub-target media file among the plurality of sub-target media files, receive a user's playback operation instruction for the second sub-target media file, and update the playback operation instruction according to the playback operation instruction.
  • the playback status of the second sub-target media file is generated according to the playback status of the second sub-target media file;
  • the first display device is specifically configured to play a first sub-target media file among the plurality of sub-target media files, and control the play status of the first sub-target media file according to the description information.
  • the display device set includes a first display device and two second display devices.
  • the display screen of the first display device can As the main display screen, the display screen of the second display device can be used as the secondary display screen.
  • Each display screen displays a part of the picture and is spliced to display a large picture.
  • the data of the second target media file can be split according to the size ratio of the display screen of the display device, so that the sub-screen of the sub-target media file corresponding to each display device
  • the size of the display area is proportional to the size of the display screen of the display device. The larger the size of the display screen of the display device, the larger the size of the displayed sub-picture display area.
  • the playback state of the sub-target media file is controlled according to the playback operation instruction input by the user, including but not limited to: whether the second target media file is in play, stop, fast forward, fast Rewind state, the playback duration when in the playback state, the corresponding playback duration when in the stop state, the fast forward magnification and corresponding playback duration when in the fast forward state, the fast rewind magnification when in the fast rewind state, and The corresponding playback duration, etc., and the description information is generated according to the playback status of the sub-target media file, and the description information is sent to the first display device through an Event message.
  • the first display device controls the playback of the corresponding sub-target media file based on the description information. status to achieve playback synchronization between multiple display devices.
  • the second display device may be a master display device in the display device set, and the first display device may be a slave display device in the display device set.
  • the first display device may be a master display device in the display device set, and the second display device may be a slave display device in the display device set.
  • An embodiment of the present disclosure also provides a display device, as shown in Figure 10, including a processor 32 and a memory 31.
  • the memory 31 stores programs or instructions that can be run on the processor 32.
  • the memory 31 stores programs or instructions that can be run on the processor 32.
  • the programs or instructions are executed by the processor 32, the first display device is implemented as described above. Side screen information synchronization method steps.
  • the memory 31 stores programs or instructions that can be run on the processor 32.
  • the programs or instructions are executed by the processor 32, the second display device is implemented as described above. Side screen information synchronization method steps.
  • Embodiments of the present disclosure also provide a readable storage medium on which programs or instructions are stored. When the programs or instructions are executed by a processor, the steps of the screen information synchronization method as described above are implemented.
  • Computer-readable media includes both persistent and non-volatile, removable and non-removable media that can be implemented by any method or technology for storage of information.
  • Information may be computer-readable instructions, data structures, modules of programs, or other data.
  • Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), and read-only memory.
  • PRAM phase change memory
  • SRAM static random access memory
  • DRAM dynamic random access memory
  • RAM random access memory
  • read-only memory read-only memory
  • ROM read-only memory
  • EEPROM electrically erasable programmable read-only memory
  • flash memory or other memory technology
  • compact disc read-only memory CD-ROM
  • DVD digital versatile disc
  • Magnetic tape cassettes tape magnetic disk storage or other magnetic storage terminal devices or any other non-transmission medium may be used to store information that can be accessed by a computing terminal device.
  • computer-readable media does not include transitory media, such as modulated data signals and carrier waves.
  • the methods of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better. implementation.
  • the technical solution of the present application can be embodied in the form of a computer software product that is essentially or contributes to the existing technology.
  • the computer software product is stored in a storage medium (such as ROM/RAM, disk , CD), including several instructions to cause a terminal (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in various embodiments of this application.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention relates to the technical field of display, and provides a screen information synchronization method and system. The screen information synchronization system comprises a first display device and a second display device; the first display device is communicatively connected to the second display device; the second display device is used for sending description information of a target event to the first display device; and the first display device is used for receiving the description information of the target event sent by the second display device, and executing a synchronization operation according to the description information. The technical solution of the present invention can achieve cooperation between multiple display devices.

Description

屏幕信息同步方法及系统Screen information synchronization method and system 技术领域Technical field
本公开涉及显示技术领域,特别是指一种屏幕信息同步方法及系统。The present disclosure relates to the field of display technology, and in particular, to a screen information synchronization method and system.
背景技术Background technique
一些场景需要将两个或三个以上显示屏设备一起使用,此时不同显示屏设备的内容需要共享,并且需要进行跨设备操作。相关技术中通过硬件将多个显示屏设备连接,但需要增加额外的硬件设备并且还需要进行物理走线,实现成本比较高。Some scenarios require the use of two or more display devices together. In this case, the content of different display devices needs to be shared and cross-device operations are required. In related technologies, multiple display devices are connected through hardware, but additional hardware devices are required and physical wiring is required, which results in relatively high implementation costs.
发明内容Contents of the invention
本公开要解决的技术问题是提供一种屏幕信息同步方法及系统,能够方便地实现多个显示设备进行协作。The technical problem to be solved by this disclosure is to provide a screen information synchronization method and system, which can easily realize the cooperation of multiple display devices.
为解决上述技术问题,本公开的实施例提供技术方案如下:In order to solve the above technical problems, embodiments of the present disclosure provide the following technical solutions:
一方面,提供一种屏幕信息同步系统,包括第一显示设备和第二显示设备,所述第一显示设备和第一显示设备通信连接,On the one hand, a screen information synchronization system is provided, including a first display device and a second display device, and the first display device and the first display device are communicatively connected,
所述第二显示设备,用于向所述第一显示设备发送目标事件的描述信息;The second display device is configured to send description information of the target event to the first display device;
所述第一显示设备,用于接收所述第二显示设备发送的目标事件的描述信息,并根据所述描述信息执行同步操作。The first display device is configured to receive the description information of the target event sent by the second display device, and perform a synchronization operation according to the description information.
一些实施例中,所述第一显示设备通过无线通信与所述第二显示设备连接。In some embodiments, the first display device is connected to the second display device through wireless communication.
一些实施例中,所述第一显示设备还用于向所述第二显示设备发送订阅请求,指示获取所述目标事件的描述信息;In some embodiments, the first display device is further configured to send a subscription request to the second display device, indicating to obtain the description information of the target event;
所述第二显示设备还用于接收所述订阅请求。The second display device is also configured to receive the subscription request.
一些实施例中,所述第二显示设备还用于向所述第一显示设备发送目标事件的列表,所述目标事件的列表包括至少一个目标事件的标识;In some embodiments, the second display device is further configured to send a list of target events to the first display device, where the list of target events includes an identification of at least one target event;
所述第一显示设备还用于接收所述列表。The first display device is also configured to receive the list.
一些实施例中,所述目标事件的描述信息包括以下至少一项:In some embodiments, the description information of the target event includes at least one of the following:
源端显示设备,指示所述描述信息的发送方;The source display device indicates the sender of the description information;
目标端显示设备,指示所述描述信息的接收方;The target display device indicates the recipient of the description information;
数据类型;type of data;
数据优先级;data priority;
数据长度;Data length;
数据内容。Data content.
一些实施例中,所述显示描述信息包括数据类型和数据优先级;In some embodiments, the display description information includes data type and data priority;
所述第一显示设备用于按照数据类型对所述描述信息进行排列,得到多个数据队列,并按照数据类型的优先级对所述多个数据队列进行排序;在每一所述数据队列中,按照数据的优先级对所述描述信息进行排序;按照所述数据队列中所述描述信息的顺序,根据所述描述信息执行同步操作。The first display device is used to arrange the description information according to data type, obtain multiple data queues, and sort the multiple data queues according to the priority of the data type; in each of the data queues , sort the description information according to the priority of data; perform synchronization operations according to the description information in the order of the description information in the data queue.
一些实施例中,所述目标事件包括用户触发对所述第一显示设备的应用图标执行点击操作,In some embodiments, the target event includes a user triggering a click operation on an application icon of the first display device,
所述第二显示设备具体用于在显示界面显示所述第一显示设备的应用图标,接收用户针对所述应用图标的点击操作指令,根据所述点击操作指令生成所述描述信息,将所述描述信息发送给所述第一显示设备;The second display device is specifically configured to display the application icon of the first display device on a display interface, receive a user's click operation instruction for the application icon, generate the description information according to the click operation instruction, and convert the The description information is sent to the first display device;
所述第一显示设备具体用于根据所述描述信息打开与所述应用图标对应的应用的界面;The first display device is specifically configured to open an interface of an application corresponding to the application icon according to the description information;
所述第一显示设备还用于向所述第二显示设备反馈所述应用的状态信息;The first display device is also configured to feed back the status information of the application to the second display device;
所述第二显示设备还用于根据所述状态信息将所述应用图标标记为已打开。The second display device is further configured to mark the application icon as opened according to the status information.
一些实施例中,所述目标事件包括用户触发对所述第二显示设备执行输入操作,所述目标事件的描述信息包括所述输入操作输入的内容;In some embodiments, the target event includes a user triggering an input operation on the second display device, and the description information of the target event includes the content input by the input operation;
所述第二显示设备具体用于在自身的显示界面显示所述输入操作输入的内容,并根据所述输入的内容生成所述描述信息,将所述描述信息发送给所述第一显示设备;The second display device is specifically configured to display the content input by the input operation on its own display interface, generate the description information according to the input content, and send the description information to the first display device;
所述第一显示设备具体用于接收所述描述信息,在自身的显示界面同步显示所述输入操作输入的内容。The first display device is specifically configured to receive the description information and synchronously display the content input by the input operation on its own display interface.
一些实施例中,所述输入操作输入的内容为用户书写的笔迹。In some embodiments, the content input by the input operation is the user's handwriting.
一些实施例中,所述目标事件包括用户触发对第一显示设备的第一目标媒体文件执行播放操作,In some embodiments, the target event includes the user triggering a playback operation on the first target media file of the first display device,
所述第二显示设备具体用于在显示界面显示所述第一目标媒体文件,接收用户针对所述第一目标媒体文件的播放操作指令,根据所述播放操作指令更新所述第一目标媒体文件的播放状态,根据所述第一目标媒体文件的播放状态生成所述描述信息;The second display device is specifically configured to display the first target media file on a display interface, receive a user's playback operation instruction for the first target media file, and update the first target media file according to the playback operation instruction. The playback status of the first target media file is used to generate the description information according to the playback status of the first target media file;
所述第一显示设备具体用于根据所述描述信息控制所述第一目标媒体文件的播放状态。The first display device is specifically configured to control the playback state of the first target media file according to the description information.
一些实施例中,所述目标事件包括用户触发对第二目标媒体文件执行播放操作,所述第二目标媒体文件拆分为多个子目标媒体文件,不同子目标媒体文件包括不同子画面区域的媒体数据,多个子画面区域拼接成完成的显示画面,In some embodiments, the target event includes a user triggering a playback operation on a second target media file. The second target media file is split into multiple sub-target media files, and different sub-target media files include media in different sub-picture areas. Data, multiple sub-picture areas are spliced into a completed display screen,
所述第二显示设备具体用于播放所述多个子目标媒体文件中的第二子目标媒体文件,接收用户针对所述第二子目标媒体文件的播放操作指令,根据所述播放操作指令更新所述第二子目标媒体文件的播放状态,根据所述第二子目标媒体文件的播放状态生成所述描述信息;The second display device is specifically configured to play a second sub-target media file among the plurality of sub-target media files, receive a user's playback operation instruction for the second sub-target media file, and update the playback operation instruction according to the playback operation instruction. The playback status of the second sub-target media file is generated according to the playback status of the second sub-target media file;
所述第一显示设备具体用于播放所述多个子目标媒体文件中的第一子目标媒体文件,根据所述描述信息控制所述第一子目标媒体文件的播放状态。The first display device is specifically configured to play a first sub-target media file among the plurality of sub-target media files, and control the play status of the first sub-target media file according to the description information.
一些实施例中,每一显示设备对应的子目标媒体文件的子画面显示区域的尺寸与显示设备的显示屏的尺寸成正比。In some embodiments, the size of the sub-picture display area of the sub-target media file corresponding to each display device is proportional to the size of the display screen of the display device.
一些实施例中,所述第一显示设备和所述第二显示设备组成的显示设备集合中包括一主显示设备和至少一个从显示设备,所述主显示设备通过无线通信与网络和所述从显示设备通信连接,所述从显示设备通过无线通信与所述主显示设备通信连接。In some embodiments, the display device set composed of the first display device and the second display device includes a master display device and at least one slave display device, and the master display device communicates with the network and the slave display device through wireless communication. The display device is communicatively connected, and the slave display device is communicatively connected with the master display device through wireless communication.
一些实施例中,所述屏幕信息同步系统为黑板系统。In some embodiments, the screen information synchronization system is a blackboard system.
本公开的实施例还提供了一种屏幕信息同步方法,应用于如上所述的屏幕信息同步系统,所述方法包括:Embodiments of the present disclosure also provide a screen information synchronization method, which is applied to the screen information synchronization system as described above. The method includes:
第二显示设备向第一显示设备发送目标事件的描述信息;The second display device sends description information of the target event to the first display device;
所述第一显示设备接收所述第二显示设备发送的目标事件的描述信息,并根据所述描述信息执行同步操作。The first display device receives the description information of the target event sent by the second display device, and performs a synchronization operation according to the description information.
一些实施例中,所述方法还包括:In some embodiments, the method further includes:
所述第一显示设备向所述第二显示设备发送订阅请求,指示获取所述目标事件的描述信息;The first display device sends a subscription request to the second display device, indicating to obtain the description information of the target event;
所述第二显示设备接收所述订阅请求。The second display device receives the subscription request.
一些实施例中,所述方法还包括:In some embodiments, the method further includes:
所述第二显示设备向所述第一显示设备发送目标事件的列表,所述目标事件的列表包括至少一个目标事件的标识;The second display device sends a list of target events to the first display device, where the list of target events includes an identification of at least one target event;
所述第一显示设备接收所述列表。The first display device receives the list.
一些实施例中,所述目标事件的描述信息包括以下至少一项:In some embodiments, the description information of the target event includes at least one of the following:
源端显示设备,指示所述描述信息的发送方;The source display device indicates the sender of the description information;
目标端显示设备,指示所述描述信息的接收方;The target display device indicates the recipient of the description information;
数据类型;type of data;
数据优先级;data priority;
数据长度;Data length;
数据内容。Data content.
一些实施例中,所述显示描述信息包括数据类型和数据优先级,所述方法还包括:In some embodiments, the display description information includes data type and data priority, and the method further includes:
所述第一显示设备按照数据类型对所述描述信息进行排列,得到多个数据队列,并按照数据类型的优先级对所述多个数据队列进行排序;在每一所述数据队列中,按照数据的优先级对所述描述信息进行排序;按照所述数据队列中所述描述信息的顺序,根据所述描述信息执行同步操作。The first display device arranges the description information according to data type to obtain multiple data queues, and sorts the multiple data queues according to the priority of the data type; in each of the data queues, according to The description information is sorted by the priority of the data; a synchronization operation is performed according to the description information in the order of the description information in the data queue.
一些实施例中,所述目标事件包括用户触发对所述第一显示设备的应用图标执行点击操作,所述方法具体包括:In some embodiments, the target event includes the user triggering a click operation on the application icon of the first display device, and the method specifically includes:
所述第二显示设备在显示界面显示所述第一显示设备的应用图标,接收用户针对所述应用图标的点击操作指令,根据所述点击操作指令生成所述描述信息,将所述描述信息发送给所述第一显示设备;The second display device displays the application icon of the first display device on the display interface, receives the user's click operation instruction for the application icon, generates the description information according to the click operation instruction, and sends the description information to the first display device;
所述第一显示设备根据所述描述信息打开与所述应用图标对应的应用的界面;The first display device opens an interface of the application corresponding to the application icon according to the description information;
所述方法还包括:The method also includes:
所述第一显示设备向所述第二显示设备反馈所述应用的状态信息;The first display device feeds back the status information of the application to the second display device;
所述第二显示设备根据所述状态信息将所述应用图标标记为已打开。The second display device marks the application icon as opened according to the status information.
一些实施例中,所述目标事件包括用户触发对所述第二显示设备执行输入操作,所述目标事件的描述信息包括所述输入操作输入的内容;所述方法具体包括:In some embodiments, the target event includes a user triggering an input operation on the second display device, and the description information of the target event includes the content input by the input operation; the method specifically includes:
所述第二显示设备在自身的显示界面显示所述输入操作输入的内容,并根据所述输入的内容生成所述描述信息,将所述描述信息发送给所述第一显示设备;The second display device displays the content input by the input operation on its own display interface, generates the description information based on the input content, and sends the description information to the first display device;
所述第一显示设备接收所述描述信息,在自身的显示界面同步显示所述输入操作输入的内容。The first display device receives the description information and synchronously displays the content input by the input operation on its own display interface.
一些实施例中,所述目标事件包括用户触发对第一显示设备的第一目标媒体文件执行播放操作,所述方法具体包括:In some embodiments, the target event includes the user triggering a play operation on the first target media file of the first display device, and the method specifically includes:
所述第二显示设备在显示界面显示所述第一目标媒体文件,接收用户针对所述第一目标媒体文件的播放操作指令,根据所述播放操作指令更新所述第一目标媒体文件的播放状态,根据所述第一目标媒体文件的播放状态生成所述描述信息;The second display device displays the first target media file on a display interface, receives a user's playback operation instruction for the first target media file, and updates the playback status of the first target media file according to the playback operation instruction. , generate the description information according to the playback status of the first target media file;
所述第一显示设备根据所述描述信息控制所述第一目标媒体文件的播放状态。The first display device controls the playback state of the first target media file according to the description information.
一些实施例中,所述目标事件包括用户触发对第二目标媒体文件执行播放操作,所述第二目标媒体文件拆分为多个子目标媒体文件,不同子目标媒体文件包括不同子画面区域的媒体数据,多个子画面区域拼接成完成的显示画面,所述方法具体包括:In some embodiments, the target event includes a user triggering a playback operation on a second target media file. The second target media file is split into multiple sub-target media files, and different sub-target media files include media in different sub-picture areas. Data, multiple sub-picture areas are spliced into a completed display picture, and the method specifically includes:
所述第二显示设备播放所述多个子目标媒体文件中的第二子目标媒体文件,接收用户针对所述第二子目标媒体文件的播放操作指令,根据所述播放操作指令更新所述第二子目标媒体文件的播放状态,根据所述第二子目标媒体文件的播放状态生成所述描述信息;The second display device plays a second sub-target media file among the plurality of sub-target media files, receives a user's playback operation instruction for the second sub-target media file, and updates the second sub-target media file according to the playback operation instruction. The playback status of the sub-target media file, generating the description information according to the playback status of the second sub-target media file;
所述第一显示设备播放所述多个子目标媒体文件中的第一子目标媒体文件,根据所述描述信息控制所述第一子目标媒体文件的播放状态。The first display device plays a first sub-target media file among the plurality of sub-target media files, and controls the play status of the first sub-target media file according to the description information.
本公开的实施例还提供了一种显示设备,包括处理器和存储器,所述存储器存储可在所述处理器上运行的程序或指令,所述程序或指令被所述处理器执行时实现如上所述的屏幕信息同步方法的步骤。An embodiment of the present disclosure also provides a display device, including a processor and a memory. The memory stores programs or instructions that can be run on the processor. When the program or instructions are executed by the processor, the above is implemented. The steps of the screen information synchronization method.
本公开的实施例还提供了一种可读存储介质,所述可读存储介质上存储程序或指令,所述程序或指令被处理器执行时实现如上所述的屏幕信息同步方法的步骤。Embodiments of the present disclosure also provide a readable storage medium on which programs or instructions are stored. When the programs or instructions are executed by a processor, the steps of the screen information synchronization method as described above are implemented.
本公开的实施例具有以下有益效果:Embodiments of the present disclosure have the following beneficial effects:
上述方案中,在触发目标事件后,第二显示设备能够将目标事件的描述信息同步给第一显示设备,第一显示设备可以根据目标事件的描述信息执行相应的操作,以使得多个显示设备之间能够实现协作,包括但不限于应用同步、协同控制和媒体文件的共同播放等。In the above solution, after the target event is triggered, the second display device can synchronize the description information of the target event to the first display device, and the first display device can perform corresponding operations according to the description information of the target event, so that multiple display devices Collaboration can be achieved between them, including but not limited to application synchronization, collaborative control, and joint playback of media files.
附图说明Description of the drawings
图1为本公开实施例屏幕信息同步系统的结构示意图;Figure 1 is a schematic structural diagram of a screen information synchronization system according to an embodiment of the present disclosure;
图2为本公开实施例主显示设备与从显示设备的连接示意图;Figure 2 is a schematic diagram of the connection between the master display device and the slave display device according to the embodiment of the present disclosure;
图3为本公开实施例多个显示屏拼接的示意图;Figure 3 is a schematic diagram of multiple display screens spliced according to an embodiment of the present disclosure;
图4为本公开实施例多个数据队列的示意图;Figure 4 is a schematic diagram of multiple data queues according to an embodiment of the present disclosure;
图5为本公开实施例第一显示设备显示第二显示设备的应用图标的示意图;Figure 5 is a schematic diagram of a first display device displaying an application icon of a second display device according to an embodiment of the present disclosure;
图6为本公开实施例第一显示设备和第二显示设备同步显示用户输入内容的示意图;Figure 6 is a schematic diagram of a first display device and a second display device synchronously displaying user input content according to an embodiment of the present disclosure;
图7为本公开实施例第一显示设备控制第二显示设备侧目标媒体文件播 放进度的示意图;Figure 7 is a schematic diagram of the first display device controlling the playback progress of the target media file on the second display device side according to an embodiment of the present disclosure;
图8为本公开实施例多个显示屏播放目标媒体文件的示意图;Figure 8 is a schematic diagram of multiple display screens playing target media files according to an embodiment of the present disclosure;
图9为本公开实施例屏幕信息同步方法的流程示意图;Figure 9 is a schematic flowchart of a screen information synchronization method according to an embodiment of the present disclosure;
图10为本公开实施例屏幕信息同步装置的组成示意图。Figure 10 is a schematic diagram of the composition of a screen information synchronization device according to an embodiment of the present disclosure.
具体实施方式Detailed ways
为使本公开的实施例要解决的技术问题、技术方案和优点更加清楚,下面将结合附图及具体实施例进行详细描述。In order to make the technical problems, technical solutions and advantages to be solved by the embodiments of the present disclosure clearer, a detailed description will be given below with reference to the accompanying drawings and specific embodiments.
本公开实施例提供一种屏幕信息同步方法及系统,能够方便地实现多个显示设备进行协作。Embodiments of the present disclosure provide a screen information synchronization method and system, which can facilitate cooperation between multiple display devices.
本公开的实施例提供一种屏幕信息同步系统,如图1所示,包括第一显示设备11和第二显示设备12,所述第一显示设备11和第一显示设备12通信连接,Embodiments of the present disclosure provide a screen information synchronization system, as shown in Figure 1, including a first display device 11 and a second display device 12. The first display device 11 and the first display device 12 are communicatively connected.
所述第二显示设备12,用于向所述第一显示设备11发送目标事件的描述信息;The second display device 12 is configured to send the description information of the target event to the first display device 11;
所述第一显示设备11,用于接收所述第二显示设备12发送的目标事件的描述信息,并根据所述描述信息执行同步操作。The first display device 11 is configured to receive the description information of the target event sent by the second display device 12 and perform a synchronization operation according to the description information.
本公开实施例中,在触发目标事件后,第二显示设备能够将目标事件的描述信息同步给第一显示设备,第一显示设备可以根据目标事件的描述信息执行相应的操作,以使得多个显示设备之间能够实现协作,包括但不限于应用同步、协同控制和媒体文件的共同播放等。In the embodiment of the present disclosure, after triggering the target event, the second display device can synchronize the description information of the target event to the first display device, and the first display device can perform corresponding operations according to the description information of the target event, so that multiple Collaboration can be achieved between display devices, including but not limited to application synchronization, collaborative control, and joint playback of media files.
一些实施例中,第一显示设备和第二显示设备之间通过无线通信连接,无需通过硬件接口和物理走线连接,能够不增加硬件成本,并且本实施例对第一显示设备和第二显示设备的个数没有限制,可以根据需要增加参与协作的第一显示设备和第二显示设备。In some embodiments, the first display device and the second display device are connected through wireless communication without the need to connect through hardware interfaces and physical wiring, which does not increase the hardware cost, and this embodiment does not require the first display device and the second display device to be connected. There is no limit on the number of devices, and the first display device and the second display device participating in the collaboration can be added as needed.
本实施例中,第一显示设备和第二显示设备共同协作,第一显示设备和第二显示设备为带有显示屏的电子设备,包括但不限于手机(如Android手机、iOS手机等)、笔记本电脑、平板电脑、掌上电脑、MID(Mobile Internet Devices, 移动互联网设备)、PAD、台式电脑、智能电视、智慧黑板等。无线通信包括:蓝牙、WIFI及其他实现无线通信的技术,具体地,第一显示设备和第二显示设备之间可以通过WIFI连接。In this embodiment, the first display device and the second display device cooperate together. The first display device and the second display device are electronic devices with display screens, including but not limited to mobile phones (such as Android mobile phones, iOS mobile phones, etc.), Laptops, tablets, handheld computers, MID (Mobile Internet Devices, mobile Internet devices), PAD, desktop computers, smart TVs, smart blackboards, etc. Wireless communication includes: Bluetooth, WIFI and other technologies that implement wireless communication. Specifically, the first display device and the second display device can be connected through WIFI.
其中,第一显示设备中的“第一”以及第二显示设备中的“第二”仅是为了对显示设备进行区分,对于每一显示设备来说,自身为第一显示设备,其他的显示设备为第二显示设备。Among them, the "first" in the first display device and the "second" in the second display device are only to distinguish the display devices. For each display device, it is the first display device, and other display devices The device is a second display device.
第一显示设备和第二显示设备组成显示设备集合,在该显示设备集合中可以设置一主显示设备作为主要控制的显示设备,其他的显示设备作为从显示设备,主显示设备可以是第一显示设备,也可以是第二显示设备。可以事先约定一显示设备作为主显示设备,也可以后续根据实际应用再重新选择一显示设备作为主显示设备。如图2所示,主显示设备可以通过无线通信与网络和从显示设备通信连接,从显示设备通过无线通信与主显示设备通信连接。在主显示设备通过WIFI与从显示设备和网络连接时,主显示设备工作在站点(STA,station)模式,从显示设备工作在接入点(AP,Access Point)模式。所有显示设备通过WIFI连接,不用额外增加硬件接口和连接线。并且即使显示设备间占用WIFI的连接,也不影响主显示设备和网络之间的连接。The first display device and the second display device form a display device set. In the display device set, a master display device can be set as the main controlled display device, and other display devices can be set as slave display devices. The master display device can be the first display device. device, or it can be a second display device. A display device can be agreed upon in advance as the main display device, or a display device can be re-selected as the main display device later based on the actual application. As shown in Figure 2, the master display device can communicate with the network and the slave display device through wireless communication, and the slave display device can communicate with the master display device through wireless communication. When the master display device is connected to the slave display device and the network through WIFI, the master display device works in station (STA, station) mode, and the slave display device works in access point (AP, Access Point) mode. All display devices are connected via WIFI, without the need for additional hardware interfaces and cables. And even if the WIFI connection is occupied between display devices, it will not affect the connection between the main display device and the network.
如图3所示,主显示设备具有主显示屏,从显示设备具有副显示屏,主显示屏和副显示屏可以独立进行显示,可以显示相同的内容,也可以显示不同的内容,比如副显示屏显示用户的书写,主显示屏显示展示的PPT或视频;或者,主显示屏和副显示屏都显示用户的书写笔迹;或者,主显示屏和副显示屏同步播放媒体文件;或者,主显示屏和副显示屏进行拼接显示一个完整的画面。As shown in Figure 3, the master display device has a primary display screen, and the slave display device has a secondary display screen. The primary display screen and the secondary display screen can be displayed independently, and can display the same content or different content, such as the secondary display The main display screen displays the user's writing, and the main display screen displays the displayed PPT or video; or both the main display screen and the secondary display screen display the user's handwriting; or the main display screen and the secondary display screen play media files simultaneously; or the main display screen The main screen and secondary display screen are spliced to display a complete picture.
本公开实施例中,第二显示设备还用于将待进行同步或进行协作的目标事件的列表广播给第一显示设备,或者,发送给特定的第一显示设备。第一显示设备可以接收第二显示设备发送或广播的待进行同步或进行协作的目标事件的列表,所述目标事件的列表包括至少一个目标事件的标识。第一显示设备在接收到目标事件的列表后,可以订阅需要的目标事件,向所述第二显示设备发送订阅请求,指示获取所述目标事件的描述信息,第二显示设备还 用于接收所述订阅请求,这样在触发目标事件后,第二显示设备会将目标事件的描述信息发送给第一显示设备。In the embodiment of the present disclosure, the second display device is also used to broadcast the list of target events to be synchronized or collaborated to the first display device, or to send it to a specific first display device. The first display device may receive a list of target events to be synchronized or collaborated sent or broadcast by the second display device, where the list of target events includes an identification of at least one target event. After receiving the list of target events, the first display device can subscribe to the required target events, send a subscription request to the second display device, indicating to obtain the description information of the target event, and the second display device is also used to receive all the target events. Describe the subscription request, so that after the target event is triggered, the second display device will send the description information of the target event to the first display device.
同样的,第一显示设备还用于向第二显示设备发送发送目标事件的列表,所述目标事件的列表包括至少一个目标事件的标识,也可以接收第二显示设备的订阅请求,在触发目标事件后,第一显示设备会将目标事件的描述信息发送给第一显示设备。Similarly, the first display device is also used to send a list of target events to the second display device. The list of target events includes the identification of at least one target event. It can also receive a subscription request from the second display device and trigger the target event. After the event, the first display device will send the description information of the target event to the first display device.
本实施例中,第二显示设备执行的操作,第一显示设备也同样会执行,比如第一显示设备生成目标事件的描述信息,将描述信息发送给第二显示设备,以便其他的第二显示设备根据描述信息执行相应的操作。为避免赘述,本实施例以第一显示设备或第二显示设备为例,介绍显示设备需要执行的操作,但本领域技术人员应当知晓,第一显示设备执行的操作,第二显示设备均可以执行,第二显示设备执行的操作,第一显示设备也可以执行。In this embodiment, the operations performed by the second display device will also be performed by the first display device. For example, the first display device generates description information of the target event and sends the description information to the second display device for other second display devices. The device performs corresponding operations based on the description information. To avoid redundancy, this embodiment takes the first display device or the second display device as an example to introduce the operations that the display device needs to perform. However, those skilled in the art should know that the operations performed by the first display device can also be performed by the second display device. Execution, the operation performed by the second display device can also be performed by the first display device.
第一显示设备和第二显示设备之间可以通过广播的方式发送目标事件的描述信息,也可以通过端到端的方式发送目标事件的描述信息。The description information of the target event may be sent between the first display device and the second display device in a broadcast manner, or in an end-to-end manner.
一些实施例中,所述目标事件的描述信息包括以下至少一项:In some embodiments, the description information of the target event includes at least one of the following:
源端显示设备,指示所述描述信息的发送方,即指示目标事件的描述信息是哪个显示设备发送的;The source display device indicates the sender of the description information, that is, which display device sends the description information of the target event;
目标端显示设备,指示所述描述信息的接收方,即指示目标事件的描述信息是发送给哪个显示设备;The target display device indicates the recipient of the description information, that is, the display device to which the description information of the target event is sent;
数据类型,数据类型包括但不限于File、Event、Notify、Object这四种类型;Data type, data types include but are not limited to four types: File, Event, Notify, and Object;
数据优先级,表明目标事件处理的优先级;Data priority, indicating the priority of target event processing;
数据长度,数据payload的长度;Data length, the length of the data payload;
数据内容。Data content.
目标事件的描述信息可以包括上述信息中的一项,也可以包括上述信息中的几项,在目标事件的描述信息包括目标端显示设备时,第一显示设备在接收到目标事件的描述信息后,判断自身是否为目标端显示设备,如果不是目标端显示设备,可以忽略该目标事件的描述信息;如果是目标端显示设备, 则根据目标事件的描述信息执行相应的同步操作。The description information of the target event may include one item of the above information, or may include several items of the above information. When the description information of the target event includes the target display device, the first display device will receive the description information of the target event. , to determine whether it is a target display device. If it is not a target display device, the description information of the target event can be ignored; if it is a target display device, the corresponding synchronization operation is performed based on the description information of the target event.
一些实施例中,所述显示描述信息包括数据类型和数据优先级;所述第一显示设备用于按照数据类型对所述描述信息进行排列,得到多个数据队列,并按照数据类型的优先级对所述多个数据队列进行排序;在每一所述数据队列中,按照数据的优先级对所述描述信息进行排序;按照所述数据队列中所述描述信息的顺序,根据所述描述信息执行同步操作。In some embodiments, the display description information includes data type and data priority; the first display device is used to arrange the description information according to the data type to obtain multiple data queues, and arrange the description information according to the priority of the data type. Sorting the plurality of data queues; in each data queue, sorting the description information according to the priority of data; according to the order of the description information in the data queue, according to the description information Perform synchronization operations.
如图4所示,在数据类型包括File、Event、Notify、Object这四种类型时,在每个显示设备侧维护有四个数据队列:File队列、Event队列、Notify队列、Object队列,如果接收到的目标事件的描述信息的数据类型为File队列,则将目标事件的描述信息存储在File队列中;如果接收到的目标事件的描述信息的数据类型为Event队列,则将目标事件的描述信息存储在Event队列中;如果接收到的目标事件的描述信息的数据类型为Notify队列,则将目标事件的描述信息存储在Notify队列中;如果接收到的目标事件的描述信息的数据类型为Object队列,则将目标事件的描述信息存储在Object队列中,每个数据队列采用先进先出的方式,每个数据队列具有不同的优先级,可以为每个数据队列配置优先级数值,比如在优先级数值越大时越优先,一具体示例中,可以是Object队列的优先级高于Event队列的优先级,Event队列的优先级高于Notify队列的优先级,Notify队列的优先级高于File队列的优先级。As shown in Figure 4, when the data types include File, Event, Notify, and Object, four data queues are maintained on each display device side: File queue, Event queue, Notify queue, and Object queue. If receiving The data type of the description information of the target event received is File queue, then the description information of the target event is stored in the File queue; if the data type of the description information of the target event received is Event queue, the description information of the target event is stored in the File queue. Stored in the Event queue; if the data type of the description information of the received target event is Notify queue, then the description information of the target event is stored in the Notify queue; if the data type of the description information of the received target event is Object queue , the description information of the target event is stored in the Object queue. Each data queue adopts a first-in, first-out method. Each data queue has a different priority. The priority value can be configured for each data queue, such as in the priority The larger the value, the higher the priority. In a specific example, the priority of the Object queue is higher than the priority of the Event queue, the priority of the Event queue is higher than the priority of the Notify queue, and the priority of the Notify queue is higher than the priority of the File queue. priority.
另外在每个数据队列中,可能存在多个目标事件的描述信息,根据数据的优先级的不同,多个目标事件的描述信息也按照优先级进行处理,比如在Object队列中,会优先处理高优先级的数据,如果数据的优先级都相同,则按照先入先出的方式进行数据的处理。通过优先级策略的调度,可以让某些紧急程序调用的数据优先处理,对于一些文件传输类的数据可以低优先级处理,满足用户需要,提高用户体验。In addition, in each data queue, there may be description information for multiple target events. Depending on the priority of the data, the description information for multiple target events will also be processed according to the priority. For example, in the Object queue, high-level data will be processed first. Priority data, if the data have the same priority, the data will be processed in a first-in, first-out manner. Through priority policy scheduling, data called by certain emergency programs can be processed first, and some file transfer data can be processed with low priority to meet user needs and improve user experience.
本实施例中,目标事件包括但不限于用户触发对显示设备(包括第一显示设备和第二显示设备)的应用图标执行点击操作、用户触发对显示设备执行输入操作、用户触发对显示设备的目标媒体文件进行播放等,可以根据需要订阅需要获取的目标事件,在目标事件发生后,显示设备集合中的显示设 备进行协作,实现应用同步、协同控制和/或媒体播放。In this embodiment, the target events include but are not limited to the user triggering a click operation on the application icon of the display device (including the first display device and the second display device), the user triggering an input operation on the display device, and the user triggering an input operation on the display device. To play target media files, etc., you can subscribe to target events that need to be obtained as needed. After the target event occurs, the display devices in the display device collection collaborate to achieve application synchronization, collaborative control, and/or media playback.
一具体实施例中,所述目标事件包括用户触发对所述第一显示设备的应用图标执行点击操作,In a specific embodiment, the target event includes a user triggering a click operation on an application icon of the first display device,
所述第二显示设备具体用于在显示界面显示所述第一显示设备的应用图标,接收用户针对所述应用图标的点击操作指令,根据所述点击操作指令生成所述描述信息,将所述描述信息发送给所述第一显示设备;The second display device is specifically configured to display the application icon of the first display device on a display interface, receive a user's click operation instruction for the application icon, generate the description information according to the click operation instruction, and convert the The description information is sent to the first display device;
所述第一显示设备具体用于根据所述描述信息打开与所述应用图标对应的应用的界面;The first display device is specifically configured to open an interface of an application corresponding to the application icon according to the description information;
所述第一显示设备还用于向所述第二显示设备反馈所述应用的状态信息;The first display device is also configured to feed back the status information of the application to the second display device;
所述第二显示设备还用于根据所述状态信息将所述应用图标标记为已打开。The second display device is further configured to mark the application icon as opened according to the status information.
如图5所示,第二显示设备可以读取第一显示设备的所有应用,并能够在在自身显示界面将第一显示设备的应用图标显示出来,第二显示设备可以在显示界面上划定部分区域比如虚线框内圈出的部分显示所述第一显示设备的应用图标,以与第二显示设备自身的应用图标区分开;当然,第二显示设备也可以在显示界面的全部区域均用来显示第一显示设备的应用图标。本实施例中,第二显示设备可以为主显示设备,第一显示设备为从显示设备。As shown in Figure 5, the second display device can read all applications of the first display device, and can display the application icons of the first display device on its own display interface. The second display device can delineate the application icons on the display interface. Part of the area, such as the area circled in the dotted box, displays the application icon of the first display device to distinguish it from the application icon of the second display device itself; of course, the second display device can also use the application icon in all areas of the display interface. to display the application icon of the first display device. In this embodiment, the second display device may be a master display device, and the first display device may be a slave display device.
一具体示例中,第一显示设备和第二显示设备之间的通讯采用Object的数据类型,以list的方式进行传输,第二显示设备获得list后以通用的图标显示在专门为第一显示设备绘制的显示区域内,如图5所示,第二显示设备的显示界面上显示第一显示设备的应用图标1、应用图标2、应用图标3、应用图标4、应用图标5、应用图标6。此时如果用户在第二显示设备的显示界面上点击应用图标1、应用图标2、应用图标3、应用图标4、应用图标5、应用图标6中的任一者,视为接收到用户针对应用图标的点击操作指令,根据该点击操作指令生成描述信息,将描述信息通知给第一显示设备,描述信息指示对应的应用需要打开,第一显示设备接收到描述信息之后,打开应用图标对应的应用的界面,并可以以通知消息的形式向第二显示设备反馈一个状 态,第二显示设备在收到通知消息后将应用图标标记为已打开,或者,第二显示设备可以直接在接收到用户针对应用图标的点击操作指令后,将对应的应用图标标记为已打开。另外,第二显示设备可以将目标事件的描述信息发送给其他的显示设备,实现显示设备间的应用同步。In a specific example, the communication between the first display device and the second display device adopts the data type of Object and is transmitted in the form of a list. After the second display device obtains the list, it displays it as a general icon on the list specifically for the first display device. In the drawn display area, as shown in Figure 5, application icons 1, 2, 3, 4, 5 and 6 of the first display device are displayed on the display interface of the second display device. At this time, if the user clicks any one of application icon 1, application icon 2, application icon 3, application icon 4, application icon 5, and application icon 6 on the display interface of the second display device, it is deemed that the user's request for the application has been received. The click operation instruction of the icon generates description information according to the click operation instruction, and notifies the first display device of the description information. The description information indicates that the corresponding application needs to be opened. After receiving the description information, the first display device opens the application corresponding to the application icon. interface, and can feed back a status to the second display device in the form of a notification message. After receiving the notification message, the second display device marks the application icon as open, or the second display device can directly receive the user's After the click operation instruction of the application icon is executed, the corresponding application icon is marked as opened. In addition, the second display device can send the description information of the target event to other display devices to achieve application synchronization between display devices.
本实施例中,第二显示设备可以显示多个第一显示设备的应用图标,比如第二显示设备与N个第一显示设备通信,第二显示设备的显示界面可以划分为N个显示区域,在第一个显示区域显示第一个第一显示设备的应用图标,在第二个显示区域显示第二个第一显示设备的应用图标,以此类推,N为大于等于2的整数。这样通过第二显示设备的显示界面,可以对一个或多个第一显示设备的应用图标进行操作,在多个显示设备之间实现应用同步。In this embodiment, the second display device can display application icons of multiple first display devices. For example, the second display device communicates with N first display devices, and the display interface of the second display device can be divided into N display areas. The application icon of the first first display device is displayed in the first display area, the application icon of the second first display device is displayed in the second display area, and so on, N is an integer greater than or equal to 2. In this way, through the display interface of the second display device, the application icons of one or more first display devices can be operated, thereby realizing application synchronization between multiple display devices.
一具体实施例中,所述目标事件包括用户触发对所述第二显示设备执行输入操作,所述目标事件的描述信息包括所述输入操作输入的内容,所述第二显示设备具体用于在自身的显示界面显示所述输入操作输入的内容,并根据所述输入的内容生成所述描述信息,将所述描述信息发送给所述第一显示设备;In a specific embodiment, the target event includes a user triggering an input operation on the second display device, the description information of the target event includes the content input by the input operation, and the second display device is specifically used to perform an input operation on the second display device. Display the content input by the input operation on its own display interface, generate the description information based on the input content, and send the description information to the first display device;
所述第一显示设备具体用于接收所述描述信息,在自身的显示界面同步显示所述输入操作输入的内容。The first display device is specifically configured to receive the description information and synchronously display the content input by the input operation on its own display interface.
本实施例中,显示设备可以与用户之间进行交互,显示设备之间可以同步与用户的交互事件。比如在用户触发对所述第二显示设备执行输入操作时,第二显示设备接收用户输入的内容,在自身显示界面显示用户输入的内容,并将用户输入的内容作为目标事件的描述信息发送给第一显示设备,第一显示设备在接收目标事件的描述信息后,在自身的显示界面上显示所述输入操作输入的内容。In this embodiment, the display device can interact with the user, and the display devices can synchronize interaction events with the user. For example, when the user triggers an input operation on the second display device, the second display device receives the content input by the user, displays the content input by the user on its own display interface, and sends the content input by the user as the description information of the target event to The first display device, after receiving the description information of the target event, displays the content input by the input operation on its own display interface.
一具体示例中,所述输入操作输入的内容为用户书写的笔迹。如图6所示,在用户通过书写白板软件执行输入操作时,通过本实施例的技术方案可以将用户的书写笔迹进行实时的同步。如图6所示,在第二显示设备上启动手写白板软件,用户通过触摸屏进行书写,白板软件将笔迹绘制到相应区域,同时,第二显示设备可以将用户输入的内容作为目标事件的描述信息通过输 入事件Input Event发送给第一显示设备,第一显示设备模拟一个uinput设备,第一显示设备上运行的白板软件将其绘制在第一显示设备的显示界面的相关区域中。In a specific example, the content input by the input operation is the user's handwriting. As shown in Figure 6, when the user performs an input operation through the writing whiteboard software, the user's handwriting can be synchronized in real time through the technical solution of this embodiment. As shown in Figure 6, the handwriting whiteboard software is started on the second display device. The user writes through the touch screen, and the whiteboard software draws the handwriting to the corresponding area. At the same time, the second display device can use the content input by the user as the description information of the target event. The input event is sent to the first display device through the input event. The first display device simulates a uinput device, and the whiteboard software running on the first display device draws it in the relevant area of the display interface of the first display device.
本实施例中,第一显示设备可以在显示界面上划定部分区域显示用户在第二显示设备上输入的内容,以与第一显示设备自身的显示内容区分开,当然,第一显示设备也可以在显示界面的全部区域均用来显示用户在第二显示设备上输入的内容。In this embodiment, the first display device can delimit a portion of the display interface to display the content input by the user on the second display device to distinguish it from the display content of the first display device itself. Of course, the first display device can also All areas of the display interface can be used to display content input by the user on the second display device.
本实施例中,第一显示设备可以显示多个第二显示设备的输入内容,比如第一显示设备与N个第二显示设备通信,第一显示设备的显示界面可以划分为N个显示区域,在第一个显示区域显示第一个第二显示设备的输入内容,在第二个显示区域显示第二个第二显示设备的输入内容,以此类推,N为大于等于2的整数。这样通过第一显示设备的显示界面,可以对一个或多个第二显示设备的输入内容进行显示,在多个显示设备之间实现显示内容的同步。In this embodiment, the first display device can display the input content of multiple second display devices. For example, the first display device communicates with N second display devices, and the display interface of the first display device can be divided into N display areas. The input content of the first second display device is displayed in the first display area, the input content of the second second display device is displayed in the second display area, and so on, N is an integer greater than or equal to 2. In this way, the input content of one or more second display devices can be displayed through the display interface of the first display device, thereby achieving synchronization of display content between multiple display devices.
本实施例中,第一显示设备可以为显示设备集合中的主显示设备,第二显示设备为显示设备集合中的从显示设备;当然,第一显示设备还可以为显示设备集合中的从显示设备,第二显示设备可以为显示设备集合中的主显示设备。In this embodiment, the first display device may be a master display device in the display device set, and the second display device may be a slave display device in the display device set; of course, the first display device may also be a slave display device in the display device set. device, the second display device may be the main display device in the display device set.
一些实施例中,所述屏幕信息同步系统为黑板系统,通过本公开的技术方案可以实现黑板系统中多个黑板的书写操作的同步。In some embodiments, the screen information synchronization system is a blackboard system, and the technical solution of the present disclosure can realize synchronization of writing operations on multiple blackboards in the blackboard system.
一具体实施例中,所述目标事件包括用户触发对第一显示设备的第一目标媒体文件执行播放操作,In a specific embodiment, the target event includes the user triggering a playback operation on the first target media file of the first display device,
所述第二显示设备具体用于在显示界面显示所述第一目标媒体文件,接收用户针对所述第一目标媒体文件的播放操作指令,根据所述播放操作指令更新所述第一目标媒体文件的播放状态,根据所述第一目标媒体文件的播放状态生成所述描述信息;The second display device is specifically configured to display the first target media file on a display interface, receive a user's playback operation instruction for the first target media file, and update the first target media file according to the playback operation instruction. The playback status of the first target media file is used to generate the description information according to the playback status of the first target media file;
所述第一显示设备具体用于根据所述描述信息控制所述第一目标媒体文件的播放状态。The first display device is specifically configured to control the playback state of the first target media file according to the description information.
本实施例中,在第一显示设备和第二显示设备之间可以实现文件列表和 文件的共享,进而可以实现媒体文件的跨设备播放,其中,媒体文件包括但不限于音频、视频和图片。本实施例中,可以在第二显示设备上查看任意第一显示设备上的媒体文件列表,使用Object类型中的list数据,用户可以在第二显示设备控制第一显示设备播放某个目标媒体文件,为了进行区分,称为第一目标媒体文件,第二显示设备接收用户针对所述第一目标媒体文件的播放操作指令后,可以控制该第一目标媒体文件的播放、停止、暂停、快进、快退等播放状态,更新第一目标媒体文件的播放状态,根据第一目标媒体文件的播放状态生成所述描述信息,将描述信息同步给第一显示设备,从而实现显示设备间的播放同步。描述信息可以是通过第二显示设备向第一显示设备发送Notify事件实现,同时,第二显示设备上显示第一目标媒体文件的播放状态,这些状态信息是第一显示设备向第二显示设备发送Notify事件来实现的,如图7所示。In this embodiment, file lists and files can be shared between the first display device and the second display device, thereby enabling cross-device playback of media files, where the media files include but are not limited to audio, video, and pictures. In this embodiment, the list of media files on any first display device can be viewed on the second display device. Using the list data in the Object type, the user can control the first display device to play a certain target media file on the second display device. , in order to distinguish, it is called the first target media file. After receiving the user's playback operation instruction for the first target media file, the second display device can control the playback, stop, pause, and fast forward of the first target media file. , rewind and other playback states, update the playback state of the first target media file, generate the description information according to the playback state of the first target media file, and synchronize the description information to the first display device, thereby achieving playback synchronization between display devices. . The description information may be implemented by sending a Notify event from the second display device to the first display device. At the same time, the playback status of the first target media file is displayed on the second display device. This status information is sent by the first display device to the second display device. Notify event is implemented, as shown in Figure 7.
在第一显示设备上播放第一目标媒体文件后,可以将第一目标媒体文件的播放状态发送给第二显示设备,包括但不限于:第一目标媒体文件是处于播放、停止、快进、快退等状态,在处于播放状态时的播放时长,在处于停止状态时对应的播放时长、在处于快进状态时快进的倍率以及对应的播放时长、在处于快退状态时快退的倍率以及对应的播放时长等,第二显示设备在接收到第一目标媒体文件的播放状态后,根据用户输入的播放操作指令更新第一目标媒体文件的播放状态,比如第一目标媒体文件的初始状态是处于播放状态,用户输入快进的播放操作指令后,第二显示设备更新第一目标媒体文件的播放状态为快进,并确定对应的播放时长,将快进状态和对应的播放时长作为描述信息发送给第一显示设备,第一显示设备可以根据描述信息控制第一目标媒体文件的播放状态。再比如第一目标媒体文件的初始状态是处于暂停状态,用户输入指示播放的播放操作指令后,第二显示设备更新第一目标媒体文件的播放状态为播放,并确定对应的播放时长,将播放状态和对应的播放时长作为描述信息发送给第一显示设备,第一显示设备可以根据描述信息控制第一目标媒体文件的播放状态。After playing the first target media file on the first display device, the playback status of the first target media file can be sent to the second display device, including but not limited to: whether the first target media file is in play, stop, fast forward, Fast rewind and other states, the playback duration when in the playback state, the corresponding playback duration when in the stop state, the fast forward magnification when in the fast forward state and the corresponding playback duration, and the fast rewind magnification when in the fast rewind state And the corresponding playback duration, etc., after receiving the playback status of the first target media file, the second display device updates the playback status of the first target media file according to the playback operation instruction input by the user, such as the initial status of the first target media file. is in the playback state. After the user inputs a fast-forward playback operation instruction, the second display device updates the playback state of the first target media file to fast-forward, determines the corresponding playback duration, and uses the fast-forward state and the corresponding playback duration as descriptions. The information is sent to the first display device, and the first display device can control the playback state of the first target media file according to the description information. For another example, the initial state of the first target media file is in a paused state. After the user inputs a playback operation instruction instructing playback, the second display device updates the playback status of the first target media file to play, determines the corresponding playback duration, and plays the file. The status and corresponding playback duration are sent to the first display device as description information, and the first display device can control the playback status of the first target media file based on the description information.
本实施例中,第二显示设备可以在显示界面上划定部分区域显示第一目 标媒体文件的播放控制界面(包括暂停、播放、快进、快退等按钮),以与第二显示设备自身的显示内容区分开,当然,第二显示设备也可以在显示界面的全部区域均用来显示第一目标媒体文件的播放控制界面。In this embodiment, the second display device can delimit a portion of the display interface to display the playback control interface (including pause, play, fast forward, rewind, etc. buttons) of the first target media file to communicate with the second display device itself. of course, the second display device can also be used to display the playback control interface of the first target media file in all areas of the display interface.
本实施例中,第二显示设备可以显示多个第一显示设备的第一目标媒体文件的播放控制界面,比如第二显示设备与N个第一显示设备通信,第二显示设备的显示界面可以划分为N个显示区域,在第一个显示区域显示第一个第一显示设备的第一目标媒体文件的播放控制界面,在第二个显示区域显示第二个第一显示设备的第一目标媒体文件的播放控制界面,以此类推,N为大于等于2的整数。这样通过第二显示设备的显示界面,可以对一个或多个第一显示设备的第一目标媒体文件的播放状态进行控制,在多个显示设备之间实现媒体文件的共享、协同控制和播放。In this embodiment, the second display device can display the playback control interface of the first target media file of multiple first display devices. For example, the second display device communicates with N first display devices, and the display interface of the second display device can Divided into N display areas, the first display area displays the playback control interface of the first target media file of the first first display device, and the second display area displays the first target of the second first display device. The playback control interface of media files, and so on, N is an integer greater than or equal to 2. In this way, through the display interface of the second display device, the playback status of the first target media file of one or more first display devices can be controlled, and the sharing, collaborative control and playback of media files can be realized between multiple display devices.
本实施例中,第二显示设备可以为显示设备集合中的主显示设备,第一显示设备可以为显示设备集合中的从显示设备。In this embodiment, the second display device may be a master display device in the display device set, and the first display device may be a slave display device in the display device set.
一些实施例中,所述目标事件包括用户触发对第二目标媒体文件执行播放操作,所述第二目标媒体文件拆分为多个子目标媒体文件,不同子目标媒体文件包括不同子画面区域的媒体数据,多个子画面区域拼接成完成的显示画面,In some embodiments, the target event includes a user triggering a playback operation on a second target media file. The second target media file is split into multiple sub-target media files, and different sub-target media files include media in different sub-picture areas. Data, multiple sub-picture areas are spliced into a completed display screen,
所述第二显示设备具体用于播放所述多个子目标媒体文件中的第二子目标媒体文件,接收用户针对所述第二子目标媒体文件的播放操作指令,根据所述播放操作指令更新所述第二子目标媒体文件的播放状态,根据所述第二子目标媒体文件的播放状态生成所述描述信息;The second display device is specifically configured to play a second sub-target media file among the plurality of sub-target media files, receive a user's playback operation instruction for the second sub-target media file, and update the playback operation instruction according to the playback operation instruction. The playback status of the second sub-target media file is generated according to the playback status of the second sub-target media file;
所述第一显示设备具体用于播放所述多个子目标媒体文件中的第一子目标媒体文件,根据所述描述信息控制所述第一子目标媒体文件的播放状态。The first display device is specifically configured to play a first sub-target media file among the plurality of sub-target media files, and control the play status of the first sub-target media file according to the description information.
多个显示设备的显示屏可以拼接在一起进行画面显示,一具体示例中,如图8所示,显示设备集合包括第一显示设备和两个第二显示设备,第一显示设备的显示屏可以作为主显示屏,第二显示设备的显示屏可以作为副显示屏,每一显示屏显示画面的一部分,拼接进行大的画面的显示。在利用多个显示设备播放第二目标媒体文件时,可以按照显示设备的显示屏的尺寸比例 对第二目标媒体文件的数据进行拆分,使得每一显示设备对应的子目标媒体文件的子画面显示区域的尺寸与显示设备的显示屏的尺寸成正比,显示设备的显示屏的尺寸越大,显示的子画面显示区域的尺寸越大。The display screens of multiple display devices can be spliced together for screen display. In a specific example, as shown in Figure 8, the display device set includes a first display device and two second display devices. The display screen of the first display device can As the main display screen, the display screen of the second display device can be used as the secondary display screen. Each display screen displays a part of the picture and is spliced to display a large picture. When multiple display devices are used to play the second target media file, the data of the second target media file can be split according to the size ratio of the display screen of the display device, so that the sub-screen of the sub-target media file corresponding to each display device The size of the display area is proportional to the size of the display screen of the display device. The larger the size of the display screen of the display device, the larger the size of the displayed sub-picture display area.
在第二显示设备播放对应的子目标媒体文件时,根据用户输入的播放操作指令控制子目标媒体文件的播放状态,包括但不限于:第二目标媒体文件是处于播放、停止、快进、快退等状态,在处于播放状态时的播放时长,在处于停止状态时对应的播放时长、在处于快进状态时快进的倍率以及对应的播放时长、在处于快退状态时快退的倍率以及对应的播放时长等,并根据子目标媒体文件的播放状态生成所述描述信息,将描述信息通过Event消息发送给第一显示设备,第一显示设备根据描述信息控制对应的子目标媒体文件的播放状态,从而实现多个显示设备间的播放同步。When the second display device plays the corresponding sub-target media file, the playback state of the sub-target media file is controlled according to the playback operation instruction input by the user, including but not limited to: whether the second target media file is in play, stop, fast forward, fast Rewind state, the playback duration when in the playback state, the corresponding playback duration when in the stop state, the fast forward magnification and corresponding playback duration when in the fast forward state, the fast rewind magnification when in the fast rewind state, and The corresponding playback duration, etc., and the description information is generated according to the playback status of the sub-target media file, and the description information is sent to the first display device through an Event message. The first display device controls the playback of the corresponding sub-target media file based on the description information. status to achieve playback synchronization between multiple display devices.
本实施例中,第二显示设备可以为显示设备集合中的主显示设备,第一显示设备可以为显示设备集合中的从显示设备。或者,第一显示设备可以为显示设备集合中的主显示设备,第二显示设备可以为显示设备集合中的从显示设备。In this embodiment, the second display device may be a master display device in the display device set, and the first display device may be a slave display device in the display device set. Alternatively, the first display device may be a master display device in the display device set, and the second display device may be a slave display device in the display device set.
本公开的实施例还提供了一种屏幕信息同步方法,应用于如上所述的屏幕信息同步系统,如图9所示,所述方法包括:Embodiments of the present disclosure also provide a screen information synchronization method, which is applied to the screen information synchronization system as described above. As shown in Figure 9, the method includes:
步骤101:第二显示设备向第一显示设备发送目标事件的描述信息;Step 101: The second display device sends the description information of the target event to the first display device;
步骤102:所述第一显示设备接收所述第二显示设备发送的目标事件的描述信息,并根据所述描述信息执行同步操作。Step 102: The first display device receives the description information of the target event sent by the second display device, and performs a synchronization operation based on the description information.
本公开实施例中,在触发目标事件后,第二显示设备能够将目标事件的描述信息同步给第一显示设备,第一显示设备可以根据目标事件的描述信息执行相应的操作,以使得多个显示设备之间能够实现协作,包括但不限于应用同步、协同控制和媒体文件的共同播放等。In the embodiment of the present disclosure, after triggering the target event, the second display device can synchronize the description information of the target event to the first display device, and the first display device can perform corresponding operations according to the description information of the target event, so that multiple Collaboration can be achieved between display devices, including but not limited to application synchronization, collaborative control, and joint playback of media files.
一些实施例中,第一显示设备和第二显示设备之间通过无线通信连接,无需通过硬件接口和物理走线连接,能够不增加硬件成本,并且本实施例对第一显示设备和第二显示设备的个数没有限制,可以根据需要增加参与协作的第一显示设备和第二显示设备。In some embodiments, the first display device and the second display device are connected through wireless communication without the need to connect through hardware interfaces and physical wiring, which does not increase the hardware cost, and this embodiment does not require the first display device and the second display device to be connected. There is no limit on the number of devices, and the first display device and the second display device participating in the collaboration can be added as needed.
本实施例中,第一显示设备和第二显示设备共同协作,第一显示设备和第二显示设备为带有显示屏的电子设备,包括但不限于手机(如Android手机、iOS手机等)、笔记本电脑、平板电脑、掌上电脑、MID(Mobile Internet Devices,移动互联网设备)、PAD、台式电脑、智能电视、智慧黑板等。无线通信包括:蓝牙、WIFI及其他实现无线通信的技术,具体地,第一显示设备和第二显示设备之间可以通过WIFI连接。In this embodiment, the first display device and the second display device cooperate together. The first display device and the second display device are electronic devices with display screens, including but not limited to mobile phones (such as Android mobile phones, iOS mobile phones, etc.), Laptops, tablets, handheld computers, MID (Mobile Internet Devices, mobile Internet devices), PAD, desktop computers, smart TVs, smart blackboards, etc. Wireless communication includes: Bluetooth, WIFI and other technologies that implement wireless communication. Specifically, the first display device and the second display device can be connected through WIFI.
其中,第一显示设备中的“第一”以及第二显示设备中的“第二”仅是为了对显示设备进行区分,对于每一显示设备来说,自身为第一显示设备,其他的显示设备为第二显示设备。Among them, the "first" in the first display device and the "second" in the second display device are only to distinguish the display devices. For each display device, it is the first display device, and other display devices The device is a second display device.
第一显示设备和第二显示设备组成显示设备集合,在该显示设备集合中可以设置一主显示设备作为主要控制的显示设备,其他的显示设备作为从显示设备,主显示设备可以是第一显示设备,也可以是第二显示设备。可以事先约定一显示设备作为主显示设备,也可以后续根据实际应用再重新选择一显示设备作为主显示设备。如图2所示,主显示设备可以通过无线通信与网络和从显示设备通信连接,从显示设备通过无线通信与主显示设备通信连接。在主显示设备通过WIFI与从显示设备和网络连接时,主显示设备工作在站点(STA,station)模式,从显示设备工作在接入点(AP,Access Point)模式。所有显示设备通过WIFI连接,不用额外增加硬件接口和连接线。并且即使显示设备间占用WIFI的连接,也不影响主显示设备和网络之间的连接。The first display device and the second display device form a display device set. In the display device set, a master display device can be set as the main controlled display device, and other display devices can be set as slave display devices. The master display device can be the first display device. device, or it can be a second display device. A display device can be agreed upon in advance as the main display device, or a display device can be re-selected as the main display device later based on the actual application. As shown in Figure 2, the master display device can communicate with the network and the slave display device through wireless communication, and the slave display device can communicate with the master display device through wireless communication. When the master display device is connected to the slave display device and the network through WIFI, the master display device works in station (STA, station) mode, and the slave display device works in access point (AP, Access Point) mode. All display devices are connected via WIFI, without the need for additional hardware interfaces and cables. And even if the WIFI connection is occupied between display devices, it will not affect the connection between the main display device and the network.
如图3所示,主显示设备具有主显示屏,从显示设备具有副显示屏,主显示屏和副显示屏可以独立进行显示,可以显示相同的内容,也可以显示不同的内容,比如副显示屏显示用户的书写,主显示屏显示展示的PPT或视频;或者,主显示屏和副显示屏都显示用户的书写笔迹;或者,主显示屏和副显示屏同步播放媒体文件;或者,主显示屏和副显示屏进行拼接显示一个完整的画面。As shown in Figure 3, the master display device has a primary display screen, and the slave display device has a secondary display screen. The primary display screen and the secondary display screen can be displayed independently, and can display the same content or different content, such as the secondary display The main display screen displays the user's writing, and the main display screen displays the displayed PPT or video; or both the main display screen and the secondary display screen display the user's handwriting; or the main display screen and the secondary display screen play media files simultaneously; or the main display screen The main screen and secondary display screen are spliced to display a complete picture.
本公开实施例中,第二显示设备还用于将待进行同步或进行协作的目标事件的列表广播给第一显示设备,或者,发送给特定的第一显示设备。第一显示设备可以接收第二显示设备发送或广播的待进行同步或进行协作的目标 事件的列表,所述目标事件的列表包括至少一个目标事件的标识。第一显示设备在接收到目标事件的列表后,可以订阅需要的目标事件,向所述第二显示设备发送订阅请求,指示获取所述目标事件的描述信息,第二显示设备还用于接收所述订阅请求,这样在触发目标事件后,第二显示设备会将目标事件的描述信息发送给第一显示设备。In the embodiment of the present disclosure, the second display device is also used to broadcast the list of target events to be synchronized or collaborated to the first display device, or to send it to a specific first display device. The first display device may receive a list of target events to be synchronized or collaborated sent or broadcast by the second display device, where the list of target events includes an identification of at least one target event. After receiving the list of target events, the first display device can subscribe to the required target events, send a subscription request to the second display device, indicating to obtain the description information of the target event, and the second display device is also used to receive all the target events. Describe the subscription request, so that after the target event is triggered, the second display device will send the description information of the target event to the first display device.
同样的,第一显示设备还用于向第二显示设备发送发送目标事件的列表,所述目标事件的列表包括至少一个目标事件的标识,也可以接收第二显示设备的订阅请求,在触发目标事件后,第一显示设备会将目标事件的描述信息发送给第一显示设备。Similarly, the first display device is also used to send a list of target events to the second display device. The list of target events includes the identification of at least one target event. It can also receive a subscription request from the second display device and trigger the target event. After the event, the first display device will send the description information of the target event to the first display device.
本实施例中,第二显示设备执行的操作,第一显示设备也同样会执行,比如第一显示设备生成目标事件的描述信息,将描述信息发送给第二显示设备,以便其他的第二显示设备根据描述信息执行相应的操作。为避免赘述,本实施例以第一显示设备或第二显示设备为例,介绍显示设备需要执行的操作,但本领域技术人员应当知晓,第一显示设备执行的操作,第二显示设备均可以执行,第二显示设备执行的操作,第一显示设备也可以执行。In this embodiment, the operations performed by the second display device will also be performed by the first display device. For example, the first display device generates description information of the target event and sends the description information to the second display device for other second display devices. The device performs corresponding operations based on the description information. To avoid redundancy, this embodiment takes the first display device or the second display device as an example to introduce the operations that the display device needs to perform. However, those skilled in the art should know that the operations performed by the first display device can also be performed by the second display device. Execution, the operation performed by the second display device can also be performed by the first display device.
第一显示设备和第二显示设备之间可以通过广播的方式发送目标事件的描述信息,也可以通过端到端的方式发送目标事件的描述信息。The description information of the target event may be sent between the first display device and the second display device in a broadcast manner, or in an end-to-end manner.
一些实施例中,所述目标事件的描述信息包括以下至少一项:In some embodiments, the description information of the target event includes at least one of the following:
源端显示设备,指示所述描述信息的发送方,即指示目标事件的描述信息是哪个显示设备发送的;The source display device indicates the sender of the description information, that is, which display device sends the description information of the target event;
目标端显示设备,指示所述描述信息的接收方,即指示目标事件的描述信息是发送给哪个显示设备;The target display device indicates the recipient of the description information, that is, the display device to which the description information of the target event is sent;
数据类型,数据类型包括但不限于File、Event、Notify、Object这四种类型;Data type, data types include but are not limited to four types: File, Event, Notify, and Object;
数据优先级,表明目标事件处理的优先级;Data priority, indicating the priority of target event processing;
数据长度,数据payload的长度;Data length, the length of the data payload;
数据内容。Data content.
目标事件的描述信息可以包括上述信息中的一项,也可以包括上述信息 中的几项,在目标事件的描述信息包括目标端显示设备时,第一显示设备在接收到目标事件的描述信息后,判断自身是否为目标端显示设备,如果不是目标端显示设备,可以忽略该目标事件的描述信息;如果是目标端显示设备,则根据目标事件的描述信息执行相应的同步操作。The description information of the target event may include one item of the above information, or may include several items of the above information. When the description information of the target event includes the target display device, the first display device will receive the description information of the target event. , determine whether it is a target display device. If it is not a target display device, you can ignore the description information of the target event; if it is a target display device, perform corresponding synchronization operations based on the description information of the target event.
一些实施例中,所述显示描述信息包括数据类型和数据优先级;所述第一显示设备用于按照数据类型对所述描述信息进行排列,得到多个数据队列,并按照数据类型的优先级对所述多个数据队列进行排序;在每一所述数据队列中,按照数据的优先级对所述描述信息进行排序;按照所述数据队列中所述描述信息的顺序,根据所述描述信息执行同步操作。In some embodiments, the display description information includes data type and data priority; the first display device is used to arrange the description information according to the data type to obtain multiple data queues, and arrange the description information according to the priority of the data type. Sorting the plurality of data queues; in each data queue, sorting the description information according to the priority of data; according to the order of the description information in the data queue, according to the description information Perform synchronization operations.
如图4所示,在数据类型包括File、Event、Notify、Object这四种类型时,在每个显示设备侧维护有四个数据队列:File队列、Event队列、Notify队列、Object队列,如果接收到的目标事件的描述信息的数据类型为File队列,则将目标事件的描述信息存储在File队列中;如果接收到的目标事件的描述信息的数据类型为Event队列,则将目标事件的描述信息存储在Event队列中;如果接收到的目标事件的描述信息的数据类型为Notify队列,则将目标事件的描述信息存储在Notify队列中;如果接收到的目标事件的描述信息的数据类型为Object队列,则将目标事件的描述信息存储在Object队列中,每个数据队列采用先进先出的方式,每个数据队列具有不同的优先级,可以为每个数据队列配置优先级数值,比如在优先级数值越大时越优先,一具体示例中,可以是Object队列的优先级高于Event队列的优先级,Event队列的优先级高于Notify队列的优先级,Notify队列的优先级高于File队列的优先级。As shown in Figure 4, when the data types include File, Event, Notify, and Object, four data queues are maintained on each display device side: File queue, Event queue, Notify queue, and Object queue. If receiving The data type of the description information of the target event received is File queue, then the description information of the target event is stored in the File queue; if the data type of the description information of the target event received is Event queue, the description information of the target event is stored in the File queue. Stored in the Event queue; if the data type of the description information of the received target event is Notify queue, then the description information of the target event is stored in the Notify queue; if the data type of the description information of the received target event is Object queue , the description information of the target event is stored in the Object queue. Each data queue adopts a first-in, first-out method. Each data queue has a different priority. The priority value can be configured for each data queue, such as in the priority The larger the value, the higher the priority. In a specific example, the priority of the Object queue is higher than the priority of the Event queue, the priority of the Event queue is higher than the priority of the Notify queue, and the priority of the Notify queue is higher than the priority of the File queue. priority.
另外在每个数据队列中,可能存在多个目标事件的描述信息,根据数据的优先级的不同,多个目标事件的描述信息也按照优先级进行处理,比如在Object队列中,会优先处理高优先级的数据,如果数据的优先级都相同,则按照先入先出的方式进行数据的处理。通过优先级策略的调度,可以让某些紧急程序调用的数据优先处理,对于一些文件传输类的数据可以低优先级处理,满足用户需要,提高用户体验。In addition, in each data queue, there may be description information for multiple target events. Depending on the priority of the data, the description information for multiple target events will also be processed according to the priority. For example, in the Object queue, high-level data will be processed first. Priority data, if the data have the same priority, the data will be processed in a first-in, first-out manner. Through priority policy scheduling, data called by certain emergency programs can be processed first, and some file transfer data can be processed with low priority to meet user needs and improve user experience.
本实施例中,目标事件包括但不限于用户触发对显示设备(包括第一显 示设备和第二显示设备)的应用图标执行点击操作、用户触发对显示设备执行输入操作、用户触发对显示设备的目标媒体文件进行播放等,可以根据需要订阅需要获取的目标事件,在目标事件发生后,显示设备集合中的显示设备进行协作,实现应用同步、协同控制和/或媒体播放。In this embodiment, the target events include but are not limited to the user triggering a click operation on the application icon of the display device (including the first display device and the second display device), the user triggering an input operation on the display device, and the user triggering an input operation on the display device. To play target media files, etc., you can subscribe to target events that need to be obtained as needed. After the target event occurs, the display devices in the display device collection collaborate to achieve application synchronization, collaborative control, and/or media playback.
一具体实施例中,所述目标事件包括用户触发对所述第一显示设备的应用图标执行点击操作,In a specific embodiment, the target event includes a user triggering a click operation on an application icon of the first display device,
所述第二显示设备具体用于在显示界面显示所述第一显示设备的应用图标,接收用户针对所述应用图标的点击操作指令,根据所述点击操作指令生成所述描述信息,将所述描述信息发送给所述第一显示设备;The second display device is specifically configured to display the application icon of the first display device on a display interface, receive a user's click operation instruction for the application icon, generate the description information according to the click operation instruction, and convert the The description information is sent to the first display device;
所述第一显示设备具体用于根据所述描述信息打开与所述应用图标对应的应用的界面;The first display device is specifically configured to open an interface of an application corresponding to the application icon according to the description information;
所述第一显示设备还用于向所述第二显示设备反馈所述应用的状态信息;The first display device is also configured to feed back the status information of the application to the second display device;
所述第二显示设备还用于根据所述状态信息将所述应用图标标记为已打开。The second display device is further configured to mark the application icon as opened according to the status information.
如图5所示,第二显示设备可以读取第一显示设备的所有应用,并能够在在自身显示界面将第一显示设备的应用图标显示出来,第二显示设备可以在显示界面上划定部分区域比如虚线框内圈出的部分显示所述第一显示设备的应用图标,以与第二显示设备自身的应用图标区分开;当然,第二显示设备也可以在显示界面的全部区域均用来显示第一显示设备的应用图标。本实施例中,第二显示设备可以为主显示设备,第一显示设备为从显示设备。As shown in Figure 5, the second display device can read all applications of the first display device, and can display the application icons of the first display device on its own display interface. The second display device can delineate the application icons on the display interface. Part of the area, such as the area circled in the dotted box, displays the application icon of the first display device to distinguish it from the application icon of the second display device itself; of course, the second display device can also use the application icon in all areas of the display interface. to display the application icon of the first display device. In this embodiment, the second display device may be a master display device, and the first display device may be a slave display device.
一具体示例中,第一显示设备和第二显示设备之间的通讯采用Object的数据类型,以list的方式进行传输,第二显示设备获得list后以通用的图标显示在专门为第一显示设备绘制的显示区域内,如图5所示,第二显示设备的显示界面上显示第一显示设备的应用图标1、应用图标2、应用图标3、应用图标4、应用图标5、应用图标6。此时如果用户在第二显示设备的显示界面上点击应用图标1、应用图标2、应用图标3、应用图标4、应用图标5、应用图标6中的任一者,视为接收到用户针对应用图标的点击操作指令,根据 该点击操作指令生成描述信息,将描述信息通知给第一显示设备,描述信息指示对应的应用需要打开,第一显示设备接收到描述信息之后,打开应用图标对应的应用的界面,并可以以通知消息的形式向第二显示设备反馈一个状态,第二显示设备在收到通知消息后将应用图标标记为已打开,或者,第二显示设备可以直接在接收到用户针对应用图标的点击操作指令后,将对应的应用图标标记为已打开。另外,第二显示设备可以将目标事件的描述信息发送给其他的显示设备,实现显示设备间的应用同步。In a specific example, the communication between the first display device and the second display device adopts the data type of Object and is transmitted in the form of a list. After the second display device obtains the list, it displays it as a general icon on the list specifically for the first display device. In the drawn display area, as shown in Figure 5, application icons 1, 2, 3, 4, 5 and 6 of the first display device are displayed on the display interface of the second display device. At this time, if the user clicks any one of application icon 1, application icon 2, application icon 3, application icon 4, application icon 5, and application icon 6 on the display interface of the second display device, it is deemed that the user's request for the application has been received. The click operation instruction of the icon generates description information according to the click operation instruction, and notifies the first display device of the description information. The description information indicates that the corresponding application needs to be opened. After receiving the description information, the first display device opens the application corresponding to the application icon. interface, and can feed back a status to the second display device in the form of a notification message. After receiving the notification message, the second display device marks the application icon as open, or the second display device can directly receive the user's After the click operation instruction of the application icon is executed, the corresponding application icon is marked as opened. In addition, the second display device can send the description information of the target event to other display devices to achieve application synchronization between display devices.
本实施例中,第二显示设备可以显示多个第一显示设备的应用图标,比如第二显示设备与N个第一显示设备通信,第二显示设备的显示界面可以划分为N个显示区域,在第一个显示区域显示第一个第一显示设备的应用图标,在第二个显示区域显示第二个第一显示设备的应用图标,以此类推,N为大于等于2的整数。这样通过第二显示设备的显示界面,可以对一个或多个第一显示设备的应用图标进行操作,在多个显示设备之间实现应用同步。In this embodiment, the second display device can display application icons of multiple first display devices. For example, the second display device communicates with N first display devices, and the display interface of the second display device can be divided into N display areas. The application icon of the first first display device is displayed in the first display area, the application icon of the second first display device is displayed in the second display area, and so on, N is an integer greater than or equal to 2. In this way, through the display interface of the second display device, the application icons of one or more first display devices can be operated, thereby realizing application synchronization between multiple display devices.
一具体实施例中,所述目标事件包括用户触发对所述第二显示设备执行输入操作,所述目标事件的描述信息包括所述输入操作输入的内容,所述第二显示设备具体用于在自身的显示界面显示所述输入操作输入的内容,并根据所述输入的内容生成所述描述信息,将所述描述信息发送给所述第一显示设备;In a specific embodiment, the target event includes a user triggering an input operation on the second display device, the description information of the target event includes the content input by the input operation, and the second display device is specifically used to perform an input operation on the second display device. Display the content input by the input operation on its own display interface, generate the description information based on the input content, and send the description information to the first display device;
所述第一显示设备具体用于接收所述描述信息,在自身的显示界面同步显示所述输入操作输入的内容。The first display device is specifically configured to receive the description information and synchronously display the content input by the input operation on its own display interface.
本实施例中,显示设备可以与用户之间进行交互,显示设备之间可以同步与用户的交互事件。比如在用户触发对所述第二显示设备执行输入操作时,第二显示设备接收用户输入的内容,在自身显示界面显示用户输入的内容,并将用户输入的内容作为目标事件的描述信息发送给第一显示设备,第一显示设备在接收目标事件的描述信息后,在自身的显示界面上显示所述输入操作输入的内容。In this embodiment, the display device can interact with the user, and the display devices can synchronize interaction events with the user. For example, when the user triggers an input operation on the second display device, the second display device receives the content input by the user, displays the content input by the user on its own display interface, and sends the content input by the user as the description information of the target event to The first display device, after receiving the description information of the target event, displays the content input by the input operation on its own display interface.
一具体示例中,所述输入操作输入的内容为用户书写的笔迹。如图6所示,在用户通过书写白板软件执行输入操作时,通过本实施例的技术方案可 以将用户的书写笔迹进行实时的同步。如图6所示,在第二显示设备上启动手写白板软件,用户通过触摸屏进行书写,白板软件将笔迹绘制到相应区域,同时,第二显示设备可以将用户输入的内容作为目标事件的描述信息通过输入事件Input Event发送给第一显示设备,第一显示设备模拟一个uinput设备,第一显示设备上运行的白板软件将其绘制在第一显示设备的显示界面的相关区域中。In a specific example, the content input by the input operation is the user's handwriting. As shown in Figure 6, when the user performs an input operation through the writing whiteboard software, the user's handwriting can be synchronized in real time through the technical solution of this embodiment. As shown in Figure 6, the handwriting whiteboard software is started on the second display device. The user writes through the touch screen, and the whiteboard software draws the handwriting to the corresponding area. At the same time, the second display device can use the content input by the user as the description information of the target event. The input event is sent to the first display device through the input event. The first display device simulates a uinput device, and the whiteboard software running on the first display device draws it in the relevant area of the display interface of the first display device.
本实施例中,第一显示设备可以在显示界面上划定部分区域显示用户在第二显示设备上输入的内容,以与第一显示设备自身的显示内容区分开,当然,第一显示设备也可以在显示界面的全部区域均用来显示用户在第二显示设备上输入的内容。In this embodiment, the first display device can delimit a portion of the display interface to display the content input by the user on the second display device to distinguish it from the display content of the first display device itself. Of course, the first display device can also All areas of the display interface can be used to display content input by the user on the second display device.
本实施例中,第一显示设备可以显示多个第二显示设备的输入内容,比如第一显示设备与N个第二显示设备通信,第一显示设备的显示界面可以划分为N个显示区域,在第一个显示区域显示第一个第二显示设备的输入内容,在第二个显示区域显示第二个第二显示设备的输入内容,以此类推,N为大于等于2的整数。这样通过第一显示设备的显示界面,可以对一个或多个第二显示设备的输入内容进行显示,在多个显示设备之间实现显示内容的同步。In this embodiment, the first display device can display the input content of multiple second display devices. For example, the first display device communicates with N second display devices, and the display interface of the first display device can be divided into N display areas. The input content of the first second display device is displayed in the first display area, the input content of the second second display device is displayed in the second display area, and so on, N is an integer greater than or equal to 2. In this way, the input content of one or more second display devices can be displayed through the display interface of the first display device, thereby achieving synchronization of display content between multiple display devices.
本实施例中,第一显示设备可以为显示设备集合中的主显示设备,第二显示设备为显示设备集合中的从显示设备;当然,第一显示设备还可以为显示设备集合中的从显示设备,第二显示设备可以为显示设备集合中的主显示设备。In this embodiment, the first display device may be a master display device in the display device set, and the second display device may be a slave display device in the display device set; of course, the first display device may also be a slave display device in the display device set. device, the second display device may be the main display device in the display device set.
一些实施例中,所述屏幕信息同步系统为黑板系统,通过本公开的技术方案可以实现黑板系统中多个黑板的书写操作的同步。In some embodiments, the screen information synchronization system is a blackboard system, and the technical solution of the present disclosure can realize synchronization of writing operations on multiple blackboards in the blackboard system.
一具体实施例中,所述目标事件包括用户触发对第一显示设备的第一目标媒体文件执行播放操作,In a specific embodiment, the target event includes the user triggering a playback operation on the first target media file of the first display device,
所述第二显示设备具体用于在显示界面显示所述第一目标媒体文件,接收用户针对所述第一目标媒体文件的播放操作指令,根据所述播放操作指令更新所述第一目标媒体文件的播放状态,根据所述第一目标媒体文件的播放状态生成所述描述信息;The second display device is specifically configured to display the first target media file on a display interface, receive a user's playback operation instruction for the first target media file, and update the first target media file according to the playback operation instruction. The playback status of the first target media file is used to generate the description information according to the playback status of the first target media file;
所述第一显示设备具体用于根据所述描述信息控制所述第一目标媒体文件的播放状态。The first display device is specifically configured to control the playback state of the first target media file according to the description information.
本实施例中,在第一显示设备和第二显示设备之间可以实现文件列表和文件的共享,进而可以实现媒体文件的跨设备播放,其中,媒体文件包括但不限于音频、视频和图片。本实施例中,可以在第二显示设备上查看任意第一显示设备上的媒体文件列表,使用Object类型中的list数据,用户可以在第二显示设备控制第一显示设备播放某个目标媒体文件,为了进行区分,称为第一目标媒体文件,第二显示设备接收用户针对所述第一目标媒体文件的播放操作指令后,可以控制该第一目标媒体文件的播放、停止、暂停、快进、快退等播放状态,更新第一目标媒体文件的播放状态,根据第一目标媒体文件的播放状态生成所述描述信息,将描述信息同步给第一显示设备,从而实现显示设备间的播放同步。描述信息可以是通过第二显示设备向第一显示设备发送Notify事件实现,同时,第二显示设备上显示第一目标媒体文件的播放状态,这些状态信息是第一显示设备向第二显示设备发送Notify事件来实现的,如图7所示。In this embodiment, file lists and files can be shared between the first display device and the second display device, thereby enabling cross-device playback of media files, where the media files include but are not limited to audio, video, and pictures. In this embodiment, the list of media files on any first display device can be viewed on the second display device. Using the list data in the Object type, the user can control the first display device to play a certain target media file on the second display device. , in order to distinguish, it is called the first target media file. After receiving the user's playback operation instruction for the first target media file, the second display device can control the playback, stop, pause, and fast forward of the first target media file. , rewind and other playback states, update the playback state of the first target media file, generate the description information according to the playback state of the first target media file, and synchronize the description information to the first display device, thereby achieving playback synchronization between display devices. . The description information may be implemented by sending a Notify event from the second display device to the first display device. At the same time, the playback status of the first target media file is displayed on the second display device. This status information is sent by the first display device to the second display device. Notify event is implemented, as shown in Figure 7.
在第一显示设备上播放第一目标媒体文件后,可以将第一目标媒体文件的播放状态发送给第二显示设备,包括但不限于:第一目标媒体文件是处于播放、停止、快进、快退等状态,在处于播放状态时的播放时长,在处于停止状态时对应的播放时长、在处于快进状态时快进的倍率以及对应的播放时长、在处于快退状态时快退的倍率以及对应的播放时长等,第二显示设备在接收到第一目标媒体文件的播放状态后,根据用户输入的播放操作指令更新第一目标媒体文件的播放状态,比如第一目标媒体文件的初始状态是处于播放状态,用户输入快进的播放操作指令后,第二显示设备更新第一目标媒体文件的播放状态为快进,并确定对应的播放时长,将快进状态和对应的播放时长作为描述信息发送给第一显示设备,第一显示设备可以根据描述信息控制第一目标媒体文件的播放状态。再比如第一目标媒体文件的初始状态是处于暂停状态,用户输入指示播放的播放操作指令后,第二显示设备更新第一目标媒体文件的播放状态为播放,并确定对应的播放时长,将播放状态和对 应的播放时长作为描述信息发送给第一显示设备,第一显示设备可以根据描述信息控制第一目标媒体文件的播放状态。After playing the first target media file on the first display device, the playback status of the first target media file can be sent to the second display device, including but not limited to: whether the first target media file is in play, stop, fast forward, Fast rewind and other states, the playback duration when in the playback state, the corresponding playback duration when in the stop state, the fast forward magnification when in the fast forward state and the corresponding playback duration, and the fast rewind magnification when in the fast rewind state And the corresponding playback duration, etc., after receiving the playback status of the first target media file, the second display device updates the playback status of the first target media file according to the playback operation instruction input by the user, such as the initial status of the first target media file. is in the playback state. After the user inputs a fast-forward playback operation instruction, the second display device updates the playback state of the first target media file to fast-forward, determines the corresponding playback duration, and uses the fast-forward state and the corresponding playback duration as descriptions. The information is sent to the first display device, and the first display device can control the playback state of the first target media file according to the description information. For another example, the initial state of the first target media file is in a paused state. After the user inputs a playback operation instruction instructing playback, the second display device updates the playback status of the first target media file to play, determines the corresponding playback duration, and plays the file. The status and corresponding playback duration are sent to the first display device as description information, and the first display device can control the playback status of the first target media file based on the description information.
本实施例中,第二显示设备可以在显示界面上划定部分区域显示第一目标媒体文件的播放控制界面(包括暂停、播放、快进、快退等按钮),以与第二显示设备自身的显示内容区分开,当然,第二显示设备也可以在显示界面的全部区域均用来显示第一目标媒体文件的播放控制界面。In this embodiment, the second display device can delimit a portion of the display interface to display the playback control interface (including pause, play, fast forward, rewind, etc. buttons) of the first target media file to communicate with the second display device itself. of course, the second display device can also be used to display the playback control interface of the first target media file in all areas of the display interface.
本实施例中,第二显示设备可以显示多个第一显示设备的第一目标媒体文件的播放控制界面,比如第二显示设备与N个第一显示设备通信,第二显示设备的显示界面可以划分为N个显示区域,在第一个显示区域显示第一个第一显示设备的第一目标媒体文件的播放控制界面,在第二个显示区域显示第二个第一显示设备的第一目标媒体文件的播放控制界面,以此类推,N为大于等于2的整数。这样通过第二显示设备的显示界面,可以对一个或多个第一显示设备的第一目标媒体文件的播放状态进行控制,在多个显示设备之间实现媒体文件的共享、协同控制和播放。In this embodiment, the second display device can display the playback control interface of the first target media file of multiple first display devices. For example, the second display device communicates with N first display devices, and the display interface of the second display device can Divided into N display areas, the first display area displays the playback control interface of the first target media file of the first first display device, and the second display area displays the first target of the second first display device. The playback control interface of media files, and so on, N is an integer greater than or equal to 2. In this way, through the display interface of the second display device, the playback status of the first target media file of one or more first display devices can be controlled, and the sharing, collaborative control and playback of media files can be realized between multiple display devices.
本实施例中,第二显示设备可以为显示设备集合中的主显示设备,第一显示设备可以为显示设备集合中的从显示设备。In this embodiment, the second display device may be a master display device in the display device set, and the first display device may be a slave display device in the display device set.
一些实施例中,所述目标事件包括用户触发对第二目标媒体文件执行播放操作,所述第二目标媒体文件拆分为多个子目标媒体文件,不同子目标媒体文件包括不同子画面区域的媒体数据,多个子画面区域拼接成完成的显示画面,In some embodiments, the target event includes a user triggering a playback operation on a second target media file. The second target media file is split into multiple sub-target media files, and different sub-target media files include media in different sub-picture areas. Data, multiple sub-picture areas are spliced into a completed display screen,
所述第二显示设备具体用于播放所述多个子目标媒体文件中的第二子目标媒体文件,接收用户针对所述第二子目标媒体文件的播放操作指令,根据所述播放操作指令更新所述第二子目标媒体文件的播放状态,根据所述第二子目标媒体文件的播放状态生成所述描述信息;The second display device is specifically configured to play a second sub-target media file among the plurality of sub-target media files, receive a user's playback operation instruction for the second sub-target media file, and update the playback operation instruction according to the playback operation instruction. The playback status of the second sub-target media file is generated according to the playback status of the second sub-target media file;
所述第一显示设备具体用于播放所述多个子目标媒体文件中的第一子目标媒体文件,根据所述描述信息控制所述第一子目标媒体文件的播放状态。The first display device is specifically configured to play a first sub-target media file among the plurality of sub-target media files, and control the play status of the first sub-target media file according to the description information.
多个显示设备的显示屏可以拼接在一起进行画面显示,一具体示例中,如图8所示,显示设备集合包括第一显示设备和两个第二显示设备,第一显 示设备的显示屏可以作为主显示屏,第二显示设备的显示屏可以作为副显示屏,每一显示屏显示画面的一部分,拼接进行大的画面的显示。在利用多个显示设备播放第二目标媒体文件时,可以按照显示设备的显示屏的尺寸比例对第二目标媒体文件的数据进行拆分,使得每一显示设备对应的子目标媒体文件的子画面显示区域的尺寸与显示设备的显示屏的尺寸成正比,显示设备的显示屏的尺寸越大,显示的子画面显示区域的尺寸越大。The display screens of multiple display devices can be spliced together for screen display. In a specific example, as shown in Figure 8, the display device set includes a first display device and two second display devices. The display screen of the first display device can As the main display screen, the display screen of the second display device can be used as the secondary display screen. Each display screen displays a part of the picture and is spliced to display a large picture. When multiple display devices are used to play the second target media file, the data of the second target media file can be split according to the size ratio of the display screen of the display device, so that the sub-screen of the sub-target media file corresponding to each display device The size of the display area is proportional to the size of the display screen of the display device. The larger the size of the display screen of the display device, the larger the size of the displayed sub-picture display area.
在第二显示设备播放对应的子目标媒体文件时,根据用户输入的播放操作指令控制子目标媒体文件的播放状态,包括但不限于:第二目标媒体文件是处于播放、停止、快进、快退等状态,在处于播放状态时的播放时长,在处于停止状态时对应的播放时长、在处于快进状态时快进的倍率以及对应的播放时长、在处于快退状态时快退的倍率以及对应的播放时长等,并根据子目标媒体文件的播放状态生成所述描述信息,将描述信息通过Event消息发送给第一显示设备,第一显示设备根据描述信息控制对应的子目标媒体文件的播放状态,从而实现多个显示设备间的播放同步。When the second display device plays the corresponding sub-target media file, the playback state of the sub-target media file is controlled according to the playback operation instruction input by the user, including but not limited to: whether the second target media file is in play, stop, fast forward, fast Rewind state, the playback duration when in the playback state, the corresponding playback duration when in the stop state, the fast forward magnification and corresponding playback duration when in the fast forward state, the fast rewind magnification when in the fast rewind state, and The corresponding playback duration, etc., and the description information is generated according to the playback status of the sub-target media file, and the description information is sent to the first display device through an Event message. The first display device controls the playback of the corresponding sub-target media file based on the description information. status to achieve playback synchronization between multiple display devices.
本实施例中,第二显示设备可以为显示设备集合中的主显示设备,第一显示设备可以为显示设备集合中的从显示设备。或者,第一显示设备可以为显示设备集合中的主显示设备,第二显示设备可以为显示设备集合中的从显示设备。In this embodiment, the second display device may be a master display device in the display device set, and the first display device may be a slave display device in the display device set. Alternatively, the first display device may be a master display device in the display device set, and the second display device may be a slave display device in the display device set.
本公开的实施例还提供了一种显示设备,如图10所示,包括处理器32和存储器31,所述存储器31存储可在所述处理器32上运行的程序或指令,所述程序或指令被所述处理器32执行时实现如上所述的屏幕信息同步方法的步骤。An embodiment of the present disclosure also provides a display device, as shown in Figure 10, including a processor 32 and a memory 31. The memory 31 stores programs or instructions that can be run on the processor 32. The program or When the instructions are executed by the processor 32, the steps of the screen information synchronization method as described above are implemented.
该显示设备为第一显示设备时,所述存储器31存储可在所述处理器32上运行的程序或指令,所述程序或指令被所述处理器32执行时实现如上所述第一显示设备侧的屏幕信息同步方法的步骤。When the display device is a first display device, the memory 31 stores programs or instructions that can be run on the processor 32. When the programs or instructions are executed by the processor 32, the first display device is implemented as described above. Side screen information synchronization method steps.
该显示设备为第二显示设备时,所述存储器31存储可在所述处理器32上运行的程序或指令,所述程序或指令被所述处理器32执行时实现如上所述第二显示设备侧的屏幕信息同步方法的步骤。When the display device is a second display device, the memory 31 stores programs or instructions that can be run on the processor 32. When the programs or instructions are executed by the processor 32, the second display device is implemented as described above. Side screen information synchronization method steps.
本公开的实施例还提供了一种可读存储介质,所述可读存储介质上存储程序或指令,所述程序或指令被处理器执行时实现如上所述的屏幕信息同步方法的步骤。Embodiments of the present disclosure also provide a readable storage medium on which programs or instructions are stored. When the programs or instructions are executed by a processor, the steps of the screen information synchronization method as described above are implemented.
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储待检测终端设备或任何其他非传输介质,可用于存储可以被计算待检测终端设备访问的信息。按照本文中的界定,计算机可读介质不包括暂存电脑可读媒体(transitory media),如调制的数据信号和载波。Computer-readable media includes both persistent and non-volatile, removable and non-removable media that can be implemented by any method or technology for storage of information. Information may be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), and read-only memory. (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, Magnetic tape cassettes, tape magnetic disk storage or other magnetic storage terminal devices or any other non-transmission medium may be used to store information that can be accessed by a computing terminal device. As defined in this article, computer-readable media does not include transitory media, such as modulated data signals and carrier waves.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。此外,需要指出的是,本申请实施方式中的方法和装置的范围不限按示出或讨论的顺序来执行功能,还可包括根据所涉及的功能按基本同时的方式或按相反的顺序来执行功能,例如,可以按不同于所描述的次序来执行所描述的方法,并且还可以添加、省去、或组合各种步骤。另外,参照某些示例所描述的特征可在其他示例中被组合。It should be noted that, in this document, the terms "comprising", "comprises" or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article or device that includes a series of elements not only includes those elements, It also includes other elements not expressly listed or inherent in the process, method, article or apparatus. Without further limitation, an element defined by the statement "comprises a..." does not exclude the presence of additional identical elements in a process, method, article or apparatus that includes that element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, but may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved. Functions may be performed, for example, the methods described may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以计算机软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁 碟、光盘)中,包括若干指令用以使得一台终端(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本申请各个实施例所述的方法。Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better. implementation. Based on this understanding, the technical solution of the present application can be embodied in the form of a computer software product that is essentially or contributes to the existing technology. The computer software product is stored in a storage medium (such as ROM/RAM, disk , CD), including several instructions to cause a terminal (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in various embodiments of this application.
上面结合附图对本申请的实施例进行了描述,但是本申请并不局限于上述的具体实施方式,上述的具体实施方式仅仅是示意性的,而不是限制性的,本领域的普通技术人员在本申请的启示下,在不脱离本申请宗旨和权利要求所保护的范围情况下,还可做出很多形式,均属于本申请的保护之内。The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above-mentioned specific implementations. The above-mentioned specific implementations are only illustrative and not restrictive. Those of ordinary skill in the art will Inspired by this application, many forms can be made without departing from the purpose of this application and the scope protected by the claims, all of which fall within the protection of this application.

Claims (25)

  1. 一种屏幕信息同步系统,其特征在于,包括第一显示设备和第二显示设备,所述第一显示设备和第一显示设备通信连接,A screen information synchronization system, characterized by including a first display device and a second display device, the first display device and the first display device being communicatively connected,
    所述第二显示设备,用于向所述第一显示设备发送目标事件的描述信息;The second display device is configured to send description information of the target event to the first display device;
    所述第一显示设备,用于接收所述第二显示设备发送的目标事件的描述信息,并根据所述描述信息执行同步操作。The first display device is configured to receive the description information of the target event sent by the second display device, and perform a synchronization operation according to the description information.
  2. 根据权利要求1所述的屏幕信息同步系统,其特征在于,所述第一显示设备通过无线通信与所述第二显示设备连接。The screen information synchronization system according to claim 1, wherein the first display device is connected to the second display device through wireless communication.
  3. 根据权利要求1所述的屏幕信息同步系统,其特征在于,The screen information synchronization system according to claim 1, characterized in that:
    所述第一显示设备还用于向所述第二显示设备发送订阅请求,指示获取所述目标事件的描述信息;The first display device is further configured to send a subscription request to the second display device, indicating to obtain the description information of the target event;
    所述第二显示设备还用于接收所述订阅请求。The second display device is also configured to receive the subscription request.
  4. 根据权利要求3所述的屏幕信息同步系统,其特征在于,The screen information synchronization system according to claim 3, characterized in that:
    所述第二显示设备还用于向所述第一显示设备发送目标事件的列表,所述目标事件的列表包括至少一个目标事件的标识;The second display device is further configured to send a list of target events to the first display device, where the list of target events includes an identification of at least one target event;
    所述第一显示设备还用于接收所述列表。The first display device is also configured to receive the list.
  5. 根据权利要求1所述的屏幕信息同步系统,其特征在于,所述目标事件的描述信息包括以下至少一项:The screen information synchronization system according to claim 1, wherein the description information of the target event includes at least one of the following:
    源端显示设备,指示所述描述信息的发送方;The source display device indicates the sender of the description information;
    目标端显示设备,指示所述描述信息的接收方;The target display device indicates the recipient of the description information;
    数据类型;type of data;
    数据优先级;data priority;
    数据长度;Data length;
    数据内容。Data content.
  6. 根据权利要求5所述的屏幕信息同步系统,其特征在于,所述显示描述信息包括数据类型和数据优先级;The screen information synchronization system according to claim 5, wherein the display description information includes data type and data priority;
    所述第一显示设备用于按照数据类型对所述描述信息进行排列,得到多 个数据队列,并按照数据类型的优先级对所述多个数据队列进行排序;在每一所述数据队列中,按照数据的优先级对所述描述信息进行排序;按照所述数据队列中所述描述信息的顺序,根据所述描述信息执行同步操作。The first display device is used to arrange the description information according to the data type, obtain multiple data queues, and sort the multiple data queues according to the priority of the data type; in each of the data queues , sort the description information according to the priority of data; perform synchronization operations according to the description information in the order of the description information in the data queue.
  7. 根据权利要求1所述的屏幕信息同步系统,其特征在于,所述目标事件包括用户触发对所述第一显示设备的应用图标执行点击操作,The screen information synchronization system according to claim 1, wherein the target event includes a user triggering a click operation on an application icon of the first display device,
    所述第二显示设备具体用于在显示界面显示所述第一显示设备的应用图标,接收用户针对所述应用图标的点击操作指令,根据所述点击操作指令生成所述描述信息,将所述描述信息发送给所述第一显示设备;The second display device is specifically configured to display the application icon of the first display device on a display interface, receive a user's click operation instruction for the application icon, generate the description information according to the click operation instruction, and convert the The description information is sent to the first display device;
    所述第一显示设备具体用于根据所述描述信息打开与所述应用图标对应的应用的界面;The first display device is specifically configured to open an interface of an application corresponding to the application icon according to the description information;
    所述第一显示设备还用于向所述第二显示设备反馈所述应用的状态信息;The first display device is also configured to feed back the status information of the application to the second display device;
    所述第二显示设备还用于根据所述状态信息将所述应用图标标记为已打开。The second display device is further configured to mark the application icon as opened according to the status information.
  8. 根据权利要求1所述的屏幕信息同步系统,其特征在于,所述目标事件包括用户触发对所述第二显示设备执行输入操作,所述目标事件的描述信息包括所述输入操作输入的内容;The screen information synchronization system according to claim 1, wherein the target event includes a user triggering an input operation on the second display device, and the description information of the target event includes the content input by the input operation;
    所述第二显示设备具体用于在自身的显示界面显示所述输入操作输入的内容,并根据所述输入的内容生成所述描述信息,将所述描述信息发送给所述第一显示设备;The second display device is specifically configured to display the content input by the input operation on its own display interface, generate the description information according to the input content, and send the description information to the first display device;
    所述第一显示设备具体用于接收所述描述信息,在自身的显示界面同步显示所述输入操作输入的内容。The first display device is specifically configured to receive the description information and synchronously display the content input by the input operation on its own display interface.
  9. 根据权利要求8所述的屏幕信息同步系统,其特征在于,所述输入操作输入的内容为用户书写的笔迹。The screen information synchronization system according to claim 8, wherein the content input by the input operation is the user's handwriting.
  10. 根据权利要求1所述的屏幕信息同步系统,其特征在于,所述目标事件包括用户触发对第一显示设备的第一目标媒体文件执行播放操作,The screen information synchronization system according to claim 1, wherein the target event includes a user triggering a playback operation on the first target media file of the first display device,
    所述第二显示设备具体用于在显示界面显示所述第一目标媒体文件,接收用户针对所述第一目标媒体文件的播放操作指令,根据所述播放操作指令 更新所述第一目标媒体文件的播放状态,根据所述第一目标媒体文件的播放状态生成所述描述信息;The second display device is specifically configured to display the first target media file on a display interface, receive a user's playback operation instruction for the first target media file, and update the first target media file according to the playback operation instruction. The playback status of the first target media file is used to generate the description information according to the playback status of the first target media file;
    所述第一显示设备具体用于根据所述描述信息控制所述第一目标媒体文件的播放状态。The first display device is specifically configured to control the playback state of the first target media file according to the description information.
  11. 根据权利要求1所述的屏幕信息同步系统,其特征在于,所述目标事件包括用户触发对第二目标媒体文件执行播放操作,所述第二目标媒体文件拆分为多个子目标媒体文件,不同子目标媒体文件包括不同子画面区域的媒体数据,多个子画面区域拼接成完成的显示画面,The screen information synchronization system according to claim 1, wherein the target event includes a user triggering a playback operation on a second target media file, and the second target media file is split into multiple sub-target media files. The sub-target media file includes media data of different sub-picture areas, and multiple sub-picture areas are spliced into a completed display screen.
    所述第二显示设备具体用于播放所述多个子目标媒体文件中的第二子目标媒体文件,接收用户针对所述第二子目标媒体文件的播放操作指令,根据所述播放操作指令更新所述第二子目标媒体文件的播放状态,根据所述第二子目标媒体文件的播放状态生成所述描述信息;The second display device is specifically configured to play a second sub-target media file among the plurality of sub-target media files, receive a user's playback operation instruction for the second sub-target media file, and update the playback operation instruction according to the playback operation instruction. The playback status of the second sub-target media file is generated according to the playback status of the second sub-target media file;
    所述第一显示设备具体用于播放所述多个子目标媒体文件中的第一子目标媒体文件,根据所述描述信息控制所述第一子目标媒体文件的播放状态。The first display device is specifically configured to play a first sub-target media file among the plurality of sub-target media files, and control the play status of the first sub-target media file according to the description information.
  12. 根据权利要求11所述的屏幕信息同步系统,其特征在于,每一显示设备对应的子目标媒体文件的子画面显示区域的尺寸与显示设备的显示屏的尺寸成正比。The screen information synchronization system according to claim 11, characterized in that the size of the sub-picture display area of the sub-target media file corresponding to each display device is proportional to the size of the display screen of the display device.
  13. 根据权利要求1-12中任一项所述的屏幕信息同步系统,其特征在于,所述第一显示设备和所述第二显示设备组成的显示设备集合中包括一主显示设备和至少一个从显示设备,所述主显示设备通过无线通信与网络和所述从显示设备通信连接,所述从显示设备通过无线通信与所述主显示设备通信连接。The screen information synchronization system according to any one of claims 1 to 12, wherein the display device set composed of the first display device and the second display device includes a master display device and at least one slave display device. Display device, the master display device is communicatively connected to the network through wireless communication, and the slave display device is communicatively connected to the master display device through wireless communication.
  14. 根据权利要求1-12中任一项所述的屏幕信息同步系统,其特征在于,所述屏幕信息同步系统为黑板系统。The screen information synchronization system according to any one of claims 1-12, characterized in that the screen information synchronization system is a blackboard system.
  15. 一种屏幕信息同步方法,其特征在于,应用于如权利要求1-14中任一项所述的屏幕信息同步系统,所述方法包括:A screen information synchronization method, characterized in that it is applied to the screen information synchronization system according to any one of claims 1-14, and the method includes:
    第二显示设备向第一显示设备发送目标事件的描述信息;The second display device sends description information of the target event to the first display device;
    所述第一显示设备接收所述第二显示设备发送的目标事件的描述信息, 并根据所述描述信息执行同步操作。The first display device receives the description information of the target event sent by the second display device, and performs a synchronization operation according to the description information.
  16. 根据权利要求15所述的屏幕信息同步方法,其特征在于,所述方法还包括:The screen information synchronization method according to claim 15, characterized in that the method further includes:
    所述第一显示设备向所述第二显示设备发送订阅请求,指示获取所述目标事件的描述信息;The first display device sends a subscription request to the second display device, indicating to obtain the description information of the target event;
    所述第二显示设备接收所述订阅请求。The second display device receives the subscription request.
  17. 根据权利要求15所述的屏幕信息同步方法,其特征在于,所述方法还包括:The screen information synchronization method according to claim 15, characterized in that the method further includes:
    所述第二显示设备向所述第一显示设备发送目标事件的列表,所述目标事件的列表包括至少一个目标事件的标识;The second display device sends a list of target events to the first display device, where the list of target events includes an identification of at least one target event;
    所述第一显示设备接收所述列表。The first display device receives the list.
  18. 根据权利要求15所述的屏幕信息同步方法,其特征在于,所述目标事件的描述信息包括以下至少一项:The screen information synchronization method according to claim 15, wherein the description information of the target event includes at least one of the following:
    源端显示设备,指示所述描述信息的发送方;The source display device indicates the sender of the description information;
    目标端显示设备,指示所述描述信息的接收方;The target display device indicates the recipient of the description information;
    数据类型;type of data;
    数据优先级;data priority;
    数据长度;Data length;
    数据内容。Data content.
  19. 根据权利要求18所述的屏幕信息同步方法,其特征在于,所述显示描述信息包括数据类型和数据优先级,所述方法还包括:The screen information synchronization method according to claim 18, wherein the display description information includes data type and data priority, and the method further includes:
    所述第一显示设备按照数据类型对所述描述信息进行排列,得到多个数据队列,并按照数据类型的优先级对所述多个数据队列进行排序;在每一所述数据队列中,按照数据的优先级对所述描述信息进行排序;按照所述数据队列中所述描述信息的顺序,根据所述描述信息执行同步操作。The first display device arranges the description information according to data type to obtain multiple data queues, and sorts the multiple data queues according to the priority of the data type; in each of the data queues, according to The description information is sorted by the priority of the data; a synchronization operation is performed according to the description information in the order of the description information in the data queue.
  20. 根据权利要求15所述的屏幕信息同步方法,其特征在于,所述目标事件包括用户触发对所述第一显示设备的应用图标执行点击操作,所述方法具体包括:The screen information synchronization method according to claim 15, wherein the target event includes a user triggering a click operation on an application icon of the first display device, and the method specifically includes:
    所述第二显示设备在显示界面显示所述第一显示设备的应用图标,接收用户针对所述应用图标的点击操作指令,根据所述点击操作指令生成所述描述信息,将所述描述信息发送给所述第一显示设备;The second display device displays the application icon of the first display device on the display interface, receives the user's click operation instruction for the application icon, generates the description information according to the click operation instruction, and sends the description information to the first display device;
    所述第一显示设备根据所述描述信息打开与所述应用图标对应的应用的界面;The first display device opens an interface of the application corresponding to the application icon according to the description information;
    所述方法还包括:The method also includes:
    所述第一显示设备向所述第二显示设备反馈所述应用的状态信息;The first display device feeds back the status information of the application to the second display device;
    所述第二显示设备根据所述状态信息将所述应用图标标记为已打开。The second display device marks the application icon as opened according to the status information.
  21. 根据权利要求15所述的屏幕信息同步方法,其特征在于,所述目标事件包括用户触发对所述第二显示设备执行输入操作,所述目标事件的描述信息包括所述输入操作输入的内容;所述方法具体包括:The screen information synchronization method according to claim 15, wherein the target event includes a user triggering an input operation on the second display device, and the description information of the target event includes the content input by the input operation; The method specifically includes:
    所述第二显示设备在自身的显示界面显示所述输入操作输入的内容,并根据所述输入的内容生成所述描述信息,将所述描述信息发送给所述第一显示设备;The second display device displays the content input by the input operation on its own display interface, generates the description information based on the input content, and sends the description information to the first display device;
    所述第一显示设备接收所述描述信息,在自身的显示界面同步显示所述输入操作输入的内容。The first display device receives the description information and synchronously displays the content input by the input operation on its own display interface.
  22. 根据权利要求15所述的屏幕信息同步方法,其特征在于,所述目标事件包括用户触发对第一显示设备的第一目标媒体文件执行播放操作,所述方法具体包括:The screen information synchronization method according to claim 15, wherein the target event includes a user triggering a playback operation on the first target media file of the first display device, and the method specifically includes:
    所述第二显示设备在显示界面显示所述第一目标媒体文件,接收用户针对所述第一目标媒体文件的播放操作指令,根据所述播放操作指令更新所述第一目标媒体文件的播放状态,根据所述第一目标媒体文件的播放状态生成所述描述信息;The second display device displays the first target media file on a display interface, receives a user's playback operation instruction for the first target media file, and updates the playback status of the first target media file according to the playback operation instruction. , generate the description information according to the playback status of the first target media file;
    所述第一显示设备根据所述描述信息控制所述第一目标媒体文件的播放状态。The first display device controls the playback state of the first target media file according to the description information.
  23. 根据权利要求15所述的屏幕信息同步方法,其特征在于,所述目标事件包括用户触发对第二目标媒体文件执行播放操作,所述第二目标媒体文件拆分为多个子目标媒体文件,不同子目标媒体文件包括不同子画面区域的 媒体数据,多个子画面区域拼接成完成的显示画面,所述方法具体包括:The screen information synchronization method according to claim 15, wherein the target event includes a user triggering a playback operation on a second target media file, and the second target media file is split into multiple sub-target media files. The sub-target media file includes media data of different sub-picture areas, and multiple sub-picture areas are spliced into a completed display screen. The method specifically includes:
    所述第二显示设备播放所述多个子目标媒体文件中的第二子目标媒体文件,接收用户针对所述第二子目标媒体文件的播放操作指令,根据所述播放操作指令更新所述第二子目标媒体文件的播放状态,根据所述第二子目标媒体文件的播放状态生成所述描述信息;The second display device plays a second sub-target media file among the plurality of sub-target media files, receives a user's playback operation instruction for the second sub-target media file, and updates the second sub-target media file according to the playback operation instruction. The playback status of the sub-target media file, generating the description information according to the playback status of the second sub-target media file;
    所述第一显示设备播放所述多个子目标媒体文件中的第一子目标媒体文件,根据所述描述信息控制所述第一子目标媒体文件的播放状态。The first display device plays a first sub-target media file among the plurality of sub-target media files, and controls the play status of the first sub-target media file according to the description information.
  24. 一种显示设备,其特征在于,包括处理器和存储器,所述存储器存储可在所述处理器上运行的程序或指令,所述程序或指令被所述处理器执行时实现如权利要求15至23任一项所述的屏幕信息同步方法的步骤。A display device, characterized in that it includes a processor and a memory, the memory stores a program or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the implementation of claims 15 to 10 Steps of the screen information synchronization method described in any one of 23.
  25. 一种可读存储介质,其特征在于,所述可读存储介质上存储程序或指令,所述程序或指令被处理器执行时实现如权利要求15至23任一项所述的屏幕信息同步方法的步骤。A readable storage medium, characterized in that the readable storage medium stores programs or instructions, and when the programs or instructions are executed by a processor, the screen information synchronization method according to any one of claims 15 to 23 is implemented. A step of.
PCT/CN2022/095979 2022-05-30 2022-05-30 Screen information synchronization method and system WO2023230765A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2022/095979 WO2023230765A1 (en) 2022-05-30 2022-05-30 Screen information synchronization method and system
CN202280001573.9A CN117480487A (en) 2022-05-30 2022-05-30 Screen information synchronization method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/095979 WO2023230765A1 (en) 2022-05-30 2022-05-30 Screen information synchronization method and system

Publications (1)

Publication Number Publication Date
WO2023230765A1 true WO2023230765A1 (en) 2023-12-07

Family

ID=89026479

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/095979 WO2023230765A1 (en) 2022-05-30 2022-05-30 Screen information synchronization method and system

Country Status (2)

Country Link
CN (1) CN117480487A (en)
WO (1) WO2023230765A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101789955A (en) * 2009-12-25 2010-07-28 宇龙计算机通信科技(深圳)有限公司 Desktop sharing control method, device and mobile terminal
CN108055704A (en) * 2017-12-22 2018-05-18 广州视源电子科技股份有限公司 interaction control method, system, terminal and storage medium
US10853019B1 (en) * 2018-10-29 2020-12-01 BlueOwl, LLC Systems and methods for the secure synchronization of user interface state amongst computing devices
WO2022042326A1 (en) * 2020-08-31 2022-03-03 华为技术有限公司 Display control method and related apparatus
WO2022083296A1 (en) * 2020-10-22 2022-04-28 华为技术有限公司 Display method and electronic device
CN114442969A (en) * 2020-10-30 2022-05-06 华为技术有限公司 Inter-device screen cooperation method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101789955A (en) * 2009-12-25 2010-07-28 宇龙计算机通信科技(深圳)有限公司 Desktop sharing control method, device and mobile terminal
CN108055704A (en) * 2017-12-22 2018-05-18 广州视源电子科技股份有限公司 interaction control method, system, terminal and storage medium
US10853019B1 (en) * 2018-10-29 2020-12-01 BlueOwl, LLC Systems and methods for the secure synchronization of user interface state amongst computing devices
WO2022042326A1 (en) * 2020-08-31 2022-03-03 华为技术有限公司 Display control method and related apparatus
WO2022083296A1 (en) * 2020-10-22 2022-04-28 华为技术有限公司 Display method and electronic device
CN114442969A (en) * 2020-10-30 2022-05-06 华为技术有限公司 Inter-device screen cooperation method and device

Also Published As

Publication number Publication date
CN117480487A (en) 2024-01-30

Similar Documents

Publication Publication Date Title
US10936270B2 (en) Presentation facilitation
US9298362B2 (en) Method and apparatus for sharing media in a multi-device environment
US20240053879A1 (en) Object Drag Method and Device
KR101897603B1 (en) Apparatus and Method for displaying usage history of application between devices
US10496354B2 (en) Terminal device, screen sharing method, and screen sharing system
CN106572139B (en) Multi-terminal control method, terminal, server and system
TW201232388A (en) Coordination of animations across multiple applications or processes
US10277546B2 (en) Information processing system, information processing apparatus, and storage medium
US20100045567A1 (en) Systems and methods for facilitating presentation
US20240089529A1 (en) Content collaboration method and electronic device
WO2015176352A1 (en) Android system-based method and device for information exchange between applications
WO2024037418A1 (en) Display method and apparatus, electronic device, and readable storage medium
KR20160053462A (en) Terminal apparatus and method for controlling thereof
CN110752999B (en) Screen broadcasting method, device, system, electronic equipment and storage medium
WO2024114513A1 (en) Media content display method and apparatus, electronic device and storage medium
WO2024078516A1 (en) Media content display method and apparatus, device, and storage medium
KR101621496B1 (en) System and method of replaying presentation using touch event information
WO2023230765A1 (en) Screen information synchronization method and system
US10158594B2 (en) Group headers for differentiating conversation scope and exposing interactive tools
JP2011108087A (en) Data processing system, data processing method and data processing program
KR20110052817A (en) Method for providing contents to external apparatus
CN104380624A (en) Method of transmitting contents and user's interactions among multiple devices
WO2022242628A1 (en) Screen casting method, apparatus, and device, and storage medium
CA3224322A1 (en) Video playing method and apparatus, and storage medium
JP2016099773A (en) Terminal device, reproduction method, program, and image sharing system

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 202280001573.9

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22944107

Country of ref document: EP

Kind code of ref document: A1