CN114449203A - Conference teaching system, screen interaction method, electronic device and storage medium - Google Patents

Conference teaching system, screen interaction method, electronic device and storage medium Download PDF

Info

Publication number
CN114449203A
CN114449203A CN202210101260.2A CN202210101260A CN114449203A CN 114449203 A CN114449203 A CN 114449203A CN 202210101260 A CN202210101260 A CN 202210101260A CN 114449203 A CN114449203 A CN 114449203A
Authority
CN
China
Prior art keywords
image data
shared image
content
user
instruction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210101260.2A
Other languages
Chinese (zh)
Inventor
郑颖
张阳阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BOE Technology Group Co Ltd
Original Assignee
BOE Technology Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BOE Technology Group Co Ltd filed Critical BOE Technology Group Co Ltd
Priority to CN202210101260.2A priority Critical patent/CN114449203A/en
Publication of CN114449203A publication Critical patent/CN114449203A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Information Transfer Between Computers (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the application provides a conference teaching system, a screen interaction method, electronic equipment and a storage medium, wherein the conference teaching system comprises: a master device and a plurality of slave devices; a master device for transmitting shared image data to each slave device; the slave equipment is used for receiving and playing the shared image data sent by the master equipment; after a first instruction which is input by a user and indicates that a private note mode is started is obtained, a transparent window is created on a layer of shared image data; and acquiring the scribbling operation input by the user in the private note mode, and displaying the scribbling content corresponding to the scribbling operation in a transparent window of the user. The device can display the scribbled content of the user through the transparent window on the shared image data layer in the private note mode, and private display of the recorded content is achieved.

Description

Conference teaching system, screen interaction method, electronic device and storage medium
Technical Field
The application relates to the technical field of multi-screen interaction, in particular to a conference teaching system, a screen interaction method, electronic equipment and a storage medium.
Background
With the development of computer technology, especially the emergence of intelligent terminal equipment, teleconference, teaching are prevailing gradually, provide very big facility for people's work and study.
In the existing multi-screen interaction scene, in the process of screen interaction between main equipment and mobile equipment, the contents displayed on the screens of the equipment are all in a synchronous state, and the contents displayed on each equipment are the same. When the participators record ideas or learn notes on the display interface, the recorded contents can be synchronously displayed in all the devices of the conference teaching system.
However, in some scenarios, the user does not want to synchronize their own recording to all devices in the system, and therefore how to implement private display of the recorded content becomes an urgent problem to be solved.
Disclosure of Invention
An object of the embodiments of the present application is to provide a conference teaching system, a screen interaction method, an electronic device, and a storage medium, so as to implement private display of recorded content in a multi-screen interaction process. The specific technical scheme is as follows:
in a first aspect, an embodiment of the present application provides a meeting teaching system, including:
a master device and a plurality of slave devices;
the master device is used for sending shared image data to each slave device;
the slave device is used for receiving and playing the shared image data sent by the master device; after a first instruction which is input by a user and indicates that a private note mode is started is obtained, a transparent window is created on a layer of shared image data; and acquiring scribbling operation input by a user in a private note mode, and displaying scribbling content corresponding to the scribbling operation in the transparent window of the user.
In one possible implementation, the slave device is further configured to: after a second instruction which is input by a user and indicates that private note sharing is carried out is obtained, a target area to be shared is selected in the transparent window according to an area selection instruction input by the user; acquiring the coordinate of the target area in the transparent window to obtain a first area coordinate; sending the first area coordinate and the content of the target area to the main equipment;
the master device is further configured to: acquiring an identifier of slave equipment uploading the first area coordinate to obtain a target identifier; converting the first area coordinate into a second area coordinate in an image coordinate system of the shared image data; superposing the content of the target area to a second area coordinate of the shared image data to obtain updated shared image data; and sending the updated shared image data and the target identification to each slave device.
In one possible embodiment, the slave device is further configured to; judging whether the received target identification is the identification of the target identification; if the shared image data is the identifier of the shared image data, discarding the updated shared image data; if the shared image data is not the own identifier and the private note mode is not started, the updated shared image data is played; if the shared image data is not the own identity and the private note mode is started, the own screen content is stored, and the updated shared image data is played.
In one possible implementation, the slave device is further configured to: after a second instruction which is input by a user and indicates that private note sharing is carried out is obtained, a target area to be shared is selected in the transparent window according to an area selection instruction input by the user; acquiring the coordinate of the target area in the transparent window to obtain a first area coordinate; sending the first area coordinate and the content of the target area to the main equipment;
the master device is further configured to: acquiring an identifier of slave equipment uploading the first area coordinate to obtain a target identifier; sending the first area coordinate, the content of the target area and the target identification to each slave device;
the slave device is also used; judging whether the received target identifier is the identifier of the target identifier; if the first area coordinate is the identifier of the target area, discarding the first area coordinate and the content of the target area; if the first area coordinate is not the own identifier and the private note mode is not started, converting the first area coordinate into a third area coordinate in an image coordinate system of the own screen, and superposing the content of the target area on the third area coordinate of the own screen; if the first area coordinate is not the own identifier and the private note mode is started, saving the screen content of the self, converting the first area coordinate into a third area coordinate in an image coordinate system of the self screen, and overlaying the content of the target area onto the third area coordinate of the self screen.
In one possible implementation, the slave device is further configured to: after a third instruction which is input by a user and indicates that image storage is carried out is obtained, the time when the third instruction is input by the user is obtained to obtain a first time; subtracting a first preset time length from the first time length to obtain a second time length; and obtaining a first time period by taking the second time as a time period starting point and the first time as a time period ending point, and storing the screen content in the first time period.
In one possible implementation, the slave device is further configured to: acquiring the moment when the content of the latest shared image data changes to obtain a third moment; judging whether the difference value between the first moment and the third moment is greater than a second preset time length or not; if so, subtracting a first preset time length from the first time length to obtain a second time length; obtaining a first time period by taking the second time as a time period starting point and the first time as a time period ending point, and storing the screen content in the first time period; if the time duration is less than the preset time duration, displaying the screen content with the first preset time duration in a progress bar window mode, and responding to the operation of adjusting the progress of the progress bar window by a user to display the screen content with the first preset time duration in different time intervals; after a determination instruction of the user for the progress bar window is obtained, screen content of a first preset duration currently selected by the user is saved; and the second preset time length is greater than the first preset time length.
In one possible implementation, the master device is further configured to: when detecting that the content of the shared image data changes, sending a fourth instruction indicating that the content of the shared image data changes to each slave device;
the slave device is further configured to: and when a fourth instruction is received, saving the screen content of the user.
In one possible implementation, the master device is further configured to: when the annotation function of the master device is closed or the annotation content is cleared, a fifth instruction for storing the annotations is sent to each slave device;
the slave device is further configured to: and when a fifth instruction is received, saving the screen content of the user.
In one possible implementation, the slave device is further configured to: if the shared image data displayed by the user is in a state of starting the private note mode before the shared image data is changed, after the displayed shared image data is changed, after an instruction which is input by the user and indicates that a last saved file is displayed is obtained, displaying the latest saved screen content, and starting the private note mode.
In a second aspect, an embodiment of the present application provides a screen interaction method, which is applied to a slave device, and the method includes:
receiving and playing shared image data sent by the main equipment;
after a first instruction which is input by a user and indicates that a private note mode is started is obtained, a transparent window is created on a layer of shared image data;
and acquiring scribbling operation input by a user in a private note mode, and displaying scribbling content corresponding to the scribbling operation in the transparent window.
In one possible embodiment, the method further comprises:
after a second instruction which is input by a user and indicates that private note sharing is carried out is obtained, a target area to be shared is selected in the transparent window according to an area selection instruction input by the user;
acquiring the coordinate of the target area in the transparent window to obtain a first area coordinate;
and sending the first area coordinate and the content of the target area to the master device, so that the master device obtains updated shared image data according to the first area coordinate and the content of the target area, and sends the updated shared image data and a target identifier to the slave device, wherein the target identifier is the identifier of the slave device uploading the first area coordinate.
In one possible embodiment, the method further comprises;
judging whether the received target identification is the identification of the target identification;
if the shared image data is the identifier of the shared image data, discarding the updated shared image data;
if the shared image data is not the own identifier and the private note mode is not started, the updated shared image data is played; if the shared image data is not the own identifier and the private note mode is started, the own screen content is stored, and the updated shared image data is played.
In one possible embodiment, the method further comprises:
after a third instruction which is input by a user and indicates that image storage is carried out is obtained, the time when the third instruction is input by the user is obtained to obtain a first time;
subtracting a first preset time length from the first time to obtain a second time; and obtaining a first time period by taking the second time as a time period starting point and the first time as a time period ending point, and storing the screen content in the first time period.
In a possible implementation manner, the second time is obtained by subtracting a first preset time length from the first time; obtaining a first time period by taking the second time as a time period starting point and the first time as a time period ending point, and storing the screen content in the first time period, wherein the method comprises the following steps:
acquiring the moment when the content of the latest shared image data changes to obtain a third moment;
judging whether the difference value between the first moment and the third moment is greater than a second preset duration or not;
if so, subtracting a first preset time length from the first time length to obtain a second time length;
obtaining a first time period by taking the second time as a time period starting point and the first time as a time period ending point, and storing the screen content in the first time period;
the method further comprises the following steps:
if the time duration is less than the preset time duration, displaying the screen content with the first preset time duration in a progress bar window mode, and responding to the operation of adjusting the progress of the progress bar window by a user to display the screen content with the first preset time duration in different time intervals; after a determination instruction of the user for the progress bar window is obtained, screen content of a first preset duration currently selected by the user is saved; and the second preset time length is longer than the first preset time length.
In one possible embodiment, the method further comprises:
and saving the screen content of the master device when a fourth instruction which indicates that the content of the shared image data changes is received, wherein the fourth instruction is sent to each slave device by the master device when the content of the shared image data changes is detected.
In one possible embodiment, the method further comprises:
and when a fifth instruction sent by the master device is received, saving the screen content of the master device, wherein the fifth instruction is sent to each slave device by the master device when the annotation function of the master device is closed or the annotation content is cleared.
In one possible embodiment, the method further comprises:
if the slave device is in a state of starting the private note mode before the shared image data displayed by the slave device changes, after the displayed shared image data changes, and after an instruction which is input by a user and indicates that a last saved file is displayed is obtained, displaying the latest saved screen content, and starting the private note mode.
In a third aspect, an embodiment of the present application provides a screen interaction method, which is applied to a host device, and the method includes:
playing the shared image data;
after a first instruction which is input by a user and indicates that a private note mode is started is obtained, a transparent window is created on a layer of shared image data;
and acquiring scribbling operation input by a user in a private note mode, and displaying scribbling content corresponding to the scribbling operation in the transparent window.
In one possible embodiment, the method further comprises:
acquiring a first area coordinate and the content of a target area uploaded by slave equipment, and acquiring an identifier of the slave equipment which uploads the first area coordinate to obtain a target identifier;
converting the first area coordinate into a second area coordinate in an image coordinate system of the image data shared by the main equipment;
superposing the content of the target area to a second area coordinate of the shared image data to obtain updated shared image data;
and sending the updated shared image data and the target identification to each slave device.
In one possible embodiment, the method further comprises:
when detecting that the content of the shared image data changes, sending a fourth instruction indicating that the content of the shared image data changes to each slave device so that the slave devices save the screen content of the slave devices when receiving the fourth instruction.
In one possible embodiment, the method further comprises:
and when the annotation function of the master device is closed or the annotation content is cleared, sending a fifth instruction for storing the annotation to each slave device, so that the slave device stores the screen content of the slave device when receiving the fifth instruction.
In a fourth aspect, an embodiment of the present application further provides an electronic device, including a processor and a memory;
the memory is used for storing a computer program;
the processor is used for realizing the screen interaction method in the application when executing the program stored in the memory.
In a fifth aspect, an embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements the screen interaction method described in any of the present applications.
In a sixth aspect, an embodiment of the present application further provides a computer program product including instructions, which when run on a computer, cause the computer to execute any of the screen interaction methods described in the present application.
The embodiment of the application has the following beneficial effects:
the conference teaching system, the screen interaction method, the electronic device and the storage medium provided by the embodiment of the application comprise: a master device and a plurality of slave devices; a master device for transmitting shared image data to each slave device; the slave equipment is used for receiving and playing the shared image data sent by the master equipment; after a first instruction which is input by a user and indicates that a private note mode is started is obtained, a transparent window is created on a layer of shared image data; and acquiring the scribbling operation input by the user in the private note mode, and displaying the scribbling content corresponding to the scribbling operation in a transparent window of the user. The device can display the scribbled content of the user through the transparent window on the shared image data layer in the private note mode, and private display of the recorded content is achieved. Of course, not all advantages described above need to be achieved at the same time in the practice of any one product or method of the present application.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art according to the drawings.
Fig. 1 is a schematic view of a conference teaching system according to an embodiment of the present application;
FIG. 2 is a first diagram illustrating a screen interaction method according to an embodiment of the present application;
FIG. 3 is a second diagram illustrating a screen interaction method according to an embodiment of the present application;
FIG. 4 is a third diagram illustrating a screen interaction method according to an embodiment of the present application;
FIG. 5 is a fourth diagram illustrating a screen interaction method according to an embodiment of the present application;
fig. 6 is a schematic diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments that can be derived by one of ordinary skill in the art from the description herein are intended to be within the scope of the present disclosure.
In the existing multi-screen interaction scene, in the process of screen interaction between main equipment and mobile equipment, the contents displayed on the screens of the equipment are all in a synchronous state, and the contents displayed on each equipment are the same. When the participants record ideas or learn notes on the display interface, the recorded contents are synchronously displayed in all the devices of the conference teaching system. However, in some scenarios, the user does not want to synchronize their own recording to all devices in the system, and therefore how to implement private display of the recorded content becomes an urgent problem to be solved.
In view of the above problem, an embodiment of the present application provides a meeting teaching system, see fig. 1, including:
a master device 11 and a plurality of slave devices 12;
the master device 11 is configured to transmit shared image data to each of the slave devices;
the slave device 12 is configured to receive and play the shared image data sent by the master device; after a first instruction which is input by a user and indicates that a private note mode is started is obtained, a transparent window is created on a layer of shared image data; and acquiring scribbling operation input by a user in a private note mode, and displaying scribbling content corresponding to the scribbling operation in the transparent window of the user.
The master device may specifically be a video server device or a conference teaching all-in-one machine, and the slave device may be a smart phone, a smart watch, a personal computer, or the like.
The master device is configured to send, to each slave device, shared image data to be displayed in a screen interaction process, where the shared image data is also referred to as Surface flicker data, and in one example, the shared image data may be video data generated by a user operating the master device; in one example, a user may operate the slave device to generate video data and then upload the video data to the master device, thereby generating shared image data by the master device; the master device has a video composition function and can compose video data from a plurality of sources, and in one example, the shared image data is obtained by composing video data from a plurality of devices (at least two devices among the master device and the slave device) by the master device.
The slave device receives and plays the shared image data sent by the master device, the first instruction indicates that the private note mode is started, and the user can start the private note mode of the slave device through the first instruction. When the user of the slave device selects the private note mode, the display interface of the slave device still displays the shared image data synchronously with other device interfaces, and in addition, the slave device establishes a transparent window layer on the layer of the shared image data. In the private note mode, scribbling operations such as handwriting touch of a user are acquired from the slave device, and scribbling contents corresponding to the scribbling operations are displayed on the transparent window, so that the operation handwriting of the user is only displayed on the slave device, and the phenomenon that the user sees is that private handwriting is added on an interface of shared image data. In an example, the master device may also start the private note mode, and the specific process may refer to the process of the slave device, which is not described herein again.
In the embodiment of the application, the device can display the scribbled content of the user through the transparent window on the shared image data layer in the private note mode, so that the private display of the recorded content is realized.
In the private note mode, the device does not actively share and display the content in the transparent window, but in some scenarios, there is still a sharing requirement, and in one possible implementation, the slave device is further configured to: after a second instruction which is input by a user and indicates that private note sharing is carried out is obtained, a target area to be shared is selected in the transparent window according to an area selection instruction input by the user; acquiring the coordinate of the target area in the transparent window to obtain a first area coordinate; sending the first area coordinate and the content of the target area to the main equipment;
the master device is further configured to: acquiring an identifier of slave equipment uploading the first area coordinate to obtain a target identifier; converting the first area coordinate into a second area coordinate in an image coordinate system of the shared image data; overlaying the content of the target area to a second area coordinate of the shared image data to obtain updated shared image data; and sending the updated shared image data and the target identification to each slave device.
The slave device needs to update the content in its own screen after receiving the updated shared image data. In one possible implementation, the slave device is further configured to: judging whether the received target identifier is the identifier of the target identifier; if the shared image data is the identifier of the shared image data, discarding the updated shared image data; if the shared image data is not the own identifier and the private note mode is not started, the updated shared image data is played; if the shared image data is not the own identifier and the private note mode is started, the own screen content is stored, and the updated shared image data is played.
When the user needs to share the content in the private note, the user can open the note sharing function through a second instruction, for example, clicking a 'share note' button, the user can freely select the note content, after the selection is completed, the region coordinate of the selection region (target region), namely the first region coordinate, is acquired from the device, and the content of the selection region and the first region coordinate are sent to the main device. The master device receives the content of the frame selection area and the first area coordinates sent by the slave device, and obtains an identifier (i.e., a target identifier) of the slave device, where the target identifier is used to uniquely represent the slave device, and in one example, the target identifier may be a connection serial number of the slave device and the master device. The resolutions of the master device and the slave device may not be the same, so the master device needs to convert the first area coordinates into the second area coordinates in the image coordinate system of the master device sharing image data according to the ratio of the screen resolutions of the master device and the slave device. And then the main equipment synthesizes the content of the frame selection area with the shared image data based on the second area coordinate, and superposes the content of the frame selection area on the second area coordinate of the shared image data to obtain updated shared image data.
The master device may display the updated shared image data on its own screen, and send the updated shared image data and the target identifier to each slave device. After receiving updated shared image data and a target identifier sent by a master device, a slave device firstly judges whether the slave device uploading the first area coordinates/target area content is the slave device or not according to the target identifier, and if not, receives and displays the updated shared image data sent by the master device; and if so, discarding the updated shared image data sent by the master device.
If in the process, when the current slave equipment is in the private note mode, the self screen content needs to be stored firstly; after the slave device finishes storing the screen content of the slave device, the slave device can change along with the change of the screen of the master device, and the updated shared image data is displayed. When the current slave device is not in the private note mode, the slave device can directly display the updated shared image data.
In some scenarios, the master device may not perform sending the area coordinates of the target area and the content of the target area to each slave device. In one possible implementation, the slave device is further configured to: after a second instruction which is input by a user and indicates that private note sharing is carried out is obtained, a target area to be shared is selected in the transparent window according to an area selection instruction input by the user; acquiring the coordinate of the target area in the transparent window to obtain a first area coordinate; sending the first area coordinate and the content of the target area to the main equipment;
the master device is further configured to: acquiring an identifier of slave equipment uploading the first area coordinate to obtain a target identifier; sending the first area coordinate, the content of the target area and the target identification to each slave device;
the slave device is also used; judging whether the received target identifier is the identifier of the target identifier; if the first area coordinate is the identifier of the target area, discarding the first area coordinate and the content of the target area; if the first area coordinate is not the own identifier and the private note mode is not started, converting the first area coordinate into a third area coordinate in an image coordinate system of the own screen, and superposing the content of the target area on the third area coordinate of the own screen; if the first area coordinate is not the own identifier and the private note mode is started, saving the screen content of the self, converting the first area coordinate into a third area coordinate in an image coordinate system of the self screen, and overlaying the content of the target area onto the third area coordinate of the self screen.
In the prior art, the screen recording file for storing the whole conference or course is adopted by the equipment, but for the video recorded in the conference or course for a long time, the video is not a key point at all times, so that the user needs to see the shared video once again for key point extraction, the efficiency is inevitably reduced, and the waste of storage resources can be caused by storing all the screen recording files.
In one possible implementation, the slave device is further configured to: after a third instruction which is input by a user and indicates that image storage is carried out is obtained, the time when the third instruction is input by the user is obtained to obtain a first time; subtracting a first preset time length from the first time length to obtain a second time length; and obtaining a first time period by taking the second time as a time period starting point and the first time as a time period ending point, and storing the screen content in the first time period.
The time in the embodiment of the present application may be a system time of the device, for example, 30 ms at 12/31/8/15/06/30/1, or may be a time stamp time of the shared image data, for example, 50 ms at 30/10/50/10/30/10. The precision of the time can be set according to the actual situation in a customized way, for example, the precision can be set to be seconds or milliseconds. The first preset time period can be customized according to practical situations, and is set to be 1 second, 500 milliseconds, 100 milliseconds or 50 milliseconds, for example.
In one example, the screen content is saved, and the screen capture content may be a screen capture of the screen content and saved as a file; the file may be an image file, a word file, a PDF file, or the like, and is within the protection scope of the present application. In one example, the shared image data and the transparent window may be stored as two image files, respectively. The user can autonomously judge whether the current screen content needs to be saved as a file, and the corresponding moment (first moment) when the user clicks the save button is assumed to be T0If the first preset time is T, the second time is T0-T, slave save (T)0-T) to T0The screen content in the time period, specifically, can be obtained from the cached screen recording file (T)0-T) to T0And storing the screen content in the time period.
In one possible implementation, the slave device is further configured to: acquiring the moment when the content of the latest shared image data changes to obtain a third moment; judging whether the difference value between the first moment and the third moment is greater than a second preset time length or not; if so, subtracting a first preset time length from the first time length to obtain a second time length; obtaining a first time period by taking the second time as a time period starting point and the first time as a time period ending point, and storing the screen content in the first time period; if the time duration is less than the preset time duration, displaying the screen content with the first preset time duration in a progress bar window mode, and responding to the operation of adjusting the progress of the progress bar window by a user to display the screen content with the first preset time duration in different time intervals; after a determination instruction of the user for the progress bar window is obtained, screen content of a first preset duration currently selected by the user is saved; and the second preset time length is greater than the first preset time length.
The slave device may record the time at which the content of the shared image data changes; when a user actively stores screen recording contents, the slave equipment acquires the time when the contents of the last shared image data change, namely the third time; calculating a difference value between the first moment and the third moment, and judging whether the difference value is greater than a second preset time length; and if so, subtracting the first preset time length from the first time to obtain a second time, and storing the screen content from the second time to the first time. If the time duration is less than the preset time duration, displaying the screen content with the first preset time duration in a progress bar window mode, and displaying the screen content with the first preset time duration in different time intervals by the slave device through dragging the progress bar of the progress bar window and responding to the operation of the user for adjusting the progress of the progress bar window, so that the user can see the screen content in the time duration with the first preset time duration. After a determining instruction of a user for a progress bar window is acquired from the equipment, screen content of a first preset time length currently selected by the user is stored. The second preset duration can be set according to actual conditions, but it is required to ensure that the second preset duration is greater than the first preset duration.
In one possible implementation, the master device is further configured to: when detecting that the content of the shared image data changes, sending a fourth instruction indicating that the content of the shared image data changes to each slave device;
the slave device is further configured to: and when a fourth instruction is received, saving the screen content of the user.
The automatic file saving of the device can be realized by reading the Surface flag data. In the multi-screen interaction process, the master equipment can be controlled by operating the slave equipment, and then the master equipment sends the shared image data after being operated and changed to each slave equipment; or directly operating the master device and then sending the shared image data after being operated and changed to each slave device; in either of the above-described modes, the shared image data of the master device is actually changed and synchronized with the slave devices. Therefore, when the master device detects that the content of the shared image data changes, the master device sends a fourth instruction indicating that the content of the shared image data changes to each slave device, and after receiving the fourth instruction, the slave devices actively save the screen content of the slave devices as a file and then change along with the change of the screen interface of the master device.
In one possible implementation, the master device is further configured to: when the annotation function of the master device is closed or the annotation content is cleared, a fifth instruction for storing the annotations is sent to each slave device;
the slave device is further configured to: and when a fifth instruction is received, saving the screen content of the user.
When the master device carries out annotation operation (non-private note mode), all the slave devices synchronously display annotations of the master device, when the master device exits the annotation writing function or triggers the erasing function, the master device sends a fifth instruction to all the slave devices, and when the slave devices receive the fifth instruction, the slave devices store the screen contents of the slave devices and then carry out synchronization of shared image data along with the master device.
In one possible implementation, the slave device is further configured to: if the shared image data displayed by the user is in a state of starting the private note mode before the shared image data is changed, after the displayed shared image data is changed, after an instruction which is input by the user and indicates that a last saved file is displayed is obtained, displaying the latest saved screen content, and starting the private note mode.
When the slave device performs writing operation in the private note mode, if the shared image data in the master device changes, the slave device needs to store the screen content no matter whether the writing action is completed or not, and if the writing action of the user is not completed, the user can display the uncompleted screen content on the layer of the shared image data by clicking a last file saving button, so that the user can continuously complete writing and actively store the uncompleted screen content. In one example, in order to prevent the private note from being lost, after the device starts the private note mode, the retention time of the handwriting action of the user may be recorded, and the screen content is stored when the retention time of the handwriting action of the user is greater than a preset time threshold, where the preset time threshold may be set in a self-defined manner according to an actual situation, for example, may be set to 30 seconds, 1 minute, or 3 minutes, and the like.
In the embodiment of the application, in the private note mode, the shared image data is separated from the user note operation interface (transparent window), so that private display of recorded content is realized. The user can share the private note content selected by the user in a self-defined mode, and meanwhile, the key screen content is automatically stored in the whole using process, so that the user experience is better, and the working efficiency is improved.
The embodiment of the application provides a screen interaction method applied to slave equipment, and referring to fig. 2, the method includes:
s201, receiving and playing shared image data sent by a main device;
s202, after a first instruction which is input by a user and indicates that a private note mode is started is obtained, a transparent window is created on a layer of shared image data;
s203, obtaining the scribbling operation input by the user in the private note mode, and displaying the scribbling content corresponding to the scribbling operation in the transparent window.
In one possible embodiment, referring to fig. 3, the method further comprises:
s301, after a second instruction which is input by a user and indicates that private note sharing is carried out is obtained, a target area to be shared is selected in the transparent window according to an area selection instruction input by the user;
s302, obtaining the coordinates of the target area in the transparent window to obtain first area coordinates;
s303, sending the first area coordinate and the content of the target area to the master device, so that the master device obtains updated shared image data according to the first area coordinate and the content of the target area, and sends the updated shared image data and a target identifier to each of the slave devices, where the target identifier is an identifier of a slave device uploading the first area coordinate;
s304, judging whether the received target identifier is the identifier of the target identifier;
s305, if the shared image data is the identifier of the shared image data, discarding the updated shared image data;
s306, if the shared image data is not the own identifier and the private note mode is not started, the updated shared image data is played; if the shared image data is not the own identifier and the private note mode is started, the own screen content is stored, and the updated shared image data is played.
In one possible embodiment, referring to fig. 4, the method further comprises:
s401, after a third instruction which is input by a user and indicates that image storage is carried out is obtained, the time when the user inputs the third instruction is obtained to obtain a first time;
s402, subtracting a first preset duration from the first time to obtain a second time; and obtaining a first time period by taking the second time as a time period starting point and the first time as a time period ending point, and storing the screen content in the first time period.
In a possible implementation, referring to fig. 5, the second time is obtained by subtracting a first preset time from the first time; obtaining a first time period by taking the second time as a time period starting point and the first time as a time period ending point, and storing the screen content in the first time period, wherein the method comprises the following steps:
s4021, acquiring the time when the content of the latest shared image data changes, and acquiring a third time;
s4022, judging whether the difference value between the first moment and the third moment is greater than a second preset time length;
s4023, if the time is greater than the first time, subtracting a first preset time length from the first time to obtain a second time; obtaining a first time period by taking the second time as a time period starting point and the first time as a time period ending point, and storing the screen content in the first time period;
the method further comprises the following steps:
s501, if the time duration is smaller than the preset time duration, displaying the screen content with the first preset time duration in a progress bar window mode, and responding to the operation of a user for adjusting the progress of the progress bar window to display the screen content with the first preset time duration in different time intervals; after a determination instruction of the user for the progress bar window is obtained, screen content of a first preset duration currently selected by the user is saved; and the second preset time length is greater than the first preset time length.
In one possible embodiment, the method further comprises:
and saving the screen content of the master device when a fourth instruction which indicates that the content of the shared image data changes is received, wherein the fourth instruction is sent to each slave device by the master device when the content of the shared image data changes is detected.
In one possible embodiment, the method further comprises:
and when a fifth instruction sent by the master device is received, saving the screen content of the master device, wherein the fifth instruction is sent to each slave device by the master device when the annotation function of the master device is closed or the annotation content is cleared.
In one possible embodiment, the method further comprises:
if the slave device is in a state of starting the private note mode before the shared image data displayed by the slave device changes, after the displayed shared image data changes, and after an instruction which is input by a user and indicates that a last saved file is displayed is obtained, displaying the latest saved screen content, and starting the private note mode.
The embodiment of the application provides a screen interaction method, which is applied to main equipment, and comprises the following steps:
playing the shared image data;
after a first instruction which is input by a user and indicates that a private note mode is started is obtained, a transparent window is created on a layer of shared image data;
and acquiring scribbling operation input by a user in a private note mode, and displaying scribbling content corresponding to the scribbling operation in the transparent window.
In one possible embodiment, the method further comprises:
acquiring a first area coordinate and the content of a target area uploaded by slave equipment, and acquiring an identifier of the slave equipment which uploads the first area coordinate to obtain a target identifier;
converting the first area coordinate into a second area coordinate in an image coordinate system of the image data shared by the main equipment;
superposing the content of the target area to a second area coordinate of the shared image data to obtain updated shared image data;
and sending the updated shared image data and the target identification to each slave device.
In one possible embodiment, the method further comprises:
when detecting that the content of the shared image data changes, sending a fourth instruction indicating that the content of the shared image data changes to each slave device so that the slave devices save the screen content of the slave devices when receiving the fourth instruction.
In one possible embodiment, the method further comprises:
and when the annotation function of the master device is closed or the annotation content is cleared, sending a fifth instruction for storing the annotation to each slave device, so that the slave device stores the screen content of the slave device when receiving the fifth instruction.
An embodiment of the present application further provides an electronic device, including: a processor and a memory;
the memory is used for storing computer programs;
when the processor is used for executing the computer program stored in the memory, the screen interaction method is provided.
In a possible implementation manner, referring to fig. 6, the electronic device according to the embodiment of the present application further includes a communication interface 602 and a communication bus 604, where the processor 601, the communication interface 602, and the memory 603 complete communication with each other through the communication bus 604.
The communication bus mentioned in the electronic device may be a PCI (Peripheral Component Interconnect) bus, an EISA (Extended Industry Standard Architecture) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a RAM (Random Access Memory) or an NVM (Non-Volatile Memory), such as at least one disk Memory. Alternatively, the memory may be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also a DSP (Digital Signal Processing), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component.
An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements the screen interaction method in any of the above embodiments.
In yet another embodiment provided by the present application, there is also provided a computer program product comprising instructions which, when run on a computer, cause the computer to perform the screen interaction method of any of the above embodiments.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, digital subscriber line) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It should be noted that, in this document, the technical features in the various alternatives can be combined to form the scheme as long as the technical features are not contradictory, and the scheme is within the scope of the disclosure of the present application. Relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the embodiments of the apparatus, the electronic device, the computer program product and the storage medium, since they are substantially similar to the method embodiments, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiments.
The above description is only for the preferred embodiment of the present application and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application are included in the protection scope of the present application.

Claims (23)

1. A meeting teaching system, comprising:
a master device and a plurality of slave devices;
the master device is used for sending shared image data to each slave device;
the slave device is used for receiving and playing the shared image data sent by the master device; after a first instruction which is input by a user and indicates that a private note mode is started is obtained, a transparent window is created on a layer of shared image data; and acquiring scribbling operation input by a user in a private note mode, and displaying scribbling content corresponding to the scribbling operation in the transparent window of the user.
2. The system of claim 1, wherein the slave device is further configured to: after a second instruction which is input by a user and indicates that private note sharing is carried out is obtained, a target area to be shared is selected in the transparent window according to an area selection instruction input by the user; acquiring the coordinate of the target area in the transparent window to obtain a first area coordinate; sending the first area coordinate and the content of the target area to the main equipment;
the master device is further configured to: acquiring an identifier of slave equipment uploading the first area coordinate to obtain a target identifier; converting the first area coordinate into a second area coordinate in an image coordinate system of the shared image data; superposing the content of the target area to a second area coordinate of the shared image data to obtain updated shared image data; and sending the updated shared image data and the target identification to each slave device.
3. The system of claim 2, wherein the slave device is further configured to; judging whether the received target identifier is the identifier of the target identifier; if the shared image data is the identifier of the shared image data, discarding the updated shared image data; if the shared image data is not the own identifier and the private note mode is not started, the updated shared image data is played; if the shared image data is not the own identity and the private note mode is started, the own screen content is stored, and the updated shared image data is played.
4. The system of claim 1, wherein the slave device is further configured to: after a second instruction which is input by a user and indicates that private note sharing is carried out is obtained, a target area to be shared is selected in the transparent window according to an area selection instruction input by the user; acquiring the coordinate of the target area in the transparent window to obtain a first area coordinate; sending the first area coordinate and the content of the target area to the main equipment;
the master device is further configured to: acquiring an identifier of slave equipment uploading the first area coordinate to obtain a target identifier; sending the first area coordinate, the content of the target area and the target identification to each slave device;
the slave device is also used; judging whether the received target identifier is the identifier of the target identifier; if the first area coordinate is the identifier of the target area, discarding the first area coordinate and the content of the target area; if the first area coordinate is not the own identifier and the private note mode is not started, converting the first area coordinate into a third area coordinate in an image coordinate system of the own screen, and superposing the content of the target area on the third area coordinate of the own screen; if the first area coordinate is not the own identifier and the private note mode is started, saving the screen content of the self, converting the first area coordinate into a third area coordinate in an image coordinate system of the self screen, and overlaying the content of the target area onto the third area coordinate of the self screen.
5. The system of claim 1, wherein the slave device is further configured to: after a third instruction which is input by a user and indicates that image storage is carried out is obtained, the time when the third instruction is input by the user is obtained to obtain a first time; subtracting a first preset time length from the first time length to obtain a second time length; and obtaining a first time period by taking the second time as a time period starting point and the first time as a time period ending point, and storing the screen content in the first time period.
6. The system of claim 5, wherein the slave device is further configured to: acquiring the moment when the content of the latest shared image data changes to obtain a third moment; judging whether the difference value between the first moment and the third moment is greater than a second preset time length or not; if so, subtracting a first preset time length from the first time length to obtain a second time length; obtaining a first time period by taking the second time as a time period starting point and the first time as a time period ending point, and storing the screen content in the first time period; if the time duration is less than the preset time duration, displaying the screen content with the first preset time duration in a progress bar window mode, and responding to the operation of adjusting the progress of the progress bar window by a user to display the screen content with the first preset time duration in different time intervals; after a determination instruction of the user for the progress bar window is obtained, screen content of a first preset duration currently selected by the user is saved; and the second preset time length is greater than the first preset time length.
7. The system of claim 1, wherein the master device is further configured to: when detecting that the content of the shared image data changes, sending a fourth instruction indicating that the content of the shared image data changes to each slave device;
the slave device is further configured to: and when a fourth instruction is received, saving the screen content of the user.
8. The system of claim 1, wherein the master device is further configured to: when the annotation function of the master device is closed or the annotation content is cleared, a fifth instruction for storing the annotations is sent to each slave device;
the slave device is further configured to: and when a fifth instruction is received, saving the screen content of the user.
9. The system of any of claims 3-8, wherein the slave device is further configured to: if the shared image data displayed by the user is in a state of starting the private note mode before the shared image data is changed, after the displayed shared image data is changed, after an instruction which is input by the user and indicates that a last saved file is displayed is obtained, displaying the latest saved screen content, and starting the private note mode.
10. A screen interaction method is applied to a slave device, and comprises the following steps:
receiving and playing shared image data sent by the main equipment;
after a first instruction which is input by a user and indicates that a private note mode is started is obtained, a transparent window is created on a layer of shared image data;
and acquiring scribbling operation input by a user in a private note mode, and displaying scribbling content corresponding to the scribbling operation in the transparent window.
11. The method of claim 10, further comprising:
after a second instruction which is input by a user and indicates that private note sharing is carried out is obtained, a target area to be shared is selected in the transparent window according to an area selection instruction input by the user;
acquiring the coordinate of the target area in the transparent window to obtain a first area coordinate;
and sending the first area coordinate and the content of the target area to the master device, so that the master device obtains updated shared image data according to the first area coordinate and the content of the target area, and sends the updated shared image data and a target identifier to the slave device, wherein the target identifier is the identifier of the slave device uploading the first area coordinate.
12. The method of claim 11, further comprising;
judging whether the received target identifier is the identifier of the target identifier;
if the shared image data is the identifier of the shared image data, discarding the updated shared image data;
if the shared image data is not the own identifier and the private note mode is not started, the updated shared image data is played; if the shared image data is not the own identifier and the private note mode is started, the own screen content is stored, and the updated shared image data is played.
13. The method of claim 10, further comprising:
after a third instruction which is input by a user and indicates that image storage is carried out is obtained, the time when the third instruction is input by the user is obtained to obtain a first time;
subtracting a first preset time length from the first time length to obtain a second time length; and obtaining a first time period by taking the second time as a time period starting point and the first time as a time period ending point, and storing the screen content in the first time period.
14. The method according to claim 13, wherein the second time is obtained by subtracting a first preset time length from the first time; obtaining a first time period by taking the second time as a time period starting point and the first time as a time period ending point, and storing the screen content in the first time period, wherein the method comprises the following steps:
acquiring the moment when the content of the latest shared image data changes to obtain a third moment;
judging whether the difference value between the first moment and the third moment is greater than a second preset time length or not;
if so, subtracting a first preset time length from the first time length to obtain a second time length;
obtaining a first time period by taking the second time as a time period starting point and the first time as a time period ending point, and storing the screen content in the first time period;
the method further comprises the following steps:
if the time duration is less than the preset time duration, displaying the screen content with the first preset time duration in a progress bar window mode, and responding to the operation of adjusting the progress of the progress bar window by a user to display the screen content with the first preset time duration in different time intervals; after a determination instruction of the user for the progress bar window is obtained, screen content of a first preset duration currently selected by the user is saved; and the second preset time length is greater than the first preset time length.
15. The method of claim 10, further comprising:
and saving the screen content of the master device when a fourth instruction which indicates that the content of the shared image data changes is received, wherein the fourth instruction is sent to each slave device by the master device when the content of the shared image data changes is detected.
16. The method of claim 10, further comprising:
and when a fifth instruction sent by the master device is received, saving the screen content of the master device, wherein the fifth instruction is sent to each slave device by the master device when the annotation function of the master device is closed or the annotation content is cleared.
17. The method according to any one of claims 12-16, further comprising:
if the slave device is in a state of starting the private note mode before the shared image data displayed by the slave device changes, after the displayed shared image data changes, and after an instruction which is input by a user and indicates that a last saved file is displayed is obtained, displaying the latest saved screen content, and starting the private note mode.
18. A screen interaction method is applied to a main device, and comprises the following steps:
playing the shared image data;
after a first instruction which is input by a user and indicates that a private note mode is started is obtained, a transparent window is created on a layer of shared image data;
and acquiring scribbling operation input by a user in a private note mode, and displaying scribbling content corresponding to the scribbling operation in the transparent window.
19. The method of claim 18, further comprising:
acquiring a first area coordinate and the content of a target area uploaded by slave equipment, and acquiring an identifier of the slave equipment which uploads the first area coordinate to obtain a target identifier;
converting the first area coordinate into a second area coordinate in an image coordinate system of the image data shared by the main equipment;
superposing the content of the target area to a second area coordinate of the shared image data to obtain updated shared image data;
and sending the updated shared image data and the target identification to each slave device.
20. The method of claim 18, further comprising:
and when detecting that the content of the shared image data changes, sending a fourth instruction indicating that the content of the shared image data changes to each slave device so that the slave device saves the screen content of the slave device when receiving the fourth instruction.
21. The method of claim 18, further comprising:
and when the annotation function of the master device is closed or the annotation content is cleared, sending a fifth instruction for performing annotation storage to each slave device, so that the slave device stores the screen content of the slave device when receiving the fifth instruction.
22. An electronic device comprising a processor and a memory;
the memory is used for storing a computer program;
the processor, when executing the program stored in the memory, is configured to implement the screen interaction method according to any one of claims 10 to 21.
23. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, implements the screen interaction method of any one of claims 10 to 21.
CN202210101260.2A 2022-01-27 2022-01-27 Conference teaching system, screen interaction method, electronic device and storage medium Pending CN114449203A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210101260.2A CN114449203A (en) 2022-01-27 2022-01-27 Conference teaching system, screen interaction method, electronic device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210101260.2A CN114449203A (en) 2022-01-27 2022-01-27 Conference teaching system, screen interaction method, electronic device and storage medium

Publications (1)

Publication Number Publication Date
CN114449203A true CN114449203A (en) 2022-05-06

Family

ID=81369175

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210101260.2A Pending CN114449203A (en) 2022-01-27 2022-01-27 Conference teaching system, screen interaction method, electronic device and storage medium

Country Status (1)

Country Link
CN (1) CN114449203A (en)

Similar Documents

Publication Publication Date Title
US11943486B2 (en) Live video broadcast method, live broadcast device and storage medium
CN111970577B (en) Subtitle editing method and device and electronic equipment
CN111510760A (en) Video information display method and device, storage medium and electronic equipment
EP4333439A1 (en) Video sharing method and apparatus, device, and medium
CN109446025B (en) Operation behavior playback method and device, electronic equipment and readable medium
CN111970571B (en) Video production method, device, equipment and storage medium
CN110634220B (en) Information processing method and device
CN114500432A (en) Session message transceiving method and device, electronic equipment and readable storage medium
CN113163230A (en) Video message generation method and device, electronic equipment and storage medium
CN112969097A (en) Content playing method and device, and content commenting method and device
CN110083768B (en) Information sharing method, device, equipment and medium
CN114363686B (en) Method, device, equipment and medium for publishing multimedia content
CN106998493B (en) Video previewing method and device
US20150143261A1 (en) Information processing terminal, information processing method, and information processing system
CN110673886B (en) Method and device for generating thermodynamic diagrams
CN113986574A (en) Comment content generation method and device, electronic equipment and storage medium
CN113986083A (en) File processing method and electronic equipment
CN112492399B (en) Information display method and device and electronic equipment
CN110071959B (en) Method and device for timing synchronization of third-party national standard resources
CN107995538B (en) Video annotation method and system
CN114449203A (en) Conference teaching system, screen interaction method, electronic device and storage medium
CN102984193A (en) Reception terminal, information processing method, server, transmission terminal, and information processing system
CN114374761A (en) Information interaction method and device, electronic equipment and medium
CN105094633A (en) Method and device for transmitting control instruction
CN116800988A (en) Video generation method, apparatus, device, storage medium, and program product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination