CN114296671A - Multi-screen conference interaction method, equipment, device and storage medium - Google Patents
Multi-screen conference interaction method, equipment, device and storage medium Download PDFInfo
- Publication number
- CN114296671A CN114296671A CN202111595725.6A CN202111595725A CN114296671A CN 114296671 A CN114296671 A CN 114296671A CN 202111595725 A CN202111595725 A CN 202111595725A CN 114296671 A CN114296671 A CN 114296671A
- Authority
- CN
- China
- Prior art keywords
- terminal
- display
- track
- speaker
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 230000003993 interaction Effects 0.000 title claims abstract description 24
- 238000005266 casting Methods 0.000 claims abstract description 21
- 238000012544 monitoring process Methods 0.000 claims abstract description 15
- 238000010977 unit operation Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 5
- 230000009467 reduction Effects 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 2
- 230000008859 change Effects 0.000 description 7
- 230000001360 synchronised effect Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000008054 signal transmission Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 230000002269 spontaneous effect Effects 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
Images
Abstract
The application relates to a multi-screen conference interaction method, equipment, a device and a storage medium, wherein the method comprises the following steps: receiving a screen-casting adding request sent by a conference master through a master control equipment terminal, wherein the screen-casting adding request comprises identity information of a speaker terminal; sending a screen throwing entry link to the speaker terminal according to the identity information; receiving a screen projection request sent by a speaker terminal, wherein the screen projection request comprises identity information of the speaker terminal; if the identity information in the screen-throwing adding request is consistent with the identity information in the screen-throwing request, sending interface information displayed by a display terminal to the speaker terminal; monitoring a touch screen track input by a speaker when the speaker terminal displays the interface information; and synchronizing the touch screen track information to the interface information displayed by the display terminal. The application has the technical effects that: the conference efficiency is improved.
Description
Technical Field
The present application relates to the field of terminal screen display, and in particular, to a multi-screen conference interaction method, device, apparatus, and storage medium.
Background
At present, with the development of information technology, when a multi-person conference is carried out, an electronic display screen or a projector is generally used for projecting contents to be displayed, and if the number of persons participating in the conference is large, a plurality of display screens are arranged to display the contents to be projected at different positions.
In the process of participating in a meeting, a conference master controller needs to connect the display device with a personal device terminal, and then projects the content to be displayed in the device terminal onto the display device, so that all conference participants can see the content to be displayed and learn and discuss the content.
In view of the above-mentioned related art, the inventors found that at least the following problems exist in the art: in the process of the conference, when conference participants need to speak aiming at displayed contents, the speakers are far away from the display equipment and are difficult to express clearly only in a verbal description mode, the speakers need to go to the display equipment from the conference seats, the speakers can speak by combining with content labeling or sketching displayed on the display equipment, and the speakers return to the conference seats after the speaking is finished, so that the whole speaking process is troublesome and time-consuming, and the conference efficiency is low.
Disclosure of Invention
In order to solve the problem of low conference efficiency, the application provides a multi-screen conference interaction method, equipment, a device and a storage medium.
In a first aspect, the present application provides a multi-screen conference interaction method, which adopts the following technical scheme:
the method comprises the following steps:
receiving a screen-casting adding request sent by a conference master through a master control equipment terminal, wherein the screen-casting adding request comprises identity information of a speaker terminal;
sending a screen throwing entry link to the speaker terminal according to the identity information;
receiving a screen projection request sent by a speaker terminal, wherein the screen projection request comprises identity information of the speaker terminal;
if the identity information in the screen-throwing adding request is consistent with the identity information in the screen-throwing request, sending interface information displayed by a display terminal to the speaker terminal;
monitoring a touch screen track input by a speaker when the speaker terminal displays the interface information;
and synchronizing the touch screen track information to the interface information displayed by the display terminal.
By adopting the technical scheme, when a speaker speaks, the screen throwing inlet sent by the background is connected into the background in a linked mode, the speaker marks or draws a touch screen track formed in the interface information displayed on the terminal device of the speaker, the touch screen track can be synchronized to the interface information displayed on the display device, the possibility that an operator needs to go back and forth between the display device and the terminal is reduced, the speaker speaks more conveniently, time consumed by the speaker when the speaker goes back and forth is saved, and conference efficiency is improved.
Optionally, after the sending the interface information displayed by the display terminal to the speaker terminal, the method further includes:
receiving a writing request sent by the speaker terminal;
in a display interface of a display terminal, reducing a corresponding interface when the interface information is displayed according to a preset reduction rule, and taking the interface information as initial interface information;
setting the rest interfaces in the display interfaces of the display terminal as blank areas;
and updating the interface information displayed by the display terminal, and sending the updated interface information to the speaker terminal.
By adopting the technical scheme, when characters or pictures in the interface information displayed by the display equipment are dense and inconvenient to write, the speaker can send a writing request to the background through the speaking terminal. The background can automatically add a blank area to the interface information displayed by the display device to update the interface information displayed by the display device, at the moment, the speaker can write the blank part in the interface information synchronized on the mobile phone, and the background automatically synchronizes a touch screen track of the speaker when the blank area is written into the blank area displayed by the display device, so that the speaker can write when speaking.
Optionally, the sending the updated interface information to the speaker terminal includes:
sending a preset writing interface to the speaker terminal so that the speaker terminal can display the writing interface;
the monitoring of the touch screen track input by the speaker when the speaker terminal displays the interface information includes:
recording touch screen tracks in the writing interface, and timing after each touch screen track is finished until the next touch screen track is recorded;
if the time length of the timing information is greater than a preset time length threshold value, taking a touch screen track corresponding to the timing information as an ending track;
overlapping the ending track and all touch screen tracks from the ending track to the last ending track to generate a writing track;
comparing the writing track with a character track corresponding to each character stored in a preset character database;
selecting a character track which is most matched with the writing track;
the synchronizing the touch screen track information to the interface information displayed by the display terminal comprises:
adjusting the character specification corresponding to the character track to a preset specification;
and sending the adjusted characters to the display terminal so that the display terminal arranges the characters in a blank area displayed according to a preset arrangement rule.
By adopting the technical scheme, the speaker can write at any position in the writing interface displayed by the personal equipment terminal, and the backstage can automatically determine the separation point of the touch screen track between two characters when the speaker continuously inputs the touch screen track and automatically identify the corresponding character, so that the movable range of the fingers is wider when the speaker writes. After the background identifies the characters input by the operator, the specifications of the characters are adjusted to certain specifications and are arranged according to rules, so that the possibility that the characters written by the operator are disorderly in a blank area of the display equipment is reduced, the attractiveness is improved, and the characters written by a speaker are clearer and more clear and can be easily understood by participants. Meanwhile, as the characters are orderly arranged according to the rule, an operator can input more characters to be displayed in the blank area of the display interface, and the writing utilization rate of the blank area is improved.
Optionally, before the recording the touch screen trajectory, the method further includes:
receiving a formula writing request sent by a speaker terminal;
after the adjusting the character specification corresponding to the character track to a preset specification, the method further includes:
storing the adjusted characters until a line feed command sent by a speaker terminal is received;
arranging the stored characters from left to right according to the generated front and back sequence to form a single-line formula;
the sending the adjusted character to the display terminal includes:
if a line feed command sent by the speaker terminal exists before all characters corresponding to the single-line formula are stored, sending the line feed command to a display terminal;
sending the single-line formula to a display terminal so that the single-line formula is displayed after the display terminal feeds lines;
if a line feed command sent by a speaker terminal does not exist before all characters corresponding to the single-line formula are stored, marking the single-line formula as a first-line formula;
judging whether the number of the characters which can be displayed in the residual blank area in the row where the first line formula is located is less than the number of the characters in the first line formula;
if so, sending a line feed instruction to the display terminal;
and sending the first line formula to a display terminal so that the display terminal displays the characters after line feed.
By adopting the technical scheme, when an operator needs a mathematical formula, the background can sequentially display the line-changing of each line of formula according to the line-changing instruction sent by a speaker after storing the single line of formula input by the operator. The background can automatically judge the first line formula, and for the first line formula input by a user, the background can judge whether the blank area of the line where the first line formula is located is enough to display the first line formula, and if not, the line is automatically changed for display. Thereby making it more convenient for the operator to write the formula.
Optionally, after the sending the adjusted character to the display terminal, the method further includes:
receiving a writing ending instruction sent by a speaker terminal;
deleting touch screen track information in the initial interface information;
intercepting an area with characters in the blank area, and storing a picture formed by the intercepted area and the characters in the area as a writing termination image corresponding to the initial interface information;
the method further comprises the following steps:
receiving a writing termination image calling instruction sent by the main control equipment terminal, wherein the writing termination image calling instruction comprises initial interface information;
and acquiring all writing termination images corresponding to the initial interface information, and sending the writing termination images to the main control equipment terminal.
By adopting the technical scheme, when a conference controller needs to compare and present viewpoints of different speakers with the same content, after the conference controller selects the initial interface information, the background automatically calls out all the writing termination images corresponding to the initial interface information, and the background arranges the images according to the received writing termination images and synchronously displays the images on the display device.
Optionally, after the sending the writing termination image to the main control device terminal, the method further includes:
if a split-screen display request sent by the main control equipment terminal is received, the split-screen display request comprises selected auxiliary demonstration terminals and writing termination images corresponding to each selected auxiliary demonstration terminal;
sending the corresponding writing termination image to the corresponding auxiliary demonstration terminal so that the corresponding auxiliary demonstration terminal displays the writing termination image;
if a display instruction sent by the main control equipment terminal is received, the display instruction comprises a selected writing termination image;
equally dividing the display interface of the display terminal into a plurality of display areas according to the number of the writing termination images;
and reducing and displaying each writing termination image in a display area.
By adopting the technical scheme, if a plurality of devices are arranged in the meeting place and simultaneously display interface information, so that meetings at different positions in the meeting place can be seen. The conference controller can choose whether to display different terminating images on different screens in order to avoid having a single image with too small an area to see. When the images are displayed on the same screen, the background equally divides a display interface into a plurality of display areas for displaying the writing termination image selected by the conference controller; when the images are not displayed on the same screen, the conference control person selects the writing termination images and the display equipment corresponding to each writing termination image, and the background sends the writing images to the corresponding display equipment respectively, so that the display equipment can display the writing termination images and the display equipment.
Optionally, the synchronizing the touch screen track information to the interface information displayed by the display terminal includes:
calculating the duration of the monitored touch screen track;
if the duration is shorter than the preset unit operation duration, skipping the touch screen track;
and if the duration is longer than the preset unit operation duration, synchronizing the touch screen track information to interface information displayed by the display terminal.
By adopting the technical scheme, the background can automatically skip the touch screen track formed by the participant mistakenly clicking, so that the received touch screen track is filtered, the time consumed for clearing the touch screen track formed by the mistaken touch is saved, the user is more convenient to mark the content, and the conference efficiency is further improved.
Optionally, the synchronizing the touch screen track information to the interface information displayed by the display terminal includes:
equally dividing the duration of the touch screen track by a preset number, determining positions corresponding to the equally divided points in the touch screen track, and calculating the thickness of the touch screen track corresponding to each position;
if the numerical value corresponding to the calculated thickness is larger than a preset thickness threshold value, skipping the touch screen track;
otherwise, synchronizing the touch screen track information to the interface information displayed by the display terminal.
By adopting the technical scheme, the background can automatically judge whether the touch screen track is the situation that other objects scrape the display interface or the participator carelessly scrapes the display interface by the palm, and can automatically skip the correspondingly generated touch screen track, so that the received touch screen track is further filtered, the touch screen track displayed on the display equipment is more accurate, and the possibility that the conference process is influenced by misoperation of the participator is reduced.
In a second aspect, the present application provides a computer device, which adopts the following technical solution: the multi-screen conference interaction system comprises a memory and a processor, wherein the memory stores a computer program which can be loaded by the processor and executes any one of the multi-screen conference interaction methods.
In a third aspect, the present application provides a multi-screen conference interaction device, which adopts the following technical scheme:
the conference main controller comprises a request receiving module, a screen-casting adding module and a screen-casting adding module, wherein the request receiving module is used for receiving a screen-casting adding request sent by a conference main controller through a main control equipment terminal, and the screen-casting adding request comprises identity information of a speaker terminal;
the information sending module is used for sending a screen throwing inlet link to the speaker terminal according to the identity information;
the system comprises an information receiving module, a screen display module and a screen display module, wherein the information receiving module is used for receiving a screen projection request sent by a speaker terminal, and the screen projection request comprises identity information of the speaker terminal;
the information judgment module is used for sending interface information displayed by the display terminal to the speaker terminal if the identity information in the screen-throwing addition request is consistent with the identity information in the screen-throwing request;
the track monitoring module is used for monitoring a touch screen track input by the speaker when the speaker terminal displays the interface information;
and the information synchronization module is used for synchronizing the touch screen track information to the interface information displayed by the display terminal.
By adopting the technical scheme, when a speaker speaks, the screen throwing inlet sent by the background is connected into the background in a linked mode, the speaker marks or writes a touch screen track formed in the interface information displayed on the terminal device of the speaker, the touch screen track can be synchronized to the interface information displayed on the display device, the possibility that an operator needs to go back and forth between the display device and the terminal is reduced, the speaker speaks more conveniently, time consumed by the speaker when going back and forth is saved, and conference efficiency is improved.
In a fourth aspect, the present application provides a computer-readable storage medium, which adopts the following technical solutions: a computer program is stored which can be loaded by a processor and which can perform any of the multi-screen conference interaction methods described above.
In summary, the present application includes at least one of the following beneficial technical effects:
1. when a speaker speaks, the speaker can be connected into the background through the screen throwing inlet link sent by the background, a touch screen track formed by marking or writing the interface information displayed on the terminal device of the speaker can be synchronized into the interface information displayed on the display device, the possibility that an operator needs to go back and forth between the display device and the terminal is reduced, the speaker speaks more conveniently, the time consumed by the speaker when going back and forth is saved, and the conference efficiency is improved;
2. when an operator needs a mathematical formula, the background stores a single-line formula input by the operator and then can sequentially display the line change of each line of formula according to a line change instruction sent by a speaker. The background can automatically judge the first line formula, and for the first line formula input by a user, the background can judge whether the blank area of the line where the first line formula is located is enough to display the first line formula, and if not, the line is automatically changed for display. Thereby making it more convenient for the operator to write the formula.
Drawings
Fig. 1 is a flowchart of a multi-screen conference interaction method according to an embodiment of the present application.
Fig. 2 is a block diagram illustrating a multi-screen conference interaction device according to an embodiment of the present application.
Fig. 3 is a block diagram illustrating a multi-screen conference interaction device according to another embodiment of the present application.
Fig. 4 is a block diagram illustrating a multi-screen conference interaction device according to another embodiment of the present application.
Description of reference numerals: 20. a request receiving module; 21. an information sending module; 22. an information receiving module; 23. an information judgment module; 24. a trajectory monitoring module; 25. an information synchronization module; 30. an image processing module; 31. a region setting module; 32. an information updating module; 40. a character storage module; 41. a formula identification module; 42. and a quantity calculation module.
Detailed Description
The application discloses a multi-screen conference interaction method. The method is based on a display terminal, a main control device terminal and a speaker terminal, wherein the display terminal can be a display device, the display device comprises a display screen and a processor, the display screen is used for displaying information, the processor is used for processing information and controlling the display screen to display, and a background can be the processor. In a conference, the master control device terminal may be a computer. The speaker terminal may be a mobile phone or a computer. The conference controller connects the main control equipment terminal with the display equipment, the connection mode can be wired connection or wireless connection, the main control equipment terminal can control the interface information displayed on the display screen through signal transmission with the processor, the speaker terminal can be in signal connection with the processor through a wireless mode, and the annotation or writing carried out at the speaker terminal is synchronized to the interface information displayed on the display screen through the processor. If a plurality of display devices exist in a conference room at the same time, the display devices can be divided into a main display device and an auxiliary display device, and a processor in the main display device can control the auxiliary display device.
In one embodiment, as shown in fig. 1, a multi-screen conference interaction method is provided, which includes the following steps:
and S10, receiving a screen-casting adding request sent by the conference master through the master control equipment terminal.
Specifically, after the conference master controller is connected with the background, the conference master controller controls the display device to display interface information, and if a speaker needs to speak, the conference controller sends a screen-throwing adding request to the background. The screen-cast addition request includes identity information of the speaker terminal. When the speaker terminal is a smart phone, the identity information can be a phone number; when the speaker terminal is a computer, the identity information may be an IP address. The speaker informs the conference master controller of the identity information, and the conference master controller sends a screen-casting addition request to the background.
S10, sending the screen-casting entry link to the speaker terminal.
Specifically, the background sends a screen-throwing entry link to the speaker terminal according to the received identity information, the screen-throwing entry link is preset, and the speaker can enter a screen-throwing control page after clicking the link and perform signal transmission with the background.
And S12, receiving a screen projection request sent by the speaker terminal.
Specifically, a speaker sends a screen-casting request to the background through a speaker terminal, in a specific implementation, a "screen-casting request" key can be set on a screen-casting control page, and the screen-casting request can be sent to the background after the speaker clicks an area corresponding to the key. The screen-casting request includes identity information of the speaker terminal.
S13, the interface information displayed on the display terminal is transmitted to the speaker terminal.
Specifically, the background compares the identity information in the screen-throwing adding request with the identity information in the screen-throwing request, and if the identity information is consistent, the interface information displayed by the display device is sent to the speaker terminal. The interface information can be sent in the form of pictures, and the speaker can open the interface information on the terminal.
And S14, monitoring a touch screen track input by the speaker when the speaker terminal displays the interface information.
Specifically, the screen-casting control page can contain a tool pack downloading option, interface information can be selected to be opened in the control page after a speaker downloads the tool pack, at the moment, the tool pack can touch a terminal screen with a finger of the speaker to automatically form a touch screen track, and after a background sends a monitoring instruction to the speaker terminal, the speaker terminal automatically sends the touch screen track formed in the opened interface information to the background.
And S15, synchronizing the touch screen track information to the interface information displayed by the display device.
Specifically, the background synchronizes the touch screen track to the interface information displayed by the display terminal, and synchronizes the interface information displayed by the display terminal to the speaker terminal in real time. Therefore, the interface information can be synchronously marked on the terminal by the speaker, participants can see the marks of the speaker, and the speaking content of the speaker can be conveniently understood by combining the marks.
In one embodiment, considering that there is a writing requirement after a speaker finishes marking on a display interface, but a blank space is difficult to find for writing when a character or a picture in interface information is full, after the speaker finishes marking on the display interface, a writing request is sent to a background through a speaker terminal, and the writing request includes identity information of the speaker terminal. A button for starting writing can be preset in the screen-throwing control page, and a speaker can send a writing request to the background by clicking the button corresponding to the button for starting writing.
And the background reduces the corresponding interface when the display equipment displays the interface information according to a preset reduction rule, and takes the interface information as initial interface information. For example, the preset zoom-out rule may be to zoom out to half and place the screen at the top left corner. And the background sets the interfaces except the reduced initial interface information in the display interfaces of the display terminal as blank areas, updates the interface information displayed by the display equipment, and sends the updated interface information to the speaker terminal. The speaker writes in a blank area in interface information displayed by the speaker terminal through a finger to form a touch screen track, the background synchronizes the touch screen track to a blank area displayed on the display device, and participants can check the content written by the speaker in the blank area, so that the inventor can write in the blank area except the initial interface information.
In another embodiment, in consideration of writing, a speaker needs to write in a blank area displayed on the terminal through a finger, and a touch trace of the finger of the speaker is too large relative to the blank area, so that a synchronous touch trace of the speaker in the blank area on the speaker terminal is too large, the writing utilization rate of the blank area is low, and the writing requirement is difficult to meet. At the moment, the speaker terminal is equally an electronic tablet, the background monitors the touch screen tracks of the speaker at any position in the writing interface displayed by the speaker terminal, records the touch screen tracks, and times after each touch screen track is finished until the next touch screen track is recorded, if the time length of the timing information is greater than a preset time length threshold value, the speaker is indicated that one character is written, and the background takes the touch screen track corresponding to the timing information as an ending track; and if the time length of the timing information is not longer than the preset time length threshold value, the background continues to time each touch screen track. And the background superposes the ending track and all touch screen tracks from the ending track to the last ending track, so that a writing track can be generated. The time length threshold is the time length of an interval between every two characters when the characters are written, and is obtained and preset by a developer through analysis of a large sample.
The method comprises the steps that a preset character database is called in a background, a character track corresponding to each character is stored in character data, the background compares the writing track with the character track, the character track which is most matched with the writing track is selected, the specification of the character corresponding to the selected character track is adjusted to a preset specification, the adjusted spontaneous character is sent to a display terminal, and the display terminal displays the characters in a blank area of display according to a preset arrangement rule. The preset specification may be a size of each character relative to the blank area, and may be automatically set by a developer, the preset arrangement rule may be arranged from left to right at a specified interval, and when a row is full of characters, the next row is automatically entered for arrangement. On the one hand, the operator can write at any position on the display interface of the touch screen terminal, the writing range of the operator during writing is enlarged, so that the operator can write more conveniently, on the other hand, the touch screen track of the operator is automatically recognized and converted into characters, and the characters are arranged according to certain specifications and arrangement modes, so that the situation that participants understand the content written by a speaker is facilitated, and the writing utilization rate of a blank area is improved.
In another embodiment, considering the situation that the operator needs a mathematical formula, in the writing interface of the operator, the following steps can be included: the option of "text" and "formula" allows the operator to switch between text entry and formula entry. When the operator clicks the formula option, the formula writing request is automatically sent to the background, and a line feed key appears. And the background records a touch screen track in the writing interface, identifies a character track formed by the touch screen track, determines a character corresponding to the character track, adjusts the specification of the character to a preset specification, stores the adjusted character, and continues to identify and store the next character until a line feed instruction sent by the speaker terminal is received.
The background arranges the stored characters from left to right according to the stored sequence to form a single-line formula, judges whether a line change instruction sent by a speaker terminal is received before all characters corresponding to the single-line formula are stored, if so, sends the line change instruction to a display screen, and sends the single-line formula to the display terminal, so that the display terminal displays the single-line formula after line change; if not, marking the single-line formula as a first-line formula, judging whether the number of the characters which can be displayed in the residual blank area in the line where the first-line formula is located is less than the number of the characters in the first-line formula, if so, sending a line-changing instruction to the display terminal, and sending the first-line formula to the display terminal so as to display the characters after the line of the display terminal is changed; otherwise, the first line formula is sent to the display terminal, so that the display terminal arranges the first line formula behind the character before the first line formula. Therefore, when a user inputs a formula, the background can sequentially display the line change of each line of formula according to the line change instruction sent by the speaker. The background can automatically judge the first line formula, and the background can judge whether the blank area of the line where the first line formula is located is enough to display the first line formula, and if not, the line is automatically changed for display. Thereby making it more convenient for the operator to write the formula.
In another embodiment, considering that a conference master has a need of comparatively explaining writing contents of a plurality of speakers, after the speakers write, sending a writing ending instruction to a background through a speaking terminal, deleting a touch screen track in initial interface information corresponding to the writing contents by the background, intercepting an area where characters exist in a blank area, storing a picture writing ending image formed by the blank area and the characters in the blank area, and storing the initial interface information and the writing ending image in a manner that the background associates with each other.
When the main controller of the conference can send a writing termination image calling instruction to the background, the writing termination image calling instruction carries the initial interface information. In actual operation, an interface used by a main conference controller comprises a toolbar option, after an operator opens initial interface information, the toolbar is clicked, and a writing termination image calling option in the toolbar is selected, so that a command for sending the writing termination image calling can be sent to a background. And the background calls out all the writing termination images stored in association with the initial interface information, and sends the called out writing termination images to the conference main controller, and the conference main controller can arrange the writing termination images on the main control equipment terminal and synchronously display the writing termination images on the display equipment. At this time, the conference master can compare and explain the written contents of a plurality of speakers through a plurality of writing termination images.
In another embodiment, in consideration of the problem that a single writing termination image is too small if more writing termination images need to be displayed simultaneously, if a conference is located in a conference place, one or more auxiliary display devices are provided in addition to a main display device, and the auxiliary display devices and the main display device display the same content at the same time, so that participants at different positions in the conference place can conveniently watch the content. After receiving all the writing termination images, the conference master controller can send a split-screen display request to the background through the master control equipment terminal, wherein the split-screen display request comprises display equipment selected by the conference master controller and the writing termination image corresponding to each selected display equipment.
And the background sends the corresponding writing termination image to the corresponding display equipment so that the corresponding display equipment displays the writing termination image. Therefore, the writing termination images which need to be displayed simultaneously are displayed on a plurality of display screens, and the possibility that a single writing termination image is too small is reduced. If the conference master wants to display in the same screen, the conference master can arrange the writing termination images on the master control device terminal manually, and the background can equally divide the display interface of the display device according to the number of the writing termination images to form equally divided areas. And background reducing each writing termination image, and then putting the reduced writing termination image into an equal partition area for displaying.
In another embodiment, considering that an inadvertent error point may occur when a speaker synchronizes a touch screen track to a display device, after the speaker monitors the touch screen track in the background, the background calculates the duration of each touch screen track, and if the duration is shorter than a preset unit operation duration, it indicates that the touch screen track is likely to be an error point, rather than a label, and the background skips the touch screen track; if the duration is not shorter than the preset unit operation duration, the contact track is probably marked, and the background synchronizes the touch screen track information to the interface information displayed by the display terminal. Therefore, the automatic judgment and processing of the error point are realized.
In another embodiment, considering that a situation that an arm or a palm of a speaker carelessly scrapes a display screen of a speaker terminal when the speaker synchronizes a touch screen track to a display device may occur, after monitoring the touch screen track, a background performs equal division on the duration of the touch screen track by a preset number, determines positions corresponding to the equal division in the touch screen track, and calculates the thickness of the touch screen track corresponding to each position. For example, if the preset number of equal divisions can be trisected, the position of each trisected equant point is determined in the touch screen track, and the thickness corresponding to the touch screen track at each trisected point is calculated. The background judges whether a numerical value larger than a preset roughness threshold value exists in the numerical values corresponding to the calculated roughness, if so, the corresponding touch screen track is skipped; otherwise, synchronizing the corresponding touch screen track information to the interface information displayed by the display terminal. The preset thickness threshold value is preset by a worker through analyzing a large amount of finger touch screen data.
According to the multi-screen conference interaction method, the speaker can synchronize the touch screen track of the screen on the speaker terminal to the interface information displayed by the display device, so that the speaker can remotely mark the content displayed on the display device. When a speaker needs to write, the speaker enters a writing mode, the background can automatically recognize a touch screen track of the speaker on a writing interface, determine characters corresponding to the touch screen track, and arrange the characters in sequence in interface information of display equipment, so that the speaker can remotely add characters to the display equipment in a handwriting mode. When needed, the conference controller can simultaneously display the written contents of a plurality of speakers on the display device and compare the written contents with the written contents.
In one embodiment, as shown in fig. 2, there is provided a multi-screen conference interaction device, including:
the request receiving module 20 is configured to receive a screen-casting addition request sent by a conference master through a master control device terminal, where the screen-casting addition request includes identity information of a speaker terminal;
the information sending module 21 is configured to send a screen throwing entry link to the speaker terminal according to the identity information;
the information receiving module 22 is configured to receive a screen projection request sent by a speaker terminal, where the screen projection request includes identity information of the speaker terminal;
the information judgment module 23 is configured to send interface information displayed by the display terminal to the speaker terminal if the identity information in the screen-throwing addition request is consistent with the identity information in the screen-throwing request;
the track monitoring module 24 is configured to monitor a touch screen track input by the speaker when the speaker terminal displays interface information;
and the information synchronization module 25 is configured to synchronize the touch screen track information to interface information displayed by the display terminal.
In another embodiment, the request receiving module 20 is further configured to receive a writing request sent by a speaker terminal;
as shown in fig. 3, a multi-screen conference interaction apparatus further includes:
the image processing module 30 is configured to, in a display interface of the display terminal, reduce a corresponding interface when the interface information is displayed according to a preset reduction rule, and use the interface information as initial interface information;
the area setting module 31 is configured to set all remaining interfaces in the display interface of the display terminal as blank areas;
and the information updating module 32 is configured to update the interface information displayed by the display terminal, and send the updated interface information to the speaker terminal.
In another embodiment, the information updating module 32 is specifically configured to send a preset writing interface to the speaker terminal, so that the speaker terminal displays the writing interface;
the trajectory monitoring module 24 is specifically configured to:
recording touch screen tracks in a writing interface, and timing after each touch screen track is finished until the next touch screen track is recorded;
if the time length of the timing information is greater than a preset time length threshold value, taking a touch screen track corresponding to the timing information as an ending track;
overlapping the ending track and all touch screen tracks from the ending track to the last ending track to generate a writing track;
comparing the writing track with a character track corresponding to each character stored in a preset character database;
selecting a character track which is most matched with the writing track;
the information synchronization module 25 is specifically configured to:
adjusting the character specification corresponding to the character track to a preset specification;
and sending the adjusted characters to a display terminal so that the display terminal arranges the characters in the blank area according to a preset arrangement rule.
In another embodiment, the request receiving module 20 further receives a formula writing request sent by the speaker terminal;
as shown in fig. 4, a multi-screen conference interaction apparatus further includes:
the character storage module 40 is used for storing the adjusted characters until a line feed instruction sent by the speaker terminal is received;
a formula identification module 41, configured to arrange the stored characters from left to right according to the generated front-back order to form a single-line formula;
the information synchronization module 25 is specifically configured to:
if a line feed command sent by the speaker terminal exists before all characters corresponding to the single-line formula are stored, sending the line feed command to the display terminal;
sending the single-line formula to a display terminal so that the display terminal displays the single-line formula after line feed;
if the line-changing instruction sent by the speaker terminal does not exist before all characters corresponding to the single-line formula are stored, marking the single-line formula as a first-line formula;
the quantity calculating module 42 is configured to determine whether the quantity of the characters displayable in the remaining blank area in the row where the first-line formula is located is less than the quantity of the characters in the first-line formula;
the information sending module 21 is configured to send a line feed instruction to the display terminal if the line feed instruction is received;
and sending the first line formula to the display terminal so that the display terminal displays the characters after line feed.
In another embodiment, the information receiving module 22. The terminal is also used for receiving a writing ending instruction sent by the speaker terminal;
the information judgment module 23 is further configured to delete the touch screen track information in the initial interface information;
the image processing module 30 is further configured to intercept an area where the characters exist in the blank area, and store a picture formed by the intercepted area and the characters in the area as a writing termination image corresponding to the initial interface information;
the information receiving module 22 is further configured to receive a writing termination image call instruction sent by the main control device terminal, where the writing termination image call instruction includes initial interface information;
the information sending module 21 is further configured to obtain all writing termination images corresponding to the initial interface information, and send the writing termination images to the main control device terminal.
In another embodiment, the request receiving module 20 is further configured to, if a split-screen display request sent by the main control device terminal is received, determine that the split-screen display request includes the selected secondary presentation terminals and the writing termination image corresponding to each selected secondary presentation terminal;
the information sending module 21 is further configured to send the corresponding writing termination image to the corresponding auxiliary demonstration terminal, so that the corresponding auxiliary demonstration terminal displays the writing termination image;
if a display instruction sent by the main control equipment terminal is received, the display instruction comprises the selected writing termination image;
the region setting module 31 is further configured to equally divide the display interface of the display terminal into a plurality of display regions according to the number of the writing termination images;
the information sending module 21 is further configured to reduce and display each writing termination image in the display area.
In another embodiment, the information synchronization module 25 is specifically configured to:
calculating the duration of the monitored touch screen track;
if the duration is shorter than the preset unit operation duration, skipping the touch screen track;
and if the duration is longer than the preset unit operation duration, synchronizing the touch screen track information to interface information displayed by the display terminal.
In another embodiment, the information synchronization module 25 is specifically configured to:
equally dividing the duration of the touch screen track by a preset number, determining positions corresponding to the equally divided points in the touch screen track, and calculating the thickness of the touch screen track corresponding to each position;
if the numerical value corresponding to the calculated thickness is larger than a preset thickness threshold value, skipping the touch screen track;
otherwise, synchronizing the touch screen track information to the interface information displayed by the display terminal.
In one embodiment, a computer device is provided.
Specifically, the computer device comprises a memory and a processor, wherein the memory stores a computer program which can be loaded by the processor and executes the multi-screen conference interaction method.
In one embodiment, a computer-readable storage medium is provided.
Specifically, the computer-readable storage medium stores a computer program capable of being loaded by a processor and executing the multi-screen conference interaction method as described above, and the computer-readable storage medium includes, for example: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The present embodiment is only for explaining the present invention, and it is not limited to the present invention, and those skilled in the art can make modifications of the present embodiment without inventive contribution as needed after reading the present specification, but all of them are protected by patent law within the scope of the claims of the present invention.
Claims (10)
1. A multi-screen conference interaction method is characterized by comprising the following steps:
receiving a screen-casting adding request sent by a conference master through a master control equipment terminal, wherein the screen-casting adding request comprises identity information of a speaker terminal;
sending a screen throwing entry link to the speaker terminal according to the identity information;
receiving a screen projection request sent by a speaker terminal, wherein the screen projection request comprises identity information of the speaker terminal;
if the identity information in the screen-throwing adding request is consistent with the identity information in the screen-throwing request, sending interface information displayed by a display terminal to the speaker terminal;
monitoring a touch screen track input by a speaker when the speaker terminal displays the interface information;
and synchronizing the touch screen track information to the interface information displayed by the display terminal.
2. The method according to claim 1, further comprising, after the transmitting interface information displayed by the display terminal to the speaker terminal:
receiving a writing request sent by the speaker terminal;
in a display interface of a display terminal, reducing a corresponding interface when the interface information is displayed according to a preset reduction rule, and taking the interface information as initial interface information;
setting the rest interfaces in the display interfaces of the display terminal as blank areas;
and updating the interface information displayed by the display terminal, and sending the updated interface information to the speaker terminal.
3. The method of claim 2, wherein sending the updated interface information to the speaker terminal comprises:
sending a preset writing interface to the speaker terminal so that the speaker terminal can display the writing interface;
the monitoring of the touch screen track input by the speaker when the speaker terminal displays the interface information includes:
recording touch screen tracks in the writing interface, and timing after each touch screen track is finished until the next touch screen track is recorded;
if the time length of the timing information is greater than a preset time length threshold value, taking a touch screen track corresponding to the timing information as an ending track;
overlapping the ending track and all touch screen tracks from the ending track to the last ending track to generate a writing track;
comparing the writing track with a character track corresponding to each character stored in a preset character database;
selecting a character track which is most matched with the writing track;
the synchronizing the touch screen track information to the interface information displayed by the display terminal comprises:
adjusting the character specification corresponding to the character track to a preset specification;
and sending the adjusted characters to the display terminal so that the display terminal arranges the characters in a blank area displayed according to a preset arrangement rule.
4. The method of claim 3, further comprising, prior to the recording the touch screen trajectory:
receiving a formula writing request sent by a speaker terminal;
after the adjusting the character specification corresponding to the character track to a preset specification, the method further includes:
storing the adjusted characters until a line feed command sent by a speaker terminal is received;
arranging the stored characters from left to right according to the generated front and back sequence to form a single-line formula;
the sending the adjusted character to the display terminal includes:
if a line feed command sent by the speaker terminal exists before all characters corresponding to the single-line formula are stored, sending the line feed command to a display terminal;
sending the single-line formula to a display terminal so that the single-line formula is displayed after the display terminal feeds lines;
if a line feed command sent by a speaker terminal does not exist before all characters corresponding to the single-line formula are stored, marking the single-line formula as a first-line formula;
judging whether the number of the characters which can be displayed in the residual blank area in the row where the first line formula is located is less than the number of the characters in the first line formula;
if so, sending a line feed instruction to the display terminal;
and sending the first line formula to a display terminal so that the display terminal displays the characters after line feed.
5. The method according to claim 3, further comprising, after the sending the adjusted character to the display terminal:
receiving a writing ending instruction sent by a speaker terminal;
deleting touch screen track information in the initial interface information;
intercepting an area with characters in the blank area, and storing a picture formed by the intercepted area and the characters in the area as a writing termination image corresponding to the initial interface information;
the method further comprises the following steps:
receiving a writing termination image calling instruction sent by the main control equipment terminal, wherein the writing termination image calling instruction comprises initial interface information;
and acquiring all writing termination images corresponding to the initial interface information, and sending the writing termination images to the main control equipment terminal.
6. The method according to claim 4, wherein after the sending the writing termination image to the master device terminal, further comprising:
if a split-screen display request sent by the main control equipment terminal is received, the split-screen display request comprises selected auxiliary demonstration terminals and writing termination images corresponding to each selected auxiliary demonstration terminal;
sending the corresponding writing termination image to the corresponding auxiliary demonstration terminal so that the corresponding auxiliary demonstration terminal displays the writing termination image;
if a display instruction sent by the main control equipment terminal is received, the display instruction comprises a selected writing termination image;
equally dividing the display interface of the display terminal into a plurality of display areas according to the number of the writing termination images;
and reducing and displaying each writing termination image in a display area.
7. The method according to claim 1, wherein the synchronizing the touch screen trajectory information to the interface information displayed by the display terminal comprises:
calculating the duration of the monitored touch screen track;
if the duration is shorter than the preset unit operation duration, skipping the touch screen track;
and if the duration is longer than the preset unit operation duration, synchronizing the touch screen track information to interface information displayed by the display terminal.
8. The method according to claim 1, wherein the synchronizing the touch screen trajectory information to the interface information displayed by the display terminal comprises:
equally dividing the duration of the touch screen track by a preset number, determining positions corresponding to the equally divided points in the touch screen track, and calculating the thickness of the touch screen track corresponding to each position;
if the numerical value corresponding to the calculated thickness is larger than a preset thickness threshold value, skipping the touch screen track;
otherwise, synchronizing the touch screen track information to the interface information displayed by the display terminal.
9. A computer device comprising a memory and a processor, the memory having stored thereon a computer program that can be loaded by the processor and that executes the method according to any of claims 1 to 7.
10. A multi-screen conference interaction device, the device comprising:
the conference system comprises a request receiving module (20) and a screen throwing adding module, wherein the request receiving module is used for receiving a screen throwing adding request sent by a conference master controller through a master control equipment terminal, and the screen throwing adding request comprises identity information of a speaker terminal;
the information sending module (21) is used for sending a screen throwing entry link to the speaker terminal according to the identity information;
the system comprises an information receiving module (22) and a screen projection module, wherein the information receiving module is used for receiving a screen projection request sent by a speaker terminal, and the screen projection request comprises identity information of the speaker terminal;
the information judgment module (23) is used for sending the interface information displayed by the display terminal to the speaker terminal if the identity information in the screen-throwing addition request is consistent with the identity information in the screen-throwing request;
a track monitoring module (24) for monitoring a touch screen track input by the speaker when the speaker terminal displays the interface information;
and the information synchronization module (25) is used for synchronizing the touch screen track information to the interface information displayed by the display terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111595725.6A CN114296671A (en) | 2021-12-23 | 2021-12-23 | Multi-screen conference interaction method, equipment, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111595725.6A CN114296671A (en) | 2021-12-23 | 2021-12-23 | Multi-screen conference interaction method, equipment, device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114296671A true CN114296671A (en) | 2022-04-08 |
Family
ID=80969725
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111595725.6A Pending CN114296671A (en) | 2021-12-23 | 2021-12-23 | Multi-screen conference interaction method, equipment, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114296671A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107844953A (en) * | 2017-11-03 | 2018-03-27 | 广州视源电子科技股份有限公司 | Management method, device, terminal and the computer-readable recording medium of committee paper |
| CN108366062A (en) * | 2018-01-24 | 2018-08-03 | 上海哇嗨网络科技有限公司 | Method, client, server and the system of throwing screen connection are established by inviting |
| CN109032390A (en) * | 2018-08-01 | 2018-12-18 | 广州视源电子科技股份有限公司 | Handwriting data caching method, device, equipment and storage medium |
| CN110297550A (en) * | 2019-06-28 | 2019-10-01 | 北京百度网讯科技有限公司 | A kind of mark display methods, throws screen equipment, terminal and storage medium at device |
| CN110597472A (en) * | 2018-06-12 | 2019-12-20 | 广州视源电子科技股份有限公司 | Whiteboard content display method and device, whiteboard equipment and server |
| CN110928468A (en) * | 2019-10-09 | 2020-03-27 | 广州视源电子科技股份有限公司 | Page display method, device, equipment and storage medium of intelligent interactive tablet |
| CN111654742A (en) * | 2020-06-18 | 2020-09-11 | 中电长城(长沙)信息技术有限公司 | Remote intelligent linkage screen projection method and system |
| CN111813302A (en) * | 2020-06-08 | 2020-10-23 | 广州视源电子科技股份有限公司 | Screen projection display method and device, terminal equipment and storage medium |
| CN112783461A (en) * | 2021-02-01 | 2021-05-11 | 游密科技(深圳)有限公司 | Screen projection method and device, electronic equipment and storage medium |
-
2021
- 2021-12-23 CN CN202111595725.6A patent/CN114296671A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107844953A (en) * | 2017-11-03 | 2018-03-27 | 广州视源电子科技股份有限公司 | Management method, device, terminal and the computer-readable recording medium of committee paper |
| CN108366062A (en) * | 2018-01-24 | 2018-08-03 | 上海哇嗨网络科技有限公司 | Method, client, server and the system of throwing screen connection are established by inviting |
| CN110597472A (en) * | 2018-06-12 | 2019-12-20 | 广州视源电子科技股份有限公司 | Whiteboard content display method and device, whiteboard equipment and server |
| CN109032390A (en) * | 2018-08-01 | 2018-12-18 | 广州视源电子科技股份有限公司 | Handwriting data caching method, device, equipment and storage medium |
| CN110297550A (en) * | 2019-06-28 | 2019-10-01 | 北京百度网讯科技有限公司 | A kind of mark display methods, throws screen equipment, terminal and storage medium at device |
| CN110928468A (en) * | 2019-10-09 | 2020-03-27 | 广州视源电子科技股份有限公司 | Page display method, device, equipment and storage medium of intelligent interactive tablet |
| CN111813302A (en) * | 2020-06-08 | 2020-10-23 | 广州视源电子科技股份有限公司 | Screen projection display method and device, terminal equipment and storage medium |
| CN111654742A (en) * | 2020-06-18 | 2020-09-11 | 中电长城(长沙)信息技术有限公司 | Remote intelligent linkage screen projection method and system |
| CN112783461A (en) * | 2021-02-01 | 2021-05-11 | 游密科技(深圳)有限公司 | Screen projection method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8823768B2 (en) | Conference system, event management server, and program | |
| US8671359B2 (en) | Scroll display control | |
| EP0617562A2 (en) | Apparatus and method for playing back continuous data | |
| WO2013121455A1 (en) | Projector, graphical input/display device, portable terminal and program | |
| CN109286836B (en) | Multimedia data processing method and device, intelligent terminal and storage medium | |
| US11348587B2 (en) | Review system for online communication, method, and computer program | |
| CN105608462A (en) | Character similarity judgment method and device | |
| EP4057633A1 (en) | Video processing method and apparatus, and terminal device | |
| US10761718B2 (en) | Electronic whiteboard, method for image processing in electronic whiteboard, and recording medium containing computer program of electronic whiteboard | |
| CN114296671A (en) | Multi-screen conference interaction method, equipment, device and storage medium | |
| CN111832455A (en) | Method, device, storage medium and electronic equipment for acquiring content image | |
| CN112463098A (en) | Method and system for freezing specific application program update | |
| CN109697242B (en) | Photographing question searching method and device, storage medium and computing equipment | |
| US8515173B2 (en) | Image processing system, image processing method and computer readable medium | |
| CN113194279B (en) | Recording method of network conference, computer readable storage medium and electronic device | |
| CN112270264A (en) | Multi-party interactive teaching system | |
| JP2020144725A (en) | Information processing system and control method thereof | |
| JP7314624B2 (en) | Information processing device and program | |
| US20200294552A1 (en) | Recording device, recording method, reproducing device, reproducing method, and recording/reproducing device | |
| CN115357519B (en) | Test method, device, equipment and medium | |
| CN114900641A (en) | Data storage and backtracking method, device and system | |
| CN114449203A (en) | Conference teaching system, screen interaction method, electronic device and storage medium | |
| JP2022106271A (en) | Program, method, information processor, and system | |
| CN116610243A (en) | Display control method, display control device, electronic equipment and storage medium | |
| CN112463092A (en) | Remote annotation method, smart phone and conference tablet |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |