CN110971860B - Display method and device - Google Patents
Display method and device Download PDFInfo
- Publication number
- CN110971860B CN110971860B CN201811139537.0A CN201811139537A CN110971860B CN 110971860 B CN110971860 B CN 110971860B CN 201811139537 A CN201811139537 A CN 201811139537A CN 110971860 B CN110971860 B CN 110971860B
- Authority
- CN
- China
- Prior art keywords
- meeting place
- window
- identifier
- code stream
- meeting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
- H04N7/152—Multipoint control units therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Telephonic Communication Services (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the application provides a display method, wherein a meeting place identifier and a window identifier are bound, a code stream of a meeting place is associated with a window through the binding relationship between the meeting place identifier and the window identifier, and when the code stream of a certain meeting place is not displayed any more, the association between the code stream of the meeting place and the window can be cut off by removing the binding relationship between the meeting place identifier and the window identifier, so that the code stream of the meeting place cannot be displayed in the window, and the problem of residual frames in a video conference is avoided.
Description
Technical Field
The present application relates to the field of communications, and in particular, to a display method and apparatus.
Background
The current terminal supports a Multi-stream conference, and a Multipoint Control Unit (MCU) is responsible for receiving a Multi-stream watching request, collecting code streams sent by each meeting place, and forwarding the watched code streams to the corresponding terminal according to the watching request of each meeting place. The code stream may be a video stream, or may be a data stream such as a presentation. When each terminal requests a code stream, the request needs to carry the selected meeting place identifier, and the terminal resolution can also be carried. The meeting place identifier is bound with a meeting place Synchronization Source (SSRC), and the SSRC is an identifier of the code stream. And the terminal displays the code stream to be selected and viewed through the window. The window for displaying the codestream has a window handle (window handle) by which the window can be controlled. Window handles and SSRC bindings.
Assume that the user selects to see the code streams for conference room 1, conference room 2, conference room 3, and conference room 4. After receiving the request, the MCU forwards the streams SSRC-1, SSRC-2, SSRC-3 and SSRC-4 of the conference places 1, 2 and 3 and 4 to the terminal of the user. The terminal respectively displays the code streams SSRC-1, SSRC-2, SSRC-3 and SSRC-4 on the windows HA, HB, HC and HD. After a period of time, the user selects to view the streams of meeting place 1, meeting place 5, meeting place 6, and meeting place 7. However, since the MCU may consume a certain time to request, forward, and decode the streams of the meeting places 5, 6, and 7, the terminal may still display the pictures of the streams of the meeting places 2, 3, and 4 that are no longer selected, and a residual frame may appear, as shown in fig. 1.
Disclosure of Invention
The embodiment of the application provides a display method, which can solve the problem that a terminal displays a residual frame in a video conference.
In a first aspect, a display method is provided, which includes the following steps: the terminal equipment displays the code stream of the first meeting place on the first window, the identifier of the first meeting place and the identifier of the first window, used for displaying the code stream of the first meeting place, of the terminal equipment have a binding relationship, and the code stream of the first meeting place is associated with the first window through the binding relationship between the identifier of the first meeting place and the identifier of the first window; when the terminal equipment receives an instruction from a user for stopping displaying the code stream of the first meeting place, the terminal equipment removes the binding relationship between the identifier of the first meeting place and the identifier of the first window; and the terminal equipment stops displaying the code stream of the first meeting place.
Because the identifier of the first meeting place and the identifier of the first window have a binding relationship, and the code stream of the first meeting place is associated with the first window through the binding relationship, after the binding relationship between the identifier of the first meeting place and the identifier of the first window is removed, the code stream of the first meeting place cannot be continuously displayed on the first window, so that the occurrence of residual frames is avoided.
With reference to the implementation manner of the first aspect, in a first possible implementation manner of the first aspect, the instruction to stop displaying the code stream of the first meeting place includes an instruction to switch the meeting place.
With reference to the first aspect or the first possible implementation manner of the first aspect, in a second possible implementation manner, after the terminal device releases the binding relationship between the identifier of the first meeting place and the identifier of the first window, the terminal device instructs the server to stop sending the code stream of the first meeting place to the terminal device.
With reference to the first aspect or any one of the first to second possible implementation manners of the first aspect, in a third possible implementation manner, before the terminal device displays the code stream of the first meeting place on the first window, the terminal device creates at least one window handle, where a window corresponding to the at least one window handle is used for displaying the code stream of the at least one meeting place, an identifier of each window and an identifier of each meeting place have a one-to-one binding relationship, and the code stream of each meeting place is associated with a corresponding window through the identifier of the meeting place.
In a second aspect, a display method is provided, which includes that terminal equipment displays a code stream of a first meeting place in a first window; the terminal equipment receives a meeting entering indication of a second meeting place from the server, the identifier of the second meeting place and the identifier of a second window used for displaying the code stream of the second meeting place by the terminal equipment have a binding relationship, and the code stream of the second meeting place is associated with the second window through the binding relationship between the identifier of the second meeting place and the identifier of the second window; and the terminal equipment does not display the code stream of the first meeting place on the second window according to the binding relationship between the identifier of the second meeting place and the identifier of the second window.
The second window does not display the code stream of the first meeting place without the binding relationship because the identifier of the second window and the identifier of the second meeting place have the binding relationship. Therefore, the second window is prevented from displaying the picture of the first meeting place when the second meeting place is in a meeting.
With reference to the implementation manner of the second aspect, in a first possible implementation manner of the second aspect, after the terminal device receives a meeting entrance instruction of the second meeting place from the server, the method further includes: the terminal device creates a window handle for the second window.
With reference to the second aspect or the first possible implementation manner of the second aspect, the method further includes: the terminal equipment requests a code stream of a second meeting place from the server; the terminal equipment receives a code stream of a second meeting place from the server; and the terminal equipment displays the code stream of the second meeting place on the second window according to the binding relationship between the identifier of the second meeting place and the identifier of the second window.
A third aspect provides a display method, which includes that terminal equipment displays a code stream of a first meeting place on a first window, displays a code stream of a second meeting place on a second window, a binding relationship is formed between an identifier of the first meeting place and an identifier of the second window, used for displaying the code stream of the first meeting place, of the terminal equipment, and the code stream of the first meeting place is associated with the first window through the binding relationship between the identifier of the first meeting place and the identifier of the first window; the terminal equipment receives a party leaving indication of a second meeting place from the server; and the terminal equipment does not display the code stream of the first meeting place on the second window according to the binding relationship between the identifier of the first meeting place and the identifier of the first window.
Because the identifier of the first meeting place has a binding relationship with the first window, the second window cannot display the code stream of the first meeting place without the binding relationship. Therefore, the second window is prevented from displaying the picture of the first meeting place when the second meeting place leaves the meeting.
The fourth aspect provides a display method, which includes that a server receives a code stream request of a first meeting place from a terminal device, a binding relationship is formed between an identifier of the first meeting place and an identifier of a first window used for displaying the code stream of the first meeting place by the terminal device, and the code stream of the first meeting place is associated with the first window through the binding relationship between the identifier of the first meeting place and the identifier of the first window; and the server sends the code stream of the first meeting place to the terminal equipment.
With reference to the implementation manner of the fourth aspect, in a first possible implementation manner of the fourth aspect, the method further includes: and the server receives an instruction from the terminal equipment for stopping sending the code stream of the first meeting place to the terminal equipment.
With reference to the fourth aspect or the first possible implementation manner of the fourth aspect, the method further includes: the server receives a conference entrance request of a second conference place; the server sends a meeting entering indication of the second meeting place to the terminal equipment; the server receives a request of the terminal equipment for the code stream of the second meeting place; and the server sends the code stream of the second meeting place to the terminal equipment, the identifier of the second meeting place and the identifier of a second window used for displaying the code stream of the second meeting place by the terminal equipment have a binding relationship, and the code stream of the second meeting place is associated with the second window through the binding relationship between the identifier of the second meeting place and the identifier of the second window.
With reference to the fourth aspect or the first possible implementation manner of the fourth aspect, in a second possible implementation manner, the method further includes: the server receives a meeting leaving request from the second meeting place; and the server sends the departure indication of the second meeting place to the terminal equipment.
In a fifth aspect, a terminal device is provided, which includes a display module, a receiving module and a processing module: the display module is used for displaying the code stream of the first meeting place on the first window, the identifier of the first meeting place and the identifier of the first window, used for displaying the code stream of the first meeting place, of the display module have a binding relationship, and the code stream of the first meeting place is associated with the first window through the binding relationship between the identifier of the first meeting place and the identifier of the first window; the receiving module is used for receiving an instruction of stopping displaying the code stream of the first meeting place from a user; the processing module is used for removing the binding relationship between the identifier of the first meeting place and the identifier of the first window; and the display module is used for stopping displaying the code stream of the first meeting place after the binding relation between the identifier of the first meeting place and the identifier of the first window is removed.
With reference to the implementation manner of the fifth aspect, in a first possible implementation manner of the fifth aspect, the instruction to stop displaying the code stream of the first meeting place includes an instruction to switch meeting places.
With reference to the fifth aspect or the first possible implementation manner of the fifth aspect, in a second possible implementation manner, the processing module is further configured to instruct the server to stop sending the code stream of the first meeting place to the terminal device after the binding relationship between the identifier of the first meeting place and the identifier of the first window is released.
With reference to the fifth aspect or any one of the first to second possible implementation manners of the fifth aspect, in a third possible implementation manner, the processing module is further configured to create at least one window handle before the display module displays the code stream of the first meeting place on the first window, where a window corresponding to the at least one window handle is used to display the code stream of the at least one meeting place, an identifier of each window and an identifier of each meeting place have a one-to-one binding relationship, and the code stream of each meeting place is associated with a corresponding window through the identifier of the meeting place.
In a sixth aspect, a terminal device is provided, which includes a display module and a receiving module: the display module is used for displaying the code stream of the first meeting place in the first window; the receiving module is used for receiving a meeting entering instruction of a second meeting place from the server, the identifier of the second meeting place and the identifier of a second window used for displaying the code stream of the second meeting place by the display module have a binding relationship, and the code stream of the second meeting place is associated with the second window through the binding relationship between the identifier of the second meeting place and the identifier of the second window; and the display module is further used for not displaying the code stream of the first meeting place on the second window according to the binding relationship between the identifier of the second meeting place and the identifier of the second window after the receiving module receives the meeting entering indication of the second meeting place.
With reference to the implementation manner of the sixth aspect, in a first possible implementation manner of the sixth aspect, the terminal device further includes a processing module; and the processing module is used for creating a window handle of the second window.
With reference to the sixth aspect or the first possible implementation manner of the sixth aspect, in a second possible implementation manner, the terminal device further includes a sending module; the sending module is used for requesting the code stream of the second meeting place from the server; the receiving module is also used for receiving a code stream of a second meeting place from the server; and the display module is further used for displaying the code stream of the second meeting place on the second window according to the binding relationship between the identifier of the second meeting place and the identifier of the second window.
In a seventh aspect, a terminal device is provided, which includes a display module and a receiving module: the display module is used for displaying the code stream of the first meeting place on the first window and displaying the code stream of the second meeting place on the second window, the identifier of the first meeting place and the identifier of the second window, used for displaying the code stream of the first meeting place, of the display module have a binding relationship, and the code stream of the first meeting place is associated with the first window through the binding relationship between the identifier of the first meeting place and the identifier of the first window; the receiving module is used for receiving a party leaving instruction of a second meeting place from the server; and the display module is further used for not displaying the code stream of the first meeting place on the second window according to the binding relationship between the identifier of the first meeting place and the identifier of the first window after the receiving module receives the meeting leaving indication of the second meeting place.
In an eighth aspect, a server is provided, which includes a receiving module and a sending module: the receiving module is used for receiving a code stream request of a first meeting place from the terminal equipment, the identifier of the first meeting place and the identifier of a first window used for displaying the code stream of the first meeting place of the terminal equipment have a binding relationship, and the code stream of the first meeting place is associated with the first window through the binding relationship between the identifier of the first meeting place and the identifier of the first window; and the sending module is used for sending the code stream of the first meeting place to the terminal equipment.
With reference to the implementation manner of the eighth aspect, in a first possible implementation manner of the eighth aspect, the receiving module is further configured to receive an instruction from the terminal device to stop sending the code stream of the first meeting place to the terminal device.
With reference to the eighth aspect or the first possible implementation manner of the eighth aspect, in a second possible implementation manner, the receiving module is further configured to receive a conference entrance request of a second conference place; the sending module is further used for sending a conference entering instruction of the second conference place to the terminal equipment; the receiving module is also used for receiving a request of the terminal equipment for the code stream of the second meeting place; and the sending module is further used for sending the code stream of the second meeting place to the terminal device, the identifier of the second meeting place and the identifier of a second window used by the terminal device for displaying the code stream of the second meeting place have a binding relationship, and the code stream of the second meeting place is associated with the second window through the binding relationship between the identifier of the second meeting place and the identifier of the second window.
With reference to the eighth aspect or any one of the first to second possible implementation manners of the eighth aspect, in a third possible implementation manner, the receiving module is further configured to receive a conference leaving request from a second conference place; and the sending module is also used for sending the conference leaving indication of the second conference place to the terminal equipment.
According to the technical scheme provided by the embodiment of the application, the meeting place identifier and the window identifier are bound, the code stream of the meeting place is associated with the window through the binding relationship between the meeting place identifier and the window identifier, and when the code stream of a certain meeting place is not displayed any more, the association between the code stream of the meeting place and the window can be cut off by removing the binding relationship between the meeting place identifier and the window identifier, so that the code stream of the meeting place cannot be displayed in the window, and the problem of residual frames in a video conference is avoided.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.
Fig. 1 is a schematic diagram of a residual frame occurring in a multi-stream conference process in the prior art;
FIG. 2 is a schematic diagram of a network architecture for use in an embodiment of the present application;
FIG. 3 is an exemplary flow chart of a display method 300 according to an embodiment of the present application;
FIG. 4 is a diagram illustrating an effect of not displaying a residual frame when switching conference rooms according to an embodiment of the present disclosure;
FIG. 5 is a diagram illustrating the effect of residual frames occurring during a new conference session in the prior art;
FIG. 6 is a diagram illustrating an effect of not displaying a residual frame when a new conference is entered according to an embodiment of the present application;
FIG. 7 is a diagram illustrating the effect of a residual frame occurring when a meeting is away from a meeting in the prior art;
FIG. 8 is a diagram illustrating an effect of not displaying a residual frame when a meeting is away according to an embodiment of the present disclosure;
fig. 9 is a schematic structural diagram of a terminal device 900 according to an embodiment of the present application;
FIG. 10 is a block diagram of a server 1000 according to an embodiment of the present application;
fig. 11 is a hardware configuration diagram of a computer device 1100 according to an embodiment of the present application.
Detailed Description
In order to solve the problems in the prior art, in some embodiments of the present application, a meeting place identifier and a window identifier are bound, a code stream of a meeting place is associated with a window through a binding relationship between the meeting place identifier and the window identifier, and when the code stream of a certain meeting place is no longer displayed, the association between the code stream of the meeting place and the window can be cut off by removing the binding relationship between the meeting place identifier and the window identifier, so that the code stream of the meeting place cannot be displayed in the window, and thus the problem of residual frames in a video conference is avoided. The following description is made with reference to the accompanying drawings.
Fig. 2 is a network architecture applied in the embodiment of the present application. The embodiment of the application can be applied to a scene that a video terminal is adopted to carry out the multi-stream conference in an enterprise, such as the multi-stream conference by using the cloud link product of Huashi corporation, and can also be applied to a multi-stream video conference scene in a public network environment, such as instant messaging software with a video conference function. And a plurality of terminal devices participate in the multi-stream conference, and each terminal device acquires the code stream of other terminal devices through the server. The terminal equipment can be a video terminal, and can also be a smart phone or a tablet computer. The server may be an MCU or a media server. Only 4 participating terminal devices are shown in fig. 2: terminal device 201, terminal device 202, terminal device 203 and terminal device 204. The number of terminal devices actually participating in the conference can be determined according to the number of terminal devices actually accessible, which is not limited in the present application.
According to the network architecture shown in fig. 2, an embodiment of the present application provides a display method 300, as shown in fig. 3. The terminal device may be any one of the terminal devices 201 to 204 in fig. 2. The first meeting place is a meeting place where some other terminal equipment except the terminal equipment is located. For example, assuming that the terminal device in fig. 3 is the terminal device 201 in fig. 2, the first meeting place may be a meeting place where one of the terminal devices 202, 203, 204 is located.
S301, the terminal device creates at least one window handle, a window corresponding to each window handle is used for displaying code streams of associated meeting places, the identification of each window and the identification of each meeting place have a one-to-one binding relationship, and the code streams of each meeting place are associated with the corresponding windows through the identification of the meeting place.
The identification of the window may be a window handle.
Specifically, after the terminal device joins the conference, the number of window handles to be created is determined according to the number of participants and the maximum number of conference places that can be displayed on the same page on the terminal device, and then the window handles are created.
In an alternative implementation manner, if the number of the conference participants is greater than the maximum number of conference places that can be displayed on the same page on the terminal device, the number of the window handles created by the terminal device is 2 times of the maximum number of conference places that can be displayed on the same page on the terminal device. For example, if the number of participants is 20, and the maximum number of sites that the terminal device can display in the same page is 4, the number of created window handles is 8. Therefore, the user can switch the meeting places displaying the first page and the second page, and when the user switches the meeting place displaying the third page, the window handle of the window of the first page can be used by the window of the third page, so that the resources of the terminal equipment can be saved. Of course, the number of created window handles may also be more than 2 times the maximum number of meeting places that can be displayed on the same page on the terminal.
S302, the terminal device requests a code stream of a first meeting place from the server, the identifier of the first meeting place and the identifier of a first window used by the terminal device for displaying the code stream of the first meeting place have a binding relationship, the first window is used for displaying the code stream of the first meeting place, and the code stream of the first meeting place is associated with the first window through the binding relationship between the identifier of the first meeting place and the identifier of the first window.
And S303, the server sends the code stream of the first meeting place to the terminal equipment.
And S304, the terminal equipment displays the code stream of the first meeting place on the first window according to the binding relationship between the identifier of the first meeting place and the identifier of the first window.
The server stores the corresponding relation between the meeting place identification and the meeting place code stream, wherein the corresponding relation comprises the corresponding relation between the identification of the first meeting place and the code stream of the first meeting place. In S301, the request carries an identifier of the first meeting place, and the server determines the code stream of the first meeting place according to the stored correspondence between the identifier of the first meeting place and the code stream of the first meeting place, and requests the first meeting place for the code stream. And then, the server forwards the requested code stream of the first meeting place to the terminal equipment, and the terminal equipment decodes the code stream and displays the decoded code stream on the first window. The correspondence between the meeting place identifier and the meeting place code stream may specifically be a correspondence between the meeting place identifier and an SSRC of the meeting place code stream.
The meeting place identifier may be a meeting number of the meeting place.
The following description will be made from three scenarios.
The first scenario is as follows: and the user indicates to stop displaying the code stream of the first meeting place. The steps are as follows.
S3051, when the terminal device receives an instruction from a user to stop displaying the code stream of the first meeting place, the terminal device releases the binding relationship between the identifier of the first meeting place and the identifier of the first window.
S3061, the terminal device stops displaying the code stream of the first meeting place.
The instruction to stop displaying the code stream of the first meeting place comprises an instruction to switch the meeting place. And the terminal equipment sends an instruction for stopping sending the code stream of the first meeting place to the terminal equipment to the server. And after receiving the instruction, the server stops sending the code stream of the first meeting place to the terminal equipment. And the terminal equipment requests the code stream of the target meeting place from the server, wherein the code stream carries the identifier of the target meeting place. And the server determines the code stream of the target meeting place according to the corresponding relation between the stored identifier of the target meeting place and the code stream of the target meeting place, and requests the code stream from the target meeting place. And after requesting the code stream of the target meeting place, the server sends the code stream of the target meeting place to the terminal equipment, and the terminal equipment decodes and displays the code stream.
In the embodiment of the application, because the binding relationship between the identifier of the first window and the identifier of the first meeting place is released, the code stream of the first meeting place is no longer related to the first window, and the code stream of the first meeting place loses the window for displaying. Even if the server requests the code stream of the target meeting place, forwards the code stream and the terminal equipment needs to consume a period of time for decoding, the terminal equipment cannot continuously display the picture of the code stream of the first meeting place in the period of time and no residual frame occurs. As shown in fig. 4.
For example, suppose that the conference places where the terminal devices 202, 203, and 204 are located are the conference place 202, the conference place 203, and the conference place 204, respectively, and the terminal device 201 is currently displaying the code stream of the conference place 202 on the first window. After a period of time, the user selects to watch the code stream of the meeting place 203, and stops watching the code stream of the meeting place 202, and then the terminal device 201 releases the binding relationship between the identifier of the meeting place 202 and the identifier of the first window. The code stream of the meeting place 202 loses the window for displaying, so the terminal device does not display the screen of the code stream of the meeting place 202 any more. In the process that the server requests the code stream of the meeting place 203, forwards the code stream of the meeting place 203 to the terminal device, and the terminal device decodes the code stream of the meeting place 203, the terminal device does not display the code stream of the meeting place 202 any more.
According to the technical scheme provided by the embodiment of the application, the meeting place identification and the window identification are bound, the code stream of the meeting place is associated with the window through the binding relation between the meeting place identification and the window identification, and when the code stream of a certain meeting place is not displayed any more, the association between the code stream of the meeting place and the window can be cut off by removing the binding relation between the meeting place identification and the window identification, so that the code stream of the meeting place can not be displayed in the window, and the problem of residual frames in a video conference is avoided.
The second scenario is as follows: and the second meeting is entered. The steps are as follows.
S3052, the terminal device receives a meeting entering indication of a second meeting place from the server, the identifier of the second meeting place and the identifier of a second window, used for displaying the code stream of the second meeting place, of the terminal device have a binding relationship, and the code stream of the second meeting place is associated with the second window through the binding relationship between the identifier of the second meeting place and the identifier of the second window.
S3062, the terminal device does not display the code stream of the first meeting place on the second window according to the binding relation between the identifier of the second meeting place and the identifier of the second window.
And after the terminal equipment receives the conference entrance instruction of the second conference place from the server, the terminal equipment creates a window handle of the second window. And then, the terminal equipment requests the code stream of the second meeting place from the server, and after receiving the code stream of the second meeting place, the terminal equipment displays the code stream of the second meeting place on the second window according to the binding relationship between the identifier of the second meeting place and the identifier of the second window.
In the prior art, a window handle is bound with a conference site code stream, a server requests a code stream of a second conference site of a new conference, transmits the code stream of the second conference site, and a terminal device decodes the code stream of the second conference site, which consumes a period of time, and during the period of time, the server sometimes displays the code stream of a first conference site which is being displayed on a window for displaying the code stream of the second conference site, so that a residual frame appears. As shown in fig. 5.
In the technical scheme provided by the embodiment of the application, because the identifier of the second window and the identifier of the second meeting place have a binding relationship, other meeting place code streams being displayed cannot be displayed on the second window, and therefore, the occurrence of residual frames is avoided. As shown in fig. 6.
The third scenario is: after the second meeting place is entered for a period of time, the second meeting place leaves. The steps are as follows.
S3053, the terminal equipment receives a leaving indication of the second meeting place from the server.
S3063, the terminal device does not display the code stream of the first meeting place on the second window according to the binding relation between the identifier of the first meeting place and the identifier of the first window.
In the prior art, an interface displaying meeting place code streams does not close a window displaying the meeting place code streams when a certain meeting place leaves, so that the problem that the interface jumps due to the closing of the window and the experience is influenced is avoided. However, this method may cause that, after the meeting place leaves the meeting, the terminal device displays the code streams of other meeting places that are not left on the window that originally displays the meeting place, and a residual frame occurs. As shown in fig. 7.
In the technical scheme provided by the embodiment of the application, because the identifier of the first meeting place and the identifier of the first window have a binding relationship, the code stream of the first meeting place cannot be displayed in the second window which does not have the binding relationship with the identifier of the first meeting place, and therefore, the occurrence of residual frames is avoided. As shown in fig. 8.
Fig. 9 is a schematic structural diagram of a terminal device 900 according to an embodiment of the present application. The terminal device 900 comprises a display module 901, a receiving module 902 and a processing module 903. The terminal device 900 is the terminal device in fig. 3, the display module 901 may be configured to execute S304 in the embodiment of fig. 3, and the receiving module 902 may be configured to execute S303 in the embodiment of fig. 3. The processing module 903 may be used to execute S301 in the embodiment of fig. 3.
In one implementation, the display module 901 is further configured to execute S3061 in the embodiment of fig. 3. The receiving module 902 is further configured to execute S3051 in the embodiment of fig. 3.
In one implementation, the display module 901 is further configured to perform S3062 in the embodiment of fig. 3, and the receiving module 902 is further configured to perform S3052 in the embodiment of fig. 3.
In one implementation, the display module 901 is further configured to perform S3063 in the embodiment of fig. 3, and the receiving module 902 is further configured to perform S3053 in the embodiment of fig. 3.
Fig. 10 is a schematic structural diagram of a server 1000 according to an embodiment of the present application. The server 1000 includes a receiving module 1001 and a transmitting module 1002. The server 1000 is the server in fig. 3, the receiving module 1001 may be configured to execute S302 in the embodiment of fig. 3, and the sending module 1002 may be configured to execute S303, S3052, and S3053 in the embodiment of fig. 3.
Fig. 11 is a hardware configuration diagram of a computer device 1100 according to an embodiment of the present application. As shown in fig. 5, computer device 1100 includes a processor 1102, a memory 1104, a communication interface 1106, and a bus 1108. The processor 1102, the memory 1104 and the communication interface 1106 are communicatively coupled to each other via a bus 1108.
The processor 1102 may be a general-purpose Central Processing Unit (CPU), a microprocessor, an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits, configured to execute related programs to implement the technical solutions provided in the embodiments of the present Application.
The Memory 1104 may be a Read Only Memory (ROM), a static Memory device, a dynamic Memory device, or a Random Access Memory (RAM). The memory 1104 may store an operating system 11041 and other application programs 11042. When the technical solution provided by the embodiment of the present application is implemented by software or firmware, program codes for implementing the technical solution provided by the embodiment of the present application are stored in the memory 1104 and executed by the processor 1102.
Bus 1108 may include a path that transfers information between various components, such as processor 1102, memory 1104, and communication interface 1106.
When the terminal device is implemented by the computer device 1100, the processor 1102 is configured to execute the program code stored in the memory 204 for implementing the technical solution provided by the embodiment of the present application, so as to implement the method shown in the embodiment of fig. 3.
When the server is implemented by the computer device 1100, the processor 1102 is configured to execute the program codes stored in the memory 204 for implementing the technical solutions provided by the embodiments of the present application, so as to implement the method shown in the embodiment of fig. 3.
It should be noted that although the general computer architecture 1100 shown in fig. 11 only shows a processor 1102, a memory 1104, a communication interface 1106 and a bus 1108, in a particular implementation, it should be apparent to those skilled in the art that the terminal devices and servers described above also contain other components necessary to achieve proper operation. Meanwhile, according to specific needs, it should be understood by those skilled in the art that the terminal device and the server may further include hardware components for implementing other additional functions. Furthermore, it should be understood by those skilled in the art that the terminal device and the server may only contain the components necessary for implementing the embodiments of the present application, and not necessarily all of the components shown in fig. 11.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (24)
1. A display method, comprising the steps of:
the method comprises the steps that terminal equipment displays a code stream of a first meeting place on a first window, the identifier of the first meeting place and the identifier of the first window, used for displaying the code stream of the first meeting place, of the terminal equipment are in binding relation, and the code stream of the first meeting place is associated with the first window through the binding relation between the identifier of the first meeting place and the identifier of the first window;
when the terminal equipment receives an instruction from a user for stopping displaying the code stream of the first meeting place, the terminal equipment cuts off the association between the code stream of the first meeting place and the first window by removing the binding relationship between the identifier of the first meeting place and the identifier of the first window;
the terminal equipment stops displaying the code stream of the first meeting place;
And the code stream of each meeting place is associated with the corresponding window through the identifier of the meeting place.
2. The method of claim 1,
and the indication for stopping displaying the code stream of the first meeting place comprises an indication for switching the meeting place.
3. The method according to claim 1, wherein after the terminal device releases the binding relationship between the identifier of the first meeting place and the identifier of the first window, the terminal device instructs the server to stop sending the code stream of the first meeting place to the terminal device.
4. The method according to any one of claims 1 to 3, wherein before the terminal device displays the codestream of the first meeting place in the first window, the terminal device creates at least one window handle, a window corresponding to the at least one window handle is used for displaying the codestream of at least one meeting place, and an identifier of each window and an identifier of each meeting place have a one-to-one binding relationship.
5. A display method, comprising the steps of:
the terminal equipment displays a code stream of a first meeting place in a first window;
the terminal equipment receives a meeting entering indication of a second meeting place from a server, the identifier of the second meeting place and the identifier of a second window used for displaying the code stream of the second meeting place by the terminal equipment have a binding relationship, and the code stream of the second meeting place is associated with the second window through the binding relationship between the identifier of the second meeting place and the identifier of the second window;
The terminal device does not display the code stream of the first meeting place on the second window according to the binding relationship between the identifier of the second meeting place and the identifier of the second window;
when the terminal equipment receives an instruction from a user for stopping displaying the code stream of the first meeting place, the terminal equipment cuts off the association between the code stream of the first meeting place and the first window by removing the binding relationship between the identifier of the first meeting place and the identifier of the first window;
and the code stream of each meeting place is associated with the corresponding window through the identifier of the meeting place.
6. The method of claim 5, wherein after the terminal device receives the indication of conference entry from the second conference room of the server, the method further comprises:
and the terminal equipment creates a window handle of the second window.
7. The method of claim 5 or 6, further comprising:
the terminal equipment requests the code stream of the second meeting place from the server;
the terminal equipment receives the code stream of the second meeting place from the server;
and the terminal equipment displays the code stream of the second meeting place on the second window according to the binding relationship between the identifier of the second meeting place and the identifier of the second window.
8. A display method, comprising the steps of:
the method comprises the steps that terminal equipment displays a code stream of a first meeting place on a first window, displays a code stream of a second meeting place on a second window, wherein a binding relationship exists between an identifier of the first meeting place and an identifier of a first window, used for displaying the code stream of the first meeting place, of the terminal equipment, and the code stream of the first meeting place is associated with the first window through the binding relationship between the identifier of the first meeting place and the identifier of the first window;
the terminal equipment receives a meeting leaving instruction of a second meeting place from the server;
the terminal device does not display the code stream of the first meeting place on the second window according to the binding relationship between the identifier of the first meeting place and the identifier of the first window;
when the terminal equipment receives an instruction from a user for stopping displaying the code stream of the first meeting place, the terminal equipment cuts off the association between the code stream of the first meeting place and the first window by removing the binding relationship between the identifier of the first meeting place and the identifier of the first window;
and the code stream of each meeting place is associated with the corresponding window through the identifier of the meeting place.
9. A display method, comprising the steps of:
A server receives a code stream request of a first meeting place from a terminal device, wherein the identifier of the first meeting place and the identifier of a first window used by the terminal device for displaying the code stream of the first meeting place have a binding relationship, and the code stream of the first meeting place is associated with the first window through the binding relationship between the identifier of the first meeting place and the identifier of the first window;
the server sends the code stream of the first meeting place to the terminal equipment;
when the terminal equipment receives an instruction from a user for stopping displaying the code stream of the first meeting place, the terminal equipment cuts off the association between the code stream of the first meeting place and the first window by removing the binding relationship between the identifier of the first meeting place and the identifier of the first window;
and the code stream of each meeting place is associated with the corresponding window through the identifier of the meeting place.
10. The method of claim 9, further comprising:
and the server receives an instruction from the terminal equipment for stopping sending the code stream of the first meeting place to the terminal equipment.
11. The method according to claim 9 or 10, characterized in that the method further comprises:
The server receives a conference entrance request of a second conference place;
the server sends a meeting entering instruction of the second meeting place to the terminal equipment;
the server receives a request of the terminal equipment for the code stream of the second meeting place;
and the server sends the code stream of the second meeting place to the terminal equipment, the identifier of the second meeting place and the identifier of a second window used for displaying the code stream of the second meeting place by the terminal equipment have a binding relationship, and the code stream of the second meeting place is associated with the second window through the binding relationship between the identifier of the second meeting place and the identifier of the second window.
12. The method of claim 11, further comprising:
the server receives a conference leaving request from the second conference place;
and the server sends the conference leaving indication of the second conference place to the terminal equipment.
13. A terminal device is characterized by comprising a display module, a receiving module and a processing module:
the display module is used for displaying the code stream of a first meeting place on a first window, the identifier of the first meeting place and the identifier of the first window, which is used for displaying the code stream of the first meeting place, of the display module have a binding relationship, and the code stream of the first meeting place is associated with the first window through the binding relationship between the identifier of the first meeting place and the identifier of the first window;
The receiving module is used for receiving an instruction from a user for stopping displaying the code stream of the first session;
the processing module is configured to disconnect association between the code stream of the first meeting place and the first window by removing the binding relationship between the identifier of the first meeting place and the identifier of the first window;
the display module is used for stopping displaying the code stream of the first meeting place after the binding relation between the identifier of the first meeting place and the identifier of the first window is removed;
and the code stream of each meeting place is associated with the corresponding window through the identifier of the meeting place.
14. The terminal device of claim 13,
and the indication for stopping displaying the code stream of the first meeting place comprises an indication for switching the meeting place.
15. The terminal device of claim 13, wherein the processing module is further configured to instruct a server to stop sending the code stream of the first meeting place to the terminal device after the binding relationship between the identifier of the first meeting place and the identifier of the first window is released.
16. The terminal device according to any one of claims 13 to 15, wherein the processing module is further configured to create at least one window handle before the display module displays the codestream of the first meeting place in the first window, a window corresponding to the at least one window handle is used to display the codestream of at least one meeting place, and an identifier of each window and an identifier of each meeting place have a one-to-one binding relationship.
17. A terminal device is characterized by comprising a display module, a receiving module and a processing module:
the display module is used for displaying the code stream of the first meeting place on the first window;
the receiving module is configured to receive a meeting entering indication of a second meeting place from a server, where an identifier of the second meeting place and an identifier of a second window, used by the display module to display a code stream of the second meeting place, have a binding relationship, and the code stream of the second meeting place is associated with the second window through the binding relationship between the identifier of the second meeting place and the identifier of the second window;
the display module is further configured to, after the receiving module receives a meeting entering instruction of the second meeting place, according to a binding relationship between an identifier of the second meeting place and an identifier of the second window, not display the code stream of the first meeting place on the second window;
the receiving module is further configured to receive an instruction from a user to stop displaying the code stream of the first session;
the processing module is configured to disconnect association between the code stream of the first meeting place and the first window by removing the binding relationship between the identifier of the first meeting place and the identifier of the first window;
And the code stream of each meeting place is associated with the corresponding window through the identifier of the meeting place.
18. The terminal device of claim 17, wherein the terminal device further comprises a processing module;
the processing module is configured to create a window handle for the second window.
19. The terminal device according to claim 17 or 18, wherein the terminal device further comprises a transmitting module;
the sending module is used for requesting the code stream of the second meeting place from the server;
the receiving module is further configured to receive a code stream of the second meeting place from the server;
and the display module is further used for displaying the code stream of the second meeting place on the second window according to the binding relationship between the identifier of the second meeting place and the identifier of the second window.
20. A terminal device is characterized by comprising a display module, a receiving module and a processing module:
the display module is used for displaying a code stream of a first meeting place on a first window and displaying a code stream of a second meeting place on a second window, the identifier of the first meeting place and the identifier of a first window, used for displaying the code stream of the first meeting place, of the display module have a binding relationship, and the code stream of the first meeting place is associated with the first window through the binding relationship between the identifier of the first meeting place and the identifier of the first window;
The receiving module is used for receiving a conference leaving instruction of a second conference place from the server;
the display module is further configured to, after the receiving module receives the indication of departure from the second meeting place, not display the code stream of the first meeting place on the second window according to the binding relationship between the identifier of the first meeting place and the identifier of the first window;
the receiving module is further configured to receive an instruction from a user to stop displaying the code stream of the first session;
the processing module is used for cutting off association between the code stream of the first meeting place and the first window by removing the binding relationship between the identifier of the first meeting place and the identifier of the first window;
and the code stream of each meeting place is associated with the corresponding window through the identifier of the meeting place.
21. A server, comprising a receiving module, a sending module and a processing module:
the receiving module is used for receiving a code stream request of a first meeting place from a terminal device, wherein the identifier of the first meeting place and the identifier of a first window used by the terminal device for displaying the code stream of the first meeting place have a binding relationship, and the code stream of the first meeting place is associated with the first window through the binding relationship between the identifier of the first meeting place and the identifier of the first window;
The sending module is used for sending the code stream of the first meeting place to the terminal equipment;
the receiving module is further configured to receive an instruction from a user to stop displaying the code stream of the first session;
the processing module is used for cutting off association between the code stream of the first meeting place and the first window by removing the binding relationship between the identifier of the first meeting place and the identifier of the first window;
and the code stream of each meeting place is associated with the corresponding window through the identifier of the meeting place.
22. The server according to claim 21,
the receiving module is further configured to receive an instruction from the terminal device to stop sending the code stream of the first meeting place to the terminal device.
23. The server according to claim 21 or 22,
the receiving module is further configured to receive a conference entrance request of a second conference place;
the sending module is further configured to send a meeting entrance instruction of the second meeting place to the terminal device;
the receiving module is further configured to receive a request from the terminal device for the code stream of the second meeting place;
the sending module is further configured to send the code stream of the second meeting place to the terminal device, where the identifier of the second meeting place and an identifier of a second window used by the terminal device to display the code stream of the second meeting place have a binding relationship, and the code stream of the second meeting place is associated with the second window through the binding relationship between the identifier of the second meeting place and the identifier of the second window.
24. The server according to claim 23,
the receiving module is further configured to receive a conference leaving request from the second conference place;
the sending module is further configured to send a meeting leaving indication of the second meeting place to the terminal device.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811139537.0A CN110971860B (en) | 2018-09-28 | 2018-09-28 | Display method and device |
| PCT/CN2019/098063 WO2020063087A1 (en) | 2018-09-28 | 2019-07-27 | Display method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811139537.0A CN110971860B (en) | 2018-09-28 | 2018-09-28 | Display method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110971860A CN110971860A (en) | 2020-04-07 |
| CN110971860B true CN110971860B (en) | 2022-06-28 |
Family
ID=69950268
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811139537.0A Active CN110971860B (en) | 2018-09-28 | 2018-09-28 | Display method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110971860B (en) |
| WO (1) | WO2020063087A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112004049B (en) * | 2020-08-18 | 2022-06-28 | 北京字节跳动网络技术有限公司 | Double-screen different display method and device and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103680551A (en) * | 2012-09-21 | 2014-03-26 | 深圳市快播科技有限公司 | Player and method thereof for simultaneously playing multiple videos |
| CN106993212A (en) * | 2017-03-20 | 2017-07-28 | 贵阳朗玛信息技术股份有限公司 | The method and device of multi-channel video is played in browser window |
| CN107018137A (en) * | 2017-04-07 | 2017-08-04 | 成都长天信息技术有限公司 | A kind of Flash reorientation methods and device |
| CN108024087A (en) * | 2016-10-31 | 2018-05-11 | 北京视联动力国际信息技术有限公司 | A kind of method and system of video dispatching |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101198067A (en) * | 2006-12-07 | 2008-06-11 | 中兴通讯股份有限公司 | Multi-picture video display processing method |
| US8848028B2 (en) * | 2010-10-25 | 2014-09-30 | Dell Products L.P. | Audio cues for multi-party videoconferencing on an information handling system |
| CN102082945A (en) * | 2011-01-26 | 2011-06-01 | 青岛海信电器股份有限公司 | Method for realizing multi-party video calls, video terminal and system |
| US9448708B1 (en) * | 2011-10-19 | 2016-09-20 | Google Inc. | Theming for virtual collaboration |
-
2018
- 2018-09-28 CN CN201811139537.0A patent/CN110971860B/en active Active
-
2019
- 2019-07-27 WO PCT/CN2019/098063 patent/WO2020063087A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103680551A (en) * | 2012-09-21 | 2014-03-26 | 深圳市快播科技有限公司 | Player and method thereof for simultaneously playing multiple videos |
| CN108024087A (en) * | 2016-10-31 | 2018-05-11 | 北京视联动力国际信息技术有限公司 | A kind of method and system of video dispatching |
| CN106993212A (en) * | 2017-03-20 | 2017-07-28 | 贵阳朗玛信息技术股份有限公司 | The method and device of multi-channel video is played in browser window |
| CN107018137A (en) * | 2017-04-07 | 2017-08-04 | 成都长天信息技术有限公司 | A kind of Flash reorientation methods and device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020063087A1 (en) | 2020-04-02 |
| CN110971860A (en) | 2020-04-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11983456B2 (en) | Screen-projection with multiple terminals | |
| CN111447487B (en) | Reverse screen projection method and system for smart screen, smart screen and readable storage medium | |
| CN112752109B (en) | Video playing control method and system | |
| CN110582012B (en) | Video switching method, video processing device and storage medium | |
| CN106330912B (en) | System and method for fusing live video and two-way call | |
| CN114546308B (en) | Method, device, equipment and storage medium for screen projection of application interface | |
| CN110913165A (en) | Video stream carousel method and device of video conference system based on cascade framework | |
| CN113141531B (en) | Method and device for cross-device play control and play device | |
| EP4037321A1 (en) | Video encoding and decoding methods and apparatuses, storage medium, and electronic device | |
| CN111803924B (en) | Multi-terminal synchronous display method and device for cloud game and readable storage medium | |
| CN105959732A (en) | Method and device for pushing television program | |
| CN113542660A (en) | Method, system and storage medium for realizing conference multi-picture high-definition display | |
| CN112637671A (en) | Screen sharing method and system | |
| CN114143586B (en) | Split screen display sharing method, system, storage medium and intelligent screen | |
| CN110971860B (en) | Display method and device | |
| CN104469248A (en) | Video session method and device, server and terminal | |
| CN102811342A (en) | Video profile cut control method, device and system | |
| CN108632681B (en) | Method, server and terminal for playing media stream | |
| WO2013001375A2 (en) | Systems, methods, and media for controlling a presentation of data images in a video stream | |
| CN105430527B (en) | Streaming media reminding method and terminal equipment | |
| CN110392285B (en) | Media stream processing method and device | |
| CN114449348A (en) | Panoramic video processing method and device | |
| CN112887752A (en) | Live broadcast establishing method and device based on multiple live broadcast platforms and storage medium | |
| EP4387239A1 (en) | Video encoding method and apparatus, electronic device, and storage medium | |
| CN113965714B (en) | Video stream processing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |