CN108809915B - Session management method and device - Google Patents
Session management method and device Download PDFInfo
- Publication number
- CN108809915B CN108809915B CN201710313998.4A CN201710313998A CN108809915B CN 108809915 B CN108809915 B CN 108809915B CN 201710313998 A CN201710313998 A CN 201710313998A CN 108809915 B CN108809915 B CN 108809915B
- Authority
- CN
- China
- Prior art keywords
- user
- terminal
- session
- audio output
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1083—In-session procedures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a session management method and a terminal; the method comprises the following steps: receiving a first audio control instruction sent by a first terminal based on a first session group; the first session group comprises a first user corresponding to the first terminal and at least one second user except the first user; the first audio control instruction is used for requesting to control the audio output state of at least one second user in the first conversation group; and sending the first audio control instruction to at least one second terminal corresponding to the at least one second user in the first session group, so that the at least one second terminal controls the audio output state of the second terminal based on the first audio control instruction.
Description
Technical Field
The present invention relates to internet communication technologies, and in particular, to a session management method and apparatus.
Background
The appearance of instant messaging software (such as QQ and WeChat) meets the requirement of people for mutual contact, and the group video (such as multi-person video conference) function in the instant messaging software also greatly improves the communication effect of users. However, when a plurality of users perform group video, the environment of the users is different, and the sound of the environment of some users is noisy, so that the sound of the user who has uttered the speech in the conversation process cannot be clearly heard by other users, which causes trouble to the conversation among the users, and greatly reduces the communication efficiency among the users.
Disclosure of Invention
Embodiments of the present invention provide a session management method and apparatus, which at least solve the problems in the prior art, and can control an audio output state of a user in a session group, thereby reducing interference of a user side sound on a group session.
The technical scheme of the embodiment of the invention is realized as follows:
the embodiment of the invention provides a session management method, which comprises the following steps:
receiving a first audio control instruction sent by a first terminal based on a first session group; the first session group comprises a first user corresponding to the first terminal and at least one second user except the first user; the first audio control instruction is used for requesting to control the audio output state of at least one second user in the first conversation group;
and sending the first audio control instruction to at least one second terminal corresponding to the at least one second user in the first session group, so that the at least one second terminal controls the audio output state of the second terminal based on the first audio control instruction.
In the above scheme, the method further comprises:
receiving a first state updating message sent by the at least one second terminal;
updating the stored audio output status of the at least one second user in the first session group based on the first status update message;
and sending a state synchronization message to all users in the first session group, so that the terminal corresponding to each user in the first session group synchronizes the audio output states of all users in the first session group based on the state synchronization message.
In the above scheme, the method further comprises:
receiving a session joining request of a third terminal; the session joining request is used for requesting a third user corresponding to the third terminal to join the first session group;
sending a session joining response message based on the session joining request; and the session joining response message carries the audio output states of all the users in the first session group.
In the foregoing solution, after receiving a first audio control instruction sent by the first terminal based on the first session group, the method further includes:
sending a control response message to the first terminal so that the first terminal controls the audio output state of at least one second user in the first session group based on the control response message;
wherein the control response message indicates permission to control audio output states of users of the first session group.
In the above scheme, the method further comprises:
receiving a second state updating message sent by the first terminal after the first terminal changes the audio output state of the first terminal;
updating the stored audio output status of the first user in the first session group based on the second status update message.
In the foregoing solution, before the sending the first audio control instruction to at least one second terminal corresponding to the at least one second user in the first session group, the method further includes:
receiving a second audio control instruction sent by at least one fourth terminal corresponding to at least one fourth user in the first session group;
acquiring a first time parameter contained in the first audio control instruction, and respectively acquiring at least one second time parameter contained in at least one second audio control instruction;
comparing the first time parameter with the at least one second time parameter to obtain a comparison result;
correspondingly, the sending the first audio control instruction to at least one second terminal corresponding to the at least one second user in the first session group includes:
and when the time represented by the first time parameter is later than the time represented by the at least one second time parameter, sending a first audio control instruction to at least one second terminal corresponding to the at least one second user in the first session group.
An embodiment of the present invention further provides a session management apparatus, where the apparatus includes: the device comprises a receiving module and a sending module;
the receiving module is used for receiving a first audio control instruction sent by the first terminal based on the first session group; the first session group comprises a first user corresponding to the first terminal and at least one second user except the first user; the first audio control instruction is used for requesting to control the audio output state of at least one second user in the first conversation group;
the sending module is configured to send the first audio control instruction to at least one second terminal corresponding to the at least one second user in the first session group, so that the at least one second terminal controls an audio output state of the at least one second terminal based on the first audio control instruction.
In the above scheme, the apparatus further comprises a processing module;
the receiving module is further configured to receive a first status update message sent by the at least one second terminal;
the processing module is configured to update the stored audio output status of the at least one second user in the first session group based on the first status update message;
the sending module is further configured to send a status synchronization message to all users in the first session group, so that the terminal corresponding to each user in the first session group synchronizes audio output statuses of all users in the first session group based on the status synchronization message.
In the above scheme, the receiving module is further configured to receive a session joining request of a third terminal; the session joining request is used for requesting a third user corresponding to the third terminal to join the first session group;
the sending module is further configured to send a session join response message based on the session join request; and the session joining response message carries the audio output states of all the users in the first session group.
In the foregoing solution, the sending module is further configured to send a control response message to the first terminal, so that the first terminal controls an audio output state of at least one second user in the first session group based on the control response message;
wherein the control response message indicates permission to control audio output states of users of the first session group.
In the above scheme, the apparatus further comprises a processing module;
the receiving module is further configured to receive a second state update message sent by the first terminal after the first terminal changes its own audio output state;
the processing module is configured to update the stored audio output status of the first user in the first session group based on the second status update message.
In the above scheme, the apparatus further comprises a processing module;
the receiving module is further configured to receive a second audio control instruction sent by at least one fourth terminal corresponding to at least one fourth user in the first session group;
the processing module is configured to obtain a first time parameter included in the first audio control instruction, and respectively obtain at least one second time parameter included in at least one second audio control instruction;
comparing the first time parameter with the at least one second time parameter to obtain a comparison result;
correspondingly, the sending module is further configured to send a first audio control instruction to at least one second terminal corresponding to the at least one second user in the first session group when the time represented by the first time parameter is later than the time represented by the at least one second time parameter.
According to the session management method and device provided by the embodiment of the invention, a server receives a first audio control instruction sent by a first terminal based on a first session group; the first session group comprises a first user corresponding to the first terminal and at least one second user except the first user; the first audio control instruction is used for requesting to control the audio output state of at least one second user in the first conversation group; and transmitting the first audio control instruction to at least one second terminal corresponding to at least one second user in the first session group, so that the at least one second terminal controls the audio output state of the second terminal based on the first audio control instruction. Therefore, the control of the audio output state of other users in the group conversation can be realized based on the actual needs of the users, for example, one or more users in the group are controlled to prohibit the audio output, so that the other users carry out the audio output, the conversation quality and efficiency of the group conversation are improved, and the user experience is improved.
Drawings
FIG. 1 is a diagram of hardware entities performing information interaction in an embodiment of the present invention;
fig. 2 is a first flowchart illustrating a session management method according to an embodiment of the present invention;
FIG. 3 is a first topology diagram of a session management method according to an embodiment of the present invention;
FIG. 4 is a first diagram of a display interface for session management according to an embodiment of the present invention;
FIG. 5 is a flowchart illustrating a second session management method according to an embodiment of the present invention;
FIG. 6 is a topology diagram of a session management method according to an embodiment of the present invention;
FIG. 7 is a second diagram of a display interface for session management according to an embodiment of the present invention;
fig. 8 is a third schematic flowchart of a session management method according to an embodiment of the present invention;
fig. 9 is a topology diagram of a session management method according to an embodiment of the present invention;
fig. 10 is a fourth flowchart illustrating a session management method according to an embodiment of the present invention;
FIG. 11 is a third diagram of a display interface for session management according to an embodiment of the present invention;
FIG. 12 is a diagram illustrating a network architecture of a session management method according to an embodiment of the present invention;
FIG. 13 is a schematic diagram illustrating a structure of a session management apparatus according to an embodiment of the present invention;
fig. 14 is a diagram illustrating a session management apparatus as an example of a hardware entity according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
It should be noted that the terms "first \ second \ third" related to the embodiments of the present invention are merely used for distinguishing similar objects, and do not represent a specific ordering for the objects, and it should be understood that "first \ second \ third" may exchange a specific order or sequence order if allowed. It should be understood that the terms first, second, and third, as used herein, are interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in other sequences than those illustrated or otherwise described herein.
Fig. 1 is a schematic diagram of hardware entities performing information interaction in an embodiment of the present invention, where fig. 1 includes: the system comprises a server 11 … … 1n and terminal devices 21-24, wherein the terminal devices 21-24 perform information interaction with the server through a wired network or a wireless network, and the terminal devices comprise mobile phones, desktop computers, PCs, all-in-one machines and the like. In one example, an instant messaging client (e.g. We Video) is provided on the terminal device, different users perform group sessions based on the instant messaging clients on different terminal devices, and the users control audio output states of other users through the server based on actual needs.
Example one
An embodiment of the present invention provides a session management method, where the method is applied to a server, fig. 2 is a flowchart illustrating the session management method in the embodiment of the present invention, fig. 3 is a topology diagram illustrating the session management method in the embodiment of the present invention, and with reference to fig. 2 and fig. 3, the session management method in the embodiment of the present invention includes:
step 101: the server receives an audio control instruction sent by the first terminal based on the first session group.
Here, the first session group includes a first user corresponding to the first terminal and at least one second user other than the first user; the audio control instruction is used for requesting to control the audio output state of at least one second user in the first conversation group. Wherein the audio output state comprises: a first audio state characterizing an audio output of the user is enabled, and a second audio state characterizing an audio output of the user is disabled.
In practical applications, the first session group may be a multi-user video session group, for example, a group video conference is performed among multiple people, and accordingly, the first user is a user in the session group that requests to control the audio output states of other users, and the users other than the first user in the session group are second users. One example is: fig. 4 is a schematic diagram of a display interface for group conversation among multiple users, that is, for group conversation management, as shown in fig. 4, four users perform a video call, and a first user finds that an environmental sound where a second user a is located is noisy, which affects output quality of own sound, that is, noise at the second user a is interspersed with a sound spoken by the first user, which causes B, C of the second user to possibly hear the speech content of the first user, so that the first user wants to prohibit audio output of the second user a, that is, control an audio output state of a terminal corresponding to the second user a to be a second audio state, and at this time, the first user sends an audio control instruction to a server through a terminal corresponding to itself, so that the server sends the instruction to the second user a, and further controls an audio output state of a terminal corresponding to the second user a. The audio control instruction at least carries an identifier of a user in a controlled audio output state, such as an Identity (ID) corresponding to the user in the controlled audio output state, and a corresponding user audio output state, such as a first audio state/a second audio state.
Step 102: and sending the audio control instruction to at least one second terminal corresponding to at least one second user in the first session group, so that the at least one second terminal controls the audio output state of the second terminal based on the audio control instruction.
In practical implementation, after receiving the audio control instruction of the first user, the server transparently transmits the audio control instruction to all users except the first user in the first session group, that is, other users except the first user in the first session group receive the audio control instruction. When other users except the first user in the first session group receive the audio control instruction, the ID carried in the audio control instruction is found through instruction analysis, and then the audio control instruction carries the audio output control (i.e. the control forbids local audio output corresponding to the second audio state) based on the audio output state (such as the second audio state) carried in the first audio instruction. In practical application, when a first user needs to control the audio output states of a plurality of second users, the audio control instruction carries IDs corresponding to the plurality of second users.
For example, as to fig. 4 in this embodiment, after the second user A, B, C receives the audio control instruction sent by the server, the audio control instruction is respectively analyzed to obtain the ID information of the terminal corresponding to the second user a carried in the audio control instruction and a corresponding audio output state, that is, the second audio state, then the terminal corresponding to the second user B, C does not process the audio control instruction, and ignores the audio control instruction, and the terminal corresponding to the second user a controls the audio output state to be that local audio output is prohibited based on the audio control instruction.
In an embodiment, when at least one second terminal corresponding to at least one second user in the first session group implements local audio output control based on the audio control instruction transmitted by the server, a status update message (the status update message carries an audio output status after the terminal implements audio control of itself) is sent to the server, to cause the server to update its own stored audio output status of the at least one second user in the first session group based on the status update message, then the server sends a state synchronization message to all users in the first session group, so that the terminal corresponding to each user in the first session group synchronizes the audio output states of all users in the first session group based on the state synchronization message, the users in the first session group may in turn further have audio output state control based on the current user state.
By applying the above embodiment of the present invention, when the first user wants to control at least one other user except the first user in the first session group, an audio control instruction is sent to the server, the server transparently transmits the audio control instruction to all users except the first user in the first session group, and all users except the first user in the first session group know whether they need to perform audio output state control or not through the ID of the controlled user carried by the audio control instruction, and perform audio output state control corresponding to the audio output state carried by the audio control instruction when knowing that the audio control instruction carries their ID. Therefore, the control of the user audio output state in the conversation group based on the user needs is realized, the conversation quality of the group conversation is further improved, and the user experience is improved.
Example two
An embodiment of the present invention provides a session management method, where the method is applied to a server, fig. 5 is a flowchart illustrating a session management method in an embodiment of the present invention, fig. 6 is a topology diagram illustrating a session management method in an embodiment of the present invention, and with reference to fig. 5 and 6, the session management method in an embodiment of the present invention includes:
step 201: the server receives an audio control instruction sent by the first terminal based on the first session group.
Here, the first session group includes a first user corresponding to the first terminal and at least one second user other than the first user; the audio control instruction is used for requesting to control the audio output state of at least one second user in the first conversation group. Wherein the audio output state comprises: a first audio state characterizing an audio output of the user is enabled, and a second audio state characterizing an audio output of the user is disabled.
In practical application, when multiple users perform multi-user video conversation, the environment of the users is different, and the environmental sound of some users is noisy, so that the sound of the user who makes a speech in the conversation process cannot be clearly heard by other users, at this time, the user who makes a speech has a need to control the audio output state of other users in the conversation group (the audio output state of one or more users in the conversation group is controlled to be the second audio state, namely the audio output of the users is prohibited), and an audio control instruction is sent to the server through the terminal; the audio control instruction at least carries an identifier of a user in the controlled audio output state, such as an ID corresponding to the user in the controlled audio output state, and a corresponding user audio output state, such as a first audio state/a second audio state. And when the first user wants to control the audio output states of the plurality of users, the audio control instruction carries the IDs of the plurality of controlled users.
Based on the above embodiment of the present invention, in practical applications, after receiving an audio control instruction sent by a first terminal, a server sends a control response message to the first terminal, so that the first terminal locally controls an audio output state of at least one second user in a first session group based on the control response message; wherein the control response message indicates permission to control audio output states of users of the first session group. That is, after the first terminal receives the control response message sent by the server, the first terminal may implement the prohibition/permission of the audio output of the at least one second user locally before the at least one second user performs the audio control on itself without waiting for the at least one second user to implement the audio control. For example: and after the first terminal receives a control response message sent by the server, the first terminal locally forbids the audio output of the second user A and the second user B instead of realizing the audio output control of the terminal corresponding to the second user A and the terminal corresponding to the second user B. Therefore, the audio control efficiency is improved, and the group conversation quality is improved more quickly. It should be noted that, the operation performed by the first terminal after receiving the control response message sent by the server to locally control the audio output state of the at least one second user in the first session group is not necessary, that is, the first terminal may ignore the control response message sent by the server and does not perform any processing.
Step 202: and sending the audio control instruction to at least one second terminal corresponding to at least one second user in the first session group.
In practical implementation, after receiving the audio control instruction of the first user, the server transparently transmits the audio control instruction to all users except the first user in the first session group, that is, except the first user, the other users in the first session group all receive the audio control instruction, so that the at least one second terminal controls the audio output state of the second terminal based on the audio control instruction. When other users except the first user in the first session group receive the audio control instruction, the ID carried in the audio control instruction is found through instruction analysis, and then the audio control instruction carries the audio output control (i.e. the control forbids local audio output corresponding to the second audio state) based on the audio output state (such as the second audio state) carried in the first audio instruction. In practical application, when a first user needs to control the audio output states of a plurality of second users, the audio control instruction carries IDs corresponding to the plurality of second users.
Step 203: and receiving a first state updating message sent by the at least one second terminal after the local audio control is realized.
Here, in practical applications, after the at least one second terminal implements local audio control based on the audio control instruction transparently transmitted by the server, the updated state information of the second terminal is reported, and the updated audio output state information of the terminal is carried in the first state update message. For example: and the terminal corresponding to the second user A and the terminal corresponding to the second user B locally realize audio output state control, and then a first state updating message is sent to the server, wherein the first state updating message carries the audio output state updated by the terminal, such as the second audio state, so that the server updates the audio output states of the second user A and the second user B stored by the server based on the first state updating message reported by the terminal.
Step 204: and updating the stored audio output state of the at least one second user in the first session group based on the first state update message, and sending a state synchronization message to all users in the first session group.
In practical application, after updating the audio output state of the corresponding user in the first session group stored by the server based on the reported first state update message, the server sends a state synchronization message to all users in the first session group, so that the terminal corresponding to each user in the first session group synchronizes the audio output state of the users in the first session group based on the state synchronization message, and further the users in the first session group can further perform audio output state control based on the current user state. For example: after the audio output states of the users in the first session group are synchronized by all the users in the first session group based on the state synchronization message of the server, it is known that the audio output states of the second user a and the second user B are the second audio state (i.e. the audio output of the second user a and the second user B is prohibited), and then it can be determined whether to further control the audio output states of the second user a and the second user B (or other users in the first session group) according to actual needs, for example, the audio output state of the second user a is controlled to be the first audio state (the audio output of the second user a is permitted).
Based on the embodiment of the invention, in practical application, during a conversation process, a user may need to speak with a nearby person but the content is not wanted to be heard by the users in a group conversation based on the current needs, at this time, the user has a need to change the audio output state of the user, as shown in fig. 7, when a first user sends an instruction to change the audio output state of the user to a first terminal (the user clicks a mute key in fig. 7), the first terminal performs audio output control based on the instruction, and reports the audio output state of the user to a server through a second state update message (carrying updated audio output state information of the first terminal, such as a second audio state) after the audio output control is completed, after receiving the second state update message sent by the first terminal, the server updates the audio output state of the first user stored by the server based on the state update message, and sending a state synchronization message to all users in the first session group, so that each user in the first session group synchronizes the audio output state of the first user based on the state synchronization message. That is, no matter the current terminal performs audio output state control based on the instruction of the user corresponding to the current terminal or performs audio output state control based on the instructions of other users in the first session group, after the local audio output state update is realized, the audio output state control is reported to the server, so that the server updates the locally stored audio output state of the users in the first session group, and further, the users in the first session group perform audio output state synchronization.
Step 205: and receiving a session joining request of a third terminal, and sending a session joining response message to the third terminal.
Here, as shown in fig. 6, the session joining request is used to request that a third user corresponding to the third terminal is joined to the first session group; and the session joining response message carries the audio output states of all the users in the first session group. In this way, the third user can know the audio output state of each user in the first conversation group at the first time of joining the first conversation group.
By applying the above embodiment of the present invention, the first user sends the audio control instruction for controlling the other users except the first outdoor in the first session group to the server based on the first terminal, and the server transparently transmits the audio control instruction to all users except the first outdoor in the first session group to realize the control of the audio output state of the users in the first session group, and the user who completes the control of the audio output state reports the updated audio output state to the server, so that the server updates the audio output state of the users in the first session group stored by itself, and sends the state synchronization message to the users in the first session group to enable the users in the session group to update the audio output state of all users, thereby preparing for further realizing the control of the audio output state of the users in the first session group; when a user in a non-first session group wants to join the session group, the server carries the audio output states of all users in the first session group in a loopback packet for the user, so that the user can know the audio output states of the users in the session group at the first time of joining the first session group.
EXAMPLE III
An embodiment of the present invention provides a session management method, where the method is applied to a server, fig. 8 is a flowchart illustrating a session management method in an embodiment of the present invention, fig. 9 is a topology diagram illustrating a session management method in an embodiment of the present invention, and it should be noted that, in fig. 9, a first instruction is a first audio control instruction, and a second instruction is a second audio control instruction, where, with reference to fig. 8 and fig. 9, the session management method in an embodiment of the present invention includes:
step 301: the server receives a first audio control instruction sent by the first terminal based on the first session group and a second audio control instruction sent by at least one second terminal based on the first session group.
Here, the first session group at least includes a first user corresponding to the first terminal and at least one second user corresponding to the at least one second terminal; in an embodiment, the first session group further comprises at least one third user in addition to the first user and at least one second user. The first audio control instruction is used for requesting to control the audio output state of at least one fourth user in the first conversation group, and the fourth user is a user other than the first user in the first conversation group; the second audio control instruction is used for requesting to control the audio output state of at least one fifth user in the first session group, and the fifth user is a user other than the second user in the first session group corresponding to the second audio control instruction. One example is: the server receives a first audio control instruction sent by a terminal (namely a first terminal) corresponding to the user A and a second audio control instruction sent by terminals (namely two second terminals) corresponding to the user B and the user C, namely, from the perspective of instruction sending, the user A is a first user, the user B and the user C are second users, and the user D is a third user; the first audio control instruction is used for requesting to control the audio output states of the user B and the user C (from the controlled perspective, the user B and the user C are also the fourth users), and the first audio control instruction carries the IDs of the user B and the user C; the second audio control instruction is used for requesting to control the audio output state of the user D (from the controlled perspective, the user D is also the fifth user), and the second audio control instruction carries the ID of the user D.
Step 302: and obtaining a first time parameter contained in the first audio control instruction, respectively obtaining at least one second time parameter contained in at least one second audio control instruction, and comparing the first time parameter with the at least one second time parameter to obtain a comparison result.
Here, in an embodiment, the first time parameter corresponds to a first operating timestamp, and the second time parameter corresponds to a second operating timestamp; in practical implementation, when the terminal encapsulates the audio control instruction, an operation timestamp is added, the first session group shares the calibration time of a starting point, that is, the operation time corresponding to the operation timestamp is the calibrated time, after the server receives the first audio control instruction and the second audio control instruction, the operation time corresponding to the audio instruction can be obtained based on the operation timestamp added to the instruction, and the server can know the morning and evening of the sending of each audio control instruction by comparing the operation timestamps corresponding to each audio control instruction. An operation time stamp as referred to herein is a sequence of characters that uniquely identifies a time of a moment.
One example is that the operation time corresponding to the first operation timestamp is 11:03, the operation times corresponding to the two second operation timestamps are 11:01 and 11:02, respectively, and due to network latency, the server receives the first audio control command and the two second audio control commands at 11:05 at the same time, and by comparing the first operation timestamp and the two second operation timestamps, it is found that the transmission time of the first audio control command is later than the transmission time of the two second audio control commands.
Step 303: and determining that the time represented by the first time parameter is later than the time represented by the at least one second time parameter, and sending a first audio control instruction to terminals corresponding to other users except the first user in the first session group.
In practical implementation, when the server receives a plurality of audio control commands at the same time, the operating time is the closest to the current time (i.e., the time when the command is received), that is, the operating time among the plurality of audio control commands is the latest.
And after determining that the first audio control instruction is taken as a criterion, the server transparently transmits the first audio control instruction to all other users except the first user in the first session group. And the user receiving the instruction knows whether to carry out audio output state control or not based on the ID of the controlled user carried in the first audio control instruction. For example: the first audio control instruction is used for requesting to control the audio output states of the user B and the user C, and carries the IDs of the user B and the user C, when the terminal corresponding to the user B and the user C finds that the instruction carries the ID of the user B and the user C after analyzing the first audio control instruction, the audio output control (i.e., the local audio output is prohibited) is performed based on the audio output state (such as the second audio state) carried by the first audio control instruction, and the terminal corresponding to the user D in the first session group analyzes the first audio control instruction and finds that the ID of the user D does not exist, the audio control instruction is ignored, that is, no processing is performed.
Step 304: and receiving a state updating message sent by the terminal realizing the local audio control, and updating the audio output state of the terminal realizing the local audio control based on the state updating message.
Here, in practical applications, after the user terminal in the first session group implements local audio output control based on the first audio control instruction, the updated audio output state of the user terminal is reported, so that the server updates the audio output state of the user in the first session group stored in the server. For example: and after the terminals corresponding to the user B and the user C in the first session group realize local audio output control, sending a state updating message carrying the self-updated audio output state information to the server, so that the server updates the self-stored audio output states of the user B and the user C based on the state updating message.
Step 305: and sending a state synchronization message to all the users in the first session group so that the users in the first session group synchronize the audio output states of the users in the first session group.
Step 306: receiving a session joining request sent by a terminal corresponding to a user in a non-first session group, and returning a session joining response message; the session join response message carries the audio output states of all users in the first session group.
Here, as shown in fig. 9, the session join request is for requesting to join the user in the non-first session group to the first session group; the session joining response message returned by the server carries the audio output states of all the users in the first session group, so that the users in the non-first session group can know the audio output states of all the users in the session group at the first time of joining the first session group conveniently.
By applying the embodiment of the invention, when the server receives a plurality of audio control instructions in the first session group at the same time, the sending morning and night of each audio control instruction are determined by comparing the operation time stamps of the audio control instructions, and then the audio control instruction with the operation time closest to the current receiving time is taken as the reference for transparent transmission, so that the audio output state control of the users in the first session group is realized, and the session quality and the session efficiency of the group session are improved; when a user in a non-first session group wants to join the session group, the server carries the updated audio output states of all users in the first session group in a loopback packet for the user, so that the user can know the audio output states of the users in the session group at the first time of joining the first session group.
Example four
An embodiment of the present invention provides a session management method, which is applied to audio output state control in a multi-user communication process, where a first session group includes a user a, a user B, a user C, and a user D, fig. 10 is a flowchart illustrating the session management method in the embodiment of the present invention, and as shown in fig. 10, the session management method in the embodiment of the present invention includes:
step 401: and the terminal corresponding to the user A sends an audio control instruction to the server based on the first session group.
Here, the audio control instruction transmitted by the user a is for requesting control of the audio output states of the user B and the user C. The audio output states include: a first audio state characterizing an audio output of the user is enabled, and a second audio state characterizing an audio output of the user is disabled. The audio control instruction carries ID information of the user B and the user C and corresponding audio output states, which are the second audio state in this embodiment.
One example is: when a plurality of users are in a multi-user video conference, because the environment of each user is different, noise around the user is partially transmitted into the conference, which causes the environmental sound of the whole conference to be disordered, and sometimes the participating members may forget to turn off the microphone function of their terminal because of emergency, so that other members who need to participate control the sound of their ends, as shown in fig. 11, all the participating members can perform voice control (e.g. forbid) on any or all of the group video conference, the user can control their own silence (forbid) by clicking the first button in fig. 11, releases the forbid when clicking again, controls the silence (forbid) of all the members except themselves in the conference by clicking the silence mode in fig. 11, mutes (forbid) a certain member controlled by the microphone icon at the left lower part of the user head by clicking the user button G in fig. 11, and dismissing the claim to the member when clicking again. All members in the group chat have authority to send audio control commands for controlling the voice output states of other members, in practical applications, the audio control commands may be Circuit Switched (CS) signaling, the audio control commands are encapsulated by the session management module, an operation timestamp seq (i.e., a character sequence uniquely identifying time) is added, and then the audio control commands are sent to the server, as shown in fig. 12. It should be noted that the group sessions share the calibration time of a starting point, and the operation time corresponding to the operation timestamp is the time calibrated by the same calibration time.
Step 402: and the server respectively transmits the audio control instruction to terminals corresponding to the user B, the user C and the user D.
Here, in practical applications, if the server only receives the audio control instruction sent by the user a at the same time, the server directly passes the audio control instruction to other users in the first session group; if the server receives a plurality of audio control instructions at the same time, for example, the server receives the audio control instructions sent by the user a and the user D at the same time, the server determines the morning and evening of each audio control instruction by comparing the operation time stamps carried by the audio control instructions, and takes the audio control instruction with the operation time closest to the time when the server receives the audio control instructions as the standard.
Step 403: and the server sends a control response message to the terminal corresponding to the user A.
Here, the control response message is used to indicate that user a is allowed to control the other users in the session group. It should be noted that, in practical applications, when the server does not allow the user sending the audio control command to perform audio control, a message representing that his request is rejected or the audio control command is ignored may be returned.
Step 404: and the terminals corresponding to the user B, the user C and the user D analyze the received audio control instruction, and update the audio output state of the terminals based on the audio control instruction.
In practical implementation, the user terminal receiving the audio control command performs command parsing, and performs audio output control locally based on the audio output state carried in the audio control command when the parsing result includes its own ID information.
Step 405: and the terminal corresponding to the user A locally controls the audio output state of the user B, the user C and the user D.
Here, when the terminal corresponding to the user a receives permission to perform audio output state control on other users in the group, the terminal performs audio output state control on the user B, the user C and the user D locally first, for example, the user B is permitted to perform audio output, and the user C and the user D are prohibited from performing audio output.
Step 406: and reporting the state updating message to a server by the terminal for realizing local audio output control based on the audio control instruction.
In practical application, the updated audio output state of the terminal is carried in the state update message to inform the server of the completion of audio control and enable the server to update the audio output state of the user stored in the server.
Step 407: and the server updates the audio output state of the user realizing the audio output control based on the state updating message reported by the terminal.
Step 408: and sending a state synchronization message to all the user terminals in the first session group so that all the user terminals synchronize the audio output states of the users in the first session group.
Here, after the user side terminal synchronizes the audio output state of the users in the first session group on the server, the audio output state is displayed on the video interface of the terminal side, as shown in fig. 11, when the audio output of the user is allowed, the Q icon in fig. 11 is displayed, and when the audio output of the user is not allowed, the P icon in fig. 11 is displayed.
In practical application, during a group session of a user, other non-group members want to join the group session, a terminal corresponding to the non-group member sends a session joining request to a server to request to join the group session, and the server returns a session joining response message and carries audio output states of all members in the group session, so that the non-group member knows the audio output state of the group member at a first time of joining the group session.
EXAMPLE five
In this embodiment, a session management apparatus is provided, as shown in fig. 13, which is a schematic diagram of a structure of the session management apparatus according to an embodiment of the present invention, where the apparatus may be located on one server, or different modules of the apparatus are respectively located on a plurality of servers, as shown in fig. 13, the session management apparatus according to the embodiment of the present invention includes: a receiving module 31 and a transmitting module 32;
the receiving module 31 is configured to receive a first audio control instruction sent by the first terminal based on the first session group; the first session group comprises a first user corresponding to the first terminal and at least one second user except the first user; the first audio control instruction is used for requesting to control the audio output state of at least one second user in the first conversation group;
the sending module 32 is configured to send the first audio control instruction to at least one second terminal corresponding to the at least one second user in the first session group, so that the at least one second terminal controls an audio output state of the at least one second terminal based on the first audio control instruction.
In an embodiment, the apparatus further comprises a processing module 13;
the receiving module 31 is further configured to receive a first status update message sent by the at least one second terminal;
the processing module 33 is configured to update the stored audio output status of the at least one second user in the first session group based on the first status update message;
the sending module 32 is further configured to send a status synchronization message to all users in the first session group, so that the terminal corresponding to each user in the first session group synchronizes audio output statuses of all users in the first session group based on the status synchronization message.
In an embodiment, the receiving module 31 is further configured to receive a session joining request of a third terminal; the session joining request is used for requesting a third user corresponding to the third terminal to join the first session group;
the sending module 32 is further configured to send a session join response message based on the session join request; and the session joining response message carries the audio output states of all the users in the first session group.
In an embodiment, the sending module 32 is further configured to send a control response message to the first terminal, so that the first terminal controls an audio output state of at least one second user in the first session group based on the control response message;
wherein the control response message indicates permission to control audio output states of users of the first session group.
In an embodiment, the apparatus further comprises a processing module 33;
the receiving module 31 is further configured to receive a second state update message sent by the first terminal after the first terminal changes its own audio output state;
the processing module 33 is configured to update the stored audio output status of the first user in the first session group based on the second status update message.
In an embodiment, the apparatus further comprises a processing module 33;
the receiving module 31 is further configured to receive a second audio control instruction sent by at least one fourth terminal corresponding to at least one fourth user in the first session group;
the processing module 33 is configured to obtain a first time parameter included in the first audio control instruction, and respectively obtain at least one second time parameter included in at least one second audio control instruction;
comparing the first time parameter with the at least one second time parameter to obtain a comparison result;
correspondingly, the sending module 32 is further configured to send a first audio control instruction to at least one second terminal corresponding to the at least one second user in the first session group when the time represented by the first time parameter is later than the time represented by the at least one second time parameter.
In the embodiment of the present invention, the receiving module 31, the sending module 32, and the Processing module 33 in the session management apparatus may be implemented by a Central Processing Unit (CPU) or a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), or an Integrated Circuit (ASIC) in the terminal.
Here, it should be noted that: the above description related to the session management apparatus is similar to the above description of the method, and the description of the beneficial effects of the same method is not repeated. For technical details that are not disclosed in the terminal embodiments of the present invention, refer to the description of the method embodiments of the present invention.
In this embodiment, an example of a hardware entity as the session management apparatus is shown in fig. 14. The session management means comprises a processor 61, a storage medium 62 and at least one external communication interface 63; the processor 61, the storage medium 62 and the external communication interface 63 are all connected by a bus 64.
Those skilled in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: various media that can store program codes, such as a removable Memory device, a Random Access Memory (RAM), a Read-Only Memory (ROM), a magnetic disk, and an optical disk.
Alternatively, the integrated unit of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a terminal, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage device, a RAM, a ROM, a magnetic or optical disk, or various other media that can store program code.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (12)
1. A method for session management, the method comprising:
receiving a first audio control instruction sent by a first terminal based on a first session group and a second audio control instruction sent by at least one fourth terminal based on the first session group; the first session group comprises a first user corresponding to the first terminal and at least one second user except the first user; the first audio control instruction is used for requesting to control the audio output state of at least one second user in the first conversation group; the second audio control instruction is used for requesting to control the audio output states of users except for a fourth user corresponding to the fourth terminal in the first session group;
acquiring a first time parameter contained in a first audio control instruction and a second time parameter respectively contained in at least one second audio control instruction;
comparing the first time parameter with the at least one second time parameter;
and when the time represented by the first time parameter is later than the time represented by the at least one second time parameter, sending the first audio control instruction to at least one second terminal corresponding to the at least one second user in the first session group, so that the at least one second terminal controls the audio output state of the second terminal based on the first audio control instruction.
2. The method of claim 1, further comprising:
receiving a first state updating message sent by the at least one second terminal;
updating the stored audio output status of the at least one second user in the first session group based on the first status update message;
and sending a state synchronization message to all users in the first session group, so that the terminal corresponding to each user in the first session group synchronizes the audio output states of all users in the first session group based on the state synchronization message.
3. The method of claim 2, further comprising:
receiving a session joining request of a third terminal; the session joining request is used for requesting a third user corresponding to the third terminal to join the first session group;
sending a session joining response message based on the session joining request; and the session joining response message carries the audio output states of all the users in the first session group.
4. The method of claim 1, wherein after receiving a first audio control command sent by the first terminal based on the first session group, the method further comprises:
sending a control response message to the first terminal so that the first terminal controls the audio output state of at least one second user in the first session group based on the control response message;
wherein the control response message indicates permission to control audio output states of users of the first session group.
5. The method of claim 1, further comprising:
receiving a second state updating message sent by the first terminal after the first terminal changes the audio output state of the first terminal;
updating the stored audio output status of the first user in the first session group based on the second status update message.
6. A session management apparatus, characterized in that the apparatus comprises: the device comprises a receiving module, a sending module and a processing module;
the receiving module is used for receiving a first audio control instruction sent by a first terminal based on a first session group and a second audio control instruction sent by at least one fourth terminal based on the first session group; the first session group comprises a first user corresponding to the first terminal and at least one second user except the first user; the first audio control instruction is used for requesting to control the audio output state of at least one second user in the first conversation group; the second audio control instruction is used for requesting to control the audio output states of users except for a fourth user corresponding to the fourth terminal in the first session group;
the processing module is used for acquiring a first time parameter contained in a first audio control instruction and a second time parameter respectively contained in at least one second audio control instruction;
comparing the first time parameter with the at least one second time parameter;
the sending module is configured to send the first audio control instruction to at least one second terminal corresponding to the at least one second user in the first session group when the time represented by the first time parameter is later than the time represented by the at least one second time parameter, so that the at least one second terminal controls an audio output state of the at least one second terminal based on the first audio control instruction.
7. The apparatus of claim 6, further comprising a processing module;
the receiving module is further configured to receive a first status update message sent by the at least one second terminal;
the processing module is configured to update the stored audio output status of the at least one second user in the first session group based on the first status update message;
the sending module is further configured to send a status synchronization message to all users in the first session group, so that the terminal corresponding to each user in the first session group synchronizes audio output statuses of all users in the first session group based on the status synchronization message.
8. The apparatus of claim 6,
the receiving module is further configured to receive a session joining request of a third terminal; the session joining request is used for requesting a third user corresponding to the third terminal to join the first session group;
the sending module is further configured to send a session join response message based on the session join request; and the session joining response message carries the audio output states of all the users in the first session group.
9. The apparatus of claim 6,
the sending module is further configured to send a control response message to the first terminal, so that the first terminal controls an audio output state of at least one second user in the first session group based on the control response message;
wherein the control response message indicates permission to control audio output states of users of the first session group.
10. The apparatus of claim 6, further comprising a processing module;
the receiving module is further configured to receive a second state update message sent by the first terminal after the first terminal changes its own audio output state;
the processing module is configured to update the stored audio output status of the first user in the first session group based on the second status update message.
11. A session management apparatus, comprising: a processor and a memory for storing a computer program capable of running on the processor; wherein the content of the first and second substances,
the processor is configured to execute the session management method according to any one of claims 1 to 5 when running the computer program.
12. A computer-readable storage medium having computer-executable instructions stored thereon for performing the session management method of any of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710313998.4A CN108809915B (en) | 2017-05-05 | 2017-05-05 | Session management method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710313998.4A CN108809915B (en) | 2017-05-05 | 2017-05-05 | Session management method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108809915A CN108809915A (en) | 2018-11-13 |
| CN108809915B true CN108809915B (en) | 2021-10-12 |
Family
ID=64053709
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710313998.4A Active CN108809915B (en) | 2017-05-05 | 2017-05-05 | Session management method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108809915B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113162844B (en) * | 2021-04-01 | 2023-01-20 | 维沃移动通信有限公司 | Instant messaging method, instant messaging device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101808271A (en) * | 2010-02-01 | 2010-08-18 | 中兴通讯股份有限公司 | Method capable of adjusting sound volume of opposite end terminal microphone |
| CN102137333A (en) * | 2010-01-27 | 2011-07-27 | 中国移动通信集团公司 | Method and system for muting mobile terminal, and short message control device |
| CN103703719A (en) * | 2011-05-31 | 2014-04-02 | 谷歌公司 | Muting participants in a communication session |
| CN103733602A (en) * | 2011-08-16 | 2014-04-16 | 思科技术公司 | System and method for muting audio associated with a source |
| US9407448B2 (en) * | 2013-11-15 | 2016-08-02 | Cisco Technology, Inc. | Notification of audio state between endpoint devices |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8743743B1 (en) * | 2012-12-18 | 2014-06-03 | Cisco Technology, Inc. | Management of mute and unmute requests during an electronic-conference session |
-
2017
- 2017-05-05 CN CN201710313998.4A patent/CN108809915B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102137333A (en) * | 2010-01-27 | 2011-07-27 | 中国移动通信集团公司 | Method and system for muting mobile terminal, and short message control device |
| CN101808271A (en) * | 2010-02-01 | 2010-08-18 | 中兴通讯股份有限公司 | Method capable of adjusting sound volume of opposite end terminal microphone |
| CN103703719A (en) * | 2011-05-31 | 2014-04-02 | 谷歌公司 | Muting participants in a communication session |
| CN103733602A (en) * | 2011-08-16 | 2014-04-16 | 思科技术公司 | System and method for muting audio associated with a source |
| US9407448B2 (en) * | 2013-11-15 | 2016-08-02 | Cisco Technology, Inc. | Notification of audio state between endpoint devices |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108809915A (en) | 2018-11-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105915436B (en) | System and method for topic-based instant message isolation | |
| US10783891B2 (en) | Transcription presentation of communication sessions | |
| EP2879345A1 (en) | Method for multiple terminals to play multimedia file cooperatively and related apparatus and system | |
| WO2019090902A1 (en) | Screen sharing method and apparatus, electronic device, and storage medium | |
| US20160170970A1 (en) | Translation Control | |
| US20070281724A1 (en) | Group communication server | |
| CN102859480A (en) | Screen sharing | |
| CN112235121A (en) | Method, device, equipment and storage medium for realizing online conference | |
| JP2006339937A (en) | Network system performing application control corresponding to context information | |
| US20150341432A1 (en) | Grouping method, client, server, and system | |
| WO2017172652A1 (en) | Supplying context data to a servicing entity | |
| JP2015535414A (en) | Unprepared terminal call | |
| US9742823B2 (en) | System and method for identifying recipients during a communications session | |
| CN110113623A (en) | A kind of audio-video slice transmission platform based on Session Initiation Protocol | |
| CN108809915B (en) | Session management method and device | |
| US9143536B2 (en) | Determining a location address for shared data | |
| CN108293052A (en) | Communication system | |
| JP2006229379A (en) | Communications system among many person, client terminal, communication method among many person used for them, and program therefor | |
| CN107395493B (en) | Method and device for sharing message based on intention | |
| CN102016816A (en) | Messaging between events | |
| CN102017620A (en) | Communications prior to a scheduled event | |
| KR20200013974A (en) | Method of providing contents and system performing the same | |
| WO2018210268A1 (en) | Call scenario mode adjustment method, application server and storage medium | |
| CN109104535B (en) | Information processing method, electronic equipment and system | |
| WO2011110115A2 (en) | Discourse right information sharing method, related device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |