CN107786424B - Audio and video communication method, terminal and server - Google Patents
Audio and video communication method, terminal and server Download PDFInfo
- Publication number
- CN107786424B CN107786424B CN201610794524.1A CN201610794524A CN107786424B CN 107786424 B CN107786424 B CN 107786424B CN 201610794524 A CN201610794524 A CN 201610794524A CN 107786424 B CN107786424 B CN 107786424B
- Authority
- CN
- China
- Prior art keywords
- user
- state information
- terminal
- server
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/40—Network security protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L51/043—Real-time or near real-time messaging, e.g. instant messaging [IM] using or handling presence information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/52—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail for supporting social networking services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1096—Supplementary features, e.g. call forwarding or call holding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
Abstract
The invention discloses an audio and video communication method, a terminal and a server, and belongs to the technical field of the Internet. The method comprises the following steps: receiving an audio and video call request sent by a first user, wherein the audio and video call request at least carries a first user identifier and a second user identifier; allocating communication resources to the first user and the second user; sending the audio and video call request to a second user; acquiring current state information of a second user; and sending the current state information of the second user to the first user, and displaying the current state information on the call interface by the first user. When the first user initiates audio and video communication with the second user, the current state information of the second user is acquired and synchronized to the first user, so that the first user can sense the current state information of the second user in time and set reasonable call waiting time according to the current state of the second user, and the call completing rate is improved to the maximum extent while network resources are saved.
Description
Technical Field
The invention relates to the technical field of internet, in particular to an audio and video communication method, a terminal and a server.
Background
In modern society, audio and video communication has been widely applied to daily communication, business conversation, smart home, remote education, medical service and the like, and becomes an indispensable component in the life of people. In order to meet the communication requirements of users, a plurality of applications with audio and video communication functions are installed in the terminal, and based on the applications, users can acquire audio and video communication services anytime and anywhere.
At present, when a first user and a second user perform audio and video communication based on any application, the first user can send an audio and video call request to a server, the server receives the audio and video call request and then sends the audio and video call request to the second user, and the second user performs audio and video communication with the first user by receiving the audio and video call request.
In the process of implementing the invention, the inventor finds that the prior art has at least the following problems:
in the audio and video communication access process, because the terminal where the first user is located cannot display the state of the second user, or the displayed state is inaccurate, for example, the terminal where the second user is located is an android mobile phone, although the state of the second user is displayed on the terminal where the first user is located is an online state, actually, the terminal where the second user is located is not connected to the server but only connected to the android system platform, the real state of the second user is an offline state, at this time, the audio and video call request sent by the first user cannot be accepted, and the first user cannot know the situation, the audio and video call to the second user may be initiated all the time, so that a large amount of network resources are wasted.
Disclosure of Invention
In order to solve the problems in the prior art, embodiments of the present invention provide an audio and video communication method, a terminal, and a server. The technical scheme is as follows:
in a first aspect, an audio and video communication method is provided, where the method includes:
receiving an audio and video call request sent by a first user, wherein the audio and video call request at least carries a first user identifier and a second user identifier;
allocating communication resources to the first and second users;
sending the audio and video call request to the second user;
acquiring the current state information of the second user;
and sending the current state information of the second user to the first user, and displaying the current state information on a calling interface by the first user.
In a second aspect, there is provided an audio-video communication method, including:
sending an audio and video call request to a server, wherein the audio and video call request at least carries a first user identifier and a second user identifier, sending the audio and video call request to a second user by the server, and returning the current state information of the second user;
receiving the current state information of the second user sent by the server;
and displaying the current state information of the second user on a call interface.
In a third aspect, an audio-video communication method is provided, where the method includes:
receiving an audio and video call request sent by a server, wherein the audio and video call request at least carries a first user identifier and a second user identifier;
receiving a terminal state information acquisition request sent by the server;
sending the terminal state information to the server, and sending the terminal state information to the first user by the server for displaying;
and when the response operation of the audio/video call request is detected, establishing audio/video communication between a second user and the first user.
In a fourth aspect, a server is provided, the server comprising:
the first receiving module is used for receiving an audio and video call request sent by a first user, wherein the audio and video call request at least carries a first user identifier and a second user identifier;
an allocation module for allocating communication resources to the first user and the second user;
the first sending module is used for sending the audio and video call request to the second user;
the acquisition module is used for acquiring the current state information of the second user;
and the second sending module is used for sending the current state information of the second user to the first user, and the current state information is displayed on a calling interface by the first user.
In a fifth aspect, a terminal is provided, where the terminal includes:
the first sending module is used for sending an audio and video call request to a server, wherein the audio and video call request at least carries a first user identifier and a second user identifier, the server sends the audio and video call request to a second user, and current state information of the second user is returned;
the first receiving module is used for receiving the current state information of the second user, which is sent by the server;
and the first display module is used for displaying the current state information of the second user on a call interface.
In a sixth aspect, a terminal is provided, which includes:
the first receiving module is used for sending an audio and video call request by the server, wherein the audio and video call request at least carries a first user identifier and a second user identifier;
the second receiving module is used for receiving a terminal state information acquisition request sent by the server;
the first sending module is used for sending the terminal state information to the server, and the server sends the terminal state information to the first user for displaying;
and the establishing module is used for establishing audio and video communication between a second user and the first user when the response operation of the audio and video call request is detected.
The technical scheme provided by the embodiment of the invention has the following beneficial effects:
when a first user initiates audio and video communication with a second user, the current state information of the second user is acquired and synchronized to the first user, so that the first user can sense the current state information of the second user in time and set reasonable call waiting time according to the current state of the second user, and the call completing rate is improved to the maximum extent while network resources are saved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic diagram of an implementation environment related to an audio-video communication method according to an embodiment of the present invention;
fig. 2 is a flowchart of an audio-video communication method according to another embodiment of the present invention;
FIG. 3 is a schematic diagram of a terminal display interface according to another embodiment of the invention;
FIG. 4 is a schematic diagram of a terminal display interface according to another embodiment of the present invention;
FIG. 5 is a schematic diagram of a terminal display interface according to another embodiment of the invention;
fig. 6 is a schematic structural diagram of a server according to another embodiment of the present invention;
fig. 7 is a schematic structural diagram of a terminal according to another embodiment of the present invention;
fig. 8 is a schematic structural diagram of a terminal according to another embodiment of the present invention;
fig. 9 is a schematic structural diagram of an audio/video communication terminal according to an embodiment of the present invention;
fig. 10 is an illustration of a server for audio-visual communication, in accordance with an exemplary embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
Currently, there are two types of applications with an audio-video communication function used by a user, the first type of application can display the status of each contact in a contact list, such as WeChat, and the second type can display the status of each contact in the contact list, such as QQ. For the first type of application, in an audio and video communication scene, when a first user initiates audio and video communication with a second user in a contact list, the first user still waits for the response of the second user when the second user is in an offline state due to the fact that the current state of the second user cannot be displayed, so that unnecessary call waiting time of the first user is wasted, and a large amount of network resources are wasted; for the second type of application, due to the problems of android push and applet push in android phones and apple phones, the state of the second user in the contact list may be inaccurate, when the second user is in an offline state, the audio/video call request sent by the first user cannot be accepted, and the first user cannot know the situation, the audio/video call to the second user may be initiated all the time, and the waiting call time and network resources of the first user may be wasted.
In order to solve the above problem, an embodiment of the present invention provides an audio and video communication method, where a current state of a second user serving as a called party is obtained and sent to a first user, so that the first user can select a suitable waiting duration according to the current state of the second user, thereby saving network resources and improving a call completing rate when communicating with the second user. Referring to fig. 1, an implementation environment related to the audio/video communication method provided by the embodiment of the present invention is shown, and referring to fig. 1, the implementation environment includes: a first terminal 101, a server 102 and a second terminal 103.
The first terminal 101 is a terminal where a first user is located, and the second terminal 103 is a terminal where a second user is located. The first terminal 101 and the second terminal 102 may be a smart phone, a tablet computer, a notebook computer, etc., and the present embodiment does not specifically limit the product types of the first terminal 101 and the second terminal 102. In order to meet the audio-video communication requirements of users, a plurality of applications including WeChat applications, QQ applications and the like are installed in the first terminal 101 and the second terminal 103.
The server 102 is an application server, and the server 102 includes a status synchronization module 1021, an audio/video policy service module 1022, and a status notification module 1023. The state synchronization module 1021 maintains a state information database, can receive user state information reported by different users in real time, and updates the user state information to the state information database, so that the state notification module 1023 can inquire the state information of the users. The state synchronization module 1021 may be a single computing device, or may be a cluster formed by a plurality of computing devices, and is determined according to the computing capability of the computing device in practical applications. The audio/video policy service module 1022 may receive an audio/video call request sent by the first terminal 101, allocate communication resources to the first user and the second user, send the audio/video call request to the second terminal 102, and send a status query message to the status notification module 1023, so as to trigger the status notification module 1023 to obtain current status information of the second user and terminal status information of the second terminal 103. The audio/video policy service module 1022 may be one computing device, or may be a cluster formed by a plurality of computing devices, and is determined according to the computing capability of the computing device in practical applications. The status notification module 1023 may obtain the current status information of the second user from the status synchronization module 1021, obtain the terminal status information of the second terminal from the second terminal 103, and send the obtained status information to the first terminal 101 after summarizing the obtained status information. The status notification module 1023 can be a computing device or a cluster of multiple computing devices, and is determined according to the computing power of the computing devices in actual application.
The terminal 101 and the server 102 may communicate with each other through a wired network or a wireless network, and the server 102 and the terminal 103 may communicate with each other through a wired network or a wireless network.
Based on the implementation environment of audio and video communication shown in fig. 1, an embodiment of the present invention provides an audio and video communication method, and referring to fig. 2, a flow of the method provided by this embodiment includes:
201. the first terminal sends an audio and video call request to the server.
In the embodiment, a plurality of applications with audio and video communication functions are installed in the first terminal and the second terminal, when a first user at the first terminal side wants to perform audio-video communication with a second user at the second terminal side through any application, the first user can trigger the first terminal to display a communication interface with the second user, the communication interface is displayed with an audio-video call option, an expression option, a text input dialog box and the like, when detecting that the audio/video calling option is selected, the first terminal generates an audio/video calling request and sends the audio/video calling request to an audio/video strategy service module in the server through the network, the audio/video call request at least carries a first user identifier and a second user identifier, and the like, wherein the first user identifier may be a registered account of a first user in the application program, and the second user identifier may be a registered account of a second user in the application program.
202. And when receiving the audio/video call request, the server allocates communication resources for the first user and the second user.
The communication resources include data stream interface machines and the like. When receiving an audio and video call request sent by a first terminal where a first user is located, an audio and video strategy service module in a server establishes a call channel and allocates communication resources used by the audio and video communication to the first user and a second user according to the use condition of the communication resources.
203. And the server sends the audio and video call request to the second user.
After communication resources are distributed to the first user and the second user, an audio and video strategy service module in the server sends the received audio and video call request to the second user through a network based on the established call channel and the second user identification.
204. The server obtains the current state information of the second user.
The state information includes the state of the user in the application, such as an online state (including online, stealth, busy, away, etc.), an offline state (including offline, etc.), and the state of the notification function (including turning on the notification function and turning off the notification function, etc.). In this embodiment, a state synchronization module in a server maintains a state information database, where a corresponding relationship between a user identifier and state information is stored in the state information database, when an audio/video call request is received, an audio/video policy service module in the server further sends a state acquisition request to a state notification module, where the state acquisition request at least carries a second user identifier, and when the state acquisition request is received, the state notification module sends the state acquisition request to the state synchronization module, and acquires current state information of a second user from the state information database. When a user uses the application on various terminals, the state synchronization protocol built in the application can acquire the state information of the application program of the user and send the state information to a state synchronization module in the server, and when the state information reported by a plurality of users including a first user and a second user is received, the state synchronization module can update a state information database so as to ensure that the state information of each user in the state information database is the latest state information.
205. And the server sends the current state information of the second user to the first user.
When the current state information of the second user is acquired, the state notification module in the server can also send the current state information of the second user to the first user through the network.
206. And when the current state information of the second user is received, the first terminal displays the current state information of the second user on the call interface.
The calling interface is an interface for a first user to initiate a call to a second user. When receiving the current state information of the second user, the first terminal can display the current state information of the second user on the call interface, so that the first user can set reasonable call waiting time for the audio and video communication according to the current state of the second user, and the call completing rate is improved to the maximum extent on the premise of avoiding wasting network resources. For example, when the call interface displays that the second user is in an online state, the first user can appropriately prolong the call waiting time of the second user so as to realize audio-video communication with the second user; when the second user is in the offline state, the first user can immediately finish initiating the audio/video call with the second user, so as to avoid wasting unnecessary call waiting time and network resources.
And under the scene that the second user is in the online state, the first user can also optimize the audio and video communication according to other contents of the current state of the second user displayed on the call interface. Referring to fig. 3, taking QQ application as an example, a first user initiates audio/video communication with a second user, in an audio/video access process, a server acquires current state information of the second user that the second user is in an online state and a QQ notification function of the second user is turned off, which indicates that a second terminal at the second user side does not remind the second user by playing an audio file, a shake window, and the like when receiving an audio/video access request, and when receiving the current state information of the second user, the first terminal displays state information of the second user that "the other party is online and the QQ notification function is turned off" on a call interface, because in this case, the second user may spend a long time to find the audio/video call request, based on the acquired current state information of the second user, the first user prolongs a call waiting time for the second user, to improve the call completing rate.
In the process of audio and video access, when a state acquisition request sent by an audio and video strategy service module is received, a state notification module also sends a terminal state acquisition request to a second user, if a second terminal where the second user is located has a connection relation with a server, the second terminal can receive the terminal state acquisition request, and according to the terminal state acquisition request, terminal state information which cannot be reported to a state synchronization module due to the limitation or defect of a second terminal system is acquired, and then the acquired terminal state information is sent to the state notification module, when the terminal state information sent by the second terminal is received, the state notification module sends the terminal state information to a first user, and the first terminal where the first user is located displays on a call interface; if the second terminal where the second user is located is disconnected from the server, the second terminal cannot receive the terminal state acquisition request and cannot return the terminal state information to the state notification module.
The terminal state information is used for indicating a reminding mode of the terminal, wherein the reminding mode comprises a terminal type, a multi-terminal online condition, a network condition and the like, the reminding mode of the terminal comprises vibration, silence and the like, and the terminal type comprises android, IOS, Windows and the like. Since the terminal state information may relate to the privacy information of the user, upon receiving the terminal state information sent by the second terminal, the state notification module processes the terminal state information of the second terminal and sends information that does not relate to the privacy of the user to the first user.
Referring to fig. 4, taking the QQ application as an example, a first user initiates an audio-video communication with a second user, in the audio and video access process, the server acquires the current state information of the second user, that is, the second user is in an online state, and the terminal state information of the second terminal is acquired as a good network state, which shows that the second terminal at the second user side can provide good audio and video communication service for the second user when receiving the audio and video access request, when receiving the current state information and the terminal state information of the second user, the first terminal displays the state information of the terminal, that is, the opposite side is on-line and the network state is good, on the calling interface, since, in this case, the second user can quickly respond to the av call request, therefore, the first user can realize audio-video communication with the second user by adopting normal call waiting time.
Referring to fig. 5, taking QQ application as an example, a first user initiates audio/video communication with a second user, in an audio/video access process, a server acquires current state information of the second user as that the second user is in an online state, and acquires terminal state information of a second terminal as that a mobile phone is online, which indicates that the second user responds on the mobile phone when the second terminal at the second user side receives an audio/video access request, and when the current state information and the terminal state information of the second user are received, the first terminal displays state information of the terminal, namely "the other party is online and is switching to the mobile phone of the other party" on a call interface, because in this case, since the audio/video call request needs to be switched to the mobile phone of the second user, the process may take a certain time, and therefore, based on the acquired current state information and the terminal state information of the second user, the first user may extend call waiting time for the second user to increase call completion rate.
207. And when the response operation of the audio/video call request is detected, the second terminal establishes audio/video communication between the second user and the first user.
When receiving an audio and video call request, displaying a communication processing interface on the second terminal, wherein multiple options such as an answering option and a refusing option are displayed on the communication processing interface, if a second user wants to perform audio and video communication with a first user, the second user can select the answering option, and when detecting a response operation of the audio and video call request, the second terminal establishes the audio and video communication between the second user and the first user so as to realize the communication between the second user and the first user.
For the whole process of the above audio-video communication, the following will be described in detail with reference to fig. 1 for easy understanding.
When a first user at a first terminal side wants to perform audio and video communication with a second user at a second terminal side, the first user can trigger the first terminal to send an audio and video call request to an audio and video strategy service module in a server, when the audio and video call request is received, the audio and video strategy service module allocates communication resources for the first user and the second user and sends the audio and video call request to the second terminal, meanwhile, the audio and video strategy service module sends a state acquisition request to a state notification module, the state notification module sends the state acquisition request to a state synchronization module to acquire the current state information of the second user, in the process, the state notification module also sends a terminal state acquisition request to the second terminal to acquire the terminal state information of the second terminal, and when the current state information of the second user and the terminal state information of the second terminal are acquired, and the state notification module sends the current state of the second user and the terminal state information of the second terminal to the first user.
In practical applications, the method provided by this embodiment further supports multi-user audio/video communication, and for the process of multi-user audio/video communication, the process is the same as the process of the double-user audio/video communication, and for specific reference, the process is not described herein again.
It should be noted that, for example, the first user is a calling user, and the second user is a called user, in fact, the first user may also be a called user, and the second user may also be a calling user.
According to the method provided by the embodiment of the invention, when the first user initiates audio and video communication with the second user, the current state information of the second user is acquired and is synchronized to the first user, so that the first user can sense the current state information of the second user in time, and reasonable call waiting time is set according to the current state of the second user, thereby saving network resources and improving the call completing rate to the maximum extent.
Referring to fig. 6, an embodiment of the present invention provides a server, where the server includes:
a first receiving module 601, configured to receive an audio/video call request sent by a first user, where the audio/video call request at least carries a first user identifier and a second user identifier;
an allocating module 602, configured to allocate communication resources to a first user and a second user;
a first sending module 603, configured to send the audio/video call request to a second user;
an obtaining module 604, configured to obtain current state information of a second user;
a second sending module 605, configured to send the current status information of the second user to the first user, where the current status information is displayed on the call interface by the first user.
In another embodiment of the present invention, the obtaining module 604 is configured to obtain the current state information of the second user from a state information database according to the second user identifier, where the state information database stores a corresponding relationship between the user identifier and the state information.
In another embodiment of the present invention, the server further comprises:
the second receiving module is used for receiving the state information reported by a plurality of users in real time;
and the updating module is used for updating the state information database according to the state information reported by the plurality of users.
In another embodiment of the present invention, the server further comprises:
the third sending module is used for sending a terminal state obtaining request to the second user, wherein the terminal state obtaining request is used for triggering the terminal where the second user is located to return terminal state information;
and the fourth sending module is used for sending the terminal state information to the first user when receiving the terminal state information sent by the second user, and displaying the terminal state information on the calling page by the first user.
According to the server provided by the embodiment of the invention, when the first user initiates audio and video communication with the second user, the current state information of the second user is acquired and synchronized to the first user, so that the first user can sense the current state information of the second user in time, and reasonable call waiting time is set according to the current state of the second user, and therefore, network resources are saved and the call completing rate is improved to the maximum extent.
Referring to fig. 7, an embodiment of the present invention provides a terminal, where the terminal is a terminal where a first user is located, and the terminal includes:
the first sending module 701 is configured to send an audio/video call request to a server, where the audio/video call request at least carries a first user identifier and a second user identifier, and the server sends the audio/video call request to the second user and returns current state information of the second user;
a first receiving module 702, configured to receive current state information of the second user sent by the server;
the first display module 703 is configured to display the current status information of the second user on the call interface.
In another embodiment of the present invention, the terminal further includes:
and the second sending module is used for sending the state information of the first user to the server in real time, wherein the state information of the first user is used for updating the state information database by the server, and the state information database is used for acquiring the current state information of the second user by the server.
In another embodiment of the present invention, the terminal further includes:
the second receiving module is used for receiving the terminal state information of the terminal where the second user is located, which is sent by the server;
and the second display module is used for displaying the terminal state information on the call interface.
According to the terminal provided by the embodiment of the invention, when the first user initiates audio and video communication with the second user, the current state information of the second user sent by the server is received and displayed on the call interface, so that the first user can sense the current state information of the second user in time and set reasonable call waiting time according to the current state of the second user, and therefore, network resources are saved and the call completing rate is improved to the maximum extent.
Referring to fig. 8, an embodiment of the present invention provides a terminal, where the terminal is a terminal where a second user is located, and the terminal includes:
a first receiving module 801, configured to send an audio/video call request by a server, where the audio/video call request at least carries a first user identifier and a second user identifier;
a second receiving module 802, configured to receive a terminal status information acquisition request sent by a server;
a first sending module 803, configured to send the terminal status information to a server, where the server sends the terminal status information to a first user for display;
the establishing module 804 is configured to establish audio and video communication between the second user and the first user when a response operation of the audio and video call request is detected.
In another embodiment of the present invention, the terminal further includes:
and the second sending module is used for sending the state information of the second user to the server in real time, the state information of the second user is used for updating the state information database by the server, and the state information database is used for the server to acquire the current state information of the second user and send the current state information to the first user for displaying.
According to the terminal provided by the embodiment of the invention, when the first user initiates audio and video communication with the second user, the terminal state information is sent to the server and sent to the first user by the server, so that the first user can sense the terminal state information of the terminal where the second user is located in time, and reasonable call waiting time is set according to the current state of the second user, so that network resources are saved, and meanwhile, the call completing rate is improved to the maximum extent.
Referring to fig. 9, a schematic structural diagram of an audio/video communication terminal according to an embodiment of the present invention is shown, where the terminal may be used to implement the audio/video communication method provided in the foregoing embodiment. Specifically, the method comprises the following steps:
the terminal 900 may include RF (Radio Frequency) circuitry 110, memory 120 including one or more computer-readable storage media, an input unit 130, a display unit 140, a sensor 150, audio circuitry 160, a WiFi (Wireless fidelity) module 170, a processor 180 including one or more processing cores, and a power supply 190. Those skilled in the art will appreciate that the terminal structure shown in fig. 9 does not constitute a limitation of the terminal, and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:
the RF circuit 110 may be used for receiving and transmitting signals during information transmission and reception or during a call, and in particular, receives downlink information from a base station and then sends the received downlink information to the one or more processors 180 for processing; in addition, data relating to uplink is transmitted to the base station. In general, the RF circuitry 110 includes, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, and the like. In addition, the RF circuitry 110 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), e-mail, SMS (short messaging Service), etc.
The memory 120 may be used to store software programs and modules, and the processor 180 executes various functional applications and data processing by operating the software programs and modules stored in the memory 120. The memory 120 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the terminal 900, and the like. Further, the memory 120 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 120 may further include a memory controller to provide the processor 180 and the input unit 130 with access to the memory 120.
The input unit 130 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, the input unit 130 may include a touch-sensitive surface 131 as well as other input devices 132. The touch-sensitive surface 131, also referred to as a touch display screen or a touch pad, may collect touch operations by a user on or near the touch-sensitive surface 131 (e.g., operations by a user on or near the touch-sensitive surface 131 using a finger, a stylus, or any other suitable object or attachment), and drive the corresponding connection device according to a predetermined program. Alternatively, the touch sensitive surface 131 may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 180, and can receive and execute commands sent by the processor 180. Additionally, the touch-sensitive surface 131 may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch-sensitive surface 131, the input unit 130 may also include other input devices 132. In particular, other input devices 132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.
The display unit 140 may be used to display information input by or provided to a user and various graphical user interfaces of the terminal 900, which may be made up of graphics, text, icons, video, and any combination thereof. The Display unit 140 may include a Display panel 141, and optionally, the Display panel 141 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Further, the touch-sensitive surface 131 may cover the display panel 141, and when a touch operation is detected on or near the touch-sensitive surface 131, the touch operation is transmitted to the processor 180 to determine the type of the touch event, and then the processor 180 provides a corresponding visual output on the display panel 141 according to the type of the touch event. Although in FIG. 9, touch-sensitive surface 131 and display panel 141 are shown as two separate components to implement input and output functions, in some embodiments, touch-sensitive surface 131 may be integrated with display panel 141 to implement input and output functions.
The terminal 900 can also include at least one sensor 150, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel 141 according to the brightness of ambient light, and a proximity sensor that may turn off the display panel 141 and/or the backlight when the terminal 900 is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the mobile phone is stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured in the terminal 900, detailed descriptions thereof are omitted.
WiFi belongs to a short-distance wireless transmission technology, and the terminal 900 can help a user send and receive e-mails, browse web pages, access streaming media, and the like through the WiFi module 170, and it provides wireless broadband internet access for the user. Although fig. 9 shows the WiFi module 170, it is understood that it does not belong to the essential constitution of the terminal 900 and can be omitted entirely as needed within the scope not changing the essence of the invention.
The processor 180 is a control center of the terminal 900, connects various parts of the entire mobile phone using various interfaces and lines, and performs various functions of the terminal 900 and processes data by operating or executing software programs and/or modules stored in the memory 120 and calling data stored in the memory 120, thereby performing overall monitoring of the mobile phone. Optionally, processor 180 may include one or more processing cores; optionally, the processor 180 may integrate an application processor and a modem processor, wherein the application processor mainly handles operating systems, user interfaces, application programs, and the like, and the modem processor mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 180.
Although not shown, the terminal 900 may further include a camera, a bluetooth module, etc., which will not be described herein. In this embodiment, the display unit of the terminal 900 is a touch screen display, and the terminal 900 further includes a memory and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors. The one or more programs include instructions for performing functions performed by the terminal in the audio-video communication method.
According to the terminal provided by the embodiment of the invention, when the first user initiates audio and video communication with the second user, the current state information of the second user sent by the server is received and displayed on the call interface, so that the first user can sense the current state information of the second user in time and set reasonable call waiting time according to the current state of the second user, and therefore, network resources are saved and the call completing rate is improved to the maximum extent.
An embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium may be a computer-readable storage medium contained in the memory in the foregoing embodiment; or it may be a separate computer-readable storage medium not incorporated in the terminal. The computer-readable storage medium stores one or more programs, which are used by one or more processors to execute functions performed by a terminal in an audio-video communication method.
The computer-readable storage medium provided by the embodiment of the invention receives the current state information of the second user sent by the server and displays the current state information on the call interface when the first user initiates audio/video communication with the second user, so that the first user can sense the current state information of the second user in time and set reasonable call waiting time according to the current state of the second user, thereby saving network resources and improving the call completing rate to the maximum extent.
The embodiment of the invention provides a graphical user interface which is used on an audio and video communication terminal, wherein the audio and video communication terminal comprises a touch screen display, a memory and one or more processors for executing one or more programs; the graphical user interface is used for executing the functions executed by the terminal in the audio and video communication method.
According to the graphical user interface provided by the embodiment of the invention, when the first user initiates audio and video communication with the second user, the current state information of the second user sent by the server is received and displayed on the call interface, so that the first user can sense the current state information of the second user in time and set reasonable call waiting time according to the current state of the second user, and therefore, network resources are saved and the call completing rate is improved to the maximum extent.
Fig. 10 is an illustration of a server for audio-visual communication, in accordance with an exemplary embodiment. Referring to fig. 10, server 1000 includes a processing component 1022 that further includes one or more processors and memory resources, represented by memory 1032, for storing instructions, such as application programs, that are executable by processing component 1022. The application programs stored in memory 1032 may include one or more modules that each correspond to a set of instructions. Further, the processing component 1022 is configured to execute instructions to perform the functions performed by the server in the audio-video communication described above
The server 1000 may also include a power component 1026 configured to perform power management for the server 1000, a wired or wireless network interface 1050 configured to connect the server 1000 to a network, and an input/output (I/O) interface 1058. Server 1000 may operate based on an operating system stored in memory 1032, such as a Windows ServerTM，Mac OS XTM，UnixTM，LinuxTM，FreeBSDTMOr the like.
According to the server provided by the embodiment of the invention, when the first user initiates audio and video communication with the second user, the current state information of the second user is acquired and synchronized to the first user, so that the first user can sense the current state information of the second user in time, and reasonable call waiting time is set according to the current state of the second user, and therefore, network resources are saved and the call completing rate is improved to the maximum extent.
It should be noted that: in the above embodiment, when the server and the terminal perform audio/video communication, only the division of the functional modules is described as an example, and in practical application, the function distribution may be completed by different functional modules according to needs, that is, the internal structures of the server and the terminal are divided into different functional modules to complete all or part of the above-described functions. In addition, the server and terminal embodiments provided by the above embodiments belong to the same concept as the audio and video communication method embodiments, and specific implementation processes thereof are described in the method embodiments and are not described herein again.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (15)
1. An audio-video communication method, characterized in that the method comprises:
the method comprises the steps that a server receives an audio and video call request sent by a first user, wherein the audio and video call request at least carries a first user identification and a second user identification;
the server allocates communication resources for the first user and the second user;
the server sends the audio and video call request to the second user;
the server acquires the current state information of the second user from a state information database according to the second user identification, wherein the state information database stores the corresponding relation between the user identification and the state information;
the server sends the current state information of the second user to the first user, and the first user displays the current state information on a calling interface;
the server sends a terminal state acquisition request to the second user, wherein the terminal state acquisition request is used for triggering a terminal where the second user is located to return terminal state information, the terminal state information is used for indicating a reminding mode of the terminal, and the terminal state information comprises a terminal type, a multi-terminal online condition and a network condition;
and when receiving the terminal state information sent by the second user, the server sends the terminal state information to the first user, and the first user displays the terminal state information on a calling page.
2. The method of claim 1, further comprising:
the server receives state information reported by a plurality of users in real time;
and the server updates the state information database according to the state information reported by the users.
3. An audio-video communication method, characterized in that the method comprises:
a first terminal sends an audio and video call request to a server, wherein the audio and video call request at least carries a first user identifier and a second user identifier, the server sends the audio and video call request to a second user, current state information of the second user is obtained from a state information database according to the second user identifier, the current state information of the second user is returned, and the corresponding relation between the user identifiers and the state information is stored in the state information database;
the first terminal receives the current state information of the second user sent by the server;
the first terminal displays the current state information of the second user on a calling interface;
the first terminal receives terminal state information of a terminal where a second user is located, wherein the terminal state information is sent by the server and used for indicating a reminding mode of the terminal, and the terminal state information comprises a terminal type, a multi-terminal online condition and a network condition;
and the first terminal displays the terminal state information on the call interface.
4. The method of claim 3, further comprising:
the first terminal sends the state information of a first user to the server in real time, the state information of the first user is used for the server to update a state information database, and the state information database is used for the server to obtain the current state information of a second user.
5. An audio-video communication method, characterized in that the method comprises:
the method comprises the steps that a second terminal receives an audio and video call request sent by a server, wherein the audio and video call request at least carries a first user identification and a second user identification, the server obtains the current state information of a second user from a state information database according to the second user identification, the current state information of the second user is sent to a first user, the first user displays the current state information on a call interface, and the state information database stores the corresponding relation between the user identifications and the state information;
the second terminal receives a terminal state information acquisition request sent by the server;
the second terminal sends terminal state information to the server, the server sends the terminal state information to the first user for displaying, the terminal state information is used for indicating a reminding mode of the terminal, and the terminal state information comprises a terminal type, a multi-terminal online condition and a network condition;
and when the second terminal detects the response operation of the audio/video call request, establishing audio/video communication between the second user and the first user.
6. The method of claim 5, further comprising:
the second terminal sends the state information of a second user to the server in real time, the state information of the second user is used for updating a state information database by the server, and the state information database is used for the server to acquire the current state information of the second user and send the current state information to the first user for displaying.
7. A server, characterized in that the server comprises:
the first receiving module is used for receiving an audio and video call request sent by a first user, wherein the audio and video call request at least carries a first user identifier and a second user identifier;
an allocation module for allocating communication resources to the first user and the second user;
the first sending module is used for sending the audio and video call request to the second user;
the acquisition module is used for acquiring the current state information of the second user from a state information database according to the second user identification, wherein the state information database stores the corresponding relation between the user identification and the state information;
the second sending module is used for sending the current state information of the second user to the first user, and the current state information is displayed on a calling interface by the first user;
a third sending module, configured to send a terminal state obtaining request to the second user, where the terminal state obtaining request is used to trigger a terminal where the second user is located to return terminal state information, the terminal state information is used to indicate a reminding mode of the terminal, and the terminal state information includes a terminal type, a multi-terminal online condition, and a network condition;
and the fourth sending module is used for sending the terminal state information to the first user when receiving the terminal state information sent by the second user, and displaying the terminal state information on a calling page by the first user.
8. The server of claim 7, further comprising:
the second receiving module is used for receiving the state information reported by a plurality of users in real time;
and the updating module is used for updating the state information database according to the state information reported by the users.
9. A terminal, characterized in that the terminal comprises:
the first sending module is used for sending an audio and video call request to a server, wherein the audio and video call request at least carries a first user identifier and a second user identifier, the server sends the audio and video call request to a second user, current state information of the second user is obtained from a state information database according to the second user identifier, the current state information of the second user is returned, and the state information database stores the corresponding relation between the user identifiers and the state information;
the first receiving module is used for receiving the current state information of the second user, which is sent by the server;
the first display module is used for displaying the current state information of the second user on a calling interface;
the second receiving module is used for receiving terminal state information of a terminal where a second user is located, wherein the terminal state information is sent by the server and used for indicating a reminding mode of the terminal, and the terminal state information comprises a terminal type, a multi-terminal online condition and a network condition;
and the second display module is used for displaying the terminal state information on the call interface.
10. The terminal of claim 9, wherein the terminal further comprises:
and the second sending module is used for sending the state information of the first user to the server in real time, wherein the state information of the first user is used for updating a state information database by the server, and the state information database is used for acquiring the current state information of the second user by the server.
11. A terminal, characterized in that the terminal comprises:
the first receiving module is used for an audio and video call request sent by a server, wherein the audio and video call request at least carries a first user identification and a second user identification, the server obtains the current state information of a second user from a state information database according to the second user identification, the current state information of the second user is sent to a first user, the first user displays the current state information on a call interface, and the state information database stores the corresponding relation between the user identifications and the state information;
the second receiving module is used for receiving a terminal state information acquisition request sent by the server;
the first sending module is used for sending terminal state information to the server, the server sends the terminal state information to a first user for displaying, the terminal state information is used for indicating a reminding mode of a terminal, and the terminal state information comprises a terminal type, a multi-terminal online condition and a network condition;
and the establishing module is used for establishing audio and video communication between a second user and the first user when the response operation of the audio and video call request is detected.
12. The terminal of claim 11, wherein the terminal further comprises:
and the second sending module is used for sending the state information of a second user to the server in real time, wherein the state information of the second user is used for updating a state information database by the server, and the state information database is used for acquiring the current state information of the second user by the server and sending the current state information to the first user for displaying.
13. A server, characterized in that the server comprises one or more processors and one or more memories in which one or more programs are stored, the one or more programs being loaded and executed by the one or more processors to implement the audio-visual communication method according to any one of claims 1 to 2.
14. A terminal, characterized in that it comprises one or more processors and one or more memories in which one or more programs are stored, which are loaded and executed by the one or more processors to implement the audio-visual communication method according to any one of claims 3 to 6.
15. A computer-readable storage medium, in which one or more programs are stored, which are loaded and executed by a processor to implement the audio-visual communication method according to any one of claims 1 to 6.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610794524.1A CN107786424B (en) | 2016-08-31 | 2016-08-31 | Audio and video communication method, terminal and server |
| PCT/CN2017/094831 WO2018040813A1 (en) | 2016-08-31 | 2017-07-28 | Audio/video communication method, terminal, server, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610794524.1A CN107786424B (en) | 2016-08-31 | 2016-08-31 | Audio and video communication method, terminal and server |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107786424A CN107786424A (en) | 2018-03-09 |
| CN107786424B true CN107786424B (en) | 2020-04-21 |
Family
ID=61299982
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610794524.1A Active CN107786424B (en) | 2016-08-31 | 2016-08-31 | Audio and video communication method, terminal and server |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107786424B (en) |
| WO (1) | WO2018040813A1 (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110300052B (en) * | 2019-06-26 | 2022-07-26 | 北京神州慧安科技有限公司 | Instant messaging state identification method and equipment and computer readable storage medium |
| CN111078275B (en) * | 2019-12-17 | 2023-11-14 | 捷开通讯(深圳)有限公司 | Resource allocation method, device, storage medium and server |
| CN111372132B (en) * | 2020-02-25 | 2022-03-08 | 广州华多网络科技有限公司 | Method, device and equipment for audio and video transmission and storage medium |
| CN111669468B (en) * | 2020-06-05 | 2021-10-29 | 平安科技（深圳）有限公司 | Network state display method and device in call process, computer equipment and medium |
| CN112333411A (en) * | 2020-07-28 | 2021-02-05 | 深圳Tcl新技术有限公司 | Call method, server and computer readable storage medium |
| CN112562639B (en) * | 2020-11-30 | 2023-09-19 | 努比亚技术有限公司 | Audio processing method, terminal and computer readable storage medium |
| CN113141298B (en) * | 2021-05-14 | 2023-05-12 | 网易（杭州）网络有限公司 | Message processing method, message processing device, storage medium and electronic equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101616368A (en) * | 2008-06-27 | 2009-12-30 | 中国移动通信集团公司 | Method for displaying called user state, portable terminal and system for displaying called user state |
| CN101931614A (en) * | 2009-06-19 | 2010-12-29 | 中兴通讯股份有限公司 | Method and system for presenting user state information during calling |
| CN103002419A (en) * | 2011-09-15 | 2013-03-27 | 中兴通讯股份有限公司 | Profile state feedback method, profile state display method and mobile terminals |
| CN103379449A (en) * | 2012-04-23 | 2013-10-30 | 中兴通讯股份有限公司 | Method and device for showing called state on calling terminal in calling process |
| WO2014208782A1 (en) * | 2013-06-24 | 2014-12-31 | 주식회사 닉신디케이트 | Avatar-based real-time communication method in digital live map environment and system thereof |
| CN105281923A (en) * | 2014-06-27 | 2016-01-27 | 中兴通讯股份有限公司 | Video conference call implementing method and device based on user identifier |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102857410B (en) * | 2012-09-12 | 2016-03-02 | 腾讯科技（深圳）有限公司 | A kind of instant communication information Notification Method and device |
| CN105262881A (en) * | 2015-08-28 | 2016-01-20 | 北京搜狗科技发展有限公司 | Communication control method and electronic equipment |
| CN105872437A (en) * | 2015-12-15 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Video call control method, video call control device and terminal |
-
2016
- 2016-08-31 CN CN201610794524.1A patent/CN107786424B/en active Active
-
2017
- 2017-07-28 WO PCT/CN2017/094831 patent/WO2018040813A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101616368A (en) * | 2008-06-27 | 2009-12-30 | 中国移动通信集团公司 | Method for displaying called user state, portable terminal and system for displaying called user state |
| CN101931614A (en) * | 2009-06-19 | 2010-12-29 | 中兴通讯股份有限公司 | Method and system for presenting user state information during calling |
| CN103002419A (en) * | 2011-09-15 | 2013-03-27 | 中兴通讯股份有限公司 | Profile state feedback method, profile state display method and mobile terminals |
| CN103379449A (en) * | 2012-04-23 | 2013-10-30 | 中兴通讯股份有限公司 | Method and device for showing called state on calling terminal in calling process |
| WO2014208782A1 (en) * | 2013-06-24 | 2014-12-31 | 주식회사 닉신디케이트 | Avatar-based real-time communication method in digital live map environment and system thereof |
| CN105281923A (en) * | 2014-06-27 | 2016-01-27 | 中兴通讯股份有限公司 | Video conference call implementing method and device based on user identifier |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018040813A1 (en) | 2018-03-08 |
| CN107786424A (en) | 2018-03-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10831161B2 (en) | Method and device for sending communication message | |
| CN110622123B (en) | Display method and device | |
| US10635449B2 (en) | Method and apparatus for running game client | |
| CN107786424B (en) | Audio and video communication method, terminal and server | |
| KR101978590B1 (en) | Message updating method, device and terminal | |
| US11023296B2 (en) | Method for managing multiple operating systems in a terminal | |
| CN105094501B (en) | Method, device and system for displaying messages in mobile terminal | |
| CN109495769B (en) | Video communication method, terminal, smart television, server and storage medium | |
| CN107872791B (en) | Access point connection method and device | |
| CN110891262A (en) | Bluetooth pairing method, system and terminal equipment | |
| CN109728918B (en) | Virtual article transmission method, virtual article reception method, device, and storage medium | |
| CN106209601B (en) | State update message pushing method and device | |
| CN108234275B (en) | Method and device for releasing communication information | |
| CN105635379B (en) | Noise suppression method and device | |
| CN110012146B (en) | Communication sharing method and terminal | |
| CN113613310A (en) | WIFI connection method and device, storage medium and mobile terminal | |
| CN108111553B (en) | Method and device for providing service | |
| CN112399405A (en) | Method and device for reporting user equipment capability information and mobile terminal | |
| CN108307531B (en) | Call control method, device, user terminal and computer readable storage medium | |
| CN108280798B (en) | Method and device for rendering and displaying browser kernel | |
| CN111078428A (en) | Remote control method and device, storage medium and terminal equipment | |
| CN106681845B (en) | Method and device for managing communication messages | |
| CN111083285A (en) | Mobile terminal call positioning system and method | |
| CN110913022A (en) | Method, device and system for downloading network file of mobile terminal and storage medium | |
| CN111144845A (en) | Mobile terminal conference reminding method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |