WO2021120511A1

WO2021120511A1 - Network session switching method and apparatus, and computer device and storage medium

Info

Publication number: WO2021120511A1
Application number: PCT/CN2020/091181
Authority: WO
Inventors: 梁若松
Original assignee: 腾讯科技（深圳）有限公司
Priority date: 2019-12-17
Filing date: 2020-05-20
Publication date: 2021-06-24
Also published as: CN110944013A

Abstract

A network session switching method. The method comprises: displaying a first user interface, wherein the first user interface is an interface when a present client and another client conduct a network session in a video mode; in response to a network environment being worse than a first condition, switching the network session from the video mode to a speech mode; and displaying a second user interface, wherein the second user interface is an interface when the present client and the other client conduct the network session in the speech mode.

Description

Network session switching method, device, computer equipment and storage medium

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on December 17, 2019. The application number is 201911304054.6, and the application name is "Network session switching methods, devices, computer equipment, and storage media". The entire content of the Chinese patent application is approved. The reference is incorporated in this application.

Technical field

The embodiments of the present application relate to the field of cloud technology, and in particular to a method, device, computer equipment, and storage medium for switching network sessions.

Background technique

Video conference is a multi-person network conference system implemented by cloud video conference system. The cloud video conferencing system uses virtual machines to replace traditional expensive hardware resources, effectively solving the differences in video conferencing systems composed of different terminals (computers, mobile phones, conference terminals) and different networks (private networks, local area networks, Internet, mobile networks). Constitutional issues.

In related technologies, multiple clients establish network connections through a cloud video conference system and enter the same conference room. Each client uploads its own video stream and audio stream, and downloads the video stream and audio stream of other clients in the same conference room, thereby realizing a video conference.

Since some clients use wireless networks or mobile networks, there will be a situation where the network signal is poor (also called a weak network environment). At this time, the video signal and voice signal of the video conference will appear intermittent, and the conference quality is poor.

Summary of the invention

According to various embodiments provided in this application, a method, device, computer equipment, and storage medium for switching a network session are provided.

A method for switching a network session is executed by a computer device, and the method includes:

Displaying a first user interface, where the first user interface is an interface when the local client and other clients use a video mode to conduct a network conversation;

In response to the network environment being worse than the first condition, switching the network session from the video mode to the voice mode; and

A second user interface is displayed, and the second user interface is an interface when the local client and the other client use the voice mode to conduct the network conversation.

A network conversation device, the device includes:

The display module is configured to display a first user interface, where the first user interface is an interface when the local client and other clients use a video mode to conduct a network conversation;

A switching module for switching the network session from the video mode to the voice mode in response to the network environment being worse than the first condition; and

The display module is configured to display a second user interface, and the second user interface is an interface when the local client and the other clients use the voice mode to conduct the network conversation.

A non-volatile storage medium storing computer-readable instructions. When the computer-readable instructions are executed by one or more processors, the one or more processors execute the steps of the method for switching a network session.

A computer device includes a memory and a processor, and computer-readable instructions are stored in the memory. When the computer-readable instructions are executed by the processor, the processor executes the steps of a method for switching a network session.

The details of one or more embodiments of the present application are set forth in the following drawings and description. Other features, purposes and advantages of this application will become apparent from the description, drawings and claims.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings that need to be used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.

Fig. 1 is a block diagram of a computer system provided by an exemplary embodiment of the present application;

Fig. 2 is a flowchart of a method for switching a network session provided by an exemplary embodiment of the present application;

Fig. 3 is a flowchart of a method for switching a network session provided by another exemplary embodiment of the present application;

4 and 5 are schematic diagrams of user interfaces when a method for switching a network session provided by another exemplary embodiment of the present application is implemented on a mobile terminal;

6 to 9 are schematic diagrams of user interfaces when a method for switching a network session provided by another exemplary embodiment of the present application is implemented on a computer;

Fig. 10 is a structural block diagram of a device for switching a network session provided by an exemplary embodiment of the present application;

Fig. 11 is a structural block diagram of a computer device provided by an exemplary embodiment of the present application; and

Fig. 12 is a structural block diagram of a server provided by an exemplary embodiment of the present application.

Detailed ways

In order to make the purpose, technical solutions, and advantages of this application clearer and clearer, the following further describes the application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not used to limit the present application.

First, we will briefly introduce several terms involved in this application:

Cloud technology: refers to a kind of hosting technology that unifies a series of resources such as hardware, software, and network in a wide area network or a local area network to realize the calculation, storage, processing, and sharing of data. The general term for network technology, information technology, integration technology, management platform technology, and application technology based on cloud computing business model applications can form a resource pool, which can be used on demand, flexible and convenient. Cloud computing technology will become an important support. The back-end service of the technical network system requires a large amount of computing and storage resources, such as video websites, image websites and more portal websites. With the rapid development and application of the Internet industry, in the future, each item may have its own identification mark, which needs to be transmitted to the back-end system for logical processing. Data of different levels will be processed separately, and all types of industry data need to be powerful The backing of the system can only be achieved through cloud computing.

Cloud computing (cloud computing): is a computing model that distributes computing tasks on a resource pool composed of a large number of computers, enabling various application systems to obtain computing power, storage space, and information services as needed. The network that provides resources is called the "cloud." In the eyes of users, the resources in the "cloud" can be infinitely expanded, and can be obtained at any time, used on demand, expanded at any time, and paid for use.

As a basic capability provider of cloud computing, it will establish a cloud computing resource pool (cloud platform for short, generally referred to as IaaS (Infrastructure as a Service, infrastructure as a service) platform), and deploy multiple types of virtual resources in the resource pool. For external customers to choose and use. The cloud computing resource pool mainly includes: computing devices (virtualized machines, including operating systems), storage devices, and network devices.

According to the logic function, the PaaS (Platform as a Service) layer can be deployed on the IaaS (Infrastructure as a Service) layer, and the SaaS (Software as a Service) layer can be deployed on the PaaS layer. Service) layer, SaaS can also be deployed directly on IaaS. PaaS is a platform on which software runs, such as a database or web container. SaaS is a variety of business software, such as web portals or SMS group senders. Generally speaking, SaaS and PaaS are the upper layer relative to IaaS.

Cloud Call Center: It is a call center system built based on cloud computing technology. Enterprises do not need to purchase any software or hardware systems. They only need to have basic conditions such as personnel and venues to quickly own their own call center. The software and hardware platform, communication resources, daily maintenance and services are provided by the server vendor. It has many characteristics such as short construction period, low investment, low risk, flexible deployment, strong system capacity scalability, and low operation and maintenance costs; whether it is a telemarketing center or a customer service center, enterprises can set up a service simply by renting services on demand. A full-featured, stable, and reliable call center system with seats that can be distributed across the country and call access throughout the country.

Cloud meeting: It is an efficient, convenient and low-cost meeting form based on cloud computing technology. Users only need to perform simple and easy-to-use operations through the Internet interface to quickly and efficiently share voice, data files and videos with teams and customers around the world, and complex technologies such as data transmission and processing in the meeting are served by the cloud meeting The quotient helps users to operate.

At present, domestic cloud conferences mainly focus on the service content with the SaaS (Software as Service) model as the main body, including service forms such as telephone, network, and video. Cloud computing-based video conferences are called cloud conferences.

In the era of cloud conferencing, data transmission, processing and storage are all handled by the computer resources of video conferencing manufacturers. Users no longer need to purchase expensive hardware and install cumbersome software. They only need to open a browser and log in to the corresponding interface to be efficient. Remote meeting.

The cloud conference system supports multi-server dynamic cluster deployment and provides multiple high-performance servers, which greatly improves conference stability, security and availability. In recent years, video conferencing has been welcomed by many users because it can greatly improve communication efficiency, continue to reduce communication costs, and bring about internal management upgrades. It has been widely used in government, military, transportation, transportation, finance, operators, education, and enterprises. And other fields. There is no doubt that after the use of cloud computing in video conferencing, it will be more attractive in terms of convenience, speed and ease of use, which will surely stimulate the arrival of a new wave of video conferencing applications.

Cloud Social (Cloud Social) is a virtual social application mode for interactive applications of the Internet of Things, cloud computing, and mobile Internet. It aims to establish a well-known "resource sharing relationship graph" to develop online social networking. The main feature of cloud social networking is A large number of social resources are unified and evaluated to form an effective pool of resources to provide users with services on demand. The more users who participate in sharing, the greater the value that can be created.

Network session: A communication session (session) constructed between at least two clients (or user accounts) through Internet technology. Network sessions include but are not limited to: video mode and voice mode. The video mode is a mode for conducting audio and video conversations based on video streams and audio streams, and the voice mode is a mode for conducting audio conversations based on audio streams.

This application provides a solution for automatic switching of network sessions. When the client is in a weak network environment, it can automatically switch the network session from the video mode to the voice mode, so as to maximize the guarantee that the network session can proceed smoothly in the harsh network session environment.

Fig. 1 is a block diagram of a computer system 100 provided by an exemplary embodiment of the present application. The computer system 100 includes: a first terminal 120, a server 140, and a second terminal 160.

The first terminal 120 installs and runs an application program supporting network sessions. The application can be a conference client that supports web sessions, a social client that integrates web session functions, an e-commerce client that integrates web session functions, a game client that integrates web session functions, and those that integrate web session functions. Any of other clients. The first terminal 120 is a terminal used by the first user. The client in this document includes any one of an APP (Application, application) client, a webpage client, an applet client, and a quick application client. The first terminal 120 may be a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, or a smart watch, etc., but is not limited thereto. The terminal and the server can be directly or indirectly connected through wired or wireless communication, which is not limited in this application.

The first terminal 120 is connected to the server 140 through a wireless network or a wired network.

The server 140 includes at least one of a server, multiple servers, a cloud computing platform, and a virtualization center. Illustratively, the server 140 includes a processor 144 and a storage 142, and the storage 142 further includes a network session module 1421 and a storage module 1422. The network session module 1421 is used to construct a network session between at least two clients. The storage module 1422 is used to store the account and password of each client and the context information of each network session. The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also provide cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, and intermediate Cloud servers for basic cloud computing services such as software services, domain name services, security services, CDN, and big data and artificial intelligence platforms. Optionally, the server 140 is responsible for the main calculation work, and the first terminal 120 and the second terminal 160 are responsible for the secondary calculation work; or the server 140 is responsible for the secondary calculation work, and the first terminal 120 and the second terminal 160 are responsible for the main calculation work; Or, the server 140, the first terminal 120, and the second terminal 160 adopt a distributed computing architecture to perform collaborative computing.

The second terminal 160 installs and runs an application program supporting network sessions. The application can be a web session client, a social client integrated with a web session function, an e-commerce client with a web session function, a game client with a web session function, and other clients with a web session function. Any of them. The second terminal 160 is a terminal used by a second user, and the client in this document includes any one of an APP client, a web client, an applet client, and a quick app client.

Optionally, the applications installed on the first terminal 120 and the second terminal 160 are the same, or the applications installed on the two terminals are the same type of application on different control system platforms. The first terminal 120 may generally refer to one of multiple terminals, and the second terminal 160 may generally refer to one of multiple terminals. This embodiment only uses the first terminal 120 and the second terminal 160 as examples. The device types of the first terminal 120 and the second terminal 160 are the same or different. The device types include smart phones, tablet computers, e-book readers, MP3 players, MP4 players, laptop computers and desktop computers. At least one. In the following embodiment, the terminal includes a smart phone as an example.

Those skilled in the art may know that the number of the aforementioned terminals may be more or less. For example, there may be only one terminal, or there may be dozens or hundreds of terminals, or more. The embodiments of the present application do not limit the number of terminals and device types.

Fig. 2 shows a flowchart of a method for switching a network session shown in an exemplary embodiment of the present application. In this embodiment, the method is applied to the client (terminal) shown in FIG. 1 as an example for illustration. The method includes:

In step 202, a first user interface is displayed. The first user interface is an interface when the local client and other clients use a video mode to conduct a network session.

There are clients (or application programs) that support network sessions in the terminal. The web session provides video mode and voice mode. The video mode is a mode for conducting network conversations based on video streams and audio streams, and the voice mode is a mode for conducting network conversations based on audio streams.

The local client is the client in the local terminal, and the other clients are the clients in other terminals. Normally, the local client logs in with the user account of the current user, and other clients log in with the user accounts of other users. However, this application does not exclude the scenario of anonymous chat without logging in to the user account.

The user starts the local client in the terminal, and uses the local client to establish a network session with other clients. Exemplarily, the network session has a network session number or a network session room, and the local client and other clients communicate in the same network session. Among them, there is one or more than one other clients.

After the local client and other clients establish a network session, the first user interface is displayed in the local client. Exemplarily, the first user interface includes a first video window corresponding to the local client and a second video window corresponding to other clients. The first video window is used to display camera images or shared images captured by the first camera corresponding to the local client; the second video window is used to display camera images or shared images captured by the second camera corresponding to other clients.

Step 204: In response to the network environment being worse than the first condition, switch the network session from the video mode to the voice mode.

The condition that the network environment is worse than the first condition includes but is not limited to: the network speed is lower than the first threshold and is not 0, or the packet loss rate is higher than the second threshold. For example, if the first threshold is 50 kb, intermittent freezes will appear in the video screen at this time.

Exemplarily, the local client periodically measures the network speed or packet loss rate during the duration of the network session. When the network environment is worse than the first condition, the network session is automatically switched from the video mode to the voice mode. In the video mode, there are video streams and audio streams in the network session. The local client terminal stops uploading and downloading the video stream in the network session (the embodiment that only stops uploading or only stops downloading is not excluded), and keeps uploading and downloading the audio stream in the network session.

Wherein, uploading refers to uploading a video stream and/or audio stream generated by the local client; and downloading refers to downloading a video stream and/or audio stream generated by other clients.

In the process of switching from the video mode to the voice mode, since there is no interruption in the audio stream of the network session, it can ensure that the user's voice signal is continuously and preferentially transmitted.

Step 206: Display a second user interface. The second user interface is an interface when the local client and other clients use the voice mode to conduct a network conversation.

After the network session is switched from the video mode to the voice mode, the second user interface is displayed in the local client. Exemplarily, there is no second video window (or an empty second video window) on the second user interface, that is, the camera images collected by the second cameras corresponding to other clients cannot be seen. Optionally, the first video window does not exist on the second user interface (or an empty first video window is displayed), that is, the camera images collected by the first camera corresponding to the other client cannot be seen.

In an example, an avatar corresponding to another client is used to replace the second video window or the displayed content in the second video window. And, the avatar corresponding to the local client is used to replace the first video window or the displayed content in the first video window.

In summary, the method provided in this embodiment switches the network session from the video mode to the voice mode in response to the network environment being worse than the first condition. When the client is in a weak network environment, it reduces the occupation of network bandwidth by the video part of the video mode, so that the voice mode can be performed smoothly, ensuring that the network session can still be used normally in the weak network environment, and reducing the network session Failure rate in a poor network environment.

Fig. 3 shows a flowchart of a method for switching a network session shown in another exemplary embodiment of the present application. In this embodiment, the method is applied to the client (terminal) shown in FIG. 1 as an example for illustration. The method includes:

Step 202: Display a first user interface. The first user interface is an interface when the local client and other clients use a video mode to conduct a network session.

After the local client and other clients establish a network session, the first user interface is displayed in the local client. Exemplarily, the first user interface includes a first video window corresponding to the local client and a second video window corresponding to other clients. The first video window is used to display camera images or shared images captured by the first camera corresponding to the local client; the second video window is used to display camera images or shared images captured by the second camera corresponding to other clients. The shared image includes at least one of a screen image, a video image, a text (Word) file image, a presentation (PPT) file image, and an electronic spreadsheet (Excel) file image.

In this embodiment, at least two other clients are used as an example for illustration. At this time, there may also be at least two second video windows on the first user interface, and the number of second video windows is the same as the number of other clients.

Step 204a, in response to the network environment being worse than the first condition, switch the network session between the local client and other clients from the video mode to the voice mode.

The condition that the network environment is worse than the first condition includes but is not limited to: the network speed is lower than the first threshold and is not 0, or the packet loss rate is higher than the second threshold. For example, if the first threshold is 50kb, then the video will have intermittent freezes.

Exemplarily, the local client periodically measures the network speed or packet loss rate during the duration of the network session. When the network environment is worse than the first condition, the network session between the local client and other clients is automatically switched from the video mode to the voice mode. That is, the local client only switches the network session on its own side from the video mode to the voice mode, while other clients belonging to the same network session still maintain the video mode.

In the video mode, there are video streams and audio streams in the network session. The local client terminal stops uploading and downloading the video stream in the network session (the embodiment that only stops uploading or only stops downloading is not excluded), and keeps uploading and downloading the audio stream in the network session. In an illustrative example, the process does not require server and other client changes.

In response to the network environment being worse than the first condition, the local client closes the video stream in the network session between the local client and other clients, and the network session between the local client and other clients The audio stream keeps continuing to transmit.

In an example, before switching the network session from the video mode to the voice mode, the local client first superimposes and displays a query window on the first user interface, and the query window is used to ask the user whether to switch from the video mode to the voice mode; response After confirming the switching instruction, the local client then switches the network session from video mode to voice mode.

Step 208: In response to an externally inputted human-computer interaction instruction, switch the network conversation from the voice mode to the video mode.

The network environment where the client is located may change. For example, when a user holds a laptop or desktop computer while moving between outdoors and indoors, the network environment will get better or worse. Or, the user needs to use the video mode to watch the shared screen.

In these cases, the user can input a human-computer interaction instruction to the client, and the human-computer interaction instruction is used to instruct the network session to switch from the voice mode to the video mode. The human-computer interaction instruction includes at least one of: a first instruction to turn off the voice mode, a second instruction to turn on a camera, and a third instruction to share a picture.

In an example, the voice mode on/off button is displayed on the second user interface (including the secondary menu). When the user clicks the on/off button, the client switches the network session from the voice mode to the video mode.

In an example, a camera start button is displayed on the second user interface (including the secondary menu). When the user clicks the start button, the client terminal switches the network session from the voice mode to the video mode.

In an example, a sharing button for sharing files is displayed on the second user interface (including the secondary menu). When the user clicks the sharing button to share a shared file, the client switches the network session from voice mode to video mode.

Step 210: In response to the network environment being better than the second condition, switch the network session from the voice mode to the video mode.

The network environment is better than the second condition including but not limited to: the network speed is higher than the third threshold, or the packet loss rate is lower than the fourth threshold. The third threshold is greater than or equal to the first threshold, and the fourth threshold is less than or equal to the second threshold. For example, the third threshold is 100kb, which can ensure the smooth display of lower resolution video images.

As another form parallel to step 208, the local client periodically measures the network speed or the packet loss rate during the duration of the network session. When the network environment is better than the second condition, the network conversation between the local client and other clients is automatically switched from the voice mode to the video mode.

In an example, when the voice mode is switched to the video mode, the local client resumes uploading and downloading the video stream between the local client list and other clients, thereby realizing the redisplay of the video screen.

Wherein, uploading includes sending the screen data collected from the local client to other clients in the same network room, and downloading includes receiving the screen data collected from other clients in the same network room to the local client.

Step 212: Display a first user interface. The first user interface is an interface when the local client and other clients use a video mode to conduct a network conversation.

After the network session is switched from the voice mode to the video mode, the first user interface is displayed again in the local client. However, it should be noted that the display screen in the first user interface in this step may be different from the display screen in the first user interface in step 202.

In a possible embodiment, the above-mentioned switching between the video mode and the voice mode may also be manually triggered by an externally inputted human-computer interaction instruction. For example, swiping to the left on the mobile client triggers the switch from video mode to voice mode; for another example, swiping to the right on the mobile client triggers the switch from voice mode to video mode.

The method provided in this embodiment also switches the network conversation from the voice mode to the video mode by responding to an externally inputted human-computer interaction instruction. When the client switches from a weak network environment to a strong network environment, it ensures that the network session is restored to the video mode in the strong network environment, thereby providing a "video + audio" multimedia session mode in the strong network environment, improving user experience.

The method provided in this embodiment also automatically switches the network session from the voice mode to the video mode by responding to the fact that the network environment is better than the second condition. When the client switches from a weak network environment to a strong network environment, it ensures that the network session is restored to the video mode in the strong network environment, thereby providing a "video + audio" multimedia session mode in the strong network environment, improving user experience.

The following uses the client to be a mobile client and the mobile client to be a cloud meeting client for example. The user uses the cloud meeting client to conduct a multi-person video conference. In Figure 4, the multi-person video conference is a 4-person video conference. Take the meeting as an example. A first user interface 40 is displayed on the mobile client, and a first video window 41 corresponding to the local client and second video windows corresponding to three other clients are displayed on the first user interface 40. The camera picture of the current user is displayed in the first video window 41, and the camera picture of other users is displayed in the second video window. On the first user interface 40, a microphone button, a camera button, a screen sharing button, a member management button, and more setting buttons are also displayed. The microphone button is a functional control used to turn on or off the microphone, the camera button is a functional control used to turn on or off the local camera, the screen sharing button is a functional control used to share screens or files, and the manage member button is used to manage the current network The function controls of the participants in the meeting, the more setting button is used to provide other function controls located in the secondary menu.

When the network environment is worse than the first condition, the first user interface 40 will display the prompt message 42 of "the network signal is poor, automatically switch to the voice mode". Then, the mobile client switches the current network session from the video mode to the voice mode, and displays the second user interface 50. In the second user interface 50, the first video window and the second video window are no longer displayed, and the current user's avatar and other users' avatars are used instead. At the same time, the second user interface 50 will display a prompt message "in the setting, the voice mode can be turned off" on the side of the more setting buttons.

When the user wants to continue to use the video mode for the network session, he can click the more settings button in the second user interface 50, and the secondary interface 60 of the second user interface 50 is displayed at this time, as shown in FIG. 5. The secondary interface includes, but is not limited to: a camera button for joining a meeting, a microphone on button for joining a meeting, a screen sharing plus viewer watermark button, a screen sharing watermark on button, and a voice mode on button 44. When the user clicks the voice mode button 44, the conference client is switched from the voice mode to the video mode again. Alternatively, the user directly clicks the camera button or the screen sharing button in the second user interface 50 to trigger the re-switching from the voice mode to the video mode.

In the following, the client is a computer client for example, and the computer client is a cloud meeting client for example. The user uses the cloud meeting client to conduct a multi-person video conference. In Figure 6, the multi-person video conference is used. Take a 5-person video conference as an example. A first user interface 40 is displayed on the mobile client, and a first video window corresponding to the local client and a second video window (all or part) corresponding to other clients are displayed on the first user interface 40. The camera picture of the current user is displayed in the first video window, and the camera picture of other users is displayed in the second video window. When there are many other clients, part of the camera screens of other clients can be hidden.

On the first user interface 40, a microphone button, a camera button, a screen sharing button, a member invite button, a member management button, a chat button, a document sending button, and a setting button are also displayed. The microphone button is a functional control used to turn the microphone on or off, the camera button is a functional control used to turn on or off the local camera, the screen sharing button is a functional control used to share screens or files, and the invite member button is used to invite someone The function control for the contact to participate in the current web conference, the management member is the function control for managing the participants in the current web conference, the chat button is the button for text chat, and the setting button is used to provide other secondary menus. The function control of the middle function.

When the network environment is worse than the first condition, the first user interface 40 will display an inquiry window 45 of "The current network is poor. In order to ensure the quality of the conference, whether to enable the voice mode" query window 45. If the user clicks the OK button on the inquiry window 45, the computer client switches the current network session from the video mode to the voice mode, and displays the second user interface 50, as shown in FIG. 7. In the second user interface 50, the first video window and the second video window are no longer displayed, and the current user's avatar and other users' avatars are used instead. At the same time, the second user interface 50 will display a prompt message 46 of "If you continue to receive other members' videos, please turn off the voice mode in the "Settings"" on the side of the More Settings button.

When the user wants to continue to use the video mode for the network session, he can click the more settings button in the second user interface 50, and the secondary interface 60 of the second user interface 50 is displayed at this time, as shown in FIG. 8. The secondary interface includes, but is not limited to: a camera button for joining a meeting, a computer audio button for joining a meeting, a computer audio button for automatically selecting a meeting, and a voice mode button 44. When the user clicks the voice mode button 44, the conference client is switched from the voice mode to the video mode again. Alternatively, the user directly clicks the camera button or the screen sharing button in the second user interface 50 to trigger the re-switching from the voice mode to the video mode.

Of course, if the user clicks the cancel button on the inquiry window 45, the prompt message 47 of "If the network does not return to normal, you can turn on the voice mode in "Settings"" can also be displayed on the first user interface, as shown in Figure 9 .

It should be understood that, although the steps in the flowcharts in the foregoing embodiment are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless specifically stated in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least part of the steps in each flowchart may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same time, but can be executed at different times. The order of execution of these steps or stages It is not necessarily performed sequentially, but may be performed alternately or alternately with other steps or at least a part of the steps or stages in other steps.

Fig. 10 shows a block diagram of a device for switching a network session provided by an exemplary embodiment of the present application. The device includes: a display module 1020 and a switching module 1040. Each module included in the device for switching a network session may be implemented in whole or in part by software, hardware, or a combination thereof.

The display module 1020 is configured to display a first user interface. The first user interface is an interface when the local client and other clients use the video mode to conduct a network conversation.

The switching module 1040 is configured to switch the network session from the video mode to the voice mode in response to the network environment being worse than the first condition.

The display module 1020 is also used to display a second user interface, which is an interface when the local client and other clients conduct a network conversation in a voice mode.

In an exemplary embodiment, there are at least two other clients.

The switching module 1040 is further configured to switch the network session between the local client and other clients from the video mode to the voice mode in response to the network environment being worse than the first condition; wherein, the network session between at least two other clients The session remains in video mode.

In an exemplary embodiment, the switching module 1040 is further configured to, in response to the network environment being worse than the first condition, close the video stream in the network session between the local client and other clients, and switch the local client The audio stream in the network session between the client and other clients keeps transmitting.

In an exemplary embodiment, the switching module 1040 is further configured to switch the network session from the voice mode to the video mode in response to an externally inputted human-computer interaction instruction; wherein, the human-computer interaction instruction includes: the first voice mode is turned off. At least one of the instruction, the second instruction to turn on the camera, and the third instruction to share the screen.

In an exemplary embodiment, the switching module 1040 is further configured to switch the network session from the voice mode to the video mode in response to the network environment being better than the second condition.

FIG. 11 shows a structural block diagram of a computer device 1100 provided by an exemplary embodiment of the present application. The computer device 1100 may be a portable mobile terminal, such as a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, dynamic image expert compression standard audio layer 3), MP4 (Moving Picture Experts Group Audio Layer IV, The motion picture expert compresses the standard audio frequency level 4) the player. The computer device 1100 may also be called user equipment, portable terminal, and other names.

Generally, the computer device 1100 includes a processor 1101 and a memory 1102.

The processor 1101 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so on. The processor 1101 can adopt at least one hardware form among DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array, Programmable Logic Array). achieve. The processor 1101 may also include a main processor and a coprocessor. The main processor is a processor used to process data in the wake state, also called a CPU (Central Processing Unit, central processing unit); the coprocessor is A low-power processor used to process data in the standby state. In some embodiments, the processor 1101 may be integrated with a GPU (Graphics Processing Unit, image processor), and the GPU is used for rendering and drawing content that needs to be displayed on the display screen. In some embodiments, the processor 1101 may further include an AI (Artificial Intelligence) processor, and the AI processor is used to process computing operations related to machine learning.

The memory 1102 may include one or more computer-readable storage media, which may be tangible and non-transitory. The memory 1102 may also include high-speed random access memory and non-volatile memory, such as one or more magnetic disk storage devices and flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1102 is used to store at least one instruction, and the at least one instruction is used to be executed by the processor 1101 to implement the mail sending method provided in this application.

In some embodiments, the computer device 1100 may optionally further include: a peripheral device interface 1103 and at least one peripheral device. Specifically, the peripheral device includes: at least one of a radio frequency circuit 1104, a touch display screen 1105, a camera 1106, an audio circuit 1107, a positioning component 1108, and a power supply 1109.

The peripheral device interface 1103 may be used to connect at least one peripheral device related to I/O (Input/Output) to the processor 1101 and the memory 1102. In some embodiments, the processor 1101, the memory 1102, and the peripheral device interface 1103 are integrated on the same chip or circuit board; in some other embodiments, any one of the processor 1101, the memory 1102, and the peripheral device interface 1103 or The two can be implemented on a separate chip or circuit board, which is not limited in this embodiment.

The radio frequency circuit 1104 is used to receive and transmit RF (Radio Frequency, radio frequency) signals, also called electromagnetic signals. The radio frequency circuit 1104 communicates with a communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1104 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 1104 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and so on. The radio frequency circuit 1104 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to: World Wide Web, Metropolitan Area Network, Intranet, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area network and/or WiFi (Wireless Fidelity, wireless fidelity) network. In some embodiments, the radio frequency circuit 1104 may also include a circuit related to NFC (Near Field Communication), which is not limited in this application.

The touch screen 1105 is used to display UI (User Interface). The UI can include graphics, text, icons, videos, and any combination thereof. The touch display screen 1105 also has the ability to collect touch signals on or above the surface of the touch display screen 1105. The touch signal may be input to the processor 1101 as a control signal for processing. The touch screen 1105 is used to provide virtual buttons and/or virtual keyboards, also called soft buttons and/or soft keyboards. In some embodiments, there may be one touch display screen 1105, and the front panel of the computer device 1100 may be provided; in other embodiments, there may be at least two touch display screens 1105, which are respectively arranged on different surfaces or presentations of the computer device 1100. Folding design; in other embodiments, the touch screen 1105 may be a flexible display screen, which is arranged on the curved surface or the folding surface of the computer device 1100. Even the touch screen 1105 can also be set as a non-rectangular irregular figure, that is, a special-shaped screen. The touch screen 1105 can be made of materials such as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode).

The camera assembly 1106 is used to capture images or videos. Optionally, the camera assembly 1106 includes a front camera and a rear camera. Generally, the front camera is used to implement video calls or selfies, and the rear camera is used to implement photos or videos. In some embodiments, there are at least two rear cameras, each of which is a main camera, a depth-of-field camera, and a wide-angle camera, so as to realize the fusion of the main camera and the depth-of-field camera to realize the background blur function, and the main camera and the wide-angle camera are fused Realize panoramic shooting and VR (Virtual Reality, virtual reality) shooting functions. In some embodiments, the camera assembly 1106 may also include a flash. The flash can be a single-color flash or a dual-color flash. Dual color temperature flash refers to a combination of warm light flash and cold light flash, which can be used for light compensation under different color temperatures.

The audio circuit 1107 is used to provide an audio interface between the user and the computer device 1100. The audio circuit 1107 may include a microphone and a speaker. The microphone is used to collect sound waves of the user and the environment, and convert the sound waves into electrical signals and input them to the processor 1101 for processing, or input to the radio frequency circuit 1104 to implement voice communication. For the purpose of stereo collection or noise reduction, there may be multiple microphones, which are respectively arranged in different parts of the computer device 1100. The microphone can also be an array microphone or an omnidirectional collection microphone. The speaker is used to convert the electrical signal from the processor 1101 or the radio frequency circuit 1104 into sound waves. The speaker can be a traditional thin-film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into human audible sound waves, but also convert the electrical signal into human inaudible sound waves for distance measurement and other purposes. In some embodiments, the audio circuit 1107 may also include a headphone jack.

The positioning component 1108 is used to locate the current geographic location of the computer device 1100 to implement navigation or LBS (Location Based Service, location-based service). The positioning component 1108 may be a positioning component based on the GPS (Global Positioning System, Global Positioning System) of the United States, the Beidou system of China, or the Galileo system of Russia.

The power supply 1109 is used to supply power to various components in the computer device 1100. The power source 1109 may be alternating current, direct current, disposable batteries, or rechargeable batteries. When the power source 1109 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery charged through a wired line, and a wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.

In some embodiments, the computer device 1100 further includes one or more sensors 1110. The one or more sensors 1110 include, but are not limited to: an acceleration sensor 1111, a gyroscope sensor 1112, a pressure sensor 1113, a fingerprint sensor 1114, an optical sensor 1111, and a proximity sensor 1116.

The acceleration sensor 1111 detects the magnitude of acceleration on the three coordinate axes of the coordinate system established by the computer device 1100. For example, the acceleration sensor 1111 is used to detect the components of gravitational acceleration on three coordinate axes. The processor 1101 may control the touch screen 1105 to display the user interface in a horizontal view or a vertical view according to the gravity acceleration signal collected by the acceleration sensor 1111. The acceleration sensor 1111 may be used for the collection of game or user motion data.

The gyroscope sensor 1112 can detect the body direction and rotation angle of the computer device 1100, and the gyroscope sensor 1112 can collect the 3D actions of the user on the computer device 1100 together with the acceleration sensor 1111. Based on the data collected by the gyroscope sensor 1112, the processor 1101 can implement the following functions: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

The pressure sensor 1113 may be arranged on the side frame of the computer device 1100 and/or the lower layer of the touch screen 1105. When the pressure sensor 1113 is disposed on the side frame of the computer device 1100, it can detect the user's holding signal of the computer device 1100, and perform left and right hand recognition or quick operation according to the holding signal. When the pressure sensor 1113 is arranged on the lower layer of the touch display screen 1105, the control of the operability controls on the UI interface can be realized according to the user's pressure operation on the touch display screen 1105. The operability control includes at least one of a button control, a scroll bar control, an icon control, and a menu control.

The fingerprint sensor 1114 is used to collect the user's fingerprint to identify the user's identity according to the collected fingerprint. When it is recognized that the user's identity is a trusted identity, the processor 1101 authorizes the user to perform related sensitive operations, including unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings. The fingerprint sensor 1114 may be provided on the front, back or side of the computer device 1100. When the computer device 1100 is provided with a physical button or a manufacturer logo, the fingerprint sensor 1114 can be integrated with the physical button or the manufacturer logo.

The optical sensor 1111 is used to collect the ambient light intensity. In an embodiment, the processor 1101 may control the display brightness of the touch screen 1105 according to the intensity of the ambient light collected by the optical sensor 1111. Specifically, when the ambient light intensity is high, the display brightness of the touch screen 1105 is increased; when the ambient light intensity is low, the display brightness of the touch screen 1105 is decreased. In another embodiment, the processor 1101 may also dynamically adjust the shooting parameters of the camera assembly 1106 according to the ambient light intensity collected by the optical sensor 1111.

The proximity sensor 1116, also called a distance sensor, is usually arranged on the front of the computer device 1100. The proximity sensor 1116 is used to collect the distance between the user and the front of the computer device 1100. In one embodiment, when the proximity sensor 1116 detects that the distance between the user and the front of the computer device 1100 gradually becomes smaller, the processor 1101 controls the touch screen 1105 to switch from the on-screen state to the off-screen state; when the proximity sensor 1116 When it is detected that the distance between the user and the front of the computer device 1100 is gradually increasing, the processor 1101 controls the touch screen 1105 to switch from the rest screen state to the bright screen state.

Those skilled in the art can understand that the structure shown in FIG. 11 does not constitute a limitation on the computer device 1100, and may include more or fewer components than shown in the figure, or combine some components, or adopt different component arrangements.

FIG. 12 shows that the present application also provides a computer device, including a memory and a processor, the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the processor executes the steps of switching the above-mentioned network session. . Here, the steps of the image processing method may be the steps in the network session switching method of each of the foregoing embodiments. It should be noted that the computer device may be the computer device provided in Figure 12 below.

Please refer to FIG. 12, which shows a schematic structural diagram of a computer device provided by an exemplary embodiment of the present application. Specifically: the computer device 1200 includes a central processing unit (CPU) 1201, a system memory 1204 including a random access memory (RAM) 1202 and a read-only memory (ROM) 1203, and a system connecting the system memory 1204 and the central processing unit 1201 Bus 1205. The computer device 1200 also includes a basic input/output system (I/O system) 1206 that helps to transfer information between various devices in the computer, and a mass storage device for storing the operating system 1213, application programs 1214, and other program modules 1210 1207.

The basic input/output system 1206 includes a display 1208 for displaying information and an input device 1209 such as a mouse and a keyboard for the user to input information. The display 1208 and the input device 1209 are both connected to the central processing unit 1201 through the input and output controller 1210 connected to the system bus 1205. The basic input/output system 1206 may also include an input and output controller 1210 for receiving and processing input from multiple other devices such as a keyboard, a mouse, or an electronic stylus. Similarly, the input and output controller 1210 also provides output to a display screen, a printer, or other types of output devices.

The mass storage device 1207 is connected to the central processing unit 1201 through a mass storage controller (not shown) connected to the system bus 1205. The mass storage device 1207 and its associated computer-readable medium provide non-volatile storage for the computer device 1200. That is, the mass storage device 1207 may include a computer-readable medium (not shown) such as a hard disk or a CD-ROI drive.

Without loss of generality, computer-readable media may include computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storing information such as computer readable instructions, data structures, program modules or other data. Computer storage media include RAM, ROM, EPROM, EEPROM, flash memory or other solid-state storage technologies, CD-ROM, DVD or other optical storage, tape cartridges, magnetic tape, disk storage or other magnetic storage devices. Of course, those skilled in the art may know that the computer storage medium is not limited to the above-mentioned types. The aforementioned system memory 1204 and mass storage device 1207 may be collectively referred to as memory.

According to various embodiments of the present application, the computer device 1200 may also be connected to a remote computer on the network through a network such as the Internet to operate. That is, the computer device 1200 can be connected to the network 1212 through the network interface unit 1211 connected to the system bus 1205, or in other words, the network interface unit 1211 can also be used to connect to other types of networks or remote computer systems (not shown).

In one embodiment, a computer device is provided, including a memory and a processor, the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the processor executes the steps of switching the above-mentioned network session. Here, the steps of the image processing method may be the steps in the network session switching method of each of the foregoing embodiments.

In one embodiment, a computer-readable storage medium is provided, which stores computer-readable instructions, and when the computer-readable instructions are executed by a processor, the processor executes the steps of switching the above-mentioned network session. Here, the steps of the image processing method may be the steps in the switching of the network session in each of the foregoing embodiments.

A person of ordinary skill in the art can understand that all or part of the processes in the methods of the foregoing embodiments can be implemented by computer-readable instructions to instruct relevant hardware. The programs can be stored in a non-volatile computer and can be read. In the storage medium, when the program is executed, it may include the procedures of the above-mentioned method embodiments. Wherein, any reference to memory, storage, database, or other media used in the embodiments provided in this application may include non-volatile and/or volatile memory. Non-volatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not a limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Channel (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction between the combinations of these technical features, they should It is considered as the range described in this specification.

The above examples only express several implementation manners of the present application, and the description is relatively specific and detailed, but it should not be understood as a limitation on the scope of the invention patent. It should be pointed out that for those of ordinary skill in the art, without departing from the concept of this application, several modifications and improvements can be made, and these all fall within the protection scope of this application. Therefore, the scope of protection of the patent of this application shall be subject to the appended claims.

Claims

A method for switching a network session, characterized in that it is executed by a computer device, and the method includes:

Displaying a first user interface, where the first user interface is an interface when the local client and other clients use a video mode to conduct a network conversation;

In response to the network environment being worse than the first condition, switching the network session from the video mode to the voice mode; and

A second user interface is displayed, and the second user interface is an interface when the local client and the other client use the voice mode to conduct the network conversation.
The method according to claim 1, wherein there are at least two other clients, and in response to the network environment being worse than the first condition, switching the network session from the video mode to the voice mode, include:

In response to the network environment being worse than the first condition, switching the network session between the local client and the other client from the video mode to the voice mode;

Wherein, the network session between at least two of the other clients keeps using the video mode.
The method according to claim 2, wherein in response to the network environment being worse than the first condition, the network session between the local client and the other client is changed from the Switching the video mode to the voice mode includes:

In response to the network environment being worse than the first condition, the video stream in the network session between the local client and the other client is closed, and the local client is connected to the other client. The audio stream in the network session between the clients keeps transmitting.
The method according to any one of claims 1 to 3, wherein after the displaying the second user interface, the method further comprises:

In response to an externally inputted human-computer interaction instruction, switching the network session from the voice mode to the video mode;

Wherein, the human-computer interaction instruction includes: at least one of a first instruction to turn off the voice mode, a second instruction to turn on a camera, and a third instruction to share a picture.
The method according to any one of claims 1 to 3, wherein after the displaying the second user interface, the method further comprises:

In response to the network environment being better than the second condition, switching the network session from the voice mode to the video mode.
The method according to claim 5, wherein the network environment is worse than the first condition is that the network speed is lower than the first threshold and is not 0, or the packet loss rate is higher than the second threshold; the network environment The better condition is that the network speed is higher than the third threshold, or the packet loss rate is lower than the fourth threshold; the third threshold is greater than or equal to the first threshold, and the fourth threshold is less than or equal to the first threshold. Two thresholds.
The method according to claim 1, wherein the first user interface includes a first video window corresponding to the local client and a second video window corresponding to the other client; A video window is used to display the camera picture or shared picture captured by the first camera corresponding to the local client; the second video window is used to display the camera picture captured by the second camera corresponding to the other client Or share the screen.
The method according to claim 7, wherein the second user interface replaces the display content in the second video window or the second video window with the avatar corresponding to the other client, and through the local terminal The avatar corresponding to the client replaces the first video window or the displayed content in the first video window.
A device for switching a network session, characterized in that the device comprises:

The display module is configured to display a first user interface, where the first user interface is an interface when the local client and other clients use a video mode to conduct a network conversation;

A switching module for switching the network session from the video mode to the voice mode in response to the network environment being worse than the first condition; and

The display module is further configured to display a second user interface, and the second user interface is an interface when the local client and the other clients use the voice mode to conduct the network conversation.
The device according to claim 9, wherein there are at least two other clients;

The switching module is further configured to switch the network session between the local client and the other client from the video mode to the voice mode in response to the network environment being worse than the first condition ；

Wherein, the network session between at least two of the other clients keeps using the video mode.
11. The device according to claim 10, wherein the switching module is further configured to respond to the network environment being worse than the first condition, to connect the local client to the other client The video stream in the network session is closed, and the audio stream in the network session between the local client and the other clients is kept for transmission.
The device according to any one of claims 9 to 11, wherein the switching module is further configured to switch the network session from the voice mode to the voice mode in response to an externally inputted human-computer interaction instruction Video mode; wherein the human-computer interaction instruction includes: at least one of a first instruction to turn off the voice mode, a second instruction to turn on a camera, and a third instruction to share a picture.
The device according to any one of claims 9 to 11, wherein the switching module is further configured to switch the network session from the voice mode to a second condition in response to the network environment being better than a second condition The video mode.
A computer device comprising a memory and a processor. The memory stores computer readable instructions. When the computer readable instructions are executed by the processor, the processor executes any of claims 1 to 8. One of the steps of the method described.
A non-volatile storage medium storing computer-readable instructions. When the computer-readable instructions are executed by one or more processors, the one or more processors execute any one of claims 1 to 8 The steps of the described method.