CN111835531B

CN111835531B - Session processing method, device, computer equipment and storage medium

Info

Publication number: CN111835531B
Application number: CN202010753249.5A
Authority: CN
Inventors: 何芬; 林锋; 刘立强; 王芳
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2020-07-30
Filing date: 2020-07-30
Publication date: 2023-08-25
Anticipated expiration: 2040-07-30
Also published as: CN111835531A

Abstract

The application provides a session processing method, a session processing device, computer equipment and a storage medium, and belongs to the technical field of Internet. The method comprises the following steps: responding to the application joining operation of the first user account to the target session, and acquiring a face to obtain a first face image corresponding to the first user account; sending a request for adding to a server, wherein the request for adding carries the first face image, the first user account and a session identifier of the target session; and in response to the server determining that the first face image of the first user account meets the joining condition of the target session, joining the first user account to the target session. According to the technical scheme, users who do not meet the adding conditions can be automatically and effectively filtered without manual auditing, and the filtering accuracy is improved.

Description

Session processing method, device, computer equipment and storage medium

Technical Field

The present application relates to the field of internet technologies, and in particular, to a session processing method, a session processing device, a computer device, and a storage medium.

Background

With the development of the internet of things technology, users can conduct conversations with other users far out of thousands through various intelligent hardware. Group sessions are becoming popular with users as an effective way of multi-person communication.

At present, when a user applies for joining a group session, a manager of the group session needs to conduct auditing, and only users meeting the joining condition of the group session can join the group session.

The problem with the above solution is that, because the content submitted by the user when applying for joining the group session may be false content, and the manual auditing efficiency is low, the user who does not meet the joining condition cannot be effectively filtered.

Disclosure of Invention

The embodiment of the application provides a session processing method, a session processing device, computer equipment and a storage medium, which are used for acquiring a face image of a user account before the user account is added into a target session, so that when the face image of the user account meets the adding condition of the target session, the user account is allowed to be added into the group session, users which do not meet the adding condition can be automatically and effectively filtered without manual verification, and the filtering accuracy is improved. The technical scheme is as follows:

in one aspect, a session processing method is provided and applied to a terminal, and the method includes:

responding to the application joining operation of the first user account to the target session, and acquiring a face to obtain a first face image;

Sending a request for adding application to a server, wherein the request for adding application carries the first face image, the first user account and the session identifier of the target session;

and responding to the server to determine that the first face image of the first user account meets the joining condition of the target session, and displaying a session interface of the target session.

On the other hand, a session processing method is provided and is applied to a server, and the method comprises the following steps:

receiving an application joining request of a terminal, wherein the application joining request carries a first face image acquired by the terminal, a first user account of the terminal and a session identifier of the target session;

acquiring the joining condition of the target session according to the session identifier of the target session;

and responding to the first face image meeting the joining condition, and joining the first user account into the target session.

In an alternative implementation manner, after the first user account is added to the target session, the method includes:

according to the face scores of all user accounts in the target session, ordering the audio and video windows of all user accounts in a session interface of the target session;

And displaying the session interface to the terminal.

determining a second user account closest to the face score of the first user account according to the face scores of the user accounts in the target session;

in a session interface of the target session, the audio and video windows of the first user account and the second user account are adjacently arranged;

and displaying the session interface to the terminal.

acquiring the current queuing order of the first user account, and displaying a queuing interface comprising the queuing order to the terminal;

and responding to the order of the ordering is zero, and displaying a session interface comprising the audio-video window of the first user account and the audio-video windows of other user accounts in the target group to the terminal.

In an alternative implementation, the target session is created based on a session creation interface provided by the application client, the session creation interface being used to provide a set-up function of the joining condition.

In an alternative implementation, the creation of the target session includes:

receiving a session creation request, wherein the session creation request carries a management account and a joining condition of the target session;

and creating the target session, and adding the management account into the target session.

In another aspect, a session processing apparatus is provided, which is applied to a terminal, and the apparatus includes:

the face acquisition module is used for responding to the application joining operation of the first user account to the target session, and carrying out face acquisition to obtain a first face image corresponding to the first user account;

the request sending module is used for sending a request for adding to a server, wherein the request for adding carries the first face image, the first user account and the session identifier of the target session;

and the session processing module is used for responding to the server to determine that the first face image of the first user account meets the joining condition of the target session, and joining the first user account into the target session.

In an optional implementation manner, the application joining operation is initiated by the first user account in a group session, and the target session is an audio-video session initiated in the group session; or alternatively, the first and second heat exchangers may be,

The application joining operation is initiated by the first user account in a session display interface, the target session is an audio-video session, and the session display interface is used for displaying at least one audio-video session in progress.

In an alternative implementation, the apparatus further includes: and the display module is used for displaying the audio and video windows of the user accounts from high to low according to the face scores of the user accounts in the target session.

In an alternative implementation, the apparatus further includes: and the display module is used for displaying the audio-video window of the second user account closest to the face score of the first user account at the adjacent position of the audio-video window of the first user account.

In an alternative implementation, the apparatus further includes: the display module is used for displaying the current queuing order of the first user account in the queuing waiting interface; and in response to the queuing order being zero, displaying the audio-video window of the first user account and the audio-video window of at least one other user account.

In an optional implementation manner, the face collection module is configured to respond to an operation of applying for joining a target session by a first user account, and perform face recognition based on an image in a viewfinder of the terminal; and responding to the identified face, and acquiring the face to obtain a first face image corresponding to the first user account.

In an alternative implementation, the apparatus further includes:

and the prompt module is used for displaying prompt information in response to the fact that the face is not recognized, wherein the prompt information is used for indicating that the face is not recognized currently.

In an alternative implementation, the apparatus further includes: and the display module is used for responding to the server to determine that the first face image of the first user account does not meet the joining condition, and displaying a session display interface, wherein the session display interface is used for displaying at least one audio-video session in progress.

In an alternative implementation, the creation of the target session includes:

responding to the group creation operation of the management account number of the target session, and displaying a session creation interface provided by the application client;

and receiving the setting operation of the management account on the joining condition on the session creation page, and sending a session creation request to the server, wherein the session creation request carries the joining condition.

In another aspect, a session processing apparatus is provided, which is applied to a server, and the apparatus includes:

the request receiving module is used for receiving a request of adding application of a terminal, wherein the request of adding application carries a first face image acquired by the terminal, a first user account of the terminal and a session identifier of the target session;

the joining condition acquisition module is used for acquiring the joining condition of the target session according to the session identifier of the target session;

and the session joining module is used for joining the first user account to the target session in response to the first face image meeting the joining condition.

In an alternative implementation, the apparatus further includes: the display module is used for sequencing the audio and video windows of the user accounts in the session interface of the target session according to the face scores of the user accounts in the target session; and displaying the session interface to the terminal.

In an alternative implementation, the apparatus further includes: the display module is used for determining a second user account closest to the face score of the first user account according to the face scores of the user accounts in the target session; in a session interface of the target session, the audio and video windows of the first user account and the second user account are adjacently arranged; and displaying the session interface to the terminal.

In an alternative implementation, the apparatus further includes: the display module is used for acquiring the current queuing order of the first user account and displaying a queuing waiting interface comprising the queuing order to the terminal; and responding to the order of the ordering is zero, and displaying a session interface comprising the audio-video window of the first user account and the audio-video windows of other user accounts in the target group to the terminal.

In an alternative implementation, the creating of the target session includes:

In another aspect, a computer device is provided, where the computer device is a terminal, and the terminal includes a processor and a memory, where the memory is configured to store at least one section of program code, where the at least one section of program code is loaded and executed by the processor to implement operations performed in a session processing method in an embodiment of the present application.

In another aspect, a computer device is provided, where the computer device is a server, and the server includes a processor and a memory, where the memory is configured to store at least one section of program code, where the at least one section of program code is loaded and executed by the processor to implement operations performed in a session processing method in an embodiment of the present application.

In another aspect, a computer readable storage medium having stored therein at least one piece of program code loaded and executed by the processor to implement operations performed in a session processing method in an embodiment of the present application is provided.

In another aspect, a computer program product or computer program is provided, the computer program product or computer program comprising computer program code, the computer program code being stored in a computer readable storage medium. The computer program code is read from a computer readable storage medium by a processor of a computer device, and executed by the processor, causes the computer device to perform the session processing method described above or provided in various alternative implementations.

The technical scheme provided by the embodiment of the application has the beneficial effects that:

in the embodiment of the application, the face image of the user account is acquired before the user account is added into the target session, so that when the face image of the user account meets the adding condition of the target session, the user account is allowed to be added into the group session, and the users which do not meet the adding condition can be automatically and effectively filtered without manual verification, thereby improving the filtering accuracy.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a schematic diagram of an implementation environment of a session processing method according to an embodiment of the present application;

fig. 2 is a flowchart of a session processing method according to an embodiment of the present application;

FIG. 3 is a flow chart of another session handling method provided in accordance with an embodiment of the present application;

FIG. 4 is a flow chart of another session handling method provided in accordance with an embodiment of the present application;

FIG. 5 is a schematic illustration of a session interface for a group session provided in accordance with an embodiment of the present application;

FIG. 6 is a schematic diagram of a session presentation interface provided in accordance with an embodiment of the present application;

FIG. 7 is a schematic diagram of a trigger display session creation interface provided in accordance with an embodiment of the present application;

FIG. 8 is a schematic diagram of face scoring according to an embodiment of the present application;

FIG. 9 is a schematic illustration of a gender detection provided in accordance with an embodiment of the present application;

fig. 10 is a schematic logic structure diagram of an application client in a terminal according to an embodiment of the present application;

FIG. 11 is a flowchart of another session processing method provided according to an embodiment of the present application;

FIG. 12 is a flowchart of another session processing method according to an embodiment of the present application;

fig. 13 is a block diagram of a session processing apparatus provided according to an embodiment of the present application;

fig. 14 is a block diagram of a session processing apparatus provided according to an embodiment of the present application;

fig. 15 is a block diagram of a terminal 1500 provided according to an embodiment of the present application;

fig. 16 is a schematic structural diagram of a server according to an embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the embodiments of the present application will be described in further detail with reference to the accompanying drawings.

Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the application. Rather, they are merely examples of apparatus and methods consistent with aspects of the application as detailed in the accompanying claims.

Techniques that may be used with embodiments of the present application are described below.

Cloud conferencing is an efficient, convenient, low-cost form of conferencing based on cloud computing technology. The user can rapidly and efficiently share voice, data files and videos with all groups and clients in the world synchronously by simply and easily operating through an internet interface, and the user is helped by a cloud conference service provider to operate through complex technologies such as data transmission, processing and the like in the conference.

At present, domestic cloud conference mainly focuses on service contents mainly in a SaaS (Software as a Service ) mode, including service forms of telephone, network, video and the like, and video conference based on cloud computing is called as a cloud conference.

In the cloud conference era, the transmission, processing and storage of data are all processed by the computer resources of video conference factories, and users can carry out efficient remote conferences without purchasing expensive hardware and installing complicated software.

The cloud conference system supports the dynamic cluster deployment of multiple servers, provides multiple high-performance servers, and greatly improves conference stability, safety and usability. In recent years, video conferences are popular for many users because of greatly improving communication efficiency, continuously reducing communication cost and bringing about upgrade of internal management level, and have been widely used in various fields of government, army, transportation, finance, operators, education, enterprises, etc. Undoubtedly, the video conference has stronger attraction in convenience, rapidness and usability after the cloud computing is applied, and the video conference application is required to be stimulated. The cloud conference can be considered as one of group sessions, and the session processing method provided by the embodiment of the application can be applied to a scene of screening participants of the cloud conference, and can be used for screening users meeting joining conditions to join the cloud conference aiming at the open cloud conference, namely the cloud conference without appointed participants.

Cloud Social contact (Cloud Social) is a virtual Social contact application mode of Internet of things, cloud computing and mobile Internet interaction application, aims at establishing a famous 'resource sharing relation graph', and further develops network Social contact, and is characterized in that a large number of Social resources are integrated and evaluated uniformly to form a resource effective pool to provide services for users as required. The more users that participate in the sharing, the greater the utility value that can be created. The session processing method provided by the embodiment of the application can be applied to a scene of screening both sides performing cloud social contact, and can establish a group session and set the joining condition of joining the group session aiming at any side of the cloud social contact so as to screen users meeting the joining condition to enter the group session for social contact. Of course, the session processing method provided by the embodiment of the application can also be applied to scenes such as screening of 1-to-1 video chat objects, screening of multi-person video chat objects, screening of recruitment objects and the like.

Artificial intelligence cloud services, also commonly referred to as AIaaS (AI as Service, chinese is "AI as Service"). The system is a service mode of an artificial intelligence platform which is mainstream at present, and particularly, the AIaaS platform can split several common AI (Artificial Intelligence ) services and provide independent or packaged services at the cloud. This service mode is similar to an AI theme mall: all developers can access one or more artificial intelligence services provided by the use platform through an API interface, and partial deep developers can also use an AI framework and AI infrastructure provided by the platform to deploy and operate and maintain self-proprietary cloud artificial intelligence services. In the embodiment of the application, the server can determine the face score of the user account through the artificial intelligence cloud service according to the face image uploaded by the user account.

Next, an implementation environment of the session processing method provided by the embodiment of the present application is introduced, and fig. 1 is a schematic diagram of an implementation environment of the session processing method provided by the embodiment of the present application. The implementation environment includes a first terminal 101, a second terminal 102, and a server 103.

The first terminal 101 and the server 103 can be directly or indirectly connected through wired or wireless communication, and the present application is not limited herein. Optionally, the first terminal 101 is a smart terminal capable of running instant messaging software or social software, such as a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, and a smart television, but is not limited thereto. The first terminal 101 can be installed and run with an application client that can be used to engage in online activities. Optionally, the application client is a social application client, a shopping application client, or a recruitment application client, etc. Illustratively, the first terminal 101 is a terminal used by a first user, and a first user account of the first user is logged in an application client running in the first terminal 101, where the first user account is an account for applying to join a group session.

The second terminal 102 and the server 103 can be directly or indirectly connected through wired or wireless communication, and the present application is not limited herein. Optionally, the second terminal 102 is a smart terminal capable of running instant messaging software or social applications, such as a smart phone, tablet computer, notebook computer, desktop computer, smart speaker, smart watch, smart television, but not limited thereto. The second terminal 102 can be installed and run with an application client that can be used to create online activity. Optionally, the application client is a social application client, an online education application client, a video or live broadcast application client, a shopping application client, or a recruitment application client, etc. Illustratively, the second terminal 102 is a terminal used by a second user, and a second user account of the second user is logged into an application client running in the second terminal 102, where the second user account is a management account for creating a group session.

It should be noted that, in the embodiment of the present application, the division between the first terminal and the second terminal is only for convenience of description, and any one of the first terminal and the second terminal can be used as the first terminal or the second terminal, that is, an application client installed in the terminal can be used to create a group session or apply for joining the group session.

The server 103 may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or may be a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDNs, basic cloud computing services such as big data and artificial intelligence platforms, and the like. The server 103 is configured to provide background services for application clients operated by the first terminal 101 and the second terminal 102.

Optionally, during the group session processing, the server 103 performs primary group session processing, and the first terminal 101 and the second terminal 102 perform secondary group session processing; alternatively, the server 103 performs a secondary group session processing operation, and the first terminal 101 and the second terminal 102 perform a primary group session processing operation; alternatively, the server 103, the first terminal 101, or the second terminal 102 can each independently undertake the group session processing work.

Optionally, the server 103 includes: the system comprises an access server, a face detection server and a database. The access server is used for providing access services for the first terminal 101 and the second terminal 102. The face detection server is used for providing face detection service. The face detection server may be one or more. When the face detection server is multiple, there are at least two face detection servers for providing different services, and/or there are at least two face detection servers for providing the same service, such as providing the same service in a load balancing manner, which embodiments of the present application are not limited. The face detection server can be provided with an AI face detection model for determining a face score from the face image. The database is used for storing data such as user account numbers, session identifications, face images, joining conditions, group session records and the like.

Alternatively, the first terminal 101 and the second terminal 102 refer broadly to two of a plurality of terminals, and the present embodiment is exemplified only by the first terminal 101 and the second terminal 102. Those skilled in the art will appreciate that the number of the first terminals 101 can be greater. For example, the first terminal 101 may be several tens or hundreds, or more, and the implementation environment of the session processing method may further include other terminals. The embodiment of the application does not limit the number of terminals and the equipment type.

Alternatively, the wireless network or wired network described above uses standard communication techniques and/or protocols. The network is typically the internet, but can be any network including, but not limited to, a local area network (Local Area Network, LAN), metropolitan area network (Metropolitan Area Network, MAN), wide area network (Wide Area Network, WAN), mobile, wired or wireless network, private network, or any combination of virtual private networks. In some embodiments, data exchanged over the network is represented using techniques and/or formats including HyperText Mark-up Language (HTML), extensible markup Language (Extensible Markup Language, XML), and the like. In addition, all or some of the links can be encrypted using conventional encryption techniques such as secure socket layer (Secure Socket Layer, SSL), transport layer security (Transport Layer Security, TLS), virtual private network (Virtual Private Network, VPN), internet protocol security (Internet Protocol Security, IPsec), and the like. In other embodiments, custom and/or dedicated data communication techniques can also be used in place of or in addition to the data communication techniques described above.

In an optional implementation manner, the session processing method provided by the embodiment of the application can be applied to a social scene, and the description is given below taking the terminal used by the first terminal and the second terminal as the friend-making platform user as an example.

The second user of the second terminal can request the server to create an audio-video session for social contact on the social platform through the social client, and the second user screens users joining the audio-video session by setting a joining condition when the creation of the audio-video session is requested. The server of the social platform can create an audio-video session on the social platform according to the session creation request sent by the second terminal, and add the second user account of the second terminal into the audio-video session. The server can send the session links of the established audio-video session into the social platform. The first user of the first terminal can view audio and video sessions created by other users on the social platform, and applies for joining the audio and video sessions by clicking a session link of any audio and video session. If the first user clicks a session link of the audio-video session created by the second user, the first terminal sends a request for adding to the server, and the server determines whether the first face image meets the adding condition of the audio-video session according to the first face image, the first user account number and the session identifier of the audio-video session carried in the request for adding. If the joining condition is met, the server joins the first user account into the audio-video session; if the joining condition is not satisfied, the server returns a prompt of joining failure to the first terminal. Through setting up the joining condition by the creator of audio-video conversation in the social process, then the user who applies to join in this group conversation is filtered according to the joining condition that sets up by the server, has provided brand-new social mode, has enriched social scene, can satisfy user's curiosity, has improved social interest, is favorable to improving social platform's user liveness. In addition, as the users joining the audio and video session are users meeting the joining condition, the social efficiency and the success rate are improved.

In an optional implementation manner, the session processing method provided by the embodiment of the present application can be used in a recruitment scenario, and the following description will take a first terminal as a terminal used by an recruitment user and a second terminal as an example.

The second user of the second terminal, i.e., the recruiting user, can request the server to create an audio-video session for recruitment on the recruitment platform through the recruiting client, and the second user recruits users of a specific gender and appearance, such as recruiting a female model, a male model, an actress, etc., by setting joining conditions, such as gender and face scores, etc., when the creation of the audio-video session is requested. The server of the recruitment platform can create an audio-video session on the recruitment platform according to the session creation request sent by the second terminal, and add the second user account of the second terminal to the audio-video session. The first user of the first terminal, namely the application user, can view recruitment information published by other users on a recruitment platform, wherein the recruitment information comprises session links of audio and video sessions, and the first user can apply for joining the audio and video sessions by clicking the session links of any audio and video session. If the first user clicks a session link of the audio-video session created by the second user, the first terminal sends a request for adding to the server, and the server determines whether the first face image meets the adding condition of the audio-video session according to the face image carried in the request for adding, the first user account and the session identifier of the audio-video session. If the joining condition is met, the server joins the first user account into the audio-video session; if the joining condition is not satisfied, the server returns a prompt of joining failure to the first terminal. The recruitment similar to the on-site recruitment form is carried out on line in a group session mode, the creator of the audio-video session sets the joining condition, and then the server screens the users applying for joining the group session according to the set joining condition, so that unnecessary communication is reduced, a brand-new recruitment mode is provided, time of recruiters is saved, and recruitment efficiency and success rate are improved.

Fig. 2 is a flowchart of a session processing method according to an embodiment of the present application, and as shown in fig. 2, in the embodiment of the present application, an application to a first terminal is illustrated as an example. The session processing method comprises the following steps:

201. and responding to the application joining operation of the first user account to the target session, and acquiring faces by the terminal to obtain a first face image corresponding to the first user account.

In this embodiment of the present application, optionally, the terminal is the first terminal 101 shown in fig. 1, where an application client of the first terminal logs in with a first user account of the first user. The first is for a user applying for joining a target session. The first terminal can acquire the face in real time by calling the camera to obtain a first face image.

202. And the terminal sends a request for adding to the server, wherein the request for adding carries the first face image, the first user account and the session identifier of the target session.

In the embodiment of the application, the application joining request can instruct the server to detect the first face image, so as to determine whether the first face image meets the joining condition of the target session.

203. And the terminal joins the first user account to the target session in response to the server determining that the first face image of the first user account meets the joining condition of the target session.

In the embodiment of the application, if the first face image meets the joining condition, the first user can join the target session, the terminal can join the first user account into the target session, and a session interface of the target session is displayed.

Fig. 3 is a flowchart of another session processing method according to an embodiment of the present application, and as shown in fig. 3, the embodiment of the present application is described by taking application to a server as an example. The session processing method comprises the following steps:

301. the server receives a request for adding a terminal, wherein the request for adding the terminal carries a first face image acquired by the terminal, a first user account of the terminal and a session identifier of a target session.

In the embodiment of the application, after receiving the request for adding the application sent by the terminal, the server can analyze the request for adding the application to obtain the first face head portrait, the first user account and the session identifier.

302. And the server acquires the joining condition of the target session according to the session identifier of the target session.

In the embodiment of the application, the server stores the joining condition of each established group session, and the server can acquire the joining condition of the target session according to the association relationship between the session identifier of the group session and the joining condition.

303. And in response to the first face image meeting the joining condition, the server joins the first user account to the target session.

In the embodiment of the application, the server can detect the first face image based on the AI face detection model and determine whether the first face image meets the joining condition of the target session. If the joining condition is met, joining the first user account into the target session; if the joining condition is not satisfied, a prompt that the joining condition is not satisfied is returned.

Optionally, the server can display the session interface of the target session to the terminal, that is, the rendered session interface is sent to be the terminal, and the terminal displays the session interface.

In the embodiment of the application, after receiving the application adding request sent by the first terminal, the adding condition of the target session is obtained according to the session identifier carried in the application adding request, then whether the first face image carried in the application adding request meets the adding condition is determined, and then when the adding condition is met, the first user account is added into the target session, so that the automatic and effective filtering of the users which do not meet the adding condition of the group session is realized, and the filtering accuracy is improved.

Fig. 4 is a flowchart of another session processing method according to an embodiment of the present application, as shown in fig. 4, and in the embodiment of the present application, an application to a terminal is illustrated as an example. The method comprises the following steps:

401. and responding to the application joining operation of the first user account to the target session, and acquiring faces by the terminal to obtain a first face image corresponding to the first user account.

In the embodiment of the present application, the terminal is the first terminal 101 shown in fig. 1, and the application client of the first terminal logs in with the first user account of the first user. Optionally, the target session is a session for online friend making, online recruitment, online education, online competition, and the like, and the application of the target session is not limited in the embodiments of the present application. Optionally, the target session is in the form of an audio session, a video session or another session, which is not limited by the embodiment of the present application. Optionally, the operation of applying for joining the target session can be initiated by the first user account in the group session, where the first user account is a user account that has joined the group session, or initiated by the first user account in a session display interface, where the session display interface is used to display at least one audio/video session in progress. The terminal can respond to the detected application joining operation, call audio and video acquisition equipment such as a camera and a microphone to acquire faces and sounds, and obtain a first face image corresponding to the first user account and sound information corresponding to the first user account.

For example, taking the target session as an audio/video session, an application joining operation of the target session can be initiated in a group session by a first user account, as shown in fig. 5, and fig. 5 is a schematic diagram of a session interface of a group session according to an embodiment of the present application. As shown in fig. 5, the session interface of the group session displays a session link of the target session: "AAA initiates a video call" and a chat log for each user in the group session, the user can apply to join the target session by clicking on the session link, such as clicking on a join button.

For another example, taking the target session as an audio/video session, an application joining operation of the target session can be initiated in a session display interface by a first user account, as shown in fig. 6, and fig. 6 is a schematic diagram of a session display interface provided according to an embodiment of the present application. As shown in fig. 6, the session interface of the group session displays at least one session link of the audio/video session in progress, the user can apply for joining the audio/video session by clicking any session link, and the terminal can use the audio/video session corresponding to the session link clicked by the user as the target session.

In an alternative implementation, the target session is created based on a session creation interface provided by the application client, the session creation interface being used to provide setup functionality for the join condition. The session creation interface may be displayed after the second user account of the second terminal 102 triggers the setting operation of the joining condition in the group session, or the second user account may be displayed after the second user account triggers the setting operation of the joining condition in the session display interface. By providing a session creation interface in the application client, a user can set a joining condition of a group session through the session creation interface, thereby screening users capable of joining the group session. Alternatively, the user can input a joining condition in the session creation interface or select according to a preset joining condition.

For example, taking the session creation interface capable of being triggered and displayed by the second user account in the group session, the target session is an audio/video session as an example, as shown in fig. 7, fig. 7 is a schematic diagram of a triggered and displayed session creation interface according to an embodiment of the present application. As shown in fig. 7, fig. 7 (a) is a session interface of the group session. The user triggers and displays two options of "normal video chat" and "Gao Yanzhi video chat" by clicking on the video call function in the session interface, as shown in fig. 7 (b). In response to the user clicking on the "high Yan Zhi video chat option", the terminal displays a session creation interface, as shown in fig. 7 (c), which includes a gender setting option: "both male and female participatable", "male participatable only", and "face value setting option: "male face value is greater than" and "female face value is greater than". The user can make settings by way of input or selection. After the user clicks the "male color greater than" option, an alternative color score is displayed, as shown in fig. 7 (d). After the user has finished selecting, as shown in fig. 7 (e). The user clicks the "initiate video chat" button in fig. 7, and can send a session creation request to the server. The gender and the color value set by the second user account are the joining conditions of the target session. Of course, if the user selects "female only available", the setting option of "male color value is greater than" is not displayed any more; similarly, if the user selects "only male can participate", the setting option of "female color value is greater than" is not displayed any more.

In an alternative implementation, the creating of the target session includes: and the second terminal responds to the group creation operation of the management account number of the target session, and displays a session creation interface provided by the application client. And the second terminal receives the setting operation of the management account on the joining condition on the session creation page. The second terminal sends a session creation request to the server, the session creation request carrying the joining condition.

It should be noted that the session creation interface can also include other options related to appearance, such as hairstyle, eye size, face shape, whether to wear glasses, etc.; other personal options can also be included, such as age, height, etc. Optionally, the session creation interface may also be used to set a session name of an audio-video session, such as "80 minutes of beauty chat dedicated field", "welcome beauty chat", "Gao Yanzhi general chat", etc., which is not limited in this embodiment of the present application.

It should be noted that, when the group session is created based on the group session, the account having the creation authority can create the group session. Optionally, the user with the creation authority is an account for creating a group session, an account having management authority for the group session, or an account stool assigned with the creation authority. The creation of the group session based on the session presentation interface is that the creation authority of the group session can not be limited, and the creation authority of the group session can also be limited, which is not limited in the embodiment of the application.

In an optional implementation manner, the terminal can perform face collection based on the viewfinder, and correspondingly, the terminal performs face collection in response to the application joining operation of the first user account to the target session, so as to obtain the first face image, which includes the steps of: and responding to the first user account to apply for joining the target session, the terminal performs face recognition based on the image in the view-finding frame of the terminal, and performs face acquisition to obtain a first face image in response to the recognized face. Optionally, in response to not recognizing the face, a prompt message is displayed, where the prompt message is used to indicate that the face is not recognized currently.

It should be noted that, based on the different application scenarios of the target session, the effect of face recognition is also different and the same. When the application scene of the target session is a scene which limits a specific user to join, such as a scene of online education, online examination, online competition and the like, face recognition can be used for recognizing whether the acquired face is a face of a terminal user, namely, a user authorized to participate in the online education, the online examination and the online competition, so as to prevent impersonation and substitution of someone. When the application scene of the target session is a scene which does not need to be limited by a specific user, such as online friend making, online recruitment and the like, the face recognition can be used for recognizing whether the acquired face is the face or not.

402. And the terminal sends a request for adding to the server, wherein the request for adding carries the first face image, the first user account and the session identifier of the target session.

In the embodiment of the application, the terminal can generate the request for adding application according to the acquired first face image, the first user account currently logged in and the session identifier of the target session indicated by the operation for adding application.

403. And the terminal joins the first user account to the target session in response to the server determining that the first face image of the first user account meets the joining condition of the target session.

In the embodiment of the application, after the terminal joins the first user account into the target session, the terminal can display prompt information for prompting that joining is successful, and can also display a session interface of the target session, wherein the session interface is used for displaying at least one audio/video window, and one audio/video window corresponds to one user account. Optionally, the audio/video window of the at least one user account may be displayed in the session interface in different arrangements. Of course, the terminal may also display at least one audio/video window directly instead of the session interface, which is not limited in the embodiment of the present application.

In an alternative implementation, after the terminal joins the first user account to the target session: the terminal can display the audio and video window of each user account from high to low according to the face score of each user account in the target group session in the session interface of the target group session. The face scores of the user accounts are determined by the server according to the face images of the user accounts.

In an alternative implementation, after the terminal joins the first user account to the target session: the terminal can display an audio-video window of a second user account closest to the face score of the first user account at the adjacent position of the audio-video window of the first user account in a session interface of the target group session. Wherein, other user account numbers are ordered according to the adding sequence by default.

For example, the target session includes 5 user accounts, with the order of addition being user account a, user account B, user account C, user account D, and user account E. The face scores of the user account A and the user account C are closest, and the face scores of the user account B and the user account D are closest. In the session interface displayed on the terminal of the user account a, the order of the audio and video windows of each user account is: A-C-B-D-E; the sequence of the audio and video windows of each user account in the session interface displayed on the terminal of the user account B is as follows: A-B-D-C-E; the sequence of audio and video windows of each user account in a session interface displayed on a terminal of the user account C is A-C-B-D-E; the sequence of the audio and video windows of each user account in the session interface displayed on the terminal of the user account D is A-B-D-C-E.

It should be noted that, the terminal may display only the audio/video window of the first user account and the audio/video window of the second user account closest to the face score of the first user account, hide the audio/video windows of the other user accounts, and display the audio/video window of the speaking user account when the other user accounts speak.

In an alternative implementation, when the target session limits the number of joining people, the first user account needs to be queued into the target session, and after the terminal joins the first user account into the target session: the terminal can display the current queuing order of the first user account in a queuing waiting interface of the application client. And in response to the queuing order being zero, the terminal displays an audio-video window of the first user account and an audio-video window of at least one other user account in a session interface of the target session.

For example, the target session is an audio-video session for recruitment, and the target session can only join one user account at a time, and only the previous user account exits and the next user account can enter. The first user account is queued after meeting the joining condition, the terminal displays the current queuing order, the queuing order is updated in real time, the queuing order is zero when the first user account is in turn, and the first user account joins the target session. Of course, the target session can also join multiple user accounts at a time, which is not described in detail herein.

404. In response to the server determining that the first face image of the first user account does not satisfy the joining condition of the target session, a session presentation interface is displayed for presenting at least one group session in progress.

In the embodiment of the application, if the first face image does not meet the joining condition of the target session, a session display interface is displayed so that the first user account can select other group sessions in progress. Optionally, if the operation of applying for joining the target session is initiated by the first user account in the group session, the terminal can display a session interface of the group session without displaying the session display interface when the server determines that the first face image of the first user account does not meet the joining condition of the target session. The embodiment of the present application is not limited thereto.

Before displaying the session interface of the target session, the terminal may also display a detection result of the first face image of the first user account returned by the server, where the detection result is used to indicate whether the first face image meets the joining condition of the target session.

For example, when the joining condition of the target session is male, if the first face image is female face image, the terminal displays the first face image, and displays that the gender is inconsistent, and the application fails; if the first face image is a male face image, the terminal displays the first face image, displays the gender coincidence, applies to pass, and then displays a session interface of the target session.

For another example, referring to fig. 8, fig. 8 is a schematic diagram of face scoring according to an embodiment of the present application. If the joining condition of the target session is that the face value is greater than 80, if the face score of the first face image is 75 points, the terminal displays the first face image, and displays the face value of 75 points, and the application fails; if the face score of the first face is 85 points, the terminal displays the first face image, displays the face value of 85 points, applies for passing, and then displays a session interface of the target session.

When the joining condition of the target session includes gender, the terminal can detect the gender of the first face image, and after the first face image passes the gender detection, the terminal sends a request for joining to the server, if the first face image fails the gender detection, the terminal displays the failing prompt message, and does not send the request for joining to the server.

For example, referring to fig. 9, fig. 9 is a schematic diagram of a gender detection provided according to an embodiment of the present application. As shown in fig. 9, the sex detection is performed based on the first face image, and if the sex detection is not passed, a non-passing prompt message is displayed.

In order to make the flow of the session processing method described in the above steps 401 to 404 clearer, the following description is made from another point of view. Referring to fig. 10, fig. 10 is a schematic logic structure diagram of an application client in a terminal according to an embodiment of the present application. As shown in fig. 10, the application client includes three major structures of a network layer, a data layer and a presentation layer.

The network layer is used for providing communication between the application client and the server, and can be used for generating an application joining request, sending the application joining request to the server, processing the joining condition setting request, identifying the face request and receiving pushing of the server. The network layer can send the data received by the application client to the data layer, and the data layer updates the data. The communication protocol among the network layer, the data layer and the presentation layer adopts UDP (User Datagram Protocol ). The network layer is also used to alert of a connection failure when a network connection is not available.

The data layer is used for storing data related to the application client, such as group basic data, group chat data, face feature point data and the like. Wherein the group basis data includes group member information such as account numbers, nicknames, etc. The group chat data includes video chat data, text chat data, chat time, user information of chat, and the like. The face characteristic point data is obtained by extracting the first face image acquired by the terminal camera through the face recognition module, namely the face characteristic point data is carried in the application adding request sent by the terminal, and is not the complete first face image, so that the sent data volume can be reduced. Optionally, the data stored in the data layer can be stored in a memory Cache (Cache memory in the computer is located between the CPU and the main memory DRAM (Dynamic Random Access Memory), and is a small-scale but high-speed memory) and a local database, and when no data exists in the memory Cache memory, the terminal can load corresponding data from the database and Cache the corresponding data in the memory Cache memory, so that the data acquisition speed is improved. And after the data layer receives the data returned by the server sent by the network layer, updating the memory Cache and the local database at the same time.

The display layer is used for interface display of the application client, such as a session creation interface for setting joining conditions, a camera preview interface for performing face collection, namely a view-finding frame interface, a session interface of an audio-video session and a session interface of a group session. The session creation interface comprises a gender selection box, a text input box, a Yan Zhi score input box and the like, and can be displayed by applying standard system controls in the client and responding to events triggered by a user. The camera preview interface is used for displaying the collected images in real time, and optionally, the images collected by the camera preview interface can be used for face recognition by the face recognition unit, collecting the face feature points by the feature point collecting unit, and displaying the gender recognition result or the face scoring and the like. Alternatively, the face recognition unit can be provided with corresponding functionality by a third party's SDK (Software Development Kit ). The session interface of the audio-video session comprises an audio-video window for displaying a real-time preview picture, a voice message and the like of the user. The session interface of the group session includes a group name, a group text message list, a group voice message list, a message input box, etc., capable of being presented by a standard system control in the application client and responding to a user-triggered event. The presentation layer is also responsible for responding to the interactive operation of the user, monitoring clicking and dragging events, calling back to the corresponding function processing, and providing capability support by the standard system control.

Correspondingly, the implementation flow of the session processing method provided by the embodiment of the application is as follows: and the display layer responds to the application joining operation of the first user account to the target session, performs face acquisition through a camera preview interface, obtains a first face image and extracts face feature point data. The data layer stores face feature point data of the first face image. The network layer generates a request for applying for joining and sends the request for applying for joining to the server, wherein the request for joining carries face feature point data, a first user account and a session identifier of a target session, which are acquired from the data layer. The network layer receives the pushing of the server, and the presentation layer displays a session interface of the target session.

Fig. 11 is a flowchart of another session processing method according to an embodiment of the present application, as shown in fig. 11, and in the embodiment of the present application, an application to a server is illustrated as an example. The method comprises the following steps:

1101. The server receives a session creation request that carries a management account and a joining condition for the target session.

In the embodiment of the present application, the management account is the second user account of the second terminal 102, and the management account sets the joining condition through a session creation interface provided by an application client of the second terminal. The server receives and stores the management account number and the joining condition. That is, the target session is created based on a session creation interface provided by the application client of the second terminal, the session creation interface being used to provide the joining condition setting function. And the second terminal responds to the group creation operation of the management account number of the target session, and displays a session creation interface provided by the application client. And the second terminal sends a session creation request to the server based on the joining condition set by the management account on the session creation page, wherein the session creation request carries the joining condition.

1102. The server creates a target session and joins the management account to the target session.

In the embodiment of the application, after the server creates the target session, the management account can be added into the target session, at this time, only the management account is in the target session, the server displays the session interface of the target session to the second terminal of the management account, and if the rendered session interface is sent to the second terminal, the second terminal can display the session interface of the target session.

It should be noted that, the second face image of the second user account can also be carried in the session creation request sent by the second terminal, and when the server determines that the second face image meets the joining condition, a target session is created; and when the server determines that the second face image does not meet the joining condition, returning a refusal creation prompt to the second terminal. Therefore, all user accounts in the target session can be ensured to meet the joining condition, and malicious users are prevented from performing fraudulent activity on other users by setting higher joining conditions.

1103. The server receives a request for adding a terminal, wherein the request for adding the terminal carries a first face image acquired by the terminal, a first user account of the terminal and a session identifier of a target session.

In the embodiment of the present application, the terminal is the first terminal 101 shown in fig. 1, the application client of the first terminal logs in with the first user account of the first user, and after receiving the request for adding sent by the first terminal, the server can analyze the request for adding to obtain the first face head portrait of the first user account, the first user account and the session identifier.

1104. And the server acquires the joining condition of the target session according to the session identifier of the target session.

1105. And in response to the first face image meeting the joining condition, the server joins the first user account to the target session.

In the embodiment of the application, if the first face image meets the joining condition, the server can join the first user account into the target session, and establish communication connection between the first user account and the second user account.

In an alternative implementation manner, when the joining condition is a face score, the server can perform face detection on the first face image to obtain the face score of the first face image, and in response to the face score of the first face image being not less than the face score specified by the joining condition, the server determines that the first face image meets the joining condition.

It should be noted that, optionally, the first terminal may extract the face feature of the first face image, and the face feature data is carried in the request for adding the application, and accordingly, the server determines whether the face feature data meets the adding condition. Optionally, the first terminal may further obtain a joining condition of the target session from the server by applying for a joining request, and the first terminal determines whether the first face image meets the joining condition.

In an optional implementation manner, when the joining condition is an authorized face, the server can perform face recognition on the first face image, and through the result of face recognition, it is determined whether the face in the first image is the authorized face. And responding to the face in the first face image as the authorized face, determining that the first face image meets the joining condition by the server. Of course, when the face feature data is carried in the request for joining, the server can also directly determine whether the face is authorized according to the face feature data.

Optionally, the server can present the session interface of the target session to the terminal after joining the first user account to the target session. The server can adjust the positions of the audio and video windows of the user accounts in the session interface according to the face scores of the user accounts in the target session, then render the session interface and send the rendered session interface to the terminal.

In an optional implementation manner, the server can sort the audio and video windows of each user account in the session interface of the target session according to the face scores of each user account in the target session. The session interface is then presented to the terminal.

In an optional implementation manner, the server can determine a second user account closest to the face score of the first user account according to the face scores of the user accounts in the target session, and in a session interface of the target session, the audio and video windows of the first user account and the second user account are adjacently arranged. The session interface is then presented to the terminal.

In an alternative implementation, the server can obtain the current queuing order of the first user account, and display a queuing interface including the queuing order to the terminal. And in response to the order of the ordering being zero, the server displays a session interface comprising the audio-video window of the first user account and the audio-video windows of other user accounts in the target group to the terminal.

In order to make the flow of the session processing method described in steps 1101 to 1106 clearer, please refer to fig. 12, fig. 12 is a flowchart of another session processing method according to an embodiment of the present application. Taking the target session as the high Yan Zhi video chat session as an example, as shown in fig. 12, user a is the creator of the high Yan Zhi video chat session and user B and user C are participants of the high Yan Zhi video chat session. User a sends a create request to the server through the terminal to create a high Yan Zhi video chat session while setting gender and Yan Zhi score as joining conditions. And the user B and the user C respectively apply for joining the high-color-value video chat session through the terminal, and the application joining request respectively carries face feature point data of the user B and the user C. The server respectively determines the gender and Yan Zhi score of the face feature point data uploaded by the user B and the user C based on the AI face detection service, and respectively pushes detection results to the user B and the user C according to the gender and Yan Zhi score. The detection result is used for indicating whether the user B and the user C can join the high-color-value video chat session.

Fig. 13 is a block diagram of a session processing apparatus according to an embodiment of the present application. The apparatus is applied to a terminal, and is configured to perform the steps when the session processing method is performed, referring to fig. 13, where the apparatus includes: a face acquisition module 1301, a request sending module 1302, and a session processing module 1303.

The face acquisition module 1301 is configured to perform face acquisition in response to an application joining operation of a first user account to a target session, so as to obtain a first face image corresponding to the first user account;

a request sending module 1302, configured to send an application joining request to a server, where the application joining request carries the first face image, the first user account, and a session identifier of the target session;

The session processing module 1303 is configured to join the first user account into the target session in response to the server determining that the first face image of the first user account satisfies a joining condition of the target session.

In an alternative implementation, the apparatus further includes: and the display module 1304 is configured to display, from high to low, an audio/video window of each user account according to the face score of each user account in the target session.

In an alternative implementation, the apparatus further includes: and the display module 1304 is configured to display, at a position adjacent to the audio/video window of the first user account, an audio/video window of a second user account that is closest to the face score of the first user account.

In an alternative implementation, the apparatus further includes: a display module 1304, configured to display, in a queuing interface, a current queuing order of the first user account; and in response to the queuing order being zero, displaying the audio-video window of the first user account and the audio-video window of at least one other user account.

In an optional implementation manner, the face collection module 1301 is configured to perform face recognition based on an image in a viewfinder of the terminal in response to an application joining operation of the first user account to the target session; and responding to the identified face, and acquiring the face to obtain a first face image corresponding to the first user account.

In an alternative implementation, the apparatus further includes:

the prompting module 1305 is configured to display prompting information in response to the face not being recognized, where the prompting information is used to indicate that the face is not being recognized.

In an alternative implementation, the apparatus further includes: a display module 1304 for displaying a session presentation interface for presenting at least one audio video session in progress in response to the server determining that the first face image of the first user account does not satisfy the joining condition.

In an alternative implementation, the target session is created based on a session creation interface provided by the application client, the session creation interface being used to provide setup functionality for the join condition.

In an alternative implementation, the creating of the target session includes:

and receiving a setting operation of the management account on the joining condition on the session creation page, and sending a session creation request to the server, wherein the session creation request carries the joining condition.

Fig. 14 is a block diagram of a session processing apparatus according to an embodiment of the present application. The device is applied to a server, and is configured to perform the steps when the session processing method is performed, referring to fig. 13, where the device includes: a request receiving module 1401, a joining condition acquisition 1402, and a session joining module 1403.

A request receiving module 1401, configured to receive an application joining request of a terminal, where the application joining request carries a first face image acquired by the terminal, a first user account of the terminal, and a session identifier of the target session;

a joining condition acquisition module 1402, configured to acquire a joining condition of the target session according to a session identifier of the target session;

a session joining module 1403 is configured to join the first user account to the target session in response to the first face image satisfying the joining condition.

In an alternative implementation, the apparatus further includes: the display module 1404 is configured to sort audio and video windows of each user account in a session interface of the target session according to the face scores of each user account in the target session; and displaying the session interface to the terminal.

In an alternative implementation, the apparatus further includes: a display module 1404, configured to determine, according to the face scores of the user accounts in the target session, a second user account closest to the face score of the first user account; in a session interface of the target session, arranging the audio and video windows of the first user account and the second user account adjacently; and displaying the session interface to the terminal.

In an alternative implementation, the apparatus further includes: a display module 1404, configured to obtain a current queuing order of the first user account, and display a queuing interface including the queuing order to the terminal; and responding to the order of the ordering is zero, and displaying a session interface comprising the audio-video window of the first user account and the audio-video windows of other user accounts in the target group to the terminal.

In an alternative implementation, the target session is created based on a session creation interface provided by the application client, the session creation interface being used to provide the join condition setting function.

In an alternative implementation, the creating of the target session includes:

It should be noted that: in the session processing device provided in the above embodiment, when performing group session processing, only the division of the above functional modules is used for illustration, in practical application, the above functional allocation may be performed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the session processing device and the session processing method embodiment provided in the foregoing embodiments belong to the same concept, and specific implementation processes of the session processing device and the session processing method embodiment are detailed in the method embodiment, which is not described herein again.

In the embodiment of the present application, the computer device can be configured as a terminal or a server, when the computer device is configured as a terminal, the technical solution provided by the embodiment of the present application may be implemented by the terminal as an execution body, and when the computer device is configured as a server, the technical solution provided by the embodiment of the present application may be implemented by the server as an execution body, or the technical solution provided by the present application may be implemented by interaction between the terminal and the server, which is not limited by the embodiment of the present application.

Fig. 15 is a block diagram of a terminal 1500 according to an embodiment of the present application when the computer device is configured as a terminal. Alternatively, the terminal 1500 may be a portable mobile terminal, such as: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion picture expert compression standard audio plane 3), an MP4 (Moving Picture Experts Group Audio Layer IV, motion picture expert compression standard audio plane 4) player, a notebook computer, or a desktop computer. Terminal 1500 can also be referred to as a user device, portable terminal, laptop terminal, desktop terminal, and the like.

In general, the terminal 1500 includes: a processor 1501 and a memory 1502.

The processor 1501 may include one or more processing cores, such as a 4-core processor, an 8-core processor, or the like. The processor 1501 may be implemented in at least one hardware form of DSP (Digital Signal Processing ), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array ). The processor 1501 may also include a main processor, which is a processor for processing data in an awake state, also called a CPU (Central Processing Unit ), and a coprocessor; a coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 1501 may be integrated with a GPU (Graphics Processing Unit, image processor) for taking care of rendering and rendering of content to be displayed by the display screen. In some embodiments, the processor 1501 may also include an AI (Artificial Intelligence ) processor for processing computing operations related to machine learning.

Memory 1502 may include one or more computer-readable storage media, which may be non-transitory. Memory 1502 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 1502 is used to store at least one program code for execution by processor 1501 to implement the session processing method provided by the method embodiments of the present application.

In some embodiments, the terminal 1500 may further optionally include: a peripheral interface 1503 and at least one peripheral device. The processor 1501, memory 1502 and peripheral interface 1503 may be connected by a bus or signal lines. The individual peripheral devices may be connected to the peripheral device interface 1503 via a bus, signal lines, or circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 1504, a display screen 1505, a camera assembly 1506, audio circuitry 1507, a positioning assembly 1508, and a power supply 1509.

A peripheral interface 1503 may be used to connect I/O (Input/Output) related at least one peripheral device to the processor 1501 and the memory 1502. In some embodiments, processor 1501, memory 1502, and peripheral interface 1503 are integrated on the same chip or circuit board; in some other embodiments, either or both of the processor 1501, the memory 1502, and the peripheral interface 1503 may be implemented on separate chips or circuit boards, which is not limited in this embodiment.

The Radio Frequency circuit 1504 is configured to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1504 communicates with a communication network and other communication devices via electromagnetic signals. The radio frequency circuit 1504 converts an electrical signal into an electromagnetic signal for transmission, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1504 includes: antenna systems, RF transceivers, one or more amplifiers, tuners, oscillators, digital signal processors, codec chipsets, subscriber identity module cards, and so forth. The radio frequency circuit 1504 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: the world wide web, metropolitan area networks, intranets, generation mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and/or WiFi (Wireless Fidelity ) networks. In some embodiments, the radio frequency circuit 1504 may also include NFC (Near Field Communication, short range wireless communication) related circuits, which the present application is not limited to.

Display 1505 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When display screen 1505 is a touch display screen, display screen 1505 also has the ability to collect touch signals at or above the surface of display screen 1505. The touch signal may be input to the processor 1501 as a control signal for processing. At this point, display 1505 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the display 1505 may be one, disposed on the front panel of the terminal 1500; in other embodiments, the display 1505 may be at least two, respectively disposed on different surfaces of the terminal 1500 or in a folded design; in other embodiments, display 1505 may be a flexible display disposed on a curved surface or a folded surface of terminal 1500. Even more, the display 1505 may be arranged in a non-rectangular irregular pattern, i.e., a shaped screen. The display screen 1505 may be made of LCD (Liquid Crystal Display ), OLED (Organic Light-Emitting Diode) or other materials.

The camera assembly 1506 is used to capture images or video. Optionally, the camera assembly 1506 includes a front camera and a rear camera. Typically, the front camera is disposed on the front panel of the terminal and the rear camera is disposed on the rear surface of the terminal. In some embodiments, the at least two rear cameras are any one of a main camera, a depth camera, a wide-angle camera and a tele camera, so as to realize that the main camera and the depth camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize a panoramic shooting and Virtual Reality (VR) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 1506 may also include a flash. The flash lamp can be a single-color temperature flash lamp or a double-color temperature flash lamp. The dual-color temperature flash lamp refers to a combination of a warm light flash lamp and a cold light flash lamp, and can be used for light compensation under different color temperatures.

The audio circuitry 1507 may include a microphone and a speaker. The microphone is used for collecting sound waves of users and the environment, converting the sound waves into electric signals, inputting the electric signals to the processor 1501 for processing, or inputting the electric signals to the radio frequency circuit 1504 for voice communication. For purposes of stereo acquisition or noise reduction, a plurality of microphones may be respectively disposed at different portions of the terminal 1500. The microphone may also be an array microphone or an omni-directional pickup microphone. The speaker is used to convert electrical signals from the processor 1501 or the radio frequency circuit 1504 into sound waves. The speaker may be a conventional thin film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, not only the electric signal can be converted into a sound wave audible to humans, but also the electric signal can be converted into a sound wave inaudible to humans for ranging and other purposes. In some embodiments, the audio circuit 1507 may also include a headphone jack.

The positioning component 1508 is for positioning a current geographic location of the terminal 1500 to enable navigation or LBS (Location Based Service, location-based services). The positioning component 1508 may be a positioning component based on the United states GPS (Global Positioning System ), the Beidou system of China, or the Russian Galileo system.

The power supply 1509 is used to power the various components in the terminal 1500. The power supply 1509 may be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 1509 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. The wired rechargeable battery is a battery charged through a wired line, and the wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery may also be used to support fast charge technology.

In some embodiments, the terminal 1500 also includes one or more sensors 1510. The one or more sensors 1510 include, but are not limited to: acceleration sensor 1511, gyroscope sensor 1512, pressure sensor 1513, fingerprint sensor 1514, optical sensor 1515, and proximity sensor 1516.

The acceleration sensor 1511 may detect the magnitudes of accelerations on three coordinate axes of the coordinate system established with the terminal 1500. For example, the acceleration sensor 1511 may be used to detect components of gravitational acceleration in three coordinate axes. The processor 1501 may control the display screen 1505 to display the user interface in a landscape view or a portrait view based on the gravitational acceleration signal acquired by the acceleration sensor 1511. The acceleration sensor 1511 may also be used for the acquisition of motion data of a game or user.

The gyro sensor 1512 may detect a body direction and a rotation angle of the terminal 1500, and the gyro sensor 1512 may collect 3D motion of the terminal 1500 by a user in cooperation with the acceleration sensor 1511. The processor 1501, based on the data collected by the gyro sensor 1512, may implement the following functions: motion sensing (e.g., changing UI according to a tilting operation by a user), image stabilization at shooting, game control, and inertial navigation.

The pressure sensor 1513 may be disposed on a side frame of the terminal 1500 and/or under the display 1505. When the pressure sensor 1513 is disposed on the side frame of the terminal 1500, a grip signal of the user on the terminal 1500 may be detected, and the processor 1501 performs left-right hand recognition or quick operation according to the grip signal collected by the pressure sensor 1513. When the pressure sensor 1513 is disposed at the lower layer of the display screen 1505, the processor 1501 realizes control of the operability control on the UI interface according to the pressure operation of the user on the display screen 1505. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.

The fingerprint sensor 1514 is used for collecting the fingerprint of the user, and the processor 1501 recognizes the identity of the user according to the collected fingerprint of the fingerprint sensor 1514, or the fingerprint sensor 1514 recognizes the identity of the user according to the collected fingerprint. Upon recognizing that the user's identity is a trusted identity, the processor 1501 authorizes the user to perform relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying for and changing settings, etc. The fingerprint sensor 1514 may be disposed on the front, back, or side of the terminal 1500. When a physical key or vendor Logo is provided on the terminal 1500, the fingerprint sensor 1514 may be integrated with the physical key or vendor Logo.

The optical sensor 1515 is used to collect the ambient light intensity. In one embodiment, processor 1501 may control the display brightness of display screen 1505 based on the intensity of ambient light collected by optical sensor 1515. Specifically, when the ambient light intensity is high, the display brightness of the display screen 1505 is turned up; when the ambient light intensity is low, the display luminance of the display screen 1505 is turned down. In another embodiment, the processor 1501 may also dynamically adjust the shooting parameters of the camera assembly 1506 based on the ambient light intensity collected by the optical sensor 1515.

A proximity sensor 1516, also referred to as a distance sensor, is typically provided on the front panel of the terminal 1500. The proximity sensor 1516 is used to collect the distance between the user and the front of the terminal 1500. In one embodiment, when the proximity sensor 1516 detects a gradual decrease in the distance between the user and the front of the terminal 1500, the processor 1501 controls the display 1505 to switch from the on-screen state to the off-screen state; when the proximity sensor 1516 detects that the distance between the user and the front surface of the terminal 1500 gradually increases, the processor 1501 controls the display screen 1505 to switch from the off-screen state to the on-screen state.

Those skilled in the art will appreciate that the structure shown in fig. 9 is not limiting and that more or fewer components than shown may be included or certain components may be combined or a different arrangement of components may be employed.

When the computer device is configured as a server, fig. 16 is a schematic structural diagram of a server provided according to an embodiment of the present application, where the server 1600 may have a relatively large difference due to configuration or performance, and may include one or more processors (Central Processing Units, CPU) 1601 and one or more memories 1602, where at least one program code is stored in the memories 1602, and the at least one program code is loaded and executed by the processors 1601 to implement the session processing method provided in the above method embodiments. Of course, the server may also have a wired or wireless network interface, a keyboard, an input/output interface, and other components for implementing the functions of the device, which are not described herein.

The embodiment of the application also provides a computer readable storage medium, which is applied to a terminal, and at least one section of program code is stored in the computer readable storage medium, and the at least one section of program code is loaded and executed by a processor to realize the operation executed by the terminal in the session processing method of the embodiment.

The embodiment of the application also provides a computer readable storage medium, which is applied to a server, and at least one section of program code is stored in the computer readable storage medium, and the at least one section of program code is loaded and executed by a processor to realize the operation executed by the server in the session processing method of the embodiment.

Embodiments of the present application also provide a computer program product or computer program comprising computer program code stored in a computer readable storage medium. The computer program code is read from a computer readable storage medium by a processor of a computer device, and executed by the processor, causes the computer device to perform the session processing method provided in the various alternative implementations described above.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by program code related hardware, where the program may be stored in a computer readable storage medium, and the above storage medium may be a read only memory, a magnetic disk or an optical disk, etc.

The foregoing description of the preferred embodiments of the application is not intended to limit the application to the precise form disclosed, and any such modifications, equivalents, and alternatives falling within the spirit and scope of the application are intended to be included within the scope of the application.

Claims

1. A session processing method, applied to a terminal, the method comprising:

responding to the application joining operation of a first user account to a target session, and acquiring a face to obtain a first face image corresponding to the first user account;

in response to the server determining that the first face image of the first user account meets a joining condition of the target session, joining the first user account to the target session, the joining condition including a condition related to appearance and a condition unrelated to appearance, the condition related to appearance including a face score, a hairstyle, an eye size, a face shape, whether to wear glasses; the condition independent of appearance includes gender, age, height.

2. The method of claim 1, wherein the application joining operation is initiated by the first user account in a group session, the target session being an audio-video session initiated in the group session; or alternatively, the first and second heat exchangers may be,

3. The method of claim 1, wherein after the joining the first user account to the target session, the method comprises:

and displaying the audio and video window of each user account from high to low according to the face score of each user account in the target session.

4. The method of claim 1, wherein after the joining the first user account to the target session, the method comprises:

and displaying the audio-video window of the second user account closest to the face score of the first user account at the adjacent position of the audio-video window of the first user account.

5. The method of claim 1, wherein after the joining the first user account to the target session, the method comprises:

Displaying the current queuing order of the first user account in a queuing waiting interface;

and in response to the queuing order being zero, displaying the audio-video window of the first user account and the audio-video window of at least one other user account.

6. The method of claim 1, wherein the performing face collection in response to the operation of applying for joining to the target session by the first user account to obtain the first face image corresponding to the first user account includes:

responding to the application joining operation of the first user account to the target session, and carrying out face recognition based on the image in the view-finding frame of the terminal;

and responding to the identified face, and acquiring the face to obtain a first face image corresponding to the first user account.

7. The method according to claim 6, wherein after the face recognition based on the image in the viewfinder of the terminal, the method comprises:

and displaying prompt information in response to the fact that the face is not recognized, wherein the prompt information is used for indicating that the face is not recognized currently.

8. The method according to claim 1, wherein the method further comprises:

And in response to the server determining that the first face image of the first user account does not meet the joining condition, displaying a session presentation interface for presenting at least one audio-video session in progress.

9. The method of claim 1, wherein the target session is created based on a session creation interface provided by an application client, the session creation interface being used to provide a setup function for joining conditions.

10. The method of claim 9, wherein the creation of the target session comprises:

receiving setting operation of the management account on the joining condition on the session creation interface;

and sending a session creation request to the server, wherein the session creation request carries the joining condition.

11. A session processing method, applied to a server, the method comprising:

receiving an application joining request of a terminal, wherein the application joining request carries a first face image acquired by the terminal, a first user account of the terminal and a session identifier of a target session;

Acquiring a joining condition of the target session according to the session identifier of the target session, wherein the joining condition comprises a condition related to appearance and a condition unrelated to appearance, and the condition related to appearance comprises face scoring, hair style, eye size, face shape and whether to wear glasses; the condition irrelevant to appearance comprises gender, age and height;

12. A session processing apparatus, applied to a terminal, the apparatus comprising:

a session processing module, configured to, in response to the server determining that the first face image of the first user account meets a joining condition of the target session, join the first user account to the target session, where the joining condition includes a condition related to a personal appearance and a condition unrelated to the personal appearance, and the condition related to the personal appearance includes a face score, a hairstyle, an eye size, a face shape, and whether to wear glasses; the condition independent of appearance includes gender, age, height.

13. A session processing apparatus, for application to a server, the apparatus comprising:

the request receiving module is used for receiving a request of adding a terminal, wherein the request of adding the request carries a first face image acquired by the terminal, a first user account of the terminal and a session identifier of a target session;

the joining condition acquisition module is used for acquiring joining conditions of the target session according to the session identification of the target session, wherein the joining conditions comprise conditions related to appearance and conditions unrelated to appearance, and the conditions related to appearance comprise face scoring, hairstyles, eye sizes, facial shapes and whether to wear glasses; the condition irrelevant to appearance comprises gender, age and height;

14. A computer device comprising a processor and a memory for storing at least one piece of program code, the at least one piece of program code being loaded by the processor and performing the session handling method of any of claims 1 to 10 or the session handling method of claim 11.

15. A storage medium storing at least one piece of program code for performing the session processing method according to any one of claims 1 to 10 or for performing the session processing method according to claim 11.