CN105681723B

CN105681723B - Audio and video call method and device

Info

Publication number: CN105681723B
Application number: CN201410657920.0A
Authority: CN
Inventors: 伍倡辉
Original assignee: Shenzhen Tencent Computer Systems Co Ltd
Current assignee: Shenzhen Tencent Computer Systems Co Ltd
Priority date: 2014-11-18
Filing date: 2014-11-18
Publication date: 2020-09-11
Anticipated expiration: 2034-11-18
Also published as: CN105681723A

Abstract

The invention discloses an audio and video call method and device, and belongs to the technical field of the Internet. The method comprises the following steps: detecting whether a user client and a service client establish audio and video call connection or not; and if the audio and video call connection between the user client and the service client is established, sending display configuration to the user client, wherein the user client is used for displaying a menu interface corresponding to the service provided by the service client on an audio and video call interface according to the display configuration. The invention achieves the effect that the user can intuitively obtain the information from the menu interface in the audio and video communication process, and improves the speed and the accuracy of obtaining the information by the user.

Description

Audio and video call method and device

Technical Field

The invention relates to the technical field of internet, in particular to an audio and video communication method and device.

Background

The voice self-service can enable the user to perform self-service inquiry or transaction of the business according to the content of the voice prompt, and bring convenience to the user.

When a user dials a voice self-service telephone, a voice prompt is received, each service corresponds to a number in voice prompt information, and the user inputs the number corresponding to the service according to the received voice prompt to complete corresponding service operation.

For example, when a user dials a voice self-service telephone to inquire the balance of the telephone charge, similar voice prompts are heard: 1. the users of package and attribution inquiry 2, consumption inquiry 3 in the month and telephone charge balance inquiry … … will hear the corresponding voice information after inputting the number 3 corresponding to the telephone charge balance inquiry.

In the process of implementing the invention, the inventor finds that the prior art has at least the following problems: when the types of the services are more, the user needs to listen to all the voice prompts to determine the number corresponding to the target service, and the input mode of the user is single, so that the application range is smaller.

Disclosure of Invention

In order to solve the problems in the prior art, embodiments of the present invention provide a request processing method and apparatus, and an electronic device. The technical scheme is as follows:

according to a first aspect of the embodiments of the present invention, there is provided an audio and video call method, including:

the method comprises the steps that an audio and video call connection is established between a user client and a service client;

a user client acquires display configuration corresponding to the service client;

and the user client displays a menu interface corresponding to the service provided by the service client on the audio and video call interface according to the display configuration.

According to a second aspect of the embodiments of the present invention, there is provided an audio and video call method, including:

the service client establishes audio and video call connection with the user client;

the service client provides display configuration corresponding to the service client to the user client, and the user client is used for displaying a menu interface corresponding to the service provided by the service client on an audio and video call interface according to the display configuration.

According to a third aspect of the embodiments of the present invention, there is provided an audio and video call method, including:

detecting whether a user client and a service client establish audio and video call connection or not;

and if the user client and the service client establish audio and video call connection, sending display configuration to the user client, wherein the user client is used for displaying a menu interface corresponding to the service provided by the service client on an audio and video call interface according to the display configuration.

According to a fourth aspect of the embodiments of the present invention, there is provided an audio/video call apparatus, including:

the first connection establishing module is used for establishing audio and video call connection between the user client and the service client;

the configuration acquisition module is used for acquiring display configuration corresponding to the service client by the user client;

and the interface display module is used for displaying a menu interface corresponding to the service provided by the service client on the audio and video call interface by the user client according to the display configuration.

According to a fifth aspect of the embodiments of the present invention, there is provided an audio/video call apparatus, the apparatus including:

the second connection establishing module is used for establishing audio and video call connection between the service client and the user client;

the configuration providing module is used for providing display configuration corresponding to the service client to the user client by the service client, and the user client is used for displaying a menu interface corresponding to the service provided by the service client on an audio and video call interface according to the display configuration.

According to a sixth aspect of the embodiments of the present invention, there is provided an audio/video call apparatus, including:

the connection detection module is used for detecting whether the audio and video call connection is established between the user client and the service client;

and the configuration sending module is used for sending display configuration to the user client side if the audio and video call connection between the user client side and the service client side is established, and the user client side is used for displaying a menu interface corresponding to the service provided by the service client side on an audio and video call interface according to the display configuration.

The technical scheme provided by the embodiment of the invention has the following beneficial effects:

whether audio and video call connection is established between a user client and a service client is detected; if the user client and the service client establish audio and video call connection, sending display configuration to the user client, wherein the user client is used for displaying a menu interface corresponding to the service provided by the service client on an audio and video call interface according to the display configuration; the problem that when the types of the services are more, a user needs to listen to all voice prompts to determine the number corresponding to the target service, the input mode of the user is single, and the application range is small is solved; the method and the device achieve the effects that in the audio and video call process, a user can intuitively obtain information from a menu interface, and the speed and the accuracy of obtaining the information by the user are improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is an environment schematic diagram of an implementation environment related to an audio and video call method provided by various embodiments of the present invention;

fig. 2 is a flowchart of an audio/video call method according to an embodiment of the present invention;

fig. 3 is a flowchart of an audio/video call method according to another embodiment of the present invention;

fig. 4 is a flowchart of an audio/video call method according to still another embodiment of the present invention;

fig. 5A is a flowchart of an audio/video call method according to another embodiment of the present invention;

fig. 5B is a schematic implementation diagram of an audio/video call method according to another embodiment of the present invention;

fig. 5C is an interface schematic diagram of an audio/video call method according to another embodiment of the present invention;

fig. 6A is a flowchart of a method of an audio/video call method according to a further embodiment of the present invention;

fig. 6B is a schematic implementation diagram of an audio/video call method according to another embodiment of the present invention;

fig. 6C is a schematic implementation diagram of an audio/video call method according to another embodiment of the present invention;

fig. 6D is a schematic implementation diagram of an audio/video call method according to another embodiment of the present invention;

fig. 7 is a block diagram illustrating an exemplary audio/video call device according to an embodiment of the present invention;

fig. 8 is a block diagram illustrating an audio/video call device according to another embodiment of the present invention;

fig. 9 is a block diagram illustrating an audio/video call device according to still another embodiment of the present invention;

fig. 10 is a block diagram illustrating an audio/video call device according to still another embodiment of the present invention;

fig. 11 is a block diagram illustrating an audio/video call device according to still another embodiment of the present invention;

fig. 12 is a block diagram illustrating an audio/video call device according to still another embodiment of the present invention;

fig. 13 is a block diagram showing the structure of an electronic apparatus according to an embodiment of the present invention;

fig. 14 is a block diagram of a server according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Fig. 1 is an environment schematic diagram of an implementation environment related to the audio/video call method provided in various embodiments of the present invention, where the implementation environment includes a user terminal 110, a server 120, and a service terminal 130.

The user terminal 110 is an electronic device running a user client, which may be an instant messaging client or a social application client used by the user. The electronic device may be a mobile phone, a tablet computer, an e-book reader, an MP3 player (Moving Picture Experts Group Audio Layer III, motion Picture Experts Group Audio Layer IV, motion Picture Experts Group Audio Layer 4), an MP4 player, a laptop computer, a desktop computer, or the like.

The user terminal 110 and the server 120 may be connected through a wireless network or a wired network.

The server 120 may be a server, a server cluster composed of several servers, or a cloud computing service center.

The server 120 and the service terminal 130 may be connected through a wireless network or a wired network.

The service terminal 130 is an electronic device running a service client, which may be an instant messaging client or a social application client used by a service provider. The electronic device may be a mobile phone, a tablet computer, an e-book reader, an MP3 player (Moving Picture Experts Group Audio Layer III, motion Picture Experts Group Audio Layer IV, motion Picture Experts Group Audio Layer 4), an MP4 player, a laptop computer, a desktop computer, or the like.

For simplicity of description, the following description will be only illustrated by applying the audio/video call method to the implementation environment shown in fig. 1, but the present invention is not limited thereto.

Referring to fig. 2, a flowchart of an audio/video call method according to an embodiment of the present invention is shown. The present embodiment is exemplified by applying the audio and video call method to the server 120 shown in fig. 1. The method comprises the following steps:

step 202, detecting whether the user client and the service client establish audio and video call connection;

and 204, if the audio and video call connection between the user client and the service client is established, sending display configuration to the user client, wherein the user client is used for displaying a menu interface corresponding to the service provided by the service client on an audio and video call interface according to the display configuration.

In summary, the audio/video call method provided in this embodiment detects whether an audio/video call connection has been established between the user client and the service client; if the user client and the service client establish audio and video call connection, sending display configuration to the user client, wherein the user client is used for displaying a menu interface corresponding to the service provided by the service client on an audio and video call interface according to the display configuration; the problem that when the types of the services are more, a user needs to listen to all voice prompts to determine the number corresponding to the target service, the input mode of the user is single, and the application range is small is solved; the method and the device achieve the effects that in the audio and video call process, a user can intuitively obtain information from a menu interface, and the speed and the accuracy of obtaining the information by the user are improved.

Referring to fig. 3, a flowchart of an audio/video call method according to another embodiment of the present invention is shown. The present embodiment is exemplified by applying the audio and video call method to the user terminal 110 shown in fig. 1. The method comprises the following steps:

step 302, a user client establishes audio and video call connection with a service client;

step 304, the user client side obtains the display configuration corresponding to the service client side;

and step 306, the user client displays a menu interface corresponding to the service provided by the service client on the audio and video call interface according to the display configuration.

In summary, the audio/video call method provided by this embodiment establishes an audio/video call connection with the service client; acquiring display configuration corresponding to a service client; displaying a menu interface corresponding to the service provided by the service client on the audio and video call interface according to the display configuration; the problem that when the types of the services are more, a user needs to listen to all voice prompts to determine the number corresponding to the target service, the input mode of the user is single, and the application range is small is solved; the method and the device achieve the effects that in the audio and video call process, a user can intuitively obtain information from a menu interface, and the speed and the accuracy of obtaining the information by the user are improved.

Referring to fig. 4, a flowchart of an audio/video call method according to still another embodiment of the present invention is shown. The present embodiment is exemplified by applying the audio and video call method to the service terminal 130 shown in fig. 1. The method comprises the following steps:

step 402, a service client establishes audio and video call connection with a user client;

and step 404, the service client provides a display configuration corresponding to the service client to the user client, and the user client is used for displaying a menu interface corresponding to the service provided by the service client on the audio and video call interface according to the display configuration.

In summary, the audio/video call method provided in this embodiment establishes an audio/video call connection with the user client through the service client; the service client provides display configuration corresponding to the service client to the user client, and the user client is used for displaying a menu interface corresponding to the service provided by the service client on the audio and video call interface according to the display configuration; the problem that when the types of the services are more, a user needs to listen to all voice prompts to determine the number corresponding to the target service, the input mode of the user is single, and the application range is small is solved; the method and the device achieve the effects that in the audio and video call process, a user can intuitively obtain information from a menu interface, and the speed and the accuracy of obtaining the information by the user are improved.

Referring to fig. 5A, a flowchart of an audio/video call method according to another embodiment of the present invention is shown. The embodiment is exemplified by applying the audio and video call method to the implementation environment shown in fig. 1. The method comprises the following steps:

step 501, a user client and a service client establish audio and video call connection.

The user inputs an account number of the service client at the user client, sends a connection request to the service client and requests to carry out audio and video conversation with the service client. The user client is an instant messaging client or a social application client used by the user, the service client is a client providing services for the user, and is an instant messaging client or a social application client used by the service provider, and correspondingly, an account of the service client can be an account of the instant messaging client or the social application client.

The user client may operate in an electronic device such as a tablet computer or a mobile phone, and the service client may operate in an electronic device such as a tablet computer, a laptop portable computer, or a desktop computer.

Correspondingly, after receiving a connection request sent by the user client, the service client receives the connection request and establishes audio and video call connection with the user client.

Step 502, the server detects whether the user client and the service client have established an audio/video call connection.

For example, when the user client and the service client establish audio and video call connection, the user client and the service client will obtain a same session number, and when the server detects that the session numbers of the user client and the service client are the same, the user client and the service client already establish audio and video call connection; when the server detects that the session numbers of the user client and the service client are different, the user client does not establish audio and video call connection with the service client.

When the user client and the service client have established an audio/video call connection, step 503 is executed.

In step 503, if the user client and the service client have established an audio/video call connection, the server sends a display configuration to the user client.

After the user client side and the service client side establish audio and video call connection, the server sends display configuration to the user client side, and the user client side displays a menu interface corresponding to the service provided by the service client side on an audio and video call interface according to the display configuration. The step includes the following 2 possible implementation manners:

in a first possible implementation manner, a server receives a display configuration sent by a service client; the display configuration is forwarded to the user client.

After the service client establishes audio and video call connection with the user client, a pre-edited display configuration can be sent to the server at any time, wherein the display configuration can be a configuration file in an XML (extensible Markup Language), an HTML (Hypertext Markup Language) and a CONF (configuration) format; and after receiving the display configuration, the server forwards the display configuration to a user client connected with the service client.

In a second possible implementation manner, a server receives a request instruction of a user client; forwarding the request instruction to a service client; receiving display configuration fed back by the service client according to the request instruction; the display configuration is forwarded to the user client.

After the service client establishes audio and video call connection with the user client, the user sends a request instruction to the server through the user client, and the server forwards the request instruction to the service client, wherein the request instruction can be a text instruction or a voice instruction and the like input by the user at the user client. And after receiving the request instruction sent by the server, the service client sends the display configuration corresponding to the request instruction to the server, and the server forwards the display configuration to the user client.

For example, as shown in fig. 5B, the user client 51 receives a voice command "forward the mail", and sends the voice command to the server 52, the server 52 forwards the voice command to the service client 33, and the server client 53 sends the display configuration a corresponding to the voice command to the user client 51 through the server 52.

In step 504, the user client obtains a display configuration corresponding to the service client.

And the user client receives display configuration sent by the server, wherein the display configuration corresponds to the service client connected with the user client.

And 505, displaying a menu interface corresponding to the service provided by the service client on the audio and video call interface by the user client according to the display configuration.

And the user client analyzes the received display configuration and displays a corresponding menu interface on the audio and video call interface, wherein the menu interface comprises at least one element of characters, pictures, videos, a single selection menu, a multi-selection menu, a pull-down menu, a text input box or a password input box.

For example, as shown in fig. 5C, the user client 51 parses the received XML-formatted display configuration, and displays an address filling interface 57 obtained by parsing on the audio/video call interface 54, where the menu interface 55 includes text, a pull-down menu, and a text input box.

Step 506, the user client generates feedback information according to the information input by the user on the menu interface.

The user client acquires input information of a user on the menu interface, and generates feedback information, wherein the input information can be selection information or character information of the user and the like.

For example, as shown in fig. 5C, the feedback information generated by the user client according to the input information of the user may be "street D, cell E, city, B, C, province, a prefecture".

Step 507, the user client sends feedback information to the server, and the server is used for forwarding the feedback information to the service client.

In step 508, the server receives feedback information sent by the user client.

In step 509, the service client forwards the feedback information to the service client.

Step 510, the service client receives feedback information sent by the server.

The service client can send new display configuration to the server according to the received feedback information, so that interaction between the user client and the service client is realized. The specific implementation steps are similar to step 503, and are not described herein again.

In the embodiment, the user client generates feedback information according to the input information of the user on the menu interface, and the server forwards the feedback information to the service client, so that the service client can send new display configuration to the user client according to the feedback information, and the effect of interaction between the user client and the service client in the process of audio and video call is achieved.

In a specific implementation process, the server may receive at least one display configuration and identification instruction list uploaded by the service client in advance, and store the at least one display configuration and identification instruction list; the server searches the display configuration corresponding to the identification instruction according to the identification instruction table by receiving the identification instruction sent by the user client or the service client, and sends the display configuration to the user client. An embodiment will be described below.

Referring to fig. 6A, a flowchart of an audio/video call method according to another embodiment of the present invention is shown. The embodiment is exemplified by applying the audio and video call method to the implementation environment shown in fig. 1. The method comprises the following steps:

step 601, the server receives at least one display configuration and identification instruction list uploaded by the service client.

The service client uploads the display configuration and an identification instruction list to the server in advance, the identification instruction list comprises a corresponding relation between identification instructions and the display configuration, and the list structure of the identification instruction list can be as shown in table one:

watch 1

Identifying instructions	Display arrangement
		Identifying instruction A	Display configuration A
Identifying instruction B	Display configuration B
		Identification instruction C	Display configuration C

Wherein, different display configurations correspond to different menu interfaces, for example, the display configuration a corresponds to a query interface; displaying a sending interface corresponding to the configuration B; and displaying an evaluation interface corresponding to the configuration C.

In step 602, the server stores at least one display configuration and identification instruction list.

The server stores the received at least one display configuration and identification instruction list, wherein different identification instruction lists correspond to different service clients.

Step 603, the user client and the service client establish audio and video call connection.

In step 604, the server detects whether the user client and the service client have established an audio/video call connection.

When the user client and the service client have established an audio/video call connection, step 605 is executed.

Step 605, if the user client and the service client have established the audio and video call connection, the server sends a display configuration to the user client.

After the user client side and the service client side establish audio and video call connection, the server sends display configuration to the user client side, and the user client side displays a menu interface corresponding to the service provided by the service client side on an audio and video call interface according to the display configuration. The step includes the following 3 possible implementation manners:

in a first possible implementation manner, the server automatically sends the display configuration to the user client after the user client and the service client establish a connection.

After detecting that the user client is connected with the service client, the server searches for the display configuration corresponding to the service client in a preset default configuration table, and sends the display configuration to the user client, wherein the table structure of the default configuration table can be as shown in table two:

watch two

Service client	Display arrangement
		Service client A	Display configuration A
Service client B	Display configuration B

Service client C

Display configuration C

In a second possible implementation manner, the server receives an identification instruction sent by the service client; searching a display configuration corresponding to the identification instruction in a preset identification instruction table; the display configuration is sent to the user client.

After the user client side is connected with the service client side, the service client side can send an identification instruction to the server at any time, and the identification instruction can be triggered by voice, characters, a click button and the like. And after receiving the identification instruction sent by the service client, the server searches the display configuration corresponding to the identification instruction in the identification instruction list and sends the searched display configuration to the user client.

For example, as shown in fig. 6B, the service person sends an identification instruction a to the server 62 by clicking the button 64 on the service client 63, the server 62 finds the corresponding display configuration a in the identification instruction table according to the identification instruction a, and sends the display configuration a to the user client 61, and the user client 61 displays the query interface 65 corresponding to the display configuration a.

In a third possible implementation manner, the server receives an identification instruction of the user client; searching a display configuration corresponding to the identification instruction in a preset identification instruction table; the display configuration is sent to the user client.

After the user client and the service client establish audio and video call connection, the user client can also send an identification instruction to the server, and the server searches the corresponding display configuration in the identification instruction table according to the identification instruction and sends the display configuration to the user client.

For example, as shown in fig. 6C, the user sends an identification instruction a to the server 62 by clicking the query 66 on the user client 61, the server 62 finds the corresponding display configuration a in the identification instruction table according to the identification instruction a, and sends the display configuration a to the user client 61, and the user client 61 displays the query interface 65 corresponding to the display configuration a.

Step 606, the user client obtains the display configuration corresponding to the service client.

Step 607, the user client displays the menu interface corresponding to the service provided by the service client on the audio/video call interface according to the display configuration.

Step 608, the user client generates feedback information according to the information input by the user on the menu interface.

Step 609, the user client sends feedback information to the server, and the server is used for forwarding the feedback information to the service client.

In step 610, the server receives feedback information sent by the user client.

In step 611, the service client forwards the feedback information to the service client.

Step 612, the service client receives the feedback information sent by the server.

The service client can send a new identification instruction to the server according to the received feedback information, and the server sends new display configuration to the user client according to the identification instruction, so that interaction between the user client and the service client is realized. The specific implementation steps are similar to step 605, and are not described herein again.

In this embodiment, the display configuration and the identification instruction table are stored in the server in advance, and the server only needs to search for the corresponding display configuration according to the identification instruction sent by the user client or the service client, and sends the display configuration to the user client, so that the working efficiency of the server is improved.

In a specific implementation scenario, the service client may send a video segment to the user client, and perform real-time communication with the user client during the video playing process.

As shown in fig. 6D, the service client 63 establishes an audio/video call connection with the user client 61, the service client 63 sends an identification instruction a to the server 62, and the server 62 finds a corresponding display configuration a in a preset identification instruction table according to the identification instruction a, where the display configuration a is a segment of video. The server 62 sends the display configuration a to the user client 61, and the user client 61 parses the received display configuration a and plays the video in the menu interface 65 displayed in the audio/video call interface. Correspondingly, the service client 63 will also play the video synchronously. The service client 63 and the user client 62 can both control the playing progress of the video and communicate through the audio-video call in the process of playing the video.

Referring to fig. 7, a block diagram of an audio/video call device according to an embodiment of the present invention is shown. The audio-video call device can be realized by software, hardware or a combination of the software and the hardware to form all or part of the server. This audio and video calling equipment includes:

a connection detection module 720, configured to detect whether the user client and the service client have established an audio/video call connection;

the configuration sending module 740 is configured to send a display configuration to the user client if the user client and the service client have established an audio/video call connection, where the user client is configured to display a menu interface corresponding to a service provided by the service client on an audio/video call interface according to the display configuration.

In summary, the audio/video call device provided in this embodiment detects whether an audio/video call connection has been established between the user client and the service client; if the user client and the service client establish audio and video call connection, sending display configuration to the user client, wherein the user client is used for displaying a menu interface corresponding to the service provided by the service client on an audio and video call interface according to the display configuration; the problem that when the types of the services are more, a user needs to listen to all voice prompts to determine the number corresponding to the target service, the input mode of the user is single, and the application range is small is solved; the method and the device achieve the effects that in the audio and video call process, a user can intuitively obtain information from a menu interface, and the speed and the accuracy of obtaining the information by the user are improved.

Referring to fig. 8, a block diagram of an audio/video call device according to another embodiment of the present invention is shown. The audio-video call device can be realized by software, hardware or a combination of the software and the hardware to form all or part of the server. This audio and video calling equipment includes:

a connection detection module 820, configured to detect whether the user client and the service client have established an audio/video call connection;

the configuration sending module 840 is configured to send a display configuration to the user client if the user client and the service client have established an audio/video call connection, where the user client is configured to display a menu interface corresponding to a service provided by the service client on an audio/video call interface according to the display configuration.

Optionally, the configuration sending module 840 includes:

a first sending unit 841, configured to receive the display configuration sent by the service client; forwarding the display configuration to the user client;

and/or the presence of a gas in the gas,

a second sending unit 842, configured to receive a request instruction of the user client; the request instruction is forwarded to the service client; receiving the display configuration fed back by the service client according to the request instruction; forwarding the display configuration to the user client.

Optionally, the configuration sending module 840 includes:

a third sending unit 843, configured to receive the identifier instruction sent by the service client; searching a display configuration corresponding to the identification instruction in a preset identification instruction list, wherein the identification instruction list comprises a corresponding relation between the identification instruction and the display configuration, and different display configurations correspond to different menu interfaces; sending the display configuration to the user client;

and/or;

a fourth sending unit 844, configured to automatically send the display configuration to the user client after the user client and the service client establish a connection;

and/or;

a fifth sending unit 845, configured to receive an identification instruction of the user client; searching a display configuration corresponding to the identification instruction in a preset identification instruction list, wherein the identification instruction list comprises a corresponding relation between the identification instruction and the display configuration, and different display configurations correspond to different menu interfaces; and sending the display configuration to the user client.

Optionally, the apparatus further comprises:

an instruction list receiving module 850, configured to receive at least one display configuration and the identification instruction list uploaded by the service client;

an instruction list storage module 860 for storing the at least one display configuration and the identification instruction list.

Optionally, the apparatus further comprises:

a first feedback information receiving module 870, configured to receive feedback information sent by the user client, where the feedback information is generated by the user client according to information input by a user on the menu interface;

a first feedback information sending module 880, configured to forward the feedback information to the service client.

Optionally, the display configuration is a configuration file in XML or HTML or CONF format;

the menu interface comprises at least one element of characters, pictures, videos, single-choice menus, multi-choice menus, pull-down menus, text input boxes or password input boxes.

Optionally, the user client is an instant messaging client or a social application client used by the user;

the service client is an instant messaging client or a social application client used by a service provider.

Referring to fig. 9, a block diagram of an audio/video communication device according to still another embodiment of the present invention is shown. The audio-video call device can be realized by software, hardware or a combination of the software and the hardware to be all or part of the user client. This audio and video calling equipment includes:

a first connection establishing module 920, configured to establish an audio/video call connection between the user client and the service client;

a configuration obtaining module 940, configured to enable a user client to obtain a display configuration corresponding to the service client;

and the interface display module 960 is used for displaying a menu interface corresponding to the service provided by the service client on the audio and video call interface according to the display configuration by the user client.

In summary, the audio/video communication device provided in this embodiment establishes an audio/video communication connection with the service client; acquiring display configuration corresponding to a service client; displaying a menu interface corresponding to the service provided by the service client on the audio and video call interface according to the display configuration; the problem that when the types of the services are more, a user needs to listen to all voice prompts to determine the number corresponding to the target service, the input mode of the user is single, and the application range is small is solved; the method and the device achieve the effects that in the audio and video call process, a user can intuitively obtain information from a menu interface, and the speed and the accuracy of obtaining the information by the user are improved.

Referring to fig. 10, a block diagram of an audio/video call device according to another embodiment of the present invention is shown. The audio-video call device can be realized by software, hardware or a combination of the software and the hardware to be all or part of the user client. This audio and video calling equipment includes:

a first connection establishing module 1020, configured to establish an audio/video call connection between the user client and the service client;

a configuration obtaining module 1040, configured to obtain, by a user client, a display configuration corresponding to the service client;

and the interface display module 1060 is used for displaying a menu interface corresponding to the service provided by the service client on the audio and video call interface according to the display configuration by the user client.

Optionally, the configuration obtaining module 1040 includes:

a first configuration receiving unit 1041, configured to receive, by a user client, the display configuration sent by a server, where the display configuration is sent by the service client to the server, or the display configuration is sent by the server after selecting, according to an identification instruction sent by the service client, a display configuration corresponding to the identification instruction from display configurations stored in the server;

or the like, or, alternatively,

a second configuration receiving unit 1042, configured to send, by the user client, an identification instruction to the server; and receiving the display configuration fed back by the server according to the identification instruction.

Optionally, the apparatus further comprises:

a feedback information generating module 1070, configured to generate feedback information by the user client according to information input by the user on the menu interface;

a second feedback information sending module 1080, configured to send the feedback information to the server by the user client, where the server is configured to forward the feedback information to the service client.

Referring to fig. 11, a block diagram of an audio/video call device according to a further embodiment of the present invention is shown. The audio-video call device can be realized by software, hardware or a combination of the software and the hardware to be all or part of the service client. This audio and video calling equipment includes:

a second connection establishing module 1120, configured to establish an audio/video call connection between the service client and the user client;

the configuration providing module 1140 is used for a service client to provide a display configuration corresponding to the service client to the user client, and the user client is used for displaying a menu interface corresponding to the service provided by the service client on an audio and video call interface according to the display configuration.

In summary, the audio/video call device provided in this embodiment establishes an audio/video call connection with the user client through the service client; the service client provides display configuration corresponding to the service client to the user client, and the user client is used for displaying a menu interface corresponding to the service provided by the service client on the audio and video call interface according to the display configuration; the problem that when the types of the services are more, a user needs to listen to all voice prompts to determine the number corresponding to the target service, the input mode of the user is single, and the application range is small is solved; the method and the device achieve the effects that in the audio and video call process, a user can intuitively obtain information from a menu interface, and the speed and the accuracy of obtaining the information by the user are improved.

Referring to fig. 12, a block diagram of an audio/video call device according to a further embodiment of the present invention is shown. The audio-video call device can be realized by software, hardware or a combination of the software and the hardware to be all or part of the service client. This audio and video calling equipment includes:

a second connection establishing module 1220, configured to establish an audio/video call connection between the service client and the user client;

the configuration providing module 1240 is used for providing the display configuration corresponding to the service client to the user client by the service client, and the user client is used for displaying the menu interface corresponding to the service provided by the service client on the audio and video call interface according to the display configuration.

Optionally, the configuration providing module 1240 comprises:

a first configuration sending unit 1241, configured to send the display configuration to a server by the service client, where the server is configured to send the display configuration to the user client;

or the like, or, alternatively,

a second configuration sending unit 1242, configured to send an identifier instruction to the server by the service client, where the server is configured to search, according to the identifier instruction, a display configuration corresponding to the identifier instruction in a preset identifier instruction table, and send the display configuration to the user client; the identification instruction list comprises the corresponding relation between the identification instruction and the display configuration, and different display configurations correspond to different menu interfaces;

or the like, or, alternatively,

a third configuration sending unit 1243, configured to receive, by the service client, a request instruction sent by the server, where the request instruction is sent by the user client to the server; and the service client sends the fed back display configuration to the server according to the request instruction, and the server is used for forwarding the display configuration to the user client.

Optionally, the apparatus further comprises:

a second feedback information receiving module 1250, configured to receive feedback information sent by the server, where the feedback information is generated by the user client according to information input by the user on the menu interface and is sent to the server.

It should be noted that: in the above embodiment, when performing an audio/video call, the audio/video call device is exemplified by only dividing the functional modules, and in practical applications, the function distribution may be completed by different functional modules as needed, that is, the internal structure of the user client, the server, or the service client is divided into different functional modules to complete all or part of the above described functions. In addition, the audio and video communication device and the audio and video communication method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments and are not described herein again.

Referring to fig. 13, a block diagram of an electronic device according to an embodiment of the invention is shown. The electronic equipment is used for implementing the audio and video call method on the side of the user client and/or the service client in the embodiment. Specifically, the method comprises the following steps:

the electronic device 1300 may include components such as RF (Radio Frequency) circuitry 1310, memory 1320 including one or more computer-readable storage media, input unit 1330, display unit 1340, sensors 1350, audio circuitry 1360, WiFi (wireless fidelity) module 1370, a processor 1380 including one or more processing cores, and a power supply 1390. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 13 does not constitute a limitation of the electronic device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:

RF circuit 1310 may be used for receiving and transmitting signals during a message transmission or communication session, and in particular, for receiving downlink information from a base station and processing the received downlink information by one or more processors 1380; in addition, data relating to uplink is transmitted to the base station. In general, RF circuit 1310 includes, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, and the like. In addition, RF circuit 1310 may also communicate with networks and other devices via wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), e-mail, SMS (Short Messaging Service), and the like.

The memory 1320 may be used to store software programs and modules, and the processor 1380 executes various functional applications and data processing by operating the software programs and modules stored in the memory 1320. The memory 1320 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the stored data area may store data (such as audio data, a phonebook, etc.) created according to the use of the electronic device 1300, and the like. Further, the memory 1320 may include high speed random access memory and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 1320 may also include a memory controller to provide the processor 1380 and the input unit 1330 access to the memory 1320.

The input unit 1330 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. Specifically, the input unit 1330 may include an image input device 1331 and other input devices 1332. The image input device 1331 may be a camera or an electro-optical scanning device. The input unit 1330 may include other input devices 1332 in addition to the image input device 1331. In particular, other input devices 1332 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 1340 may be used to display information input by or provided to a user as well as various graphical user interfaces of the electronic device 1300, which may be made up of graphics, text, icons, video, and any combination thereof. The display unit 1340 may include a display panel 1341, and optionally, the display panel 1341 may be configured in the form of an LCD (Liquid crystal display), an OLED (Organic Light-Emitting Diode), or the like.

The electronic device 1300 may also include at least one sensor 1350, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel 1341 according to the brightness of ambient light, and a proximity sensor that may turn off the display panel 1341 and/or backlight when the electronic device 1300 is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the mobile phone is stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which may be further configured in the electronic device 1300, detailed descriptions thereof are omitted.

The audio circuit 1360, speaker 1361, microphone 1362 may provide an audio interface between a user and the electronic device 1300. The audio circuit 1360 may transmit the electrical signal converted from the received audio data to the speaker 1361, and the electrical signal is converted into a sound signal by the speaker 1361 and output; on the other hand, the microphone 1362 converts the collected sound signal into an electric signal, converts the electric signal into audio data after being received by the audio circuit 1360, processes the audio data by the audio data output processor 1380, and then transmits the audio data to, for example, another electronic device via the RF circuit 1310, or outputs the audio data to the memory 1320 for further processing. The audio circuit 1360 may also include an earbud jack to provide communication of peripheral headphones with the electronic device 1300.

WiFi belongs to short-distance wireless transmission technology, and the electronic device 1300 can help the user send and receive e-mail, browse web pages, access streaming media, etc. through the WiFi module 1370, and it provides wireless broadband internet access for the user. Although fig. 13 shows the WiFi module 1370, it is understood that it does not belong to the essential constitution of the electronic device 1300, and may be omitted entirely within the scope not changing the essence of the invention as needed.

The processor 1380 is a control center of the electronic device 1300, connects various parts of the entire cellular phone using various interfaces and lines, and performs various functions of the electronic device 1300 and processes data by operating or executing software programs and/or modules stored in the memory 1320 and calling data stored in the memory 1320, thereby integrally monitoring the cellular phone. Optionally, processor 1380 may include one or more processing cores; preferably, the processor 1380 may integrate an application processor, which handles primarily operating systems, user interfaces, application programs, etc., and a modem processor, which handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated within processor 1380.

The electronic device 1300 also includes a power supply 1390 (e.g., a battery) to supply power to the various components, which may preferably be logically coupled to the processor 1380 via a power management system that may enable management of charging, discharging, and power consumption management functions. The power supply 1390 may also include any component or components including one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

Although not shown, the electronic device 1300 may further include a bluetooth module or the like, which is not described in detail herein.

In particular, in this embodiment, the electronic device 1300 also includes a memory, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the one or more processors. One or more of the programs described above contain instructions for the user client and/or the service client side for performing the audio-video call method provided by embodiments of the present invention.

Referring to fig. 14, a block diagram of a server according to an embodiment of the present invention is shown. The server 1400 includes a Central Processing Unit (CPU)1401, a system memory 1404 including a Random Access Memory (RAM)1402 and a Read Only Memory (ROM)1403, and a system bus 1405 connecting the system memory 1404 and the central processing unit 1401. The server or terminal 1400 also includes a basic input/output system (I/O system) 1406, which facilitates transfer of information between devices within the computer, and a mass storage device 1407 for storing an operating system 1413, application programs 1414, and other program modules 1415.

The basic input/output system 1406 includes a display 1408 for displaying information and an input device 1409, such as a mouse, keyboard, etc., for user input of information. Wherein the display 1408 and input device 1409 are both connected to the central processing unit 1401 via an input-output controller 1410 connected to the system bus 1405. The basic input/output system 1406 may also include an input/output controller 1410 for receiving and processing input from a number of other devices, such as a keyboard, mouse, or electronic stylus. Similarly, input-output controller 1410 also provides output to a display screen, a printer, or other type of output device.

The mass storage device 1407 is connected to the central processing unit 1401 through a mass storage controller (not shown) connected to the system bus 1405. The mass storage device 1407 and its associated computer-readable media provide non-volatile storage for the server 1400. That is, the mass storage device 1407 may include a computer readable medium (not shown) such as a hard disk or CD-ROM drive.

Without loss of generality, the computer-readable media may comprise computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes RAM, ROM, EPROM, EEPROM, flash memory or other solid state memory technology, CD-ROM, DVD, or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices. Of course, those skilled in the art will appreciate that the computer storage media is not limited to the foregoing. The system memory 1404 and mass storage device 1407 described above may collectively be referred to as memory.

The server or terminal 1400 may also operate in conjunction with a remote computer connected to the network via a network, such as the internet, according to various embodiments of the present invention. That is, the server or terminal 1400 may be connected to the network 1412 through the network interface unit 1411 coupled to the system bus 1405, or the network interface unit 1411 may be used to connect to other types of networks or remote computer systems (not shown).

The memory further comprises one or more programs, the one or more programs are stored in the memory, and the one or more programs comprise instructions for implementing the audio and video call method provided by the embodiment of the invention on the server side.

It should be understood that, as used herein, the singular forms "a," "an," "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims

1. An audio and video call method, characterized in that the method comprises:

the method comprises the steps that an audio and video call connection is established between a user client and a service client, wherein the user client is an instant messaging client or a social application client used by a user, and the service client is an instant messaging client or a social application client used by a service provider;

the user client side obtains display configuration corresponding to the service client side, the display configuration is a configuration file, the display configuration is that after the user client side receives a user input instruction, the configuration corresponding to the user input instruction is obtained, and service client sides providing different services correspond to different display configurations;

and the user client displays a menu interface corresponding to the service provided by the service client on an audio and video call interface according to the display configuration, the menu interface comprises control elements and supports character input, the menu interface is obtained by analyzing the display configuration by the user client, and information input by a user in the menu interface is used for generating feedback information and providing the feedback information for the service client.

2. The method of claim 1, wherein the obtaining, by the user client, the display configuration corresponding to the service client comprises:

the user client receives the display configuration sent by a server, wherein the display configuration is sent to the server by the service client, or the display configuration is sent after the server selects the display configuration corresponding to the identification instruction from the display configurations stored in the server according to the identification instruction sent by the service client;

or the like, or, alternatively,

the user client sends an identification instruction to the server; and receiving the display configuration fed back by the server according to the identification instruction.

3. The method according to claim 1 or 2, wherein the user client further includes, after displaying a menu interface corresponding to the service provided by the service client on an audio/video call interface according to the display configuration:

the user client generates the feedback information according to the information input by the user on the menu interface;

and the user client sends the feedback information to a server, and the server is used for forwarding the feedback information to the service client.

4. An audio and video call method, characterized in that the method comprises:

the method comprises the steps that an audio and video call connection is established between a service client and a user client, the user client is an instant messaging client or a social application client used by a user, and the service client is an instant messaging client or a social application client used by a service provider;

the service client provides display configuration corresponding to the service client to the user client, the display configuration corresponds to a user input instruction received by the user client, the service client providing different services corresponds to different display configurations, the user client is used for displaying a menu interface corresponding to the services provided by the service client on an audio and video call interface according to the display configuration, the display configuration is a configuration file, the menu interface is obtained by analyzing the display configuration by the user client, the menu interface comprises a control element and supports text input, and information input by a user in the menu interface is used for generating feedback information and providing the feedback information to the service client.

5. The method of claim 4, wherein the service client provides the user client with a display configuration corresponding to the service client, comprising:

the service client sends the display configuration to a server, and the server is used for sending the display configuration to the user client;

or the like, or, alternatively,

the service client sends an identification instruction to the server, and the server is used for searching a display configuration corresponding to the identification instruction in a preset identification instruction table according to the identification instruction and sending the display configuration to the user client; the identification instruction list comprises the corresponding relation between the identification instruction and the display configuration, and different display configurations correspond to different menu interfaces;

or the like, or, alternatively,

the service client receives a request instruction sent by the server, wherein the request instruction is sent to the server by the user client; and the service client sends the fed back display configuration to the server according to the request instruction, and the server is used for forwarding the display configuration to the user client.

6. The method of claim 4 or 5, wherein after the service client provides the display configuration corresponding to the service client to the user client, the method further comprises:

and receiving the feedback information sent by the server, wherein the feedback information is generated by the user client according to the information input by the user on the menu interface and is sent to the server.

7. An audio and video call method, characterized in that the method comprises:

detecting whether a user client and a service client establish audio and video call connection or not, wherein the user client is an instant messaging client or a social application client used by a user, and the service client is an instant messaging client or a social application client used by a service provider;

if the user client and the service client establish audio and video call connection, sending display configuration to the user client, wherein the display configuration corresponds to a user input instruction received by the user client, and the service clients providing different services correspond to different display configurations, the user client is used for displaying a menu interface corresponding to the service provided by the service client on an audio and video call interface according to the display configuration, the display configuration is a configuration file, the menu interface is obtained by analyzing the display configuration by the user client, the menu interface comprises a control element and supports text input, and information input by a user in the menu interface is used for generating feedback information and providing the feedback information to the service client.

8. The method of claim 7, wherein sending the display configuration to the user client comprises:

receiving display configuration sent by the service client; forwarding the display configuration to the user client;

and/or the presence of a gas in the gas,

receiving a request instruction of the user client; forwarding the request instruction to the service client; receiving the display configuration fed back by the service client according to the request instruction; forwarding the display configuration to the user client.

9. The method of claim 7, wherein sending the display configuration to the user client comprises:

receiving an identification instruction sent by the service client; searching a display configuration corresponding to the identification instruction in a preset identification instruction list, wherein the identification instruction list comprises a corresponding relation between the identification instruction and the display configuration, and different display configurations correspond to different menu interfaces; sending the display configuration to the user client;

and/or;

after the user client side and the service client side are connected, the display configuration is automatically sent to the user client side;

and/or;

receiving an identification instruction of the user client; searching a display configuration corresponding to the identification instruction in a preset identification instruction list, wherein the identification instruction list comprises a corresponding relation between the identification instruction and the display configuration, and different display configurations correspond to different menu interfaces; and sending the display configuration to the user client.

10. The method of claim 9, wherein prior to sending the display configuration to the user client, further comprising:

receiving at least one display configuration and the identification instruction list uploaded by the service client;

and saving the at least one display configuration and the identification instruction list.

11. The method according to any one of claims 7 to 10, further comprising, after sending the display configuration to the user client:

receiving the feedback information sent by the user client, wherein the feedback information is generated by the user client according to the information input by the user on the menu interface;

and forwarding the feedback information to the service client.

12. An audio-video call device, comprising:

the system comprises a first connection establishing module, a service providing module and a second connection establishing module, wherein the first connection establishing module is used for establishing audio and video call connection between a user client and a service client, the user client is an instant communication client or a social application client used by a user, and the service client is an instant communication client or a social application client used by a service providing party;

the configuration acquisition module is used for acquiring display configuration corresponding to the service client, wherein the display configuration is a configuration file, the display configuration is that after the user client receives a user input instruction, the configuration corresponding to the user input instruction is acquired, and service clients providing different services correspond to different display configurations;

and the interface display module is used for displaying a menu interface corresponding to the service provided by the service client on an audio and video call interface according to the display configuration, the menu interface comprises control elements and supports character input, the menu interface is obtained by analyzing the display configuration by the user client, and the information input by the user in the menu interface is used for generating feedback information and providing the feedback information for the service client.

13. An audio-video call device, comprising:

the second connection establishing module is used for establishing audio and video call connection between a service client and a user client, wherein the user client is an instant communication client or a social application client used by a user, and the service client is an instant communication client or a social application client used by a service provider;

the configuration providing module is used for providing display configuration corresponding to the service client for the user client, the display configuration corresponds to a user input instruction received by the user client, the service clients providing different services correspond to different display configurations, the user client is used for displaying a menu interface corresponding to the services provided by the service client on an audio and video call interface according to the display configuration, the display configuration is a configuration file, the menu interface is obtained by analyzing the display configuration by the user client, the menu interface comprises a control element and supports text input, and information input by a user in the menu interface is used for generating feedback information and providing the feedback information for the service client.

14. An audio-video call device, comprising:

the connection detection module is used for detecting whether an audio and video call connection is established between a user client and a service client, wherein the user client is an instant messaging client or a social application client used by a user, and the service client is an instant messaging client or a social application client used by a service provider;

the configuration sending module is used for sending display configuration to the user client if the user client and the service client establish audio and video call connection, the display configuration corresponds to a user input instruction received by the user client, the service clients providing different services correspond to different display configurations, the user client is used for displaying a menu interface corresponding to the services provided by the service client on an audio and video call interface according to the display configuration, the display configuration is a configuration file, the menu interface is obtained by analyzing the display configuration by the user client, the menu interface comprises control elements and supports character input, and information input by a user in the menu interface is used for generating feedback information and is provided for the service client.

15. A computer-readable storage medium, characterized in that a program is stored in the computer-readable storage medium, the program being executed by hardware to implement the audio-video call method according to any one of claims 1 to 3.

16. A computer-readable storage medium, characterized in that a program is stored in the computer-readable storage medium, the program being executed by hardware to implement the audio-video call method according to any one of claims 4 to 6.

17. A computer-readable storage medium, characterized in that a program is stored in the computer-readable storage medium, the program being executed by hardware to implement the audio-video call method according to any one of claims 7 to 11.