CN106303350A - A kind of multimodal video call method and device - Google Patents

A kind of multimodal video call method and device Download PDF

Info

Publication number
CN106303350A
CN106303350A CN201510320247.6A CN201510320247A CN106303350A CN 106303350 A CN106303350 A CN 106303350A CN 201510320247 A CN201510320247 A CN 201510320247A CN 106303350 A CN106303350 A CN 106303350A
Authority
CN
China
Prior art keywords
described
terminal
data
call mode
video calling
Prior art date
Application number
CN201510320247.6A
Other languages
Chinese (zh)
Inventor
於聪
金琼瑶
严飞军
孙健康
裘钰钢
Original Assignee
阿里巴巴集团控股有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里巴巴集团控股有限公司 filed Critical 阿里巴巴集团控股有限公司
Priority to CN201510320247.6A priority Critical patent/CN106303350A/en
Publication of CN106303350A publication Critical patent/CN106303350A/en

Links

Abstract

This application discloses a kind of multimodal video call method and device, described method includes: first terminal is set up after being connected with the video calling of the second terminal, input text area is shown in the current interface of described first terminal self, receive the text data of input in described input text area, described text data is sent to described second terminal in the way of instant communication information.By said method, even if user is in the state of inconvenience, it is also possible to keep video calling to connect, and in the way of instant communication information, with the other side's communication, the state that user is current will not be impacted, effectively improve the convenience to video calling.

Description

A kind of multimodal video call method and device

Technical field

The application relates to field of computer technology, particularly relates to a kind of multimodal video call method and dress Put.

Background technology

Along with the development of information technology, traditional note and the mode of voice call can not meet user's Demand, video call technology is arisen at the historic moment.

At present, between different user, each use has the terminal of video call function, it is possible to carry out each other Between video calling.Its detailed process is: the second terminal (that is, initiator of video calling) is to first Terminal (that is, recipient of video calling) initiates the request of video calling, when after first terminal response, Two terminals just establish video calling to each other.

But, in actual applications, when first terminal and the second terminal establish video calling connection, may Owing to using the user of first terminal to be likely to be at the state (such as: in meeting) of inconvenience, this user may Can select to close audio frequency (it could also be possible that video), now, according to video calling side of the prior art Formula, the user of the only second terminal can hear the sound of first terminal, and the user of first terminal can not Hear that the sound of the second terminal, such mode will have a strong impact on video calling, and result even in video calling Can not proceed.User just can only stop video calling, and selects other communication mode (such as: note); Or user just can only wait that current state changes after (such as: meeting adjourned), just can again build The vertical video calling with the other side.Obviously, such mode is the most loaded down with trivial details, the communication being not easy between user.

Summary of the invention

The embodiment of the present application provides a kind of multimodal video call method and device, in order to solve prior art In the poor problem of video calling mode convenience in special scenes.

The multimodal video call method of one that the embodiment of the present application provides, including:

First terminal is set up after being connected with the video calling of the second terminal, in the current interface of described first terminal Middle display input text area;

Receive the text data of input in described input text area;

Described text data is sent to described second terminal in the way of instant communication information.

The embodiment of the present application provides a kind of multimodal video conversation apparatus, including:

Input text area module, sets up after being connected with the video calling of the second terminal, in institute for first terminal State in the current interface of first terminal and show input text area;

Received text module, for receiving the text data of input in described input text area;

Sending module, for sending described text data in the way of instant communication information to described second eventually End.

The embodiment of the present application provides a kind of multimodal video call method and device, in the method, when the One terminal establishes after video calling is connected with the second terminal, shows that text inputs on the interface of first terminal District so that use the user of first terminal can send text data.Adopt in such a way, though user It is in the state of inconvenience, it is also possible to keep video calling to connect, and in the way of instant communication information, With the other side's communication, the state that user is current will not be impacted, effectively improve video calling Convenience.

Accompanying drawing explanation

Accompanying drawing described herein is used for providing further understanding of the present application, constitutes of the application Point, the schematic description and description of the application is used for explaining the application, is not intended that to the application not Work as restriction.In the accompanying drawings:

The multimodal video call process that Fig. 1 provides for the embodiment of the present application;

In the multimodal video call process under actual application scenarios that Fig. 2 provides for the embodiment of the present application The schematic diagram of the call interface shown by the second terminal;

Fig. 3 a~3b, Fig. 4, Fig. 5 a~5b, Fig. 6 for the embodiment of the present application provide under actual application scenarios Multimodal video call process in interface shown by first terminal;

The multimodal video call process of another kind that Fig. 7 provides for the embodiment of the present application;

A kind of multimodal video call process that Fig. 8 provides for the embodiment of the present application;

The multimodal video conversation apparatus structural representation in first terminal that Fig. 9 provides for the embodiment of the present application Figure;

The multimodal video conversation apparatus structure in the second terminal that Figure 10 provides for the embodiment of the present application is shown It is intended to;

The most multimodal video conversation apparatus structural representation that Figure 11 provides for the embodiment of the present application Figure.

Detailed description of the invention

For making the purpose of the application, technical scheme and advantage clearer, specifically real below in conjunction with the application Execute example and technical scheme is clearly and completely described by corresponding accompanying drawing.Obviously, described Embodiment is only some embodiments of the present application rather than whole embodiments.Based on the enforcement in the application Example, the every other enforcement that those of ordinary skill in the art are obtained under not making creative work premise Example, broadly falls into the scope of the application protection.

The multimodal video call process that Fig. 1 provides for the embodiment of the present application, specifically includes following steps:

S101, after first terminal foundation is connected with the video calling of the second terminal, working as at described first terminal Front interface shows input text area.

First terminal described in the embodiment of the present application and the second terminal, include but not limited to: smart mobile phone, Panel computer, intelligent watch etc. have the mobile terminal of video call function.Wherein, the second terminal and first Video call function in terminal, can be provided by operating in the operating system of terminal, that is, operating system A kind of service for carrying out video calling is provided;A kind of optimal way in the application is embodiment, depending on Frequently call function can also be realized by the application (Application, APP) installed in the terminal, that is, Under this optimal way, the second terminal identical has video call function with being respectively mounted in first terminal APP, thus, the second terminal just can initiate the request of video calling by this APP to first terminal.

In the prior art, after establishing video calling connection between first terminal and the second terminal, both sides Just video calling can be carried out, in the call interface of first terminal (or second terminal), display the other side's Picture also plays the sound of the other side.But, once one party closes sound (as first terminal closes sound Sound) after, video calling will be caused and have a strong impact on so that the second terminal cannot obtain the sound of first terminal Frequently.

And in the embodiment of the present application, it is provided that a kind of call interface, as illustrated in fig. 2, it is assumed that user B uses Between the first terminal that second terminal and user A use, establish video calling and connect, now, user In the first terminal that A uses, show the call interface in Fig. 2, in this interface, show text defeated Enter district's (that is, in Fig. 2, printed words are the text input area of " clicking on input word ").Thus, user A just can use text message to exchange with user B.Obviously, in this case, though first Terminal closes sound, then, first terminal and the second terminal can also be normally carried out seeing Liu

Certainly, in the embodiment of the present application, user B is used the second terminal to display that corresponding interface (that is, interface showing input text area).Here the restriction to the application it is not intended that.

S102, receives the text data of input in described input text area.

User can input corresponding text data in text input area, and now, first terminal is by typing The described text data of user's input.

S103, sends described text data to described second terminal in the way of instant communication information.

Use the mode of instant communication information, so that the literary composition that first terminal (or second terminal) sends Notebook data, immediately sends to distant terminal, defines the connection of a kind of instant communication information.

By said method, after first terminal and the second terminal establish video calling connection, first eventually Input text area is shown so that use the user of first terminal can send text data on the interface of end.Adopt In such a way, even if user is in the state of inconvenience, it is also possible to keep video calling to connect, and In the way of instant communication information, with the other side's communication, the state that user is current will not be impacted, Effectively improve the convenience to video calling.

Certainly, in the embodiment of the present application, described input text area comprises exercisable Text Entry (as Shown in Fig. 2).So, in above-mentioned steps S102, receive the textual data of input in described input text area According to, particularly as follows: receive the operation for described Text Entry, and in current interface, eject keyboard, connect Receive the text data by described input through keyboard.

It is to say, after user carries out clicking operation for the Text Entry in Fig. 2, will be in current interface Middle ejection keyboard (not showing that in Fig. 2), in order to carry out text input.Certainly, described keyboard is all right It is to be directly displayed in described text input area, here and be not especially limited.

Additionally, in order to ensure that both sides can be smoothed out instant messaging, therefore work as prezone at described first terminal In face, it is provided with session show area.Under such a scenario, described method also includes: receive described second The instant communication information that terminal sends, the instant communication information that described first terminal is sent and receiving By described second terminal send instant communication information, suitable according to the time order and function of each instant communication information Sequence, shows described instant communication information in described session show area.

It is to say, when carrying out instant messaging, the instant communication information of both sides is shown in the session of correspondence In show area.

Above content be have been set up video calling connect after, carry out between first terminal and the second terminal The scene of instant messaging, in actual applications, uses the user of first terminal, can set up video calling Before connection, arranging corresponding call mode, so, the video calling connection of foundation is just directly entered Corresponding call mode.Therefore, in the embodiment of the present application, first terminal sets up the video with the second terminal Call connects, particularly as follows: first terminal receives the video calling request that the second terminal is initiated, display call mould Formula control, and receive the call mode that user is selected by described call mode control, according to described call mould Formula, sets up and is connected with the video calling of described second terminal.

In the prior art, when the second terminal is after first terminal initiates video calling request, first terminal meeting The display response interface current interface of described first terminal (the described response interface be exactly), now, as making With the user of first terminal, this user can only select response or refuse the request of this video calling.Especially when this use Family is in when being not easy in the particular state of response so that the convenience of video calling is relatively low.

The most in the embodiment of the present application, when the second terminal is after first terminal sends video calling request, the One terminal shows call mode control in response interface.Enter corresponding logical in order to control described first terminal Words pattern.Such as: described call mode control, first terminal can be controlled and normally receive the second terminal transmission Video data, but shielding the second terminal transmission voice data, so, when first terminal have answered After the video calling between the second terminal is asked and established to video calling, first terminal only shows second eventually The video image of end transmission, but do not play the sound of the second terminal transmission.Certainly, merely just to described logical The example of a kind of call mode that words mode control can realize, in actual applications, by described call mould Formula control, it is also possible to different call modes can be realized, such as: first terminal does not sends video to the second terminal Data and voice data so that the second terminal image and sound of not showing first terminal etc., foregoing It is not intended that the restriction to the application.

In the embodiment of the present application, shown on the response interface of first terminal described call mode control It is operable to.That is, use the user of described first terminal can be for the call mode in described interface Control sends corresponding operational order, such that it is able to by described call mode control, select corresponding call Pattern.Wherein, described operational order includes: click commands.

In the embodiment of the present application, described call mode includes: do not enter the voice data of described first terminal The call mode of row transmission.That is, in the embodiment of the present application, the call mode of acquiescence is exactly first terminal Do not transmit voice data so that the second terminal can not receive the voice data of this first terminal and (use second eventually The user of end can not hear the sound of first terminal).Certainly, described call mode also includes: to described The video data of one terminal, text data terminal at least one be not transmitted.It is to say, should in reality Used time, one communication data is not transmitted in the second terminal by first terminal to I haven't seen you for ages.Certainly, it is the most only Example to the call mode of first terminal, is not intended that the restriction to the application.Wherein, described communication Data just include: at least one in video data, voice data, text data.

Unlike the prior art, the described call mode control in the embodiment of the present application, display is described First terminal etc. in interface to be answered, that is, before video calling does not sets up, user just can be right Described call mode control operates so that first terminal enters corresponding call mode, the most again with institute State the second terminal and set up video calling.

By above-mentioned steps, after first terminal receives the video calling request that the second terminal is initiated, first Terminal can show call mode control in waiting interface to be answered, and receives user by described call mode Call mode selected by control so that first terminal enters corresponding call mode, the most again with described the Two terminals are set up video calling and are connected.Such mode allows user before response video calling is asked, so that it may So that first terminal is in the call mode meeting user's current state, thus, user uses first terminal to build Stand the video calling request between the second terminal, the state that user is current would not be impacted, effectively Improve the convenience to video calling.

In the embodiment of the present application, first terminal is under different call modes, and this first terminal and second is eventually Video calling mode after the video calling that end is set up connects also differs, below will be in the embodiment of the present application Different call modes is described in detail.

Mode one

In view of in actual applications, use the user of first terminal may be for privacy or safety Consider, do not want to allow other users (using the user of the second terminal) know current state, then, work as institute When stating the video calling request that first terminal receives the second terminal, user just can be at described first terminal In current interface, send the operational order to call mode control, select corresponding call mode (namely Have selected the communication data not being transmitted) so that described first terminal and the second terminal establish video and lead to After words connect, do not send the communication data not being transmitted to the second terminal.

Therefore, in the embodiment of the present application, according to described call mode, foundation regards with described second terminal Frequency call connects, particularly as follows: determine the communication data not being transmitted under described call mode, not transmit The mode of the communication data determined, sets up and is connected with the video calling of described second terminal.

Under aforesaid way, it should be noted that not transmit the transmission means of the communication data determined, build Stand and be connected with the video calling of described second terminal, particularly as follows: when the communication data determined is video data, Close the image collecting device of described first terminal self, and set up the video calling with described second terminal even Connect;When the communication data determined is voice data, close the audio collecting device of described first terminal self, And foundation is connected with the video calling of described second terminal;When the communication data determined is text data, close Close the keyboard of described first terminal self, and foundation is connected with the video calling of described second terminal.

Wherein, described image collecting device, can be the photographic head of first terminal.Described audio collection Device, can be the mike of first terminal.

Such as: assuming that user A uses first terminal, user B uses the second terminal, now, user B Using the second terminal to initiate video calling request to the first terminal of user A, as shown in Figure 3 a, first eventually By display response interface in end.

In this response interface, in addition to the option of response and refusal is provided, also show call mode control Part, that is, such as mike icon and camera icon in 3a.Wherein, mike icon for open or Close the mike of this first terminal self;Camera icon is for being turned on and off this first terminal self Photographic head.

If user A is in the consideration of privacy or safety, it is possible to for the call mode control in Fig. 3 a Operate.It is assumed that user A has clicked on two call mode controls so that first terminal closes The mike of self and photographic head, as shown in Figure 3 b, mike icon and camera icon are respectively at taboo Only state, now, the call mode of first terminal includes: video data and the audio frequency number to this first terminal According to the call mode not being transmitted, then, when user A selects after response, first terminal will be set up and the Video calling between two terminals connects, and now, user B is it cannot be seen that the picture of user A can not be listened See the sound of user A.

Mode two

In view of in actual applications, the video calling between the second terminal and first terminal connects, need by Server is set up, and therefore, under which in the embodiment of the present application, according to described call mode, sets up It is connected with the video calling of described second terminal, particularly as follows: according to described call mode, built by server Stand and be connected with the video calling of described second terminal.

In such manner, first terminal is except controlling different communication datas not in this first terminal this locality Outside being transmitted, by described server, the transmission of different communication datas can be controlled, that is, In the embodiment of the present application, set up by server and be connected with the video calling of described second terminal, particularly as follows: Described first terminal is by each communication number corresponding to pattern information corresponding for described call mode and video calling According to being sent to server, make described server determine according to described pattern information and do not carry out under described call mode The communication data of transmission, and the communication data filtration not being transmitted in each communication data that will receive, will Communication data after filtration is sent to the second terminal.

It is to say, after user have selected corresponding call mode by the call mode control of first terminal, First terminal can generate the pattern information corresponding with this call mode, and sends this pattern information to service In device, and the transmission of communication data is controlled by server.

Mode three

Above two mode, is all that the transmission to corresponding communication data is controlled, and achieves second In terminal, do not show or play these communication datas, then, in addition to above two mode, if directly In the second terminal whether corresponding communication data shown or whether play, it is also possible to reaching identical Purpose.Therefore, under mode, according to described call mode, set up the video with described second terminal and lead to Words connect, particularly as follows: described first terminal is by pattern information corresponding for described call mode and video calling Corresponding each communication data is sent to described second terminal, makes described second terminal true according to described pattern information The communication data not being transmitted under fixed described call mode, and do not carry out in each communication data received The communication data of transmission filters, and the communication data after filtering is played out or shown.

It is to say, first terminal still connects normal through video calling, transmit all kinds of communication data to second In terminal, by the second terminal according to pattern information, determine needs display or play corresponding communication data.

Mode four

In actual applications, the user of first terminal is used to be likely to be in the scene being inconvenient to answer, such as: In a meeting, or at library etc., in this case, user may not want that terminal plays to user The sound of the other side and/or picture, then, when described first terminal receives the video calling request of the second terminal Time, user just can send the operation to call mode control and refer in the current interface of described first terminal Order, selects corresponding call mode so that described first terminal and the second terminal establish video calling and connect Afterwards, shield the second terminal and send the communication datas such as image, sound, text.

Therefore, in the embodiment of the present application, also include:

The communication data needing shielding selected by described call mode control according to user, shields described the Video data, voice data or the text data that two terminals send.

It should be noted that in order to ensure that both sides exchange normally, first terminal at most shields two kinds of communication numbers According to.Here it is not especially limited.

For mode four, such as: assuming that user A uses first terminal, user B uses the second terminal, Now, user B uses the second terminal to initiate video calling request to the first terminal of user A, such as Fig. 3 a Shown in, by display response interface in first terminal.

In this response interface, in addition to the option of response and refusal is provided, also show call mode control Part, that is, as Fig. 4 " only sees the other side " with printed words and the control of " only listening the other side ".Wherein, " only See the other side " control for shielding second terminal send voice data retain video data;" only listen the other side " The video data that control sends for shielding the second terminal retains voice data.

If user A is in the environment that inconvenience is answered (such as: library), user A just can be for Fig. 4 In call mode control operate.It is assumed that user A clicks the call that printed words are " only seeing the other side " Mode control, then, after user A selects response, first terminal will set up regarding between the second terminal Frequency call connects, and now, first terminal will shield the voice data that the second terminal sends, that is, user A Can see that the picture of user B, but the sound of user B can not be heard.In order to ensure user A and user Can exchange by the way of text message between B.

Mode five

In some special scenes in actual applications, use first terminal user may for privacy or The consideration of safety, meanwhile, this user is also in the environment being inconvenient to answer, and now, user is the most permissible For call mode control, send corresponding operational order so that described first terminal i.e. controls himself The transmission of communication data, also shields the communication data that the second terminal sends.

Such as: assuming that user A uses first terminal, user B uses the second terminal, now, user B Using the second terminal to initiate video calling request to the first terminal of user A, as shown in Figure 5 a, first eventually By display response interface in end.

Visible, in current response interface, it is shown that various calls mode control.It is assumed that user A is respectively Click two call mode controls (that is, having clicked on mike icon and camera icon) so that First terminal does not transmit video data and the voice data of this locality to the other side, and user A clicks printed words and is The call mode control " only seeing the other side ", that is, as shown in Figure 5 b, now, first terminal will not pass Defeated self video data and voice data, and, only receive the video data sent by the second terminal, shield Cover the voice data of the second terminal.

Certainly, through foregoing, after establishing the video calling connection between first terminal and the second terminal, In the current interface of first terminal and the second terminal, call interface will be shown respectively.As the embodiment of the present application In a kind of optimal way, in the call interface of first terminal, display that call mode control so that use Family can change call mode during video calling.

Therefore, in the embodiment of the present application, for above-mentioned method S101 as shown in Figure 1~S103, described Method also includes: when described first terminal establishes after the video calling between described second terminal is connected, Described first terminal shows described call mode control in currently displayed interface, according to the use received Current call mode, by the call mode of described call mode control change, is changed in family.

As shown in Figure 6, the video calling established between described second terminal for described first terminal is connected After, the call interface of display in first terminal.On call interface in figure 6, user can be the most right Call mode control in this call interface sends operational order so that call mode occurs corresponding change.

It addition, when described first terminal is under the call mode not transmitting voice data, cause the other side (to make User by the second terminal) sound of first terminal user can not be heard, in order to ensure that both sides can normally hand over Stream, it is necessary to use the transmission means of text message.So, in the embodiment of the present application, described method is also Including: when described first terminal is under the call mode not transmitting voice data, described first terminal is to institute State the second terminal and send Text Mode notification message so that the current interface of described second terminal shows text Input area, to carry out the session of instant communication information.

As above described in content, as it is shown in fig. 7, for the second terminal, a kind of multimodal regard is also provided for Frequently call method, including:

S701, the second terminal is set up after being connected with the video calling of first terminal, in described second terminal self Current interface in show input text area;

S702, receives the text data of input in described input text area;

S703, sends described text data in the way of instant communication information to described first terminal, and connects Receive the instant communication information that described first terminal sends.

For said method, described input text area comprises exercisable Text Entry.Now, In step S702, receive in described input text area input text data, particularly as follows: receive for The operation of described Text Entry, and in current interface, eject keyboard, receive by described input through keyboard Text data.

It addition, in the current interface of described first terminal, arrange session show area.Under this scene, described Method also includes: by described second terminal send instant communication information and receive by described first Terminal send instant communication information, according to each instant communication information time order and function order, by described immediately Communication message shows in described session show area.

For the second terminal, the second terminal is set up and is connected with the video calling of first terminal, particularly as follows: Second terminal initiates video calling request to first terminal, receives the pattern information that described first terminal sends, According to described pattern information, determine the communication number not being transmitted under the call mode that described pattern information is corresponding According to, receive the communication data that described first terminal sends, and do not pass in each communication data received Defeated communication data filters, and the communication data after filtering is played out or shown.

For said method, also include: receive the Text Mode notification message that described first terminal sends, According to described Text Mode notification message, in the current interface of described second terminal, show input text area.

Visible, above-mentioned method S701 as shown in Figure 7~S704, be that the second end side carries out and sets up institute State the process of video calling.In this process, call mode foundation, operate according to this call mode Mode, similar with foregoing, therefore no longer Ao Shu at this.

Foregoing is all the description carried out from angle mutual between first terminal and the second terminal, and in reality In the application of border, set up video calling between first terminal and the second terminal and connect, need corresponding server complete Become.For server, in the embodiment of the present application, as shown in Figure 8, one is also provided for multimodal Video call method, including:

S801, in the video calling connection that first terminal and the second terminal are set up, server is according to receiving Instant communication information, set up instant messaging between described first terminal and the second terminal and connect;

S802, is connected by described instant messaging, and the described instant communication information received is forwarded by server Give corresponding terminal.

For the method, also include: server receives the video calling request that the second terminal sends, and should Video calling request is forwarded to first terminal, receives the pattern information that described first terminal sends, according to described Pattern information, determines the call mode that described pattern information is corresponding, according to described call mode, sets up described Video calling between second terminal and first terminal connects.

Specifically, according to described call mode, the video between described second terminal and first terminal is set up Call connects, particularly as follows: determine the communication data not being transmitted under described call mode, receives video and leads to Each communication data that words are corresponding, determines that according to described pattern information be not transmitted under described call mode leads to News data, the communication data not being transmitted in each communication data that will receive filters, leading to after filtering News data are sent to the second terminal.

The multimodal video call method provided for the embodiment of the present application above, based on same thinking, this Application embodiment provides a kind of multimodal video conversation apparatus, is arranged in first terminal, as shown in Figure 9.

In fig .9, multimodal video conversation apparatus includes:

Input text area module 901, sets up after being connected with the video calling of the second terminal for first terminal, Input text area is shown in the current interface of described first terminal.

Received text module 902, for receiving the text data of input in described input text area.

Sending module 903, for sending described text data in the way of instant communication information to described the Two terminals.

Described input text area comprises exercisable Text Entry.Now, described received text module 902, specifically for receiving the operation for described Text Entry, and in current interface, eject keyboard, Receive the text data by described input through keyboard.

Described device also includes: textual presentation module 904, is used in the current interface of described first terminal, Session show area is set, receives the instant communication information that described second terminal sends, described first terminal is sent out The instant communication information sent and the instant communication information sent by described second terminal received, according to The time order and function order of each instant communication information, shows described instant communication information in described session show area In.

It addition, when first terminal is set up and is connected with the video calling of the second terminal, described device also includes:

Receiver module 905, for receiving the video calling request that the second terminal is initiated.

Display module 906, is used for showing call mode control, and receives user by described call mode control The call mode that part selects.

Connection establishment module 907, for according to described call mode, setting up the video with described second terminal Call connects.

Wherein, described call mode includes: the call not being transmitted the voice data of described first terminal Pattern.

Certainly, under another way in the embodiment of the present application, described call mode also includes: to described The video data of first terminal, text data terminal at least one be not transmitted.

Specifically, described connection establishment module 907, do not pass under described call mode specifically for determining Defeated communication data, in the way of not transmitting the communication data determined, sets up the video with described second terminal Call connects.Wherein, during described communication data includes video data, voice data, text data at least A kind of.

More specifically, described connection establishment module 907, is video data for working as the communication data determined Time, close the image collecting device of described first terminal self, and it is logical to set up the video with described second terminal Words connect;

When the communication data determined is voice data, close the audio collection dress of described first terminal self Put, and foundation is connected with the video calling of described second terminal;

When the communication data determined is text data, closes the keyboard of described first terminal self, and set up It is connected with the video calling of described second terminal.

In actual applications, setting up under the scene that described video calling connects based on server, described connection is built Formwork erection block 907, specifically for according to described call mode, setting up and described second terminal by server Video calling connects.

More specifically, described connection establishment module 907, for by pattern letter corresponding for described call mode Breath and each communication data corresponding to video calling are sent to server, make described server according to described pattern Information determines in the communication data not being transmitted under described call mode, and each communication data that will receive The communication data not being transmitted filters, and the communication data after filtering is sent to the second terminal.

It addition, described connection establishment module 907, specifically for by pattern information corresponding for described call mode And each communication data corresponding to video calling is sent to described second terminal, make described second terminal according to institute State pattern information and determine the communication data not being transmitted under described call mode, and to each communication received The communication data not being transmitted in data filters, and plays out the communication data after filtering or aobvious Show.

In the embodiment of the present application, described display module 906, be additionally operable to when described first terminal establish with After video calling between described second terminal connects, in the interface that first terminal is currently displayed, show institute State call mode control, according to the user the received call mode by the change of described call mode control, Change current call mode.

Described connection establishment module 907, is additionally operable to when described first terminal is in the call not transmitting voice data Time under pattern, described first terminal sends Text Mode notification message to described second terminal so that described the The current interface of two terminals shows text-entry control, to carry out the message session of text type.

The embodiment of the present application also provides for a kind of multimodal video conversation apparatus, is arranged in the second terminal, as Shown in Figure 10, in Fig. 10, multimodal video conversation apparatus includes:

Input text area module 1001, sets up after being connected with the video calling of the second terminal for first terminal, The current interface of described second terminal shows input text area;

Received text module 1002, for receiving the text data of input in described input text area;

File Transfer module 1003, for sending described text data to institute in the way of instant communication information State first terminal, and receive the instant communication information that described first terminal sends.

Described input text area comprises exercisable Text Entry.Now, described received text module 1002, specifically for receiving the operation for described Text Entry, and in current interface, eject keyboard, Receive the text data by described input through keyboard.

Described device also includes: session display module 1004, is used in the current interface of described first terminal, Session show area is set, by described second terminal send instant communication information and receive by described The instant communication information that first terminal sends, according to the time order and function order of each instant communication information, by described Instant communication information shows in described session show area.

It addition, described device also includes:

Request module 1005, for initiating video calling request to first terminal.

Receiver module 1006, for receiving the pattern information that described first terminal sends.

Determine module 1007, for according to described pattern information, determine the call mould that described pattern information is corresponding The communication data not being transmitted under formula.

Processing module 1008 is for receiving the communication data that described first terminal sends and each to receive The communication data not being transmitted in communication data filters, to filter after communication data play out or Display.

Described receiver module 1006, is additionally operable to receive the Text Mode notification message that described first terminal sends, According to described Text Mode notification message, in the current interface of described second terminal, display text input control Part.

The embodiment of the present application also provides for a kind of multimodal video conversation apparatus, arranges in the server, such as figure Shown in 11, in fig. 11, multimodal video conversation apparatus includes:

Communication link block 1101, during the video calling for setting up at first terminal and the second terminal connects, According to the instant communication information received, set up the instant messaging between described first terminal and the second terminal even Connect;

Transport module 1102, for being connected by described instant messaging, server by receive described immediately Communication message is transmitted to the terminal of correspondence.

Described device also includes:

Forwarding module 1103, for receiving the video calling request that the second terminal sends, and by this video calling Request is forwarded to first terminal;

Receiver module 1104, for receiving the pattern information that described first terminal sends;

Determine module 1105, for according to described pattern information, determine the call mould that described pattern information is corresponding Formula;

Connection establishment module 1106, for according to described call mode, sets up described second terminal and first eventually Video calling between end connects.

Specifically, described connection establishment module 1106, it is not transmitted under described call mode for determining Communication data, receives each communication data that video calling is corresponding, determines described call according to described pattern information The communication data not being transmitted under pattern, the communication number not being transmitted in each communication data that will receive According to filtration, the communication data after filtering is sent to the second terminal.

In a typical configuration, calculating equipment includes one or more processor (CPU), input/defeated Outgoing interface, network interface and internal memory.

Internal memory potentially includes the volatile memory in computer-readable medium, random access memory (RAM) and/or the form such as Nonvolatile memory, such as read only memory (ROM) or flash memory (flash RAM). Internal memory is the example of computer-readable medium.

Computer-readable medium includes that removable media permanent and non-permanent, removable and non-can be by appointing Where method or technology realize information storage.Information can be computer-readable instruction, data structure, program Module or other data.The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), dynamic random access memory (DRAM), its The random access memory (RAM) of his type, read only memory (ROM), electrically erasable are read-only Memorizer (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette tape, tape magnetic Disk storage or other magnetic storage apparatus or any other non-transmission medium, can be used for storage can be calculated The information that equipment accesses.According to defining herein, computer-readable medium does not include temporary computer-readable matchmaker Body (transitory media), such as data signal and the carrier wave of modulation.

Also, it should be noted term " includes ", " comprising " or its any other variant are intended to non-row Comprising, so that include that the process of a series of key element, method, commodity or equipment not only include of his property Those key elements, but also include other key elements being not expressly set out, or also include for this process, The key element that method, commodity or equipment are intrinsic.In the case of there is no more restriction, statement " include One ... " key element that limits, it is not excluded that including the process of described key element, method, commodity or setting Other identical element is there is also in Bei.

It will be understood by those skilled in the art that embodiments herein can be provided as method, system or computer journey Sequence product.Therefore, the application can use complete hardware embodiment, complete software implementation or combine software and The form of the embodiment of hardware aspect.And, the application can use and wherein include calculating one or more The computer-usable storage medium of machine usable program code (include but not limited to disk memory, CD-ROM, Optical memory etc.) form of the upper computer program implemented.

The foregoing is only embodiments herein, be not limited to the application.For this area skill For art personnel, the application can have various modifications and variations.All institutes within spirit herein and principle Any modification, equivalent substitution and improvement etc. made, within the scope of should be included in claims hereof.

Claims (26)

1. a multimodal video call method, it is characterised in that including:
First terminal is set up after being connected with the video calling of the second terminal, current at described first terminal self Interface shows input text area;
Receive the text data of input in described input text area;
Described text data is sent to described second terminal in the way of instant communication information.
2. the method for claim 1, it is characterised in that comprise in described input text area and can grasp The Text Entry made;Receive the text data of input in described input text area, specifically include:
Receive the operation for described Text Entry, and in current interface, eject keyboard;
Receive the text data by described input through keyboard.
3. the method for claim 1, it is characterised in that in the current interface of described first terminal In, session show area is set;Described method also includes:
Receive the instant communication information that described second terminal sends;
Instant communication information that described first terminal is sent and being sent by described second terminal of receiving Instant communication information, according to each instant communication information time order and function order, by described instant communication information Display is in described session show area.
4. the method for claim 1, it is characterised in that first terminal is set up and the second terminal Video calling connects, and specifically includes:
First terminal receives the video calling request that the second terminal is initiated;
Display call mode control, and receive the call mode that user is selected by described call mode control; Wherein, described call mode includes: the call mode not being transmitted the voice data of described first terminal;
According to described call mode, set up and be connected with the video calling of described second terminal.
5. method as claimed in claim 4, it is characterised in that described call mode also includes: to institute State the video data of first terminal, text data terminal at least one be not transmitted.
6. method as claimed in claim 5, it is characterised in that according to described call mode, set up with The video calling of described second terminal connects, and specifically includes:
Determine the communication data not being transmitted under described call mode;Wherein, described communication data includes regarding At least one in frequency evidence, voice data, text data;
In the way of not transmitting the communication data determined, set up and be connected with the video calling of described second terminal.
7. method as claimed in claim 6, it is characterised in that not transmit the communication data that determines Transmission means, sets up and is connected with the video calling of described second terminal, specifically include:
When the communication data determined is video data, close the image collector of described first terminal self Put, and foundation is connected with the video calling of described second terminal;
When the communication data determined is voice data, close the audio collection dress of described first terminal self Put, and foundation is connected with the video calling of described second terminal;
When the communication data determined is text data, closes the input text area of described first terminal, and build Stand and be connected with the video calling of described second terminal.
8. method as claimed in claim 4, it is characterised in that according to described call mode, set up with The video calling of described second terminal connects, and specifically includes:
According to described call mode, set up by server and be connected with the video calling of described second terminal.
9. method as claimed in claim 8, it is characterised in that set up and described second by server The video calling of terminal connects, and specifically includes:
Described first terminal is by corresponding to pattern information corresponding for described call mode and video calling each logical News data are sent to server, make described server determine under described call mode not according to described pattern information The communication data mistake not being transmitted in the communication data being transmitted, and each communication data that will receive Filter, the communication data after filtering is sent to the second terminal.
10. method as claimed in claim 4, it is characterised in that according to described call mode, set up with The video calling of described second terminal connects, and specifically includes:
Described first terminal is by corresponding to pattern information corresponding for described call mode and video calling each logical News data are sent to described second terminal, make described second terminal determine described call according to described pattern information The communication data not being transmitted under pattern, and to the communication not being transmitted in each communication data received Data filter, and the communication data after filtering is played out or shown.
11. methods as claimed in claim 4, it is characterised in that described method also includes:
The communication data needing shielding selected by described call mode control according to user, shields described the Video data, voice data or the text data that two terminals send.
12. methods as claimed in claim 4, it is characterised in that described method also includes:
When described first terminal establishes after the video calling between described second terminal is connected, described first Terminal shows described call mode control in currently displayed interface;
According to the user the received call mode by the change of described call mode control, change current leading to Words pattern.
13. methods as claimed in claim 4, it is characterised in that described method also includes:
When described first terminal is under the call mode not transmitting voice data, described first terminal is to described Second terminal sends Text Mode notification message so that show that text is defeated in the current interface of described second terminal Enter district, to carry out instant communication information session.
14. 1 kinds of multimodal video conversation apparatus, it is characterised in that including:
Input text area module, sets up after being connected with the video calling of the second terminal, in institute for first terminal State in the current interface of first terminal and show input text area;
Received text module, for receiving the text data of input in described input text area;
Sending module, for sending described text data in the way of instant communication information to described second eventually End.
15. devices as claimed in claim 14, it is characterised in that comprising in described input text area can The Text Entry of operation;
Described received text module, specifically for receiving the operation for described Text Entry, and currently Interface is ejected keyboard, receives the text data by described input through keyboard.
16. devices as claimed in claim 14, it is characterised in that described device also includes: text exhibition Show module, in the current interface of described first terminal, session show area is set, by described first eventually Hold the instant communication information sent and the instant communication information sent by described second terminal received, According to the time order and function order of each instant communication information, described instant communication information is shown in described session exhibition Show in district.
17. devices as claimed in claim 14, it is characterised in that first terminal is set up and the second terminal Video calling connect time, described device also includes:
Receiver module, for receiving the video calling request that the second terminal is initiated;
Display module, is used for showing call mode control, and receives user by the choosing of described call mode control The call mode selected;Wherein, described call mode includes: do not carry out the voice data of described first terminal The call mode of transmission;
Connection establishment module, for according to described call mode, setting up the video calling with described second terminal Connect.
18. devices as claimed in claim 17, it is characterised in that described call mode also includes: right The video data of described first terminal, text data terminal at least one be not transmitted.
19. devices as claimed in claim 18, it is characterised in that described connection establishment module, specifically For determining the communication data not being transmitted under described call mode, not transmit the communication data that determines Mode, sets up and is connected with the video calling of described second terminal;
Wherein, at least one during described communication data includes video data, voice data, text data.
20. devices as claimed in claim 19, it is characterised in that described connection establishment module, specifically For when the communication data determined is video data, close the image collector of described first terminal self Put, and foundation is connected with the video calling of described second terminal;
When the communication data determined is voice data, close the audio collection dress of described first terminal self Put, and foundation is connected with the video calling of described second terminal;
When the communication data determined is text data, closes the keyboard of described first terminal self, and set up It is connected with the video calling of described second terminal.
21. devices as claimed in claim 17, it is characterised in that described connection establishment module, specifically For according to described call mode, set up by server and be connected with the video calling of described second terminal.
22. devices as claimed in claim 21, it is characterised in that described connection establishment module, specifically For each communication data corresponding to pattern information corresponding for described call mode and video calling is sent to Server, be not transmitted under described call mode leads to make described server determine according to described pattern information The communication data not being transmitted in news data, and each communication data that will receive filters, after filtering Communication data is sent to the second terminal.
23. devices as claimed in claim 17, it is characterised in that described connection establishment module, specifically For each communication data corresponding to pattern information corresponding for described call mode and video calling is sent to Described second terminal, makes described second terminal determine according to described pattern information and does not carries out under described call mode The communication data of transmission, and the communication data not being transmitted in each communication data received was carried out Filter, plays out the communication data after filtering or shows.
24. devices as claimed in claim 17, it is characterised in that described device also includes: shielding mould Block, for the communication data needing shielding selected by described call mode control according to user, shields institute State video data, voice data or text data that the second terminal sends.
25. devices as claimed in claim 17, it is characterised in that described display module, are additionally operable to work as Described first terminal establishes after the video calling between described second terminal is connected, current at first terminal Shown interface shows described call mode control, according to the user received by described call mode The call mode of control change, changes current call mode.
26. devices as claimed in claim 17, it is characterised in that described connection establishment module, also use In when described first terminal is under the call mode not transmitting voice data, described first terminal is to described Two terminals send Text Mode notification message so that show that text inputs in the current interface of described second terminal District, to carry out instant communication information session.
CN201510320247.6A 2015-06-11 2015-06-11 A kind of multimodal video call method and device CN106303350A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510320247.6A CN106303350A (en) 2015-06-11 2015-06-11 A kind of multimodal video call method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510320247.6A CN106303350A (en) 2015-06-11 2015-06-11 A kind of multimodal video call method and device

Publications (1)

Publication Number Publication Date
CN106303350A true CN106303350A (en) 2017-01-04

Family

ID=57660338

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510320247.6A CN106303350A (en) 2015-06-11 2015-06-11 A kind of multimodal video call method and device

Country Status (1)

Country Link
CN (1) CN106303350A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108063908A (en) * 2017-12-20 2018-05-22 维沃移动通信有限公司 A kind of video call method, device and mobile terminal
WO2018214614A1 (en) * 2017-05-26 2018-11-29 Cheung Shirley Shiu Ling A method of establishing a video call using multiple mobile communications devices

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR0153607B1 (en) * 1995-01-16 1998-11-16 김광호 Method of connecting a call of a videophone
US20030061285A1 (en) * 2001-09-25 2003-03-27 Tatsuo Usui Interactive communication system and method using an image
CN1473430A (en) * 2000-11-01 2004-02-04 奥林奇私人通讯服务有限公司 Mixed-media telecommunication call set-up
US20050208962A1 (en) * 2004-03-22 2005-09-22 Lg Electronics Inc. Mobile phone, multimedia chatting system and method thereof
CN101345962A (en) * 2008-08-15 2009-01-14 宇龙计算机通信科技(深圳)有限公司 Call mode switch control method, system and mobile terminal
US20090049395A1 (en) * 2007-08-16 2009-02-19 Lee Ha Youn Mobile communication terminal having touch screen and method of controlling the same
CN101742215A (en) * 2008-11-06 2010-06-16 乐金电子(中国)研究开发中心有限公司 Realization method, mobile terminal and system of video telephone

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR0153607B1 (en) * 1995-01-16 1998-11-16 김광호 Method of connecting a call of a videophone
CN1473430A (en) * 2000-11-01 2004-02-04 奥林奇私人通讯服务有限公司 Mixed-media telecommunication call set-up
US20030061285A1 (en) * 2001-09-25 2003-03-27 Tatsuo Usui Interactive communication system and method using an image
US20050208962A1 (en) * 2004-03-22 2005-09-22 Lg Electronics Inc. Mobile phone, multimedia chatting system and method thereof
US20090049395A1 (en) * 2007-08-16 2009-02-19 Lee Ha Youn Mobile communication terminal having touch screen and method of controlling the same
CN101345962A (en) * 2008-08-15 2009-01-14 宇龙计算机通信科技(深圳)有限公司 Call mode switch control method, system and mobile terminal
CN101742215A (en) * 2008-11-06 2010-06-16 乐金电子(中国)研究开发中心有限公司 Realization method, mobile terminal and system of video telephone

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018214614A1 (en) * 2017-05-26 2018-11-29 Cheung Shirley Shiu Ling A method of establishing a video call using multiple mobile communications devices
CN108063908A (en) * 2017-12-20 2018-05-22 维沃移动通信有限公司 A kind of video call method, device and mobile terminal

Similar Documents

Publication Publication Date Title
US10091345B2 (en) Media out interface
EP2680615A1 (en) Mobile terminal and audio zooming method thereof
US7228124B2 (en) Method and device for speeding up and simplifying information transfer between electronic devices
US9419923B2 (en) Method for sharing function between terminals and terminal thereof
US8498631B2 (en) Activation of applications based on vibration of portable electronic device
US20050101308A1 (en) Mobile station and a method for controlling the mobile station in conferencing mode for use in mobile communication system
CN101170601B (en) Method and device for communication between user device and IVR system
RU2562125C2 (en) Mobile terminal, display device and control method therefor
US20100042647A1 (en) Method and system for recording real-time communications
CN101350905A (en) Mobile terminal and method of creating multimedia contents therein
US20090287783A1 (en) Method of social interaction between communication device users
RU2431932C2 (en) Communication channel selection method and device
US9973506B2 (en) Method and apparatus for clearing notification icon, and storage medium
US8347216B2 (en) Mobile terminal and video sharing method thereof
RU2471223C2 (en) Mobile terminal and method to control communication data transfer and device to display list of communication in it
EP1986432B1 (en) Mobile communication device capable of storing video chatting log and operating method thereof
EP1920590B1 (en) Mobile wireless communication terminal and method for providing a slideshow
KR101942308B1 (en) Method for providing message function and an electronic device thereof
US7406167B2 (en) Exchange system and method using icons for controlling communications between plurality of terminals
EP2244430B1 (en) Mobile terminal and chat method in a mobile terminal using an instant messaging service
EP3110188A1 (en) Method and device for accessing operator network
JP6404937B2 (en) Call operation using IP multimedia subsystem
US20100153858A1 (en) Uniform virtual environments
AU2014201252B2 (en) Method and apparatus for providing state information
US9923845B2 (en) Terminal and method of having conversation using instant messaging service therein

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
C10 Entry into substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1233093

Country of ref document: HK

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20180814

Address after: 31119KY1 - 1205, Furong Road mailbox, 802 West Bay Road, Cayman Islands

Applicant after: Nail holding (Cayman) Limited

Address before: Cayman Islands Grand Cayman capital building a four storey No. 847 mailbox

Applicant before: Alibaba Group Holding Co., Ltd.