CN106454199A

CN106454199A - Video communication method and mobile terminal

Info

Publication number: CN106454199A
Application number: CN201610927432.6A
Authority: CN
Inventors: 谢莲花
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2016-10-31
Filing date: 2016-10-31
Publication date: 2017-02-22
Anticipated expiration: 2036-10-31
Also published as: CN106454199B

Abstract

The invention provides a video communication method and a mobile terminal. The video communication method includes the steps that in the video calling process with a second terminal, an image input window is displayed on a video calling interface; first image data stored in the image input window according to a first preset frame rate is obtained; second image data collected by a camera of the first terminal according to a second preset frame rate is obtained; the first image data and the second image data are subjected to synthesis processing to generate third image data; the third image data is sent to the second terminal. According to the technical scheme, a user can conduct real-time video communication and voice communication, graphs (like characters and images) drawn by the user, expression packages and pictures can also be transmitted by means of the communication assisting function of the image input window, accordingly information expression is more comprehensive and accurate, communication is more effective, and meanwhile fun of communication is improved.

Description

A kind of video communication method and mobile terminal

Technical field

The present invention relates to communication technical field, more particularly to a kind of video communication method and mobile terminal.

Background technology

In prior art, mainly include by way of mobile terminal is communicated：Text communication, voice communication and regard Frequency communication etc..Wherein, text communication is fairly simple, for the color that gives expression to one's sentiment in terms of compare shortage；Voice communication lacks image Information is less in linking up comprehensive；And video communication can link up compared to text communication and voice communication, the content expressed richer Richness, but it is limited to voice and real time imaging, it is impossible to accomplish that simultaneous transmission Word message and other clients need the image of transmission Information, also limit communication to a certain extent.

Content of the invention

A kind of video communication method and mobile terminal is embodiments provided, to solve in video communication not The problem of word or image information can be transmitted.

A kind of first aspect, there is provided video communication method, is applied to first terminal, and methods described includes：

Carrying out in video call process with second terminal, in video calling interface display image input window；

The first view data that described image input window is stored is obtained according to the first preset frame rate；

The second view data that the photographic head of the first terminal is gathered is obtained according to the second preset frame rate；

Described first image data and the second view data are carried out synthesis process, generates the 3rd view data；

3rd view data is sent to the second terminal.

A kind of second aspect, there is provided mobile terminal, is applied to first terminal, and the mobile terminal includes：

First display module, for carrying out in video call process with second terminal, in video calling interface display figure As input window；

First acquisition module, default according to first for obtaining the described image input window shown by the display module First view data of frame per second storage；

Second acquisition module, for obtaining the second figure that the photographic head of the first terminal is gathered according to the second preset frame rate As data；

Processing module, the first view data and second acquisition module for obtaining first acquisition module is obtained The second view data for taking carries out synthesis process, generates the 3rd view data；

Sending module, the 3rd view data for generating the processing module is sent to the second terminal.

So, in the embodiment of the present invention, by carrying out in video call process with second terminal, at video calling interface Display image input window；The first view data that described image input window is stored is obtained according to the first preset frame rate；Obtain The second view data that the photographic head of the first terminal is gathered according to the second preset frame rate；By described first image data and Two view data carry out synthesis process, generate the 3rd view data；3rd view data is sent to the second terminal, Real-time video communication and voice communication can be realized, additionally it is possible to by this subsidiary communications function of image input windows, transmit Figure (such as word, picture etc.) and some expression bags and picture etc. that user draws, make information representation more comprehensively, accurately, Make communication more efficient, while increased the enjoyment of communication.

Description of the drawings

In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, below will be to making needed for embodiment or description Accompanying drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for For those of ordinary skill in the art, without having to pay creative labor, which can also be obtained according to these accompanying drawings His accompanying drawing.

The flow chart that Fig. 1 represents the video communication method that first embodiment of the invention is provided；

The flow chart that Fig. 2 represents the video communication method that second embodiment of the invention is provided；

Fig. 3 represents the schematic diagram of the first view data of extraction provided in an embodiment of the present invention；

Fig. 4 represents the schematic diagram of the second view data of extraction provided in an embodiment of the present invention；

Fig. 5 represents the schematic diagram of the 3rd view data after synthesis provided in an embodiment of the present invention；

The flow chart that Fig. 6 represents the video communication method that third embodiment of the invention is provided；

Fig. 7 represents one of block diagram of mobile terminal that fourth embodiment of the invention is provided；

Fig. 8 represents the two of the block diagram of the mobile terminal that fourth embodiment of the invention is provided；

Fig. 9 represents the block diagram of the mobile terminal that fifth embodiment of the invention is provided；

Figure 10 represents the block diagram of the mobile terminal that sixth embodiment of the invention is provided.

Specific embodiment

Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation is described, it is clear that described embodiment is a part of embodiment of the present invention, rather than whole embodiments.Based on this Embodiment in bright, the every other enforcement obtained under the premise of creative work is not made by those of ordinary skill in the art Example, belongs to the scope of protection of the invention.

First embodiment

A kind of video communication method is embodiments provided, is applied to first terminal.As shown in figure 1, the video is logical Letter method includes：

Step 101, carrying out in video call process with second terminal, in video calling interface display image input window Mouthful.

The embodiment of the present invention is carried out in video call process with second terminal in first terminal, while regarding in first terminal Frequency call interface shows image input windows.User can be input into view data to be sent in the image input windows, its In, the mode of input is included but is not limited to：In image input windows hand drawn image (similar drawing board function) or by figure The picture for having stored or expression bag etc. are uploaded as the image of input window adds function.By increasing image input windows, this is auxiliary Communication function is helped, the content of video communication can be enriched further, make the content of video communication be not limited to regarding for photographic head collection Frequency image and voice, user can draw figure to be expressed according to demand, can so make information representation more comprehensive, accurate Really.

Wherein, video calling interface described here is for showing photographic head (photographic head of first terminal and/or second terminal Photographic head) interface of video image that gathers, the video image includes：Local terminal and/or the video image of opposite end.

Wherein, in order to avoid image input windows are blocked to video image, image input is set in the embodiment of the present invention Window is pellucidity, while for the position, size and the shape that recognize image input windows, can be in image input windows Edge arranges frame.Additionally, the position of image input windows and big I are adjusted according to user's request.

The first view data that step 102, acquisition image input windows are stored according to the first preset frame rate.

Wherein, image input windows can be stored thereon the image of drafting according to a preset frame rate (i.e. the first preset frame rate) Data.First preset frame rate can be system default value, also can be adjusted by user according to demand.

The second view data that step 103, the photographic head of acquisition first terminal are gathered according to the second preset frame rate.

Wherein, photographic head described here, for being used for during video calling gathering the photographic head of local terminal image, can be preposition Photographic head, or post-positioned pick-up head.

Wherein, the second preset frame rate can be identical with the first preset frame rate, also can be different, and concrete condition can be according to actual need Ask design.

Step 104, the first view data and the second view data are carried out synthesis process, generate the 3rd view data.

In the embodiment of the present invention, after the first view data and the second view data is got, two kinds of view data are entered The certain synthesis of row generates the 3rd view data after processing, that is, by the view data of two field picture input window storage and a frame The view data of photographic head collection synthesizes a frame and had not only included the first view data but also included through certain data handling procedure There are the new images of the second view data.

Step 105, the 3rd view data is sent to second terminal.

In this step, the 3rd view data for generating is sent to second terminal, so that second terminal is showing first eventually During the view data that end sends, the video image that first terminal photographic head shoots can either be shown, first terminal can be shown again The image that user is input into by image input windows.

Further, video communication method provided in an embodiment of the present invention also includes：Receive the 4th of second terminal transmission the View data, then the video image display window in video calling interface show the 4th view data.

Wherein, the 4th view data is：The 5th view data that the photographic head of second terminal is gathered and show second The 6th view data stored by image input windows in the video calling interface of terminal, the figure for generating after carrying out synthesis process As data.

In the embodiment of the present invention, the view data of user input is input in image input windows, right receiving During the composograph data that side sends, it is display window (the i.e. video image for showing the video image of photographic head shooting in script Display window) show.So, in addition to increasing image input windows at video calling interface, reduce to video as far as possible The change of call interface and the operating habit of user.

In sum, video communication method provided in an embodiment of the present invention, by carrying out video calling with second terminal During, in video calling interface display image input window；Obtain what image input windows were stored according to the first preset frame rate First view data；The second view data that the photographic head of first terminal is gathered is obtained according to the second preset frame rate；By the first figure As data and the second view data carry out synthesis process, the 3rd view data is generated；3rd view data is sent to described Two terminals, user not only can carry out real-time video communication and voice communication, additionally it is possible to which by image input windows, this is auxiliary Communication function is helped, figure (such as word, picture etc.) and expression bag and picture etc. of user's drafting is transmitted, so that information representation More comprehensively, accurately, make communication more efficient, while increased the enjoyment of communication.

Second embodiment

A kind of video communication method is embodiments provided, is applied to first terminal.As shown in Fig. 2 the video is logical Letter method includes：

Step 201, carrying out in video call process with second terminal, in video calling interface display image input window Mouthful.

The embodiment of the present invention is in first terminal with second terminal when video calling is carried out, while the video in first terminal Call interface shows image input windows, and user can be input into view data to be sent in the image input windows.Wherein, The mode of input is included but is not limited to：In image input windows hand drawn image (similar drawing board function) or defeated by image The image for entering window adds picture or bag etc. of expressing one's feelings that function upload has been stored.Led to by increasing this auxiliary of image input windows Telecommunication function, can enrich the content of video communication further, make the content of video communication be not limited to the video figure of photographic head collection Picture and voice, user can draw figure to be expressed according to demand, can so make information representation more comprehensively, accurately.

Operation is drawn in the track of step 202, detection first terminal user in image input windows.

In the embodiment of the present invention, the input mode that preferred manual is drawn.User can be in image input windows hand drawn figure As (similar drawing board function), to enrich communication further, effective communication is realized, enjoyment is linked up in lifting.

Wherein, user is in image input windows drawing image, and operation is drawn in the track of system real-time detection user, so as to Record to drawing rail.

Step 203, according to the first preset frame rate, the corresponding track of operation is drawn in the track for detecting and is stored as the first figure As data.

In this step, according to the first preset frame rate, the corresponding track of operation is drawn in the track for detecting and is stored as first View data.Wherein, the color of track drafting and width can be voluntarily arranged by user.

Wherein, when the first view data is stored, the first view data of each frame that can preserve image input windows is deposited It is stored in the first memory area.First memory area can be a memory area in random access memory, or its A memory area in his memorizer, concrete condition can be selected according to the actual requirements.

Wherein, first preset frame rate can be system default value, also can be adjusted by user according to demand.

The first view data that step 204, acquisition image input windows are stored according to the first preset frame rate.

In the embodiment of the present invention, in demand, the first view data that image input windows are stored can be obtained.

The second view data that step 205, the photographic head of the acquisition first terminal are gathered according to the second preset frame rate.

Wherein, second preset frame rate can be system default value, also can be adjusted by user according to demand.

Wherein, the second view data described in each frame that can gather the photographic head of first terminal is stored in the second memory block In domain.First memory area can be in a memory area, or other memorizeies in random access memory Individual memory area, concrete condition can be selected according to the actual requirements.Second view data is stored respectively with the first view data, Be for the ease of processing to the first view data and the second view data.

Preferably, the frame per second of photographic head collection video image is identical with the frame per second that track drafting is preserved, i.e., first presets frame Rate is identical with the second preset frame rate, and the image that the image path of preservation can be so shot with photographic head has preferably synchronous Property, so that other side can see the figure that first terminal user draws in real time.

Step 206, for the first view data of each frame in the first memory area, extract the view data of odd-numbered line.

Step 207, for the second view data of each frame in the second memory area, extract the view data of even number line.

In the embodiment of the present invention, adopted by step 206 and the first view data of step 207 pair and the second view data folded Computation system is processed, i.e., the first view data and the second view data are extracted, as shown in Figure 3 and Figure 4, cloudy in Fig. 3 The view data of the odd-numbered line that shadow part is extracted by the first view data, the dash area in Fig. 4 is the second view data institute Then the view data of extraction is reconfigured by the view data of the even number line of extraction, generates new view data, so, no The increase of data volume can be caused, and the transmission pressure of network-side is not resulted in during transmission yet, ensure that the fluency of video calling.

Will be understood is, for the first view data of each frame in the first memory area, can also extract even number line View data；For the second view data of each frame in the second memory area, the view data of odd-numbered line can be also extracted.Tool Body situation, can be selected according to the actual requirements.

Step 208, by the view data of the odd-numbered line for extracting and even number line according to the affiliated line number of each view data before extracting Order synthesized, generate the 3rd view data.

In the embodiment of the present invention, then after extracting to the first view data and the second view data, will extract image Data are reconfigured, and generate new view data, as shown in Figure 5.So, the increase of data volume is not resulted in, during transmission not yet The transmission pressure of network-side can be caused, ensure that the fluency of video calling.

Wherein, for ease of extraction and subsequent recombination, the first view data and the second view data can be stored as identical Size, it is assumed that the first photographic head collection frame data be 1200*1600, then in the first memory area with the first memory area in View data all keep the size of 1200*1600, the view data less than 1200*1600 can be made up using zero padding method.

Step 209, the 3rd view data is stored in the 3rd memory area.

In this step, the 3rd newly-generated view data is stored in the 3rd memory area.First memory area can To be a memory area in a memory area, or other memorizeies in random access memory, concrete condition can Select according to the actual requirements.

Step 210, the 3rd view data is sent to the second terminal.

For further understanding video communication method provided in an embodiment of the present invention, it is illustrated with an example below：

Assume that user A and user B is carrying out video calling, the mobile terminal that user A is used is that first terminal, user B makes Mobile terminal is second terminal.First terminal gathers video image using front-facing camera, leads in the video of first terminal The lower right at words interface shows image input windows, and user A just draws a smiling face in the image input windows, in smiling face Drawing process in, image input windows store smiling face's image of user's drafting according to the storage frame per second of 60 frame per second, at the same before Photographic head is put also according to the acquisition frame rate collection video image of 60 frame per second.First terminal by image input windows store each Each frame video image of frame smiling face image and front-facing camera collection carries out synthesis process, that is, extract each frame smiling face image Odd row data, extracts the even number of lines evidence of each frame video image, then reconfigures the view data of extraction, generates one The new video image of frame is sent to second terminal.When second terminal receives the video image of first terminal transmission, in video figure As display window shows the video image, the image that the front-facing camera of existing first terminal shoots in the video image, and With smiling face's image that user A draws, as the video image frame number of display per second is more and human eye resolving ability effective, because This user B can be seen that user A draws the process of smiling face, increased the enjoyment of communication.

Further, the embodiment of the present invention is to ensure that the image that user is drawn in image input windows can show that completely Track, therefore in image rendering process, to not only preserve the touch point trace information in present image input window, also need Retain historical touch locus of points information, its implementation is：

The touch locus of points that detection user is input in the corresponding touch area of image input windows, and will be currently detected Track saves as first view data of frame with historical track after merging.

Specifically, the first view data of former frame before preserving present frame first can be obtained, then will be currently detected Track data be superimposed to the first view data for obtaining present frame in the historical track in the first view data of former frame.Example Such as, the station location marker for arranging in each the first view data of frame with drawing image data is 1, and blank position is designated 0, After preserving first view data of frame, before a later frame data are not preserved, view data in the first current memory area of retaking of a year or grade, If the first view data of former frame position to be covered be designated 1, do not covered；If position to be covered be designated 0, Covered, can thus be preserved the prolonged track drafting of user.If necessary to remove current track, user can manually select Erasing rubber function, clashes track, and corresponding view data in the first memory area is reset, so can be to image input windows In image rendering area recycling, also allow for user and image modified and perfect.

Further, video communication method provided in an embodiment of the present invention also includes：Receive the 4th of second terminal transmission the View data, the video image display window in video calling interface shows the 4th view data.

In sum, the method for video communication provided in an embodiment of the present invention, by with second terminal carry out video lead to During words, in video calling interface display image input window, rail of the first terminal user in image input windows is detected Mark draws operation, according to the first preset frame rate, the corresponding track of operation is drawn in the track for detecting and is stored as the first picture number According to, the first view data that acquisition image input windows are stored according to the first preset frame rate, obtain the shooting of the first terminal The second view data that head is gathered according to the second preset frame rate, for the first view data of each frame in the first memory area, The view data of odd-numbered line is extracted, for the second view data of each frame in the second memory area, extracts the image of even number line Data, the view data of the odd-numbered line of extraction and even number line is closed according to the order of the affiliated line number of each view data before extracting Become, the 3rd view data is generated, the 3rd view data is stored in the 3rd memory area, the 3rd view data is sent to institute State second terminal, user not only can carry out real-time video communication and voice communication, additionally it is possible to by image input windows this One subsidiary communications function, transmits the figure (such as word, picture etc.) of user's drafting, so that information representation is more comprehensively, accurately, Make communication more efficient, while increased the enjoyment of communication.Further, by the first view data and the second view data It is overlapped processing, data volume to be transmitted is reduced, reduces the transmission pressure of network-side, it is ensured that the smoothness of video calling Degree.

3rd embodiment

A kind of video communication method is embodiments provided, is applied to first terminal.As shown in fig. 6, the video is logical Letter method includes：

Step 601, carrying out in video call process with second terminal, in video calling interface display image input window Mouthful.

The embodiment of the present invention is when first terminal carries out video calling with second terminal, while the video in first terminal leads to Words one image input windows of interface display, user can be input into view data to be sent in the image input windows.Wherein, defeated The mode for entering is included but is not limited to：It is input in image input windows hand drawn image (similar drawing board function) or by image The image of window adds function and uploads the picture for having stored or expression bag etc..By increasing this subsidiary communications of image input windows Function, can enrich the content of video communication further, make the content of video communication be not limited to the video image of photographic head collection And voice, user can draw figure to be expressed according to demand, can so make information representation more comprehensively, accurately.

Operation is drawn in the track of step 602, detection first terminal user in image input windows.

Step 603, according to the first preset frame rate, the corresponding track of operation is drawn in the track for detecting and is stored as the first figure As data.

The first view data that step 604, acquisition image input windows are stored according to the first preset frame rate.

The second view data that step 605, the photographic head of the acquisition first terminal are gathered according to the second preset frame rate.

Step 606, for the second view data of each frame for being stored in the second memory area, determine corresponding described image Input window has the region of track drafting.

Step 607, will be in the second view data, the view data in the region of corresponding track drafting is replaced with and is stored in institute The first view data in the first memory area is stated, generates the 3rd view data.

In the embodiment of the present invention, adopted by step 606 and the first view data of step 607 pair and the second view data embedding Enter algorithm to be processed, will the second view data of each frame correspond to track drafting region in view data replace with the first figure As data, that is, area image replacement process is carried out, so, data volume to be transmitted can be reduced, reduce the biography of network-side Defeated pressure, it is ensured that the fluency of video calling.

Step 608, the 3rd view data is stored in the 3rd memory area.

Step 609, the 3rd view data is sent to the second terminal.

Assume that user A and user B is carrying out video calling, the mobile terminal that user A is used is that first terminal, user B makes Mobile terminal is second terminal.First terminal gathers video image using front-facing camera, leads in the video of first terminal The lower right at words interface shows image input windows, and user A just draws a smiling face in the image input windows, in smiling face Drawing process in, image input windows store smiling face's image of user's drafting according to the storage frame per second of 60 frame per second, at the same before Photographic head is put also according to the acquisition frame rate collection video image of 60 frame per second.First terminal by image input windows store each Each frame video image of frame smiling face image and front-facing camera collection carries out synthesis process, will each video image correspond to and paint View data in smiling face track regions processed replaces with smiling face's view data, synthesizes the new video image of a frame and sends to second eventually End.When second terminal receives the video image of first terminal transmission, show the video image in video image display window, The image that in the video image, the front-facing camera of existing first terminal shoots, and the smiling face's image that draws with user A, due to The more and human eye resolving ability of video image frame number of display per second is effective, and therefore user B can be seen that user A draws smiling face's Process, increased the enjoyment of communication.

In sum, the method for video communication provided in an embodiment of the present invention, by with second terminal carry out video lead to During words, in video calling interface display image input window, rail of the first terminal user in image input windows is detected Mark draws operation, according to the first preset frame rate, the corresponding track of operation is drawn in the track for detecting and is stored as the first picture number According to, the first view data that acquisition image input windows are stored according to the first preset frame rate, obtain the shooting of the first terminal The second view data that head is gathered according to the second preset frame rate, for the second image of each frame for being stored in the second memory area Data, determine that corresponding described image input window has the region of track drafting, by the second view data, correspond to track drafting Region in view data replace with the first view data being stored in first memory area, generate the 3rd picture number According to, the 3rd view data being stored in the 3rd memory area, the 3rd view data is sent to the second terminal, user is not Real-time video communication and voice communication can only be carried out, additionally it is possible to by this subsidiary communications function of image input windows, pass The figure (such as word, picture etc.) that defeated user draws, so that information representation is more comprehensively, accurately, makes communication more efficient, with The enjoyment of Shi Zengjia communication.Further, by carrying out at area image replacement to the first view data and the second view data Reason, reduces data volume to be transmitted, reduces the transmission pressure of network-side, it is ensured that the fluency of video calling.

Fourth embodiment

A kind of mobile terminal 700 is embodiments provided, first terminal is applied to, first embodiment can be realized to The details of the video communication method described in three embodiments, and reach identical effect.As shown in fig. 7, the mobile terminal 700 is wrapped Include：

First display module 701, for carrying out in video call process with second terminal, in video calling interface display Image input windows.

The embodiment of the present invention is carried out in video call process with second terminal in first terminal, while regarding in first terminal Frequency call interface shows image input windows by the first display module 701.User can be input in the image input windows View data to be sent, wherein, the mode of input is included but is not limited to：(similar in image input windows hand drawn image Drawing board function) or adding function by the image of image input windows uploads the picture for having stored or expression bag etc..By increasing Plus this subsidiary communications function of image input windows, the content of video communication can be enriched further, make the content of video communication not Video image and the voice of photographic head collection is confined to, user can draw figure to be expressed according to demand, can so make Information representation is more comprehensively, accurately.

First acquisition module 702, for obtain the first display module 701 shown by image input windows pre- according to first If the first view data of frame per second storage.

Wherein, image input windows can be stored thereon the image of drafting according to a preset frame rate (i.e. the first preset frame rate) Data.The first view data of image input windows storage can be obtained by the first acquisition module 702 in demand.This is first pre- If frame per second can be system default value, also it can be adjusted by user according to demand.

Second acquisition module 703, for obtaining the second figure that the photographic head of first terminal is gathered according to the second preset frame rate As data.

Wherein, the second view data can be obtained by the second acquisition module 703 in demand.

Photographic head described here, for being used for during video calling gathering the photographic head of local terminal image, can be preposition shooting Head, or post-positioned pick-up head.

Processing module 704, for the first view data for obtaining the first acquisition module 702 and the second acquisition module 703 The second view data for obtaining carries out synthesis process, generates the 3rd view data.

In the embodiment of the present invention, got the first view data and obtained by the two the second by the first acquisition module 702 After module 703 gets the second view data, by processing module 704 by two kinds of view data carry out certain synthesize after process generate 3rd view data, that is, the view data that the view data of two field picture input window storage and a frame photographic head are gathered Through certain data handling procedure, synthesize a frame and not only included the first view data but also included the new figure of the second view data Picture.

Sending module 705, the 3rd view data for generating processing module 704 is sent to second terminal.

Wherein, sending module 705 sends the 3rd view data for generating to second terminal, so that second terminal is showing During the view data that first terminal sends, the video image that first terminal photographic head shoots can either be shown, the can be shown again The image that one terminal use is input into by image input windows.

Further, as shown in figure 8, the mobile terminal 700 also includes：

Detection module 706, operates for detecting that track of the first terminal user in image input windows is drawn.

Wherein, the color of track drafting and width can be voluntarily arranged by user.

First memory module 707, for according to the first preset frame rate, behaviour is drawn in the track that detection module 706 is detected Make corresponding track and be stored as the first view data.

In the embodiment of the present invention, by the first memory module 707, operation is drawn in the track that detection module 706 is detected and correspond to Track be stored as the first view data.

Further, as shown in figure 8, the mobile terminal 700 also includes：

Second memory module 708, the first view data of each frame for preserving image input windows is stored in first In memory area.

Wherein, when the second memory module 708 stores the first view data, can be by each frame of image input windows preservation First view data is stored in the first memory area.First memory area can be a memory block in random access memory A memory area in domain, or other memorizeies, concrete condition can be selected according to the actual requirements.

Further, as shown in figure 8, the mobile terminal 700 also includes：

3rd memory module 709, the second view data of each frame for gathering the photographic head of first terminal is stored in In second memory area.

Wherein, the second image described in each frame that the photographic head of first terminal can be gathered by the 3rd memory module 709 Data storage is in the second memory area.First memory area can be a memory area in random access memory, also may be used To be a memory area in other memorizeies, concrete condition can be selected according to the actual requirements.Second view data and first View data is stored respectively, be for the ease of processing to the first view data and the second view data.

Further, as shown in figure 8, processing module 704 includes：

First processing units 7041, for for the first view data of each frame in the first memory area, extracting odd number The view data of row.

First processing units 7041, for for the second view data of each frame in the second memory area, extracting even number The view data of row.

In the embodiment of the present invention, the first view data and the second view data are processed using superposition algorithm, that is, is led to Cross and first processing units 7041 and 7,041 first view data of first processing units and the second view data are extracted (as schemed Shown in 3 and Fig. 4), then the view data of extraction is reconfigured, new view data is generated, so, does not result in data volume Increase, do not result in the transmission pressure of network-side during transmission yet, ensure that the fluency of video calling.

3rd processing unit 7043, for the odd-numbered line that extracts first processing units 7041 and second processing unit 7042 The view data of the even number line of extraction is synthesized according to the order of the affiliated line number of each view data before extracting, and generates the 3rd image Data.

In the embodiment of the present invention, then after extracting to the first view data and the second view data, processed by the 3rd single The view data of extraction is reconfigured by unit 7043, generates new view data, as shown in Figure 5.So, data volume is not resulted in Increase, do not result in the transmission pressure of network-side during transmission yet, ensure that the fluency of video calling.

First memory element 7044, the 3rd view data for generating the 3rd processing unit 7043 is stored in the 3rd and deposits In storage area domain.

Wherein, by the first memory element 7044, the 3rd newly-generated view data is stored in the 3rd memory area. First memory area can be a storage in a memory area, or other memorizeies in random access memory Region, concrete condition can be selected according to the actual requirements.

Further, as shown in figure 8, processing module 704 includes：

Determining unit 7045, for for the second view data of each frame for being stored in the second memory area, it is right to determine Image input windows are answered to have the region of track drafting.

Fourth processing unit 7046, for by the second view data, corresponding to the view data in the region of track drafting The first view data being stored in the first memory area is replaced with, generates the 3rd view data.

In the embodiment of the present invention, the first view data and the second view data are processed using embedded mobile GIS, will The view data that the second view data of each frame is corresponded in track drafting region replaces with the first view data, that is, carries out area Area image replacement is processed, and so, can be reduced data volume to be transmitted, be reduced the transmission pressure of network-side, it is ensured that video calling Fluency.

Second memory element 7047, for the 3rd view data is stored in the 3rd memory area.

Wherein, by the second memory element 7047, the 3rd view data for generating is sent to second terminal, so that second Terminal can either show, when the view data of first terminal transmission is shown, the video image that first terminal photographic head shoots, and The image that first terminal user is input into can be shown by image input windows.

Further, as shown in figure 8, the mobile terminal 700 also includes：

Receiver module 710, for receiving the 4th view data of second terminal transmission.

Second display module 711, shows receiver module institute for the video image display window in video calling interface The 4th view data for receiving.

To sum up shown, mobile terminal provided in an embodiment of the present invention 700, by the first display module 701 in video calling Show image input windows in interface, then the first figure that image input windows are stored is obtained by the first acquisition module 702 The second view data of first terminal photographic head collection is obtained as data and by the second acquisition module 703, subsequently by place Reason module 704 will carry out synthesis process, generate the 3rd view data, send out the 3rd view data finally by sending module 705 Receiving terminal (i.e. second terminal) is delivered to, such user not only can carry out real-time video communication and voice communication, additionally it is possible to logical Cross this subsidiary communications function of image input windows, transmit the figure (such as word, picture etc.) of user's drafting and expression bag and Picture etc., so that information representation is more comprehensively, accurately, makes communication more efficient, while increased the enjoyment of communication.

5th embodiment

Fig. 9 is the block diagram of the mobile terminal of another embodiment of the present invention.Mobile terminal 900 shown in Fig. 9 includes：At least One processor 901, memorizer 902, at least one network interface 904 and user interface 903.Wherein, mobile terminal 900 is also wrapped Include：Front-facing camera and post-positioned pick-up head.

Each component in mobile terminal 900 is coupled by bus system 905.It is understood that bus system 905 is used In realizing the connection communication between these components.Bus system 905 also includes power bus, control in addition to data/address bus is included Bus processed and status signal bus in addition.But for the sake of clear explanation, in fig .9 various buses are all designated as bus system 905.

Wherein, user interface 903 can include display, keyboard or pointing device (for example, mouse, trace ball (trackball), touch-sensitive plate or touch screen etc..

It is appreciated that the memorizer 902 in the embodiment of the present invention can be volatile memory or nonvolatile memory, Or may include volatibility and nonvolatile memory.Wherein, nonvolatile memory can be read only memory (Read- Only Memory, ROM), programmable read only memory (Programmable ROM, PROM), the read-only storage of erasable programmable Device (Erasable PROM, EPROM), Electrically Erasable Read Only Memory (Electrically EPROM, EEPROM) or Flash memory.Volatile memory can be random access memory (Random Access Memory, RAM), and which is used as outside height Speed caching.By exemplary but be not restricted explanation, the RAM of many forms can use, such as static RAM (Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), Synchronous Dynamic Random Access Memory (Synchronous DRAM, SDRAM), double data speed synchronous dynamic RAM (Double Data Rate SDRAM, DDRSDRAM), enhancement mode Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronized links Dynamic random access memory (Synchlink DRAM, SLDRAM) and direct rambus random access memory (Direct Rambus RAM, DRRAM).The memorizer 902 of system and method described herein be intended to including but not limited to these and arbitrarily its It is suitable for the memorizer of type.

In some embodiments, memorizer 902 stores following element, executable module or data structure, or Their subset of person, or their superset：Operating system 9021 and application program 9022.

Wherein, operating system 9021, comprising various system programs, for example ccf layer, core library layer, driving layer etc., are used for Realize various basic businesses and process hardware based task.Application program 9022, comprising various application programs, such as media Player (Media Player), browser (Browser) etc., for realizing various applied business.Realize the embodiment of the present invention The program of method is may be embodied in application program 9022.

In embodiments of the present invention, by call memorizer 902 store program or instruction, specifically, can be application The program for storing in program 9022 or instruction, user interface 903 is used for carrying out, in video call process, regarding with second terminal Frequency call interface display image input window, processor 901 is stored according to the first preset frame rate for obtaining image input windows The first view data and first terminal the second view data for gathering according to the second preset frame rate of photographic head；Then by One view data and the second view data carry out synthesis process, generate the 3rd view data, and pass through network interface 904 by the 3rd View data is sent to second terminal.

The method that the embodiments of the present invention are disclosed is can apply in processor 901, or is realized by processor 901. Processor 901 is probably a kind of IC chip, the disposal ability with signal.During realization, said method each Step can be completed by the instruction of the integrated logic circuit of the hardware in processor 901 or software form.Above-mentioned process Device 901 can be general processor, digital signal processor (Digital Signal Processor, DSP), special integrated electricity Road (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field Programmable Gate Array, FPGA) or other PLDs, discrete gate or transistor logic, Discrete hardware components.Can realize or execute disclosed each method in the embodiment of the present invention, step and logic diagram.General Processor can be microprocessor or the processor can also be any conventional processor etc..In conjunction with embodiment of the present invention institute The step of disclosed method, can be embodied directly in hardware decoding processor and execute and complete, or with the hardware in decoding processor And software module combination execution is completed.Software module may be located at random access memory, flash memory, read only memory, may be programmed read-only In the storage medium of this area such as memorizer or electrically erasable programmable memory, depositor maturation.The storage medium is located at Memorizer 902, processor 901 reads the information in memorizer 902, the step of complete said method in conjunction with its hardware.

It is understood that embodiments described herein can use hardware, software, firmware, middleware, microcode or its Combine to realize.Hardware is realized, processing unit can be implemented in one or more special IC (Application Specific Integrated Circuits, ASIC), digital signal processor (Digital Signal Processing, DSP), digital signal processing appts (DSP Device, DSPD), programmable logic device (Programmable Logic Device, PLD), field programmable gate array (Field-Programmable Gate Array, FPGA), general processor, Controller, microcontroller, microprocessor, for executing in other electronic units of herein described function or its combination.

Software is realized, can be realized herein by the module (such as process, function etc.) of execution function described herein Described technology.Software code is storable in memorizer and by computing device.Memorizer can within a processor or Realize outside processor.

Alternatively, processor 901 is additionally operable to：Detection first terminal user draws the track in described image input window Operation, according to first preset frame rate, the corresponding track of operation is drawn in the track for detecting and is stored as described second View data.

Alternatively, memorizer 902 is used for：Each frame described first image data that described image input window is preserved are deposited It is stored in the first memory area.

Alternatively, memorizer 902 is used for：Second picture number described in each frame that the photographic head of the first terminal is gathered According to being stored in the second memory area.

Alternatively, processor 901 is additionally operable to：For the first view data of each frame in first memory area, take out Take the view data of odd-numbered line；For the second view data of each frame in second memory area, the figure of even number line is extracted As data；And by the view data of the odd-numbered line for extracting and even number line according to before extracting the affiliated line number of each view data suitable Sequence is synthesized, and generates the 3rd view data；Then the 3rd view data is stored in by the 3rd storage by memorizer 902 In region.

Alternatively, processor 901 is additionally operable to：For the second picture number of each frame for being stored in second memory area According to the corresponding described image input window of determination has the region of track drafting；By in second view data, correspond to and draw rail View data in the region of mark replaces with the first view data being stored in first memory area, generates the 3rd image Data；Then by memorizer 902, the 3rd view data is stored in the 3rd memory area.

Alternatively, network interface 904 is used for receiving the 4th view data of second terminal transmission；Then pass through user Video image display window of the interface 903 in video calling interface shows the 4th view data.Wherein, the 4th figure As data are：The 5th view data that the photographic head of the second terminal is gathered and display are led in the video of the second terminal The 6th view data stored by image input windows in words interface, the view data for generating after carrying out synthesis process.

Mobile terminal 900 can realize each process that in previous embodiment, mobile terminal is realized, for avoiding repeating, here Repeat no more.

Mobile terminal provided in an embodiment of the present invention 900, is carrying out video calling by user interface 903 with second terminal During, in video calling interface display image input window, processor 901 obtains image input windows and presets frame according to first The second view data that the photographic head of the first view data of rate storage and first terminal is gathered according to the second preset frame rate；So Afterwards the first view data and the second view data are carried out synthesis process, the 3rd view data is generated, and passes through network interface 904 3rd view data is sent to second terminal, user not only can carry out real-time video communication and voice communication, additionally it is possible to By this subsidiary communications function of image input windows, figure (such as word, picture etc.) and the expression bag of user's drafting is transmitted With picture etc., so that information representation is more comprehensively, accurately, make communication more efficient, while increased the enjoyment of communication.

Sixth embodiment

Figure 10 is the structural representation of the mobile terminal of another embodiment of the present invention.Specifically, the mobile end in Figure 10 End 1000 can be mobile phone, panel computer, personal digital assistant (Personal Digital Assistant, PDA) or vehicle-mounted Computer etc..

Mobile terminal 1 000 in Figure 10 include radio frequency (Radio Frequency, RF) circuit 1001, memorizer 1002, Input block 1003, display unit 1004, processor 1006, voicefrequency circuit 1007, WiFi (Wireless Fidelity) module 1008th, power supply 1009 and component 1010 of taking pictures.

Wherein, component 1010 of taking pictures includes：Front-facing camera and post-positioned pick-up head.

Wherein, input block 1003 can be used for numeral or the character information of receiving user's input, and produce whole with mobile The user setup at end 1000 and the relevant signal input of function control.Specifically, in the embodiment of the present invention, the input block 1003 can include contact panel 10031.Contact panel 10031, also referred to as touch screen, can collect user thereon or neighbouring Touch operation (such as user is using any suitable object such as finger, stylus or operation of the adnexa on contact panel 10031), And corresponding attachment means are driven according to formula set in advance.Optionally, contact panel 10031 may include touch detecting apparatus With two parts of touch controller.Wherein, touch detecting apparatus detect the touch orientation of user, and detect what touch operation brought Signal, transmits a signal to touch controller；Touch controller receives touch information from touch detecting apparatus, and it is changed Become contact coordinate, then the processor 1006 is given, and the order sent of receiving processor 1006 can be executed.Additionally, can To realize contact panel 10031 using the polytype such as resistance-type, condenser type, infrared ray and surface acoustic wave.Except touch surface Plate 10031, input block 1003 can also include other input equipments 10032, other input equipments 10032 can include but not The one kind being limited in physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, action bars etc. Or it is multiple.

Wherein, display unit 1004 can be used for display by the information of user input or be supplied to information and the movement of user The various menu interfaces of terminal 1000.Display unit 1004 may include display floater 10041, optionally, can adopt LCD or have The forms such as machine light emitting diode (Organic Light-Emitting Diode, OLED) are configuring display floater 10041.

It should be noted that contact panel 10031 can cover display floater 10041, touch display screen is formed, when the touch shows Screen is detected thereon or after neighbouring touch operation, sends processor 1006 to determine the type of touch event, is subsequently located Reason device 1006 provides corresponding visual output according to the type of touch event in touch display screen.

Touch display screen includes Application Program Interface viewing area and conventional control viewing area.The Application Program Interface viewing area And the arrangement mode of the conventional control viewing area is not limited, can be arranged above and below, left-right situs etc. can be distinguished two and show Show the arrangement mode in area.The Application Program Interface viewing area is displayed for the interface of application program.Each interface is permissible The interface element such as the icon comprising at least one application program and/or widget desktop control.The Application Program Interface viewing area It can also be the empty interface not comprising any content.The conventional control viewing area is used for showing the higher control of utilization rate, for example, Application icons such as settings button, interface numbering, scroll bar, phone directory icon etc..

Wherein, processor 1006 is the control centre of mobile terminal 1 000, using various interfaces and the whole handss of connection The various pieces of machine, by running or executing software program and/or the module being stored in first memory 10021, and adjust With the data being stored in second memory 10022, various functions and the processing data of mobile terminal 1 000 is executed, so as to moving Dynamic terminal 1000 carries out integral monitoring.Optionally, processor 1006 may include one or more processing units.

In embodiments of the present invention, by calling software program and/or the module for storing in the first memory 10021 And/or the data in the second memory 10022, display unit 1004 is for carrying out video call process with second terminal In, in video calling interface display image input window, processor 1006 is default according to first for obtaining image input windows The second view data that the photographic head of the first view data of frame per second storage and first terminal is gathered according to the second preset frame rate； Then the first view data and the second view data are carried out synthesis process, generates the 3rd view data, and by the 3rd picture number According to transmission to second terminal.

Alternatively, processor 1006 is additionally operable to：Detection track of the first terminal user in described image input window is painted System operation, according to first preset frame rate, the corresponding track of operation is drawn in the track for detecting and is stored as described the Two view data.

Alternatively, memorizer 1002 is used for：Each frame described first image data that described image input window is preserved It is stored in the first memory area.

Alternatively, memorizer 1002 is used for：Second image described in each frame that the photographic head of the first terminal is gathered Data storage is in the second memory area.

Alternatively, processor 1006 is additionally operable to：For the first view data of each frame in first memory area, take out Take the view data of odd-numbered line；For the second view data of each frame in second memory area, the figure of even number line is extracted As data；And by the view data of the odd-numbered line for extracting and even number line according to before extracting the affiliated line number of each view data suitable Sequence is synthesized, and generates the 3rd view data；Then by memorizer 1002, the 3rd view data is stored in the 3rd to deposit In storage area domain.

Alternatively, processor 1006 is additionally operable to：For the second image of each frame for being stored in second memory area Data, determine that corresponding described image input window has the region of track drafting；By in second view data, correspond to and draw View data in the region of track replaces with the first view data being stored in first memory area, generates the 3rd figure As data；Then by memorizer 1002, the 3rd view data is stored in the 3rd memory area.

Alternatively, processor 1006 is additionally operable to：Receive the 4th view data of second terminal transmission；Then by aobvious Show that video image display window of the unit 1004 in video calling interface shows the 4th view data.Wherein, described Four view data are：The 5th view data that the photographic head of the second terminal is gathered and display regarding in the second terminal The 6th view data stored by image input windows in frequency call interface, the view data for generating after carrying out synthesis process.

It can be seen that, mobile terminal 1 provided in an embodiment of the present invention 000, carried out with second terminal by display unit 1004 In video call process, in video calling interface display image input window, processor 1006 obtain image input windows according to First preset frame rate storage the first view data and first terminal photographic head gather according to the second preset frame rate second View data；Then the first view data and the second view data are carried out synthesis process, generates the 3rd view data, and by the Three view data are sent to second terminal, and user not only can carry out real-time video communication and voice communication, additionally it is possible to pass through This subsidiary communications function of image input windows, transmits figure (such as word, picture etc.) and expression bag and the figure of user's drafting Piece etc., so that information representation is more comprehensively, accurately, makes communication more efficient, while increased the enjoyment of communication.

Those of ordinary skill in the art are it is to be appreciated that with reference to each of the embodiment description disclosed in the embodiment of the present invention The unit of example and algorithm steps, being capable of being implemented in combination in electronic hardware or computer software and electronic hardware.These Function is executed with hardware or software mode actually, the application-specific depending on technical scheme and design constraint.Specialty Technical staff can use different methods to realize described function to each specific application, but this realization should Think beyond the scope of this invention.

Those skilled in the art can be understood that, for convenience and simplicity of description, the system of foregoing description, Device and the specific work process of unit, may be referred to the corresponding process in preceding method embodiment, will not be described here.

In embodiment provided herein, it should be understood that disclosed apparatus and method, can pass through other Mode is realized.For example, device embodiment described above is only schematically, for example division of the unit, is only A kind of division of logic function, can have other dividing mode when actually realizing, such as multiple units or component can in conjunction with or Person is desirably integrated into another system, or some features can be ignored, or does not execute.Another, shown or discussed is mutual Between coupling direct-coupling or communication connection can be the INDIRECT COUPLING or communication link of device or unit by some interfaces Connect, can be electrical, mechanical or other forms.

The unit that illustrates as separating component can be or may not be physically separate, aobvious as unit The part for showing can be or may not be physical location, you can be located at a place, or can also be distributed to multiple On NE.Some or all of unit therein can be selected according to the actual needs to realize the mesh of this embodiment scheme 's.

In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, it is also possible to It is that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.

If the function realized using in the form of SFU software functional unit and as independent production marketing or use when, permissible It is stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words The part contributed by prior art or the part of the technical scheme can be embodied in the form of software product, the meter Calculation machine software product is stored in a storage medium, is used including some instructions so that a computer equipment (can be individual People's computer, server, or network equipment etc.) execute each embodiment methods described of the present invention all or part of step. And aforesaid storage medium includes：USB flash disk, portable hard drive, ROM, RAM, magnetic disc or CD etc. are various can be with store program codes Medium.

The above, the only specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, and any Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all be contained Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be defined by scope of the claims.

Claims

1. a kind of video communication method, is applied to first terminal, it is characterised in that methods described includes：

3rd view data is sent to the second terminal.

2. video communication method according to claim 1, it is characterised in that the acquisition described image input window according to Before the step of first view data of the first preset frame rate storage, the video communication method also includes：

Detection first terminal user draws operation in the track in described image input window；

According to first preset frame rate, the corresponding track of operation is drawn in the track for detecting and is stored as first figure As data.

3. video communication method according to claim 1, it is characterised in that the acquisition described image input window according to Before the step of the first view data that first preset frame rate is preserved, the video communication method also includes：

By each frame described first image data storage of described image input window preservation in the first memory area.

4. video communication method according to claim 3, it is characterised in that the photographic head of the acquisition first terminal According to the second preset frame rate collection the first view data the step of before, the video communication method also includes：

Second view data described in each frame that the photographic head of the first terminal is gathered is stored in the second memory area.

5. video communication method according to claim 4, it is characterised in that described by described first image data and second The step of view data carries out synthesis process, three view data of generation, including：

For the first view data of each frame in first memory area, the view data of odd-numbered line is extracted；

For the second view data of each frame in second memory area, the view data of even number line is extracted；

The view data of the odd-numbered line for extracting and even number line is entered according to the order of the affiliated line number of each view data before extracting Row synthesis, generates the 3rd view data；

3rd view data is stored in the 3rd memory area.

6. video communication method according to claim 4, it is characterised in that described by described first image data and second The step of view data carries out synthesis process, three view data of generation, including：

For the second view data of each frame for being stored in second memory area, corresponding described image input window is determined Region with track drafting；

Will be in second view data, the view data in the region of corresponding track drafting replaces with and is stored in described first and deposits The first view data in storage area domain, generates the 3rd view data；

3rd view data is stored in the 3rd memory area.

7. video communication method according to any one of claim 1 to 6, it is characterised in that first preset frame rate Identical with second preset frame rate.

8. video communication method according to claim 1, it is characterised in that described by the 3rd view data send to After the step of second terminal, the video communication method also includes：

Receive the 4th view data of second terminal transmission；

Video image display window in video calling interface shows the 4th view data；

Wherein, the 4th view data is：The 5th view data that the photographic head of the second terminal is gathered and display exist The 6th view data stored by image input windows in the video calling interface of the second terminal, after carrying out synthesis process The view data of generation.

9. a kind of mobile terminal, is applied to first terminal, it is characterised in that include：

First display module, for carrying out in video call process with second terminal, defeated in video calling interface display image Enter window；

First acquisition module, default according to first for obtaining the described image input window shown by first display module First view data of frame per second storage；

Second acquisition module, for obtaining the second view data that the photographic head of first terminal is gathered according to the second preset frame rate；

Processing module, obtains for the first view data for obtaining first acquisition module and second acquisition module Second view data carries out synthesis process, generates the 3rd view data；

10. mobile terminal according to claim 9, it is characterised in that also include：

Detection module, operates for detecting that track of the first terminal user in described image input window is drawn；

First memory module, for according to first preset frame rate, the track that the detection module is detected is drawn Corresponding track is operated to be stored as described first image data.

11. mobile terminals according to claim 9, it is characterised in that also include：

Second memory module, for each frame described first image data storage for preserving described image input window in first In memory area.

12. mobile terminals according to claim 11, it is characterised in that also include：

3rd memory module, for the second view data described in each frame of the photographic head collection of the first terminal to be stored in In second memory area.

13. mobile terminals according to claim 12, it is characterised in that the processing module includes：

First processing units, for for the first view data of each frame in first memory area, extracting odd-numbered line View data；

Second processing unit, for for the second view data of each frame in second memory area, extracting even number line View data；

3rd processing unit, the odd-numbered line and the second processing unit for extracting the first processing units is extracted The view data of even number line synthesized according to the order of the affiliated line number of each view data before extracting, generate the 3rd picture number According to；

First memory element, the 3rd view data for generating the 3rd processing unit is stored in the 3rd memory area In.

14. mobile terminals according to claim 12, it is characterised in that the processing module includes：

Determining unit, for for the second view data of each frame for being stored in second memory area, determining corresponding institute State the region that image input windows have track drafting；

Fourth processing unit, for by second view data, the view data in the region of corresponding track drafting is replaced For the first view data being stored in first memory area, the 3rd view data is generated；

Second memory element, for the 3rd view data is stored in the 3rd memory area.

15. mobile terminals according to any one of claim 9 to 14, it is characterised in that first preset frame rate with Second preset frame rate is identical.

16. mobile terminals according to claim 9, it is characterised in that also include：

Receiver module, for receiving the 4th view data of second terminal transmission；

Second display module, shows the receiver module institute for the video image display window in video calling interface The 4th view data for receiving；