CN106454199B

CN106454199B - A kind of video communication method and mobile terminal

Info

Publication number: CN106454199B
Application number: CN201610927432.6A
Authority: CN
Inventors: 谢莲花
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2016-10-31
Filing date: 2016-10-31
Publication date: 2019-02-15
Anticipated expiration: 2036-10-31
Also published as: CN106454199A

Abstract

The present invention provides a kind of video communication method and mobile terminals.Wherein, which includes: to carry out in video call process with second terminal, in video calling interface display image input window；Obtain the first image data that image input windows are stored according to the first preset frame rate；Obtain the second image data that the camera of first terminal is acquired according to the second preset frame rate；First image data and the second image data are subjected to synthesis processing, generate third image data；Third image data is sent to second terminal.Technical solution provided in an embodiment of the present invention, user can not only carry out real-time video communication and voice communication, this subsidiary communications function of image input windows can also be passed through, transmit figure (such as text, picture) and expression packet and picture etc. that user draws, to make information representation more comprehensively, accurately, make to link up enjoyment that is more efficient, while increasing communication.

Description

A kind of video communication method and mobile terminal

Technical field

The present invention relates to field of communication technology more particularly to a kind of video communication methods and mobile terminal.

Background technique

In the prior art, text communication, voice communication and view are specifically included that in such a way that mobile terminal is communicated Frequency communication etc..Wherein, text communication is fairly simple, and for giving expression to one's sentiment, color aspect compares shortage；Voice communication lacks image Information is less in linking up comprehensive；And video communication can be linked up compared to text communication and voice communication, the content expressed is richer Richness, but it is limited to voice and realtime graphic, it can not accomplish simultaneous transmission text information and the image that other clients need to transmit Information also limits communication to a certain extent.

Summary of the invention

The embodiment of the invention provides a kind of video communication method and mobile terminals, to solve in video communication not The problem of text or image information can be transmitted.

In a first aspect, providing a kind of video communication method, it is applied to first terminal, which comprises

It is carried out in video call process with second terminal, in video calling interface display image input window；

Obtain the first image data that described image input window is stored according to the first preset frame rate；

Obtain the second image data that the camera of the first terminal is acquired according to the second preset frame rate；

The first image data and the second image data are subjected to synthesis processing, generate third image data；

The third image data is sent to the second terminal.

Second aspect provides a kind of mobile terminal, is applied to first terminal, and the mobile terminal includes:

First display module, for being carried out in video call process with second terminal, in video calling interface display diagram As input window；

First obtains module, default according to first for obtaining described image input window shown by the display module First image data of frame per second storage；

Second obtains module, the second figure that the camera for obtaining the first terminal is acquired according to the second preset frame rate As data；

Processing module, the first image data and the second acquisition module for obtaining the first acquisition module obtain The second image data taken carries out synthesis processing, generates third image data；

Sending module, the third image data for generating the processing module are sent to the second terminal.

In this way, in the embodiment of the present invention, by being carried out in video call process with second terminal, at video calling interface Show image input windows；Obtain the first image data that described image input window is stored according to the first preset frame rate；It obtains The second image data that the camera of the first terminal is acquired according to the second preset frame rate；By the first image data and Two image datas carry out synthesis processing, generate third image data；The third image data is sent to the second terminal, It can be realized real-time video communication and voice communication, additionally it is possible to pass through this subsidiary communications function of image input windows, transmission The figure (such as text, picture) and some expression packets and picture etc. that user draws make information representation more comprehensively, accurately, Make to link up enjoyment that is more efficient, while increasing communication.

Detailed description of the invention

In order to illustrate the technical solution of the embodiments of the present invention more clearly, will make below to required in embodiment or description Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for For those of ordinary skill in the art, without any creative labor, it can also be obtained according to these attached drawings His attached drawing.

Fig. 1 shows the flow charts for the video communication method that first embodiment of the invention provides；

Fig. 2 indicates the flow chart for the video communication method that second embodiment of the invention provides；

Fig. 3 indicates the schematic diagram of the first image data of extraction provided in an embodiment of the present invention；

Fig. 4 indicates the schematic diagram of the second image data of extraction provided in an embodiment of the present invention；

Fig. 5 indicates the schematic diagram of the third image data after synthesis provided in an embodiment of the present invention；

Fig. 6 indicates the flow chart for the video communication method that third embodiment of the invention provides；

Fig. 7 indicates one of the block diagram of mobile terminal that fourth embodiment of the invention provides；

Fig. 8 shows the two of the block diagram of the mobile terminal of fourth embodiment of the invention offer；

Fig. 9 indicates the block diagram for the mobile terminal that fifth embodiment of the invention provides；

Figure 10 indicates the block diagram for the mobile terminal that sixth embodiment of the invention provides.

Specific embodiment

Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts Example, shall fall within the protection scope of the present invention.

First embodiment

The embodiment of the invention provides a kind of video communication methods, are applied to first terminal.As shown in Figure 1, the video is logical Letter method includes:

Step 101 carries out in video call process with second terminal, in video calling interface display image input window Mouthful.

The embodiment of the present invention carries out in video call process in first terminal and second terminal, while in the view of first terminal Frequency call interface shows an image input windows.User can input the image data to be sent in the image input windows, In, the mode of input includes but is not limited to: in image input windows hand drawn image (similar drawing board function) or passing through figure As the image addition function of input window uploads stored picture or expression packet etc..By increasing image input windows, this is auxiliary Communication function is helped, the content of video communication can be further enriched, the content of video communication is made to be not limited to the view of camera acquisition Frequency image and voice, user can draw figure to be expressed according to demand, can make information representation more comprehensive, quasi- in this way Really.

Wherein, video calling interface described here is the display camera (camera and/or second terminal of first terminal Camera) acquisition video image interface, which includes: the video image of local terminal and/or opposite end.

Wherein, image is arranged in order to avoid image input windows block video image, in the embodiment of the present invention to input Window is pellucidity, while position, size and shape in order to identify image input windows, can be in image input windows Frame is arranged in edge.In addition, the position of image input windows and size can be adjusted according to user demand.

Step 102 obtains the first image data that image input windows are stored according to the first preset frame rate.

Wherein, image input windows can be stored thereon the image of drafting according to a preset frame rate (i.e. the first preset frame rate) Data.First preset frame rate can be system default value, can also be adjusted according to demand by user.

The second image data that step 103, the camera for obtaining first terminal are acquired according to the second preset frame rate.

Wherein, it for the camera for acquiring local terminal image when camera described here is video calling, can be preposition Camera is also possible to rear camera.

Wherein, the second preset frame rate can be identical with the first preset frame rate, can also be different, and concrete condition can be according to practical need Seek design.

First image data and the second image data are carried out synthesis processing by step 104, generate third image data.

In the embodiment of the present invention, after getting the first image data and the second image data, by two kinds of image datas into Third image data, that is, the image data that a frame image input windows are stored and a frame are generated after the certain synthesis processing of row The image data of camera acquisition passes through certain data handling procedure, and one frame of synthesis had not only included the first image data but also included There are the new images of the second image data.

Third image data is sent to second terminal by step 105.

In this step, the third image data of generation is sent to second terminal, so that second terminal is whole in display first When holding the image data sent, the video image of first terminal camera shooting can either be shown, and can show first terminal The image that user is inputted by image input windows.

Further, video communication method provided in an embodiment of the present invention further include: receive the second terminal is sent the 4th Image data, then the video image display window in video calling interface shows the 4th image data.

Wherein, the 4th image data are as follows: the 5th image data for acquiring the camera of second terminal and display are second The 6th image data that image input windows in the video calling interface of terminal are stored, carries out the figure generated after synthesis processing As data.

In the embodiment of the present invention, the image data of user's input is inputted in image input windows, is being received pair It is display window (the i.e. video image in the video image of script display camera shooting when the composograph data just sent Display window) display.In this way, being reduced as far as possible to video in addition to other than video calling interface increases image input windows The change of call interface and the operating habit of user.

In conclusion video communication method provided in an embodiment of the present invention, by carrying out video calling with second terminal In the process, in video calling interface display image input window；Obtain what image input windows were stored according to the first preset frame rate First image data；Obtain the second image data that the camera of first terminal is acquired according to the second preset frame rate；By the first figure As data and the second image data carry out synthesis processing, generation third image data；Third image data is sent to described Two terminals, user can not only carry out real-time video communication and voice communication, additionally it is possible to which by image input windows, this is auxiliary Help communication function, the figure (such as text, picture) and expression packet and picture etc. that transmission user draws, to make information representation More comprehensively, accurate, make to link up enjoyment that is more efficient, while increasing communication.

Second embodiment

The embodiment of the invention provides a kind of video communication methods, are applied to first terminal.As shown in Fig. 2, the video is logical Letter method includes:

Step 201 carries out in video call process with second terminal, in video calling interface display image input window Mouthful.

The embodiment of the present invention in first terminal and second terminal when carrying out video calling, while in the video of first terminal Call interface shows an image input windows, and user can input the image data to be sent in the image input windows.Wherein, The mode of input includes but is not limited to: image input windows hand drawn image (similar drawing board function) or by image it is defeated The image addition function of entering window uploads stored picture or expression packet etc..It is logical by increasing this auxiliary of image input windows Telecommunication function can further enrich the content of video communication, and the content of video communication is made to be not limited to the video figure of camera acquisition Picture and voice, user can draw figure to be expressed according to demand, can make information representation so more comprehensively, accurately.

Draw operation in the track of step 202, detection first terminal user in image input windows.

In the embodiment of the present invention, the input mode of preferred manual drafting.User can be in image input windows hand drawn figure As (similar drawing board function), further to enrich communication, realizes effective communication, promoted and link up enjoyment.

Wherein, for user in image input windows drawing image, operation is drawn in the track of system real-time detection user, so as to It is recorded to rail is drawn.

Step 203, according to the first preset frame rate, the track that will test, which is drawn, to be operated corresponding track and is stored as the first figure As data.

In this step, according to the first preset frame rate, the track that will test draws the corresponding track of operation and is stored as first Image data.Wherein, the color of track drafting and width can be set by the user himself.

Wherein, when storing the first image data, the first image data of each frame that image input windows save can be deposited It is stored in the first storage region.First storage region can be a storage region in random access memory, be also possible to it A storage region in his memory, concrete condition can select according to actual needs.

Wherein, which can be system default value, can also be adjusted according to demand by user.

Step 204 obtains the first image data that image input windows are stored according to the first preset frame rate.

In the embodiment of the present invention, in demand, the first image data that image input windows are stored can be obtained.

The second image data that step 205, the camera for obtaining the first terminal are acquired according to the second preset frame rate.

Wherein, the second image data described in each frame of the camera of first terminal acquisition can be stored in the second memory block In domain.First storage region can be a storage region in random access memory, one be also possible in other memories A storage region, concrete condition can select according to actual needs.Second image data is stored respectively with the first image data, It is for the ease of handling the first image data and the second image data.

Preferably, the frame per second of camera acquisition video image is identical as the frame per second that track drafting saves, i.e., the first default frame Rate is identical as the second preset frame rate, the image path saved can in this way had with the image that camera is shot preferable synchronous Property, so that other side can see the figure that first terminal user draws in real time.

Step 206, for the first image data of each frame in the first storage region, extract the image data of odd-numbered line.

Step 207, for the second image data of each frame in the second storage region, extract the image data of even number line.

In the embodiment of the present invention, by step 206 and step 207 to the first image data and the second image data using folded Computation system is handled, i.e., extracts to the first image data and the second image data, as shown in Figure 3 and Figure 4, negative in Fig. 3 The image data for the odd-numbered line that shadow part is extracted by the first image data, the dash area in Fig. 4 is the second image data institute Then the image data of the even number line of extraction reconfigures the image data of extraction, generate new image data, in this way, not It will cause the increase of data volume, when transmission will not cause the transmission pressure of network-side, can guarantee the fluency of video calling.

Will be understood is, for the first image data of each frame in the first storage region, can also extract even number line Image data；For the second image data of each frame in the second storage region, the image data of odd-numbered line can also be extracted.Tool Body situation can select according to actual needs.

Step 208, by the image data of the odd-numbered line of extraction and even number line according to extract before each affiliated line number of image data Sequence synthesized, generate third image data.

In the embodiment of the present invention, then after being extracted to the first image data and the second image data, by the image of extraction Data reconfigure, and generate new image data, as shown in Figure 5.In this way, not will cause the increase of data volume, when transmission also not The transmission pressure that will cause network-side, can guarantee the fluency of video calling.

Wherein, for convenient for extract and subsequent recombination, the first image data can be stored as with the second image data identical Size a, it is assumed that frame data of the first camera acquisition are 1200*1600, then in the first storage region and in the first storage region Image data keep the size of 1200*1600, the image data less than 1200*1600 can be used zero padding method and be made up.

Third image data is stored in third storage region by step 209.

In this step, newly-generated third image data is stored in third storage region.First storage region can To be a storage region in random access memory, a storage region being also possible in other memories, concrete condition can It selects according to actual needs.

Third image data is sent to the second terminal by step 210.

The video communication method that embodiment provides to further understand the present invention, is illustrated below with an example:

Assuming that user A and user B is first terminal carrying out video calling, the mobile terminal that user A is used, user B makes Mobile terminal is second terminal.First terminal acquires video image using front camera, logical in the video of first terminal The lower right at words interface shows an image input windows, and user A just draws a smiling face in the image input windows, in smiling face Drawing process in, image input windows according to 60 frame per second storage frame per second, storage user draw smiling face's image, while before It sets camera and also acquires video image according to the acquisition frame rate of 60 frame per second.First terminal stores image input windows each Frame smiling face image and each frame video image of front camera acquisition carry out synthesis processing, that is, extract each frame smiling face image Odd row data extracts the even number of lines evidence of each frame video image, then reconfigures the image data of extraction, generates one The new video image of frame is sent to second terminal.When second terminal receives the video image of first terminal transmission, in video figure As the image that display window shows the video image, and the front camera of existing first terminal is shot in the video image, again With smiling face's image that user A is drawn, since the video image frame number of display per second is more and human eye resolving ability is effective, because The process that user A draws smiling face can be seen in this user B, increases the enjoyment of communication.

Further, the embodiment of the present invention is to guarantee that user can show that completely in the image that image input windows are drawn Track not only to save the touch point trace information in present image input window, also need therefore in image rendering process Retain historical touch locus of points information, its implementation are as follows:

User is detected in the touch locus of points of the corresponding touch area input of image input windows, and will be currently detected Track saves as first image data of frame after merging with historical track.

Specifically, the first image data of former frame before preserving present frame can be first obtained, it then will be currently detected Track data be superimposed in the historical track in the first image data of former frame, obtain the first image data of present frame.Example Such as, it is 1 that the station location marker in each the first image data of frame with drawing image data, which is arranged, and blank position is identified as 0, After saving first image data of frame, before latter frame data do not save, image data in the first current storage region of readback, If the first image data of former frame position to be covered is identified as 1, without covering；If position to be covered is identified as 0, It is covered, can thus save the prolonged track drafting of user.If necessary to remove current track, user can be manually selected Erasing rubber function clashes track, and resets to image data corresponding in the first storage region, in this way can be to image input windows In image rendering area recycling, be also convenient for user and modify to image and perfect.

Further, video communication method provided in an embodiment of the present invention further include: receive the second terminal is sent the 4th Image data, the video image display window in video calling interface show the 4th image data.

In conclusion the method for video communication provided in an embodiment of the present invention, by logical with second terminal progress video During words, in video calling interface display image input window, rail of the first terminal user in image input windows is detected Mark draws operation, and according to the first preset frame rate, the track that will test draws the corresponding track of operation and is stored as the first picture number According to the first image data that acquisition image input windows are stored according to the first preset frame rate obtains the camera shooting of the first terminal The second image data that head is acquired according to the second preset frame rate, for the first image data of each frame in the first storage region, The image data for extracting odd-numbered line extracts the image of even number line for the second image data of each frame in the second storage region Data close the image data of the odd-numbered line of extraction and even number line according to the sequence of each affiliated line number of image data before extracting At third image data is stored in third storage region, third image data is sent to institute by generation third image data State second terminal, user can not only carry out real-time video communication and voice communication, additionally it is possible to by image input windows this One subsidiary communications function, the figure (such as text, picture) that transmission user draws, thus make information representation more comprehensively, accurately, Make to link up enjoyment that is more efficient, while increasing communication.Further, by the first image data and the second image data It is overlapped processing, reduces the data volume to be transmitted, the transmission pressure of network-side is reduced, ensure that the smoothness of video calling Degree.

3rd embodiment

The embodiment of the invention provides a kind of video communication methods, are applied to first terminal.As shown in fig. 6, the video is logical Letter method includes:

Step 601 carries out in video call process with second terminal, in video calling interface display image input window Mouthful.

The embodiment of the present invention is led to when first terminal and second terminal carry out video calling, while in the video of first terminal One image input windows of interface display are talked about, user can input the image data to be sent in the image input windows.Wherein, defeated The mode entered includes but is not limited to: inputting in image input windows hand drawn image (similar drawing board function) or by image The image addition function of window uploads stored picture or expression packet etc..By increasing this subsidiary communications of image input windows Function can further enrich the content of video communication, and the content of video communication is made to be not limited to the video image of camera acquisition And voice, user can draw figure to be expressed according to demand, can make information representation so more comprehensively, accurately.

Draw operation in the track of step 602, detection first terminal user in image input windows.

Step 603, according to the first preset frame rate, the track that will test, which is drawn, to be operated corresponding track and is stored as the first figure As data.

Step 604 obtains the first image data that image input windows are stored according to the first preset frame rate.

The second image data that step 605, the camera for obtaining the first terminal are acquired according to the second preset frame rate.

Step 606, the second image data of each frame for being stored in the second storage region determine corresponding described image Input window has the region of track drafting.

Step 607, will be in the second image data, the image data in the region of corresponding track drafting, which replaces with, is stored in institute The first image data in the first storage region is stated, third image data is generated.

In the embodiment of the present invention, by step 606 and step 607 to the first image data and the second image data using embedding Enter algorithm to be handled, i.e., each the second image data of frame is corresponded into the image data in track drafting region and replace with the first figure As data, that is, progress area image replacement processing reduce the biography of network-side in this way, can reduce the data volume to be transmitted Defeated pressure guarantees the fluency of video calling.

Third image data is stored in third storage region by step 608.

Third image data is sent to the second terminal by step 609.

Assuming that user A and user B is first terminal carrying out video calling, the mobile terminal that user A is used, user B makes Mobile terminal is second terminal.First terminal acquires video image using front camera, logical in the video of first terminal The lower right at words interface shows an image input windows, and user A just draws a smiling face in the image input windows, in smiling face Drawing process in, image input windows according to 60 frame per second storage frame per second, storage user draw smiling face's image, while before It sets camera and also acquires video image according to the acquisition frame rate of 60 frame per second.First terminal stores image input windows each Frame smiling face image and each frame video image of front camera acquisition carry out synthesis processing, i.e., draw each video image correspondence Image data in smiling face track regions processed replaces with smiling face's image data, and the new video image of one frame of synthesis is sent to second eventually End.When second terminal receives the video image of first terminal transmission, the video image is shown in video image display window, The image of the front camera shooting of existing first terminal in the video image, and the smiling face's image drawn with user A, due to The video image frame number of display per second is more and human eye resolving ability is effective, therefore user B can be seen user A and draw smiling face's Process increases the enjoyment of communication.

In conclusion the method for video communication provided in an embodiment of the present invention, by logical with second terminal progress video During words, in video calling interface display image input window, rail of the first terminal user in image input windows is detected Mark draws operation, and according to the first preset frame rate, the track that will test draws the corresponding track of operation and is stored as the first picture number According to the first image data that acquisition image input windows are stored according to the first preset frame rate obtains the camera shooting of the first terminal The second image data that head is acquired according to the second preset frame rate, for the second image of each frame stored in the second storage region Data determine that corresponding described image input window has the region of track drafting, by the second image data, correspond to track drafting Region in image data replace with the first image data being stored in first storage region, generate third picture number According to third image data is stored in third storage region, third image data is sent to the second terminal, user is not Real-time video communication and voice communication can only be carried out, additionally it is possible to by this subsidiary communications function of image input windows, pass The figure (such as text, picture) that defeated user draws, thus make information representation more comprehensively, it is accurate, make to link up it is more efficient, together The enjoyment of Shi Zengjia communication.Further, by being carried out at area image replacement to the first image data and the second image data Reason, reduces the data volume to be transmitted, reduces the transmission pressure of network-side, ensure that the fluency of video calling.

Fourth embodiment

The embodiment of the invention provides a kind of mobile terminal 700, it is applied to first terminal, is able to achieve first embodiment to the The details of three video communication methods as described in the examples, and reach identical effect.As shown in fig. 7, the mobile terminal 700 wraps It includes:

First display module 701, for being carried out in video call process with second terminal, in video calling interface display Image input windows.

The embodiment of the present invention carries out in video call process in first terminal and second terminal, while in the view of first terminal Frequency call interface shows an image input windows by the first display module 701.User can input in the image input windows The image data to be sent, wherein the mode of input includes but is not limited to: (similar in image input windows hand drawn image Drawing board function) or pass through the stored picture of image addition function upload of image input windows or expression packet etc..Pass through increasing Add this subsidiary communications function of image input windows, can further enrich the content of video communication, make the content of video communication not It is confined to the video image and voice of camera acquisition, user can draw figure to be expressed according to demand, can make in this way Information representation is more comprehensively, accurately.

First obtains module 702, pre- according to first for obtaining image input windows shown by the first display module 701 If the first image data of frame per second storage.

Wherein, image input windows can be stored thereon the image of drafting according to a preset frame rate (i.e. the first preset frame rate) Data.In demand the first image data that module 702 obtains image input windows storage can be obtained by first.This is first pre- If frame per second can be system default value, can also be adjusted according to demand by user.

Second obtains module 703, the second figure that the camera for obtaining first terminal is acquired according to the second preset frame rate As data.

Wherein, module 703 can be obtained by second in demand obtain the second image data.

For the camera for acquiring local terminal image when camera described here is video calling, preposition camera shooting can be Head is also possible to rear camera.

Processing module 704, the first image data and second for obtaining the first acquisition module 702 obtain module 703 The second image data obtained carries out synthesis processing, generates third image data.

In the embodiment of the present invention, the first image data is being got by the first acquisition module 702 and is being obtained by the two the second After module 703 gets the second image data, by processing module 704 by two kinds of image datas carry out it is certain synthesize processing after generate Third image data, that is, the image data that the image data of frame image input windows storage and a frame camera are acquired By certain data handling procedure, synthesizes a frame and not only included the first image data but also included the new figure of the second image data Picture.

Sending module 705, the third image data for generating processing module 704 are sent to second terminal.

Wherein, the third image data of generation is sent to second terminal by sending module 705, so that second terminal is being shown When the image data that first terminal is sent, the video image of first terminal camera shooting can either be shown, and can show the The image that one terminal user is inputted by image input windows.

Further, as shown in figure 8, the mobile terminal 700 further include:

Detection module 706 draws operation for detecting track of the first terminal user in image input windows.

Wherein, the color of track drafting and width can be set by the user himself.

First memory module 707 draws behaviour for according to the first preset frame rate, will test the track that module 706 detects Make corresponding track and is stored as the first image data.

In the embodiment of the present invention, the track that module 706 detects will test by the first memory module 707 and draw operation correspondence Track be stored as the first image data.

Further, as shown in figure 8, the mobile terminal 700 further include:

Second memory module 708, the first image data of each frame for saving image input windows are stored in first In storage region.

It wherein, can be by each frame of image input windows preservation when the second memory module 708 stores the first image data First image data is stored in the first storage region.First storage region can be a memory block in random access memory Domain, a storage region being also possible in other memories, concrete condition can select according to actual needs.

Further, as shown in figure 8, the mobile terminal 700 further include:

Third memory module 709, for the second image data of each frame of the camera acquisition of first terminal to be stored in In second storage region.

It wherein, can be by the second image described in each frame of the camera of first terminal acquisition by third memory module 709 Data are stored in the second storage region.First storage region can be a storage region in random access memory, can also To be a storage region in other memories, concrete condition can select according to actual needs.Second image data and first Image data is stored respectively, is for the ease of handling the first image data and the second image data.

Further, as shown in figure 8, processing module 704 includes:

First processing units 7041, for extracting odd number for the first image data of each frame in the first storage region Capable image data.

First processing units 7041, for extracting even number for the second image data of each frame in the second storage region Capable image data.

In the embodiment of the present invention, the first image data and the second image data are handled using superposition algorithm, i.e., it is logical It crosses and first processing units 7041 and 7,041 first image data of first processing units and the second image data is extracted (as schemed Shown in 3 and Fig. 4), then the image data of extraction is reconfigured, generates new image data, in this way, not will cause data volume Increase, when transmission will not cause the transmission pressure of network-side, can guarantee the fluency of video calling.

Third processing unit 7043, odd-numbered line and the second processing unit 7042 for extracting first processing units 7041 The image data of the even number line of extraction is synthesized according to the sequence of each affiliated line number of image data before extracting, and generates third image Data.

In the embodiment of the present invention, then after being extracted to the first image data and the second image data, handled by third single Member 7043 reconfigures the image data of extraction, generates new image data, as shown in Figure 5.In this way, not will cause data volume Increase, when transmission will not cause the transmission pressure of network-side, can guarantee the fluency of video calling.

First storage unit 7044, the third image data for generating third processing unit 7043 are stored in third and deposit In storage area domain.

Wherein, newly-generated third image data is stored in third storage region by the first storage unit 7044. First storage region can be a storage region in random access memory, a storage being also possible in other memories Region, concrete condition can select according to actual needs.

Further, as shown in figure 8, processing module 704 includes:

Determination unit 7045, for the second image data of each frame for being stored in the second storage region, determining pair Answer image input windows that there is the region of track drafting.

Fourth processing unit 7046, for corresponding to the image data in the region of track drafting in the second image data The first image data being stored in the first storage region is replaced with, third image data is generated.

In the embodiment of the present invention, the first image data and the second image data are handled using embedded mobile GIS, i.e., will Each the second image data of frame corresponds to the image data in track drafting region and replaces with the first image data, that is, carries out area Area image replacement processing reduces the transmission pressure of network-side in this way, can reduce the data volume to be transmitted, guarantees video calling Fluency.

Second storage unit 7047, for third image data to be stored in third storage region.

Wherein, the third image data of generation is sent to by second terminal by the second storage unit 7047, so that second Terminal can either show the video image of first terminal camera shooting, again when showing the image data that first terminal is sent It can show the image that first terminal user is inputted by image input windows.

Further, as shown in figure 8, the mobile terminal 700 further include:

Receiving module 710, for receiving the 4th image data of second terminal transmission.

Second display module 711 shows receiving module institute for the video image display window in video calling interface Received 4th image data.

Shown in sum up, mobile terminal 700 provided in an embodiment of the present invention, by the first display module 701 in video calling An image input windows are shown in interface, and the first figure that image input windows are stored then is obtained by the first acquisition module 702 The second image data that module 703 obtains the acquisition of first terminal camera is obtained as data and by second, subsequently passes through place Reason module 704 will carry out synthesis processing, generates third image data, sends out third image data finally by sending module 705 It send to receiving end (i.e. second terminal), such user can not only carry out real-time video communication and voice communication, additionally it is possible to logical Cross this subsidiary communications function of image input windows, figure (such as text, picture) and expression packet that transmission user draws and Picture etc., so that information representation be made more comprehensively, accurately to make to link up enjoyment that is more efficient, while increasing communication.

5th embodiment

Fig. 9 is the block diagram of the mobile terminal of another embodiment of the present invention.Mobile terminal 900 shown in Fig. 9 includes: at least One processor 901, memory 902, at least one network interface 904 and user interface 903.Wherein, mobile terminal 900 also wraps It includes: front camera and rear camera.

Various components in mobile terminal 900 are coupled by bus system 905.It is understood that bus system 905 is used Connection communication between these components of realization.Bus system 905 further includes power bus, control in addition to including data/address bus Bus and status signal bus in addition processed.But for the sake of clear explanation, various buses are all designated as bus system 905 in Fig. 9.

Wherein, user interface 903 may include display, keyboard or pointing device (for example, mouse, trace ball (trackball), touch-sensitive plate or touch screen etc..

It is appreciated that the memory 902 in the embodiment of the present invention can be volatile memory or nonvolatile memory, It or may include both volatile and non-volatile memories.Wherein, nonvolatile memory can be read-only memory (Read- Only Memory, ROM), programmable read only memory (Programmable ROM, PROM), the read-only storage of erasable programmable Device (Erasable PROM, EPROM), electrically erasable programmable read-only memory (Electrically EPROM, EEPROM) or Flash memory.Volatile memory can be random access memory (Random Access Memory, RAM), be used as external high Speed caching.By exemplary but be not restricted explanation, the RAM of many forms is available, such as static random access memory (Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), Synchronous Dynamic Random Access Memory (Synchronous DRAM, SDRAM), double data speed synchronous dynamic RAM (Double Data Rate SDRAM, DDRSDRAM), enhanced Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronized links Dynamic random access memory (Synchlink DRAM, SLDRAM) and direct rambus random access memory (Direct Rambus RAM, DRRAM).The memory 902 of system and method described herein is intended to include but is not limited to these and arbitrarily its It is suitble to the memory of type.

In some embodiments, memory 902 stores following element, executable modules or data structures, or Their subset of person or their superset: operating system 9021 and application program 9022.

Wherein, operating system 9021 include various system programs, such as ccf layer, core library layer, driving layer etc., are used for Realize various basic businesses and the hardware based task of processing.Application program 9022 includes various application programs, such as media Player (Media Player), browser (Browser) etc., for realizing various applied business.Realize the embodiment of the present invention The program of method may be embodied in application program 9022.

In embodiments of the present invention, by the program or instruction of calling memory 902 to store, specifically, can be application The program or instruction stored in program 9022, user interface 903 are used to regarding in video call process with second terminal Frequency call interface shows that image input windows, processor 901 are stored for obtaining image input windows according to the first preset frame rate The first image data and first terminal the second image data for being acquired according to the second preset frame rate of camera；Then by One image data and the second image data carry out synthesis processing, generate third image data, and pass through network interface 904 for third Image data is sent to second terminal.

The method that the embodiments of the present invention disclose can be applied in processor 901, or be realized by processor 901. Processor 901 may be a kind of IC chip, the processing capacity with signal.During realization, the above method it is each Step can be completed by the integrated logic circuit of the hardware in processor 901 or the instruction of software form.Above-mentioned processing Device 901 can be general processor, digital signal processor (Digital Signal Processor, DSP), dedicated integrated electricity Road (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic, Discrete hardware components.It may be implemented or execute disclosed each method, step and the logic diagram in the embodiment of the present invention.It is general Processor can be microprocessor or the processor is also possible to any conventional processor etc..In conjunction with institute of the embodiment of the present invention The step of disclosed method, can be embodied directly in hardware decoding processor and execute completion, or with the hardware in decoding processor And software module combination executes completion.Software module can be located at random access memory, and flash memory, read-only memory may be programmed read-only In the storage medium of this fields such as memory or electrically erasable programmable memory, register maturation.The storage medium is located at The step of memory 902, processor 901 reads the information in memory 902, completes the above method in conjunction with its hardware.

It is understood that embodiments described herein can with hardware, software, firmware, middleware, microcode or its Combination is to realize.For hardware realization, processing unit be may be implemented in one or more specific integrated circuit (Application Specific Integrated Circuits, ASIC), digital signal processor (Digital Signal Processing, DSP), digital signal processing appts (DSP Device, DSPD), programmable logic device (Programmable Logic Device, PLD), field programmable gate array (Field-Programmable Gate Array, FPGA), general processor, In controller, microcontroller, microprocessor, other electronic units for executing herein described function or combinations thereof.

For software implementations, it can be realized herein by executing the module (such as process, function etc.) of function described herein The technology.Software code is storable in memory and is executed by processor.Memory can in the processor or It is realized outside processor.

Optionally, processor 901 is also used to: detection first terminal user draws the track in described image input window Operation, according to first preset frame rate, the track that will test draws the corresponding track of operation and is stored as described second Image data.

Optionally, memory 902 is used for: each frame the first image data that described image input window is saved are deposited It is stored in the first storage region.

Optionally, memory 902 is used for: the second picture number described in each frame that the camera of the first terminal is acquired According to being stored in the second storage region.

Optionally, processor 901 is also used to: for the first image data of each frame in first storage region, being taken out Take the image data of odd-numbered line；For the second image data of each frame in second storage region, the figure of even number line is extracted As data；And by the image data of the odd-numbered line of extraction and even number line according to the suitable of the preceding each affiliated line number of image data of extraction Sequence is synthesized, and third image data is generated；Then the third image data is stored in by third storage by memory 902 In region.

Optionally, processor 901 is also used to: for the second picture number of each frame stored in second storage region According to determining corresponding described image input window has the region of track drafting；By in second image data, corresponds to and draw rail Image data in the region of mark replaces with the first image data being stored in first storage region, generates third image Data；Then the third image data is stored in third storage region by memory 902.

Optionally, network interface 904 is used to receive the 4th image data that the second terminal is sent；Then pass through user Video image display window of the interface 903 in video calling interface shows the 4th image data.Wherein, the 4th figure As data are as follows: lead to the 5th image data of the camera acquisition of the second terminal and display in the video of the second terminal The 6th image data that image input windows in words interface are stored, carries out the image data generated after synthesis processing.

Mobile terminal 900 can be realized each process that mobile terminal is realized in previous embodiment, to avoid repeating, here It repeats no more.

Mobile terminal 900 provided in an embodiment of the present invention is carrying out video calling with second terminal by user interface 903 In the process, in video calling interface display image input window, processor 901 obtains image input windows according to the first default frame The second image data that first image data of rate storage and the camera of first terminal are acquired according to the second preset frame rate；So The first image data and the second image data are subjected to synthesis processing afterwards, generate third image data, and pass through network interface 904 Third image data is sent to second terminal, user can not only carry out real-time video communication and voice communication, additionally it is possible to By this subsidiary communications function of image input windows, figure (such as text, picture) and expression packet that user draws are transmitted With picture etc., thus make information representation more comprehensively, it is accurate, make to link up enjoyment that is more efficient, while increasing communication.

Sixth embodiment

Figure 10 is the structural schematic diagram of the mobile terminal of another embodiment of the present invention.Specifically, the mobile end in Figure 10 End 1000 can be mobile phone, tablet computer, personal digital assistant (Personal Digital Assistant, PDA) or vehicle-mounted Computer etc..

Mobile terminal 1000 in Figure 10 include radio frequency (Radio Frequency, RF) circuit 1001, memory 1002, Input unit 1003, display unit 1004, processor 1006, voicefrequency circuit 1007, WiFi (Wireless Fidelity) module 1008, power supply 1009 and component 1010 of taking pictures.

Wherein, component 1010 of taking pictures includes: front camera and rear camera.

Wherein, input unit 1003 can be used for receiving the number or character information of user's input, and generate with movement eventually The related signal input of the user setting and function control at end 1000.Specifically, in the embodiment of the present invention, the input unit 1003 may include touch panel 10031.Touch panel 10031, also referred to as touch screen collect user on it or nearby Touch operation (for example user uses the operations of any suitable object or attachment on touch panel 10031 such as finger, stylus), And corresponding attachment device is driven according to preset formula.Optionally, touch panel 10031 may include touch detecting apparatus With two parts of touch controller.Wherein, the touch orientation of touch detecting apparatus detection user, and detect touch operation bring Signal transmits a signal to touch controller；Touch controller receives touch information from touch detecting apparatus, and it is converted At contact coordinate, then the processor 1006 is given, and order that processor 1006 is sent can be received and executed.In addition, can To realize touch panel 10031 using multiple types such as resistance-type, condenser type, infrared ray and surface acoustic waves.In addition to touch surface Plate 10031, input unit 1003 can also include other input equipments 10032, other input equipments 10032 may include but not It is limited to one of physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, operating stick etc. Or it is a variety of.

Wherein, display unit 1004 can be used for showing information input by user or be supplied to the information and movement of user The various menu interfaces of terminal 1000.Display unit 1004 may include display panel 10041, optionally, using LCD or can have The forms such as machine light emitting diode (Organic Light-Emitting Diode, OLED) configure display panel 10041.

It should be noted that touch panel 10031 can cover display panel 10041, touch display screen is formed, when the touch is shown After screen detects touch operation on it or nearby, processor 1006 is sent to determine the type of touch event, is then located It manages device 1006 and provides corresponding visual output in touch display screen according to the type of touch event.

Touch display screen includes Application Program Interface viewing area and common control viewing area.The Application Program Interface viewing area And arrangement mode of the common control viewing area does not limit, can be arranged above and below, left-right situs etc. can distinguish two it is aobvious Show the arrangement mode in area.The Application Program Interface viewing area is displayed for the interface of application program.Each interface can be with The interface elements such as the icon comprising at least one application program and/or widget desktop control.The Application Program Interface viewing area Or the empty interface not comprising any content.This commonly uses control viewing area for showing the higher control of utilization rate, for example, Application icons such as button, interface number, scroll bar, phone directory icon etc. are set.

Wherein, processor 1006 is the control centre of mobile terminal 1000, utilizes various interfaces and the entire hand of connection The various pieces of machine, by running or executing the software program and/or module that are stored in first memory 10021, and tune With the data being stored in second memory 10022, the various functions and processing data of mobile terminal 1000 are executed, thus to shifting Dynamic terminal 1000 carries out integral monitoring.Optionally, processor 1006 may include one or more processing units.

In embodiments of the present invention, by calling the software program and/or module that store in the first memory 10021 And/or the data in the second memory 10022, display unit 1004 are used to carry out video call process with second terminal In, in video calling interface display image input window, processor 1006 is default according to first for obtaining image input windows The second image data that first image data of frame per second storage and the camera of first terminal are acquired according to the second preset frame rate； Then the first image data and the second image data are subjected to synthesis processing, generate third image data, and by third picture number According to being sent to second terminal.

Optionally, processor 1006 is also used to: detection first terminal user draws the track in described image input window System operation, according to first preset frame rate, the track that will test, which is drawn, to be operated corresponding track and is stored as described the Two image datas.

Optionally, memory 1002 is used for: each frame the first image data that described image input window is saved It is stored in the first storage region.

Optionally, memory 1002 is used for: the second image described in each frame that the camera of the first terminal is acquired Data are stored in the second storage region.

Optionally, processor 1006 is also used to: for the first image data of each frame in first storage region, being taken out Take the image data of odd-numbered line；For the second image data of each frame in second storage region, the figure of even number line is extracted As data；And by the image data of the odd-numbered line of extraction and even number line according to the suitable of the preceding each affiliated line number of image data of extraction Sequence is synthesized, and third image data is generated；Then the third image data third is stored in by memory 1002 to deposit In storage area domain.

Optionally, processor 1006 is also used to: for the second image of each frame stored in second storage region Data determine that corresponding described image input window has the region of track drafting；By in second image data, corresponds to and draw Image data in the region of track replaces with the first image data being stored in first storage region, generates third figure As data；Then the third image data is stored in third storage region by memory 1002.

Optionally, processor 1006 is also used to: receiving the 4th image data that the second terminal is sent；Then by aobvious Show that video image display window of the unit 1004 in video calling interface shows the 4th image data.Wherein, described Four image datas are as follows: the view of the 5th image data for acquiring the camera of the second terminal and display in the second terminal The 6th image data that image input windows in frequency call interface are stored, carries out the image data generated after synthesis processing.

As it can be seen that mobile terminal 1000 provided in an embodiment of the present invention, is carried out by display unit 1004 with second terminal In video call process, in video calling interface display image input window, processor 1006 obtain image input windows according to First preset frame rate storage the first image data and first terminal camera acquired according to the second preset frame rate second Image data；Then the first image data and the second image data are subjected to synthesis processing, generate third image data, and by the Three image datas are sent to second terminal, and user can not only carry out real-time video communication and voice communication, additionally it is possible to pass through This subsidiary communications function of image input windows, the figure (such as text, picture) and expression packet and figure that transmission user draws Piece etc., so that information representation be made more comprehensively, accurately to make to link up enjoyment that is more efficient, while increasing communication.

Those of ordinary skill in the art may be aware that the embodiment in conjunction with disclosed in the embodiment of the present invention describe it is each Exemplary unit and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered Think beyond the scope of this invention.

It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.

In embodiment provided herein, it should be understood that disclosed device and method can pass through others Mode is realized.For example, the apparatus embodiments described above are merely exemplary, for example, the division of the unit, only A kind of logical function partition, there may be another division manner in actual implementation, for example, multiple units or components can combine or Person is desirably integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed is mutual Between coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING or communication link of device or unit It connects, can be electrical property, mechanical or other forms.

The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.

It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.

It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product It is stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially in other words The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a People's computer, server or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention. And storage medium above-mentioned includes: that USB flash disk, mobile hard disk, ROM, RAM, magnetic or disk etc. are various can store program code Medium.

The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be subject to the protection scope in claims.

Claims

1. a kind of video communication method is applied to first terminal, which is characterized in that the described method includes:

The third image data is sent to the second terminal；

It is described before described the step of obtaining the first image data that described image input window is saved according to the first preset frame rate Video communication method further include:

Each frame the first image data that described image input window is saved are stored in the first storage region；

Before the step of the first image data that the camera for obtaining the first terminal is acquired according to the second preset frame rate, The video communication method further include:

Second image data described in each frame of the camera acquisition of the first terminal is stored in the second storage region；

It is described that the first image data and the second image data are subjected to synthesis processing, the step of generating third image data, Include:

For the first image data of each frame in first storage region, the image data of odd-numbered line is extracted；

For the second image data of each frame in second storage region, the image data of even number line is extracted；

By the image data of the odd-numbered line of extraction and even number line according to extract before each affiliated line number of image data sequence into Row synthesis, generates third image data；

The third image data is stored in third storage region.

2. video communication method according to claim 1, which is characterized in that the acquisition described image input window according to Before the step of first image data of the first preset frame rate storage, the video communication method further include:

It detects track of the first terminal user in described image input window and draws operation；

According to first preset frame rate, the track that will test draws the corresponding track of operation and is stored as first figure As data.

3. video communication method according to claim 1 or 2, which is characterized in that first preset frame rate and described the Two preset frame rates are identical.

4. video communication method according to claim 1, which is characterized in that described to be sent to the third image data After the step of second terminal, the video communication method further include:

Receive the 4th image data that the second terminal is sent；

Video image display window in video calling interface shows the 4th image data；

Wherein, the 4th image data are as follows: the 5th image data and display for acquiring the camera of the second terminal exist The 6th image data that image input windows in the video calling interface of the second terminal are stored, after carrying out synthesis processing The image data of generation.

5. a kind of mobile terminal is applied to first terminal characterized by comprising

First display module, it is defeated in video calling interface display image for being carried out in video call process with second terminal Enter window；

First obtains module, default according to first for obtaining described image input window shown by first display module First image data of frame per second storage；

Second obtains module, the second image data that the camera for obtaining first terminal is acquired according to the second preset frame rate；

Processing module obtains what module obtained for obtaining the first image data and described second that module obtains for described first Second image data carries out synthesis processing, generates third image data；

Sending module, the third image data for generating the processing module are sent to the second terminal；

Second memory module, each frame the first image data for saving described image input window are stored in first In storage region；

Third memory module, for the second image data described in each frame of the camera acquisition of the first terminal to be stored in In second storage region；

The processing module includes:

First processing units, for extracting odd-numbered line for the first image data of each frame in first storage region Image data；

The second processing unit, for extracting even number line for the second image data of each frame in second storage region Image data；

Third processing unit, the odd-numbered line and described the second processing unit for extracting the first processing units extract The image data of even number line synthesized according to the sequence of each affiliated line number of image data before extracting, generate third picture number According to；

First storage unit, the third image data for generating the third processing unit are stored in third storage region In.

6. mobile terminal according to claim 5, which is characterized in that further include:

Detection module draws operation for detecting track of the first terminal user in described image input window；

First memory module, for according to first preset frame rate, the track that the detection module is detected to be drawn It operates corresponding track and is stored as the first image data.

7. mobile terminal according to claim 5 or 6, which is characterized in that first preset frame rate is pre- with described second If frame per second is identical.

8. mobile terminal according to claim 5, which is characterized in that further include:

Receiving module, the 4th image data sent for receiving the second terminal；

Second display module shows that the receiving module is received for the video image display window in video calling interface The 4th image data；