CN101938623A - Multipath image transmission method and terminal based on video call - Google Patents

Multipath image transmission method and terminal based on video call Download PDF

Info

Publication number
CN101938623A
CN101938623A CN 201010279102 CN201010279102A CN101938623A CN 101938623 A CN101938623 A CN 101938623A CN 201010279102 CN201010279102 CN 201010279102 CN 201010279102 A CN201010279102 A CN 201010279102A CN 101938623 A CN101938623 A CN 101938623A
Authority
CN
China
Prior art keywords
view data
terminal
camera
synthetic
scaling
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 201010279102
Other languages
Chinese (zh)
Inventor
陈维山
赵翠琴
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yulong Computer Telecommunication Scientific Shenzhen Co Ltd
Original Assignee
Yulong Computer Telecommunication Scientific Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yulong Computer Telecommunication Scientific Shenzhen Co Ltd filed Critical Yulong Computer Telecommunication Scientific Shenzhen Co Ltd
Priority to CN 201010279102 priority Critical patent/CN101938623A/en
Publication of CN101938623A publication Critical patent/CN101938623A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Image Processing (AREA)
  • Studio Devices (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the invention discloses a multipath image transmission method based on a video call, comprising the following steps of: acquiring at least two image data of a home terminal in the video call process; carrying out synthesis processing on the acquired image data to generate synthetized image data; coding the synthetized image data into image data with a specific format, and transmitting the image data with the specific format to a terminal carrying out the video call with the home terminal. Correspondingly, the embodiment of the invention also discloses a terminal. A plurality of paths of image data can be simultaneously transmitted at a time by adopting the invention, thereby avoiding the complicated operation of manually switching a camera at present so as to select the transmitted image data to promote the user experience.

Description

A kind of multiway images transmission method and terminal based on video calling
Technical field
The present invention relates to communication technical field, relate in particular to a kind of multiway images transmission method and terminal based on video calling.
Background technology
Along with development of Communication Technique, the develop rapidly of 3G (3rd-generation, 3G (Third Generation) Moblie technology) especially in recent years, existing terminal, particularly portable terminal have also correspondingly been carried out huge improvement.
Existing terminal comprises: broadband access network, and terminal office, law enforcement and commercial affairs, video calling (Video Phone, VP), terminal TV, wireless search, terminal music, multiple application such as terminal network game.With the portable terminal is example, existing portable terminal generally includes a plurality of cameras, such as: TD (Time Division-SynchronousCode Division Multiple Access, TD-SCDMA, the CDMA (Code Division Multiple Access) that time-division is synchronous) mobile phone terminal comprises preceding camera and back camera totally two cameras, when carrying out the VP application, mobile phone terminal is encoded to the view data of front camera and rear camera picked-up respectively, give the other side by network with the image data transmission of local terminal, the data of transmission can be the view data of the preceding camera picked-up behind the coding, it also can be the view data that the back camera behind the coding obtains, after distant terminal receives the image transmitted data, decode and show.
Mainly there is following defective in the image transmission plan that existing terminal is carried out video calling:
1, only can realize the transmission of single channel image.In VP uses, this end subscriber selects to use certain camera by menu, in image transmission course, network can only transmit a view data that camera absorbed, can not realize that simultaneously same, distant terminal can only show a picture material of local terminal with the view data of former and later two cameras or the picked-up of a plurality of camera, can't manyly understand the local terminal situation better, reduce user experience.
2, user experience is low.Because in the image transmission course that VP uses, the user need manually select certain camera by menu, when needs frequently switch camera, need the user to carry out frequent manual switchover operation, reduced user's experience.
Summary of the invention
Problem to be solved by this invention is, a kind of multiway images transmission method and terminal based on video calling is provided, can disposablely transmit the multiway images data simultaneously, avoid existing manual switchover camera, promote user experience to select the troublesome operation of image transmitted data.
In order to address the above problem, the embodiment of the invention provides a kind of multiway images transmission method based on video calling, comprising:
In video call process, obtain the view data of two-way at least of local terminal;
The described view data of obtaining of two-way is at least synthesized processing, generate one tunnel synthetic view data;
With described synthetic coded image data is the view data of specific format, and the image data transmission of described specific format is extremely carried out the terminal of video calling with local terminal.
Wherein, the described view data of two-path video at least comprises: the view data that at least two cameras of local terminal absorb respectively.
Wherein, described the described view data of obtaining of two-way is at least synthesized processing, generates one tunnel synthetic view data, comprising:
Be respectively described each road view data of obtaining scaling is set, wherein, the scaling sum of the various view data of described setting is 1;
Described each road view data is carried out the convergent-divergent processing of picture size respectively according to scaling separately;
Described each road view data after the convergent-divergent processing is synthesized one tunnel view data.
Wherein, described each road view data that is respectively is provided with before the scaling, and also comprise: arbitrary camera that local terminal is set is main camera, and other cameras except that this camera are auxilliary camera; Wherein, the scaling that is provided with for the view data of described main camera picked-up is more than or equal to the scaling that be the view data setting of arbitrary auxilliary camera picked-up.
Wherein, after the described view data of two-way at least of obtaining local terminal, also comprise: show the described view data of obtaining of two-way at least at local terminal.
Correspondingly, the embodiment of the invention also provides a kind of terminal, comprising:
Acquisition module is used at video call process, obtains the view data of two-way at least of local terminal;
Synthetic processing module is used for the view data that described acquisition module obtains is synthesized processing, generates one tunnel synthetic view data;
Coding module, the coded image data that is used for described synthetic processing module is generated is the view data of specific format;
Baseband module, be used for the image data transmission of the specific format behind the described coding module coding to the terminal of local terminal video calling.
Wherein, described acquisition module comprises at least two cameras.
Wherein, described synthetic processing module comprises:
Ratio is provided with the unit, is used to be respectively each road view data that described acquisition module obtains scaling is set, and wherein, the scaling sum of each road view data of described setting is 1;
Processing unit, the convergent-divergent that is used for the scaling that described each road view data is provided with the unit setting according to described ratio is respectively carried out picture size is handled;
Synthesis unit is used for described each the road view data after the described processing unit processes is synthesized one tunnel view data.
Wherein, described synthetic processing module also comprises:
The major-minor unit that is provided with, the arbitrary camera that is used to be provided with local terminal is main camera, other cameras except that this camera are auxilliary camera; Wherein, the unit is set is the scaling that scaling that the view data of described main camera picked-up is provided with is provided with more than or equal to the view data for arbitrary auxilliary camera picked-up to described ratio.
Wherein, described terminal also comprises:
Receiver module is used at video call process, receives the view data of carrying out the specific format that the terminal of video calling sends with local terminal;
Decoder module, the described receiver module that is used to decode receives the view data of described specific format;
Display module is used to the view data of two-way at least that shows that described acquisition module obtains; Or, show the view data that described decoder module decodes.
Implement the embodiment of the invention, have following beneficial effect:
1, the embodiment of the invention is obtained the view data of local terminal by at least two cameras, the multiway images data of obtaining are synthesized processing, transfer to the terminal of video calling after view data after synthetic encoded, realize the disposable transmission simultaneously of multiway images, promoted user experience;
2, the disposable view data that each camera is obtained of the embodiment of the invention is transmitted simultaneously, has avoided existing manual switchover camera to select the troublesome operation of image transmitted data, has further promoted user experience.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, to do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art below, apparently, accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the structural representation of the embodiment of the multiway images system based on video calling of the present invention;
Fig. 2 is the structural representation of the embodiment of terminal of the present invention;
Fig. 3 is the structural representation of the acquisition module of terminal shown in Figure 2;
Fig. 4 is the structural representation of first embodiment of the synthetic processing module of terminal shown in Figure 2;
Fig. 5 carries out the synthetic schematic diagram of handling of view data for synthetic processing module shown in Figure 4;
Fig. 6 is the structural representation of second embodiment of the synthetic processing module of terminal shown in Figure 2;
Fig. 7 carries out the synthetic schematic diagram of handling of view data for synthetic processing module shown in Figure 6;
Fig. 8 is the flow chart of first embodiment of the multiway images transmission method based on video calling of the present invention;
Fig. 9 is the flow chart of second embodiment of the multiway images transmission method based on video calling of the present invention;
Figure 10 is the flow chart of the 3rd embodiment of the multiway images transmission method based on video calling of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the invention, the technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that is obtained under the creative work prerequisite.
See also Fig. 1, be the structural representation of the embodiment of the multiway images system based on video calling of the present invention; Described system comprises: terminal A, communication network and terminal B.
Described terminal A and terminal B include but not limited to: PDA (Personal Digital Assistant, personal digital assistant), mobile phone, smart mobile phone, palmtop PC, laptop computer, PC (Personal Computer, PC) machine, 3G mobile terminal etc. are supported the communication terminal that VP uses.
Described terminal A, be used for carrying out the process of video calling with described terminal B, obtain the view data of two-way at least of local terminal, the described view data of obtaining synthesized be treated to one tunnel synthetic view data, with synthetic coded image data is the view data of specific format, and with the image data transmission of described specific format to described terminal B;
In the specific implementation, described specific format is the form that the described terminal B of described terminal A is supported, such as: when described terminal A and terminal B are the TD mobile phone terminal, then its coded data form is form H.263; Be understandable that data format herein is only for for example, it can also be AVI (Audio VideoInterleaved, Audio Video Interleaved form), H.264 waits data format, or other data formats of supporting of terminal.
Described terminal B is used for receiving terminal A image transmitted data, and described view data is decoded, and therefrom decodes synthetic view data, and shows described synthetic view data;
Described communication network is used for the data that transmission terminal A and terminal B carry out video calling, comprises voice data, vedio data etc., and in the specific implementation, described communication network can be 3G network.
In the specific implementation, above-mentioned terminal A is as the transmitting terminal of video calling, terminal B is as the receiving terminal of video calling, be understandable that, the transmitting terminal of described video calling is relative with receiving terminal, promptly in video call process, terminal A synthesizes processing with the multiway images data of local terminal, the coding and transfer to terminal B after, equally, terminal A can receive that terminal B sends in video call process carries out the view data of the specific format that obtains after the similar processing, after the view data of terminal A to the specific format that receives terminal B transmission, decode, and show the view data that decodes.In addition, in order to improve efficiency of transmission, terminal A or B also can compress view data, processing such as packing when synthetic view data is encoded, and compression packing processing procedure and the existing data compression processing procedure of packing is similar, does not give unnecessary details at this.
For clearer explanation the present invention, will the terminal of the multiway images system based on video calling of the present invention be described in detail below.
See also Fig. 2, be the structural representation of the embodiment of terminal of the present invention;
As shown in Figure 2, described terminal comprises: acquisition module 10, synthetic processing module 20, coding module 30 and baseband module 40.
Described acquisition module 10 is used at video call process, obtains the view data of two-way at least of local terminal;
Usually, portable terminal possesses a plurality of cameras usually, such as: the TD mobile phone terminal comprises former and later two cameras, and promptly the described acquisition module 10 of TD mobile phone terminal comprises former and later two cameras, is used to absorb the two-way view data of local terminal respectively.When described terminal possessed the hardware configuration of a plurality of cameras, the acquisition module 10 of described terminal comprised this a plurality of cameras, was used for absorbing respectively the multiway images data of local terminal.
Described synthetic processing module 20 is used for the view data that described acquisition module 10 obtains is synthesized processing, generates one tunnel synthetic view data;
In the specific implementation, 20 pairs of described view data of obtaining of described synthetic processing module are synthesized the main purpose of handling: the multiway images data are synthesized one tunnel view data, particularly, its synthetic mode of handling can be multiple, it can adopt existing various synthetic processing mode, such as: after the two-way image can being dwindled, with about mode put together side by side, synthesize one tunnel view data, and the view data about marking is respectively from certain camera in this synthetic view data; Or after the two-way view data dwindled, put together in mode up and down, synthesize one tunnel view data, and in this synthetic view data mark view data up and down respectively from certain camera; In addition, the embodiment of the invention also can adopt corresponding composite software to carry out the synthetic processing of view data.
Described coding module 30, being used for described synthetic processing module 20 synthetic coded image datas is the view data of specific format;
In the specific implementation, described specific format is described terminal and carries out the form that the distant terminal of video calling is supported with described terminal, such as: two terminals of carrying out video calling are the TD mobile phone terminal, and then its coded data form is form H.263; Be understandable that data format herein is only for for example, it can also be AVI (Audio Video Interleaved, Audio Video Interleaved form), H.264 waits data format, or other data formats of supporting of terminal.
Described baseband module 40 is used for described coding module 30 encoded image data are transferred to terminal with the local terminal video calling by communication network.
In the specific implementation, described baseband module 40 adopts the described encoded image data of baseband transmission, after the terminal of carrying out video calling with local terminal receives this view data, therefrom decode described synthetic image, and show described synthetic image, like this, the terminal of carrying out video calling with local terminal just can have been seen the picture material of at least two cameras.
See also Fig. 2 again, described terminal also comprises: receiver module 50, decoder module 60 and display module 70.
Described receiver module 50 is used at video call process, receives the view data of carrying out the specific format that the terminal of video calling sends with local terminal;
As described above, in video call process, transmitting terminal is relative with receiving terminal, promptly in video call process, described terminal with the multiway images data of local terminal synthesize processing, encode and transfer to carry out the terminal of video calling with local terminal after, described receiver module 50 promptly receives the view data of carrying out the specific format that terminal sent of video calling with local terminal.
Described decoder module 60, the described receiver module 50 that is used to decode receives the view data of described specific format;
In the specific implementation, when the terminal of carrying out video calling with local terminal possesses at least two cameras, and when the view data that this at least two cameras absorbed is adopted the processing mode identical with local terminal, the decode procedure of the view data of 60 pairs of described specific formats of described decoder module is corresponding with the cataloged procedure that described coding module 30 is carried out, and described decoder module 60 decodes synthetic view data from the view data of described specific format.Be understandable that when the terminal of carrying out video calling with local terminal only had a camera, its decoder module 60 decoded the view data of this camera picked-up of a route, this process promptly with an existing single channel image data transmission scheme compatibility, do not give unnecessary details at this.In addition, because in order to improve efficiency of transmission, carry out the terminal of video calling when synthetic view data is encoded with local terminal, also can compress view data, processing such as packing, therefore, when the view data of 60 pairs of described specific formats of described decoder module of local terminal is decoded, can corresponding processing such as this specific view data decompresses, unpacks not given unnecessary details at this yet.
Described display module 60 is used to the view data of two-way at least that shows that described acquisition module 10 obtains; Or, show the view data that described decoder module 60 decodes.
In the specific implementation, after described acquisition module 10 gets access to view data, transfer to described display module 70 and carry out the demonstration of the view data of local terminal; In addition, described display module 70 shows the view data that described decoder module 60 decodes at local terminal, and promptly described display module 70 also is used to carry out the demonstration of strange land (opposite end) view data.
The embodiment of the invention is obtained the view data of local terminal by at least two cameras, the multiway images data of obtaining are synthesized processing, transfer to the terminal of video calling after view data after synthetic encoded, realized the disposable transmission simultaneously of multiway images, promoted user experience; In addition, the disposable view data that each camera is obtained is transmitted simultaneously, has avoided existing manual switchover camera to select the troublesome operation of image transmitted data, has further promoted user experience.
For clearer explanation the present invention, will each module of described terminal be described in detail below.
See also Fig. 3, be the structural representation of the acquisition module 10 of terminal shown in Figure 2; Described acquisition module 10 comprises at least two cameras, particularly, can be referring to Fig. 3, described acquisition module 10 comprises: a plurality of cameras such as camera 101 and camera 102.
In the specific implementation, described acquisition module 10 included camera numbers are that the hardware configuration by described terminal is determined, when described terminal possessed the hardware configuration of two cameras, described acquisition module 10 can comprise camera 101 and camera 102 as shown in Figure 2; When described terminal possesses the hardware configuration of a plurality of cameras, described acquisition module 10 comprises this a plurality of cameras, described a plurality of camera absorbs the view data of local terminal respectively, and the view data of obtaining is respectively transferred to described synthetic processing module 20 synthesize processing.
The embodiment of the invention can disposablely be transmitted the multiway images data simultaneously, has avoided existing manual switchover camera to select the troublesome operation of image transmitted data, has promoted user experience.
See also Fig. 4, be the structural representation of first embodiment of the synthetic processing module of terminal shown in Figure 2;
As described above, 20 pairs of described view data of obtaining of described synthetic processing module are synthesized the main purpose of handling: the multiway images data are synthesized one tunnel view data, in the specific implementation, 20 pairs of described view data of obtaining of described synthetic processing module are synthesized the main purpose of handling: the multiway images data are synthesized one tunnel view data, particularly, its synthetic mode of handling can be multiple, it can adopt existing various synthetic processing mode, such as: after the two-way image can being dwindled, with about mode put together side by side, synthesize one tunnel view data, and the view data about marking is respectively from certain camera in this synthetic view data; Or after the two-way view data dwindled, put together in mode up and down, synthesize one tunnel view data, and in this synthetic view data mark view data up and down respectively from certain camera; In addition, the embodiment of the invention also can adopt corresponding composite software to carry out the synthetic processing of view data.
Fig. 4 shows a kind of embodiment of the synthetic processing mode of described synthetic processing module 20.
As shown in Figure 4, described synthetic processing module 20 comprises: ratio is provided with unit 201, processing unit 202 and synthesis unit 203.
Described ratio is provided with unit 201, is used to be respectively each road view data that described acquisition module 10 obtains scaling is set, and wherein, the scaling sum of each road view data of described setting is 1;
In the specific implementation, described ratio is provided with unit 201 can carry out the setting of ratio according to user's the actual needs or the performance of terminal, does not give unnecessary details at this.
Described processing unit 202 is used for that described each road view data is provided with the convergent-divergent that scaling that unit 201 is provided with carries out picture size according to described ratio respectively and handles;
Described synthesis unit 203 is used for described each the road view data after described processing unit 202 processing is synthesized one tunnel view data.
Illustrate that with an instantiation described synthetic processing module 20 carries out the synthetic detailed process of handling of multiway images data below.
See also Fig. 5, for synthetic processing module shown in Figure 4 20 is carried out the synthetic schematic diagram of handling of view data;
Suppose that portable terminal comprises camera 1 and 2 two cameras of camera, the size of this camera 1 picked-up local terminal is the view data 1 of 176*144, and the size of these camera 2 picked-up local terminals is the view data 2 of 176*144.
It is 1/2 for view data 1 is provided with scaling that described ratio is provided with unit 201, and for view data 2 scaling being set is 1/2, and the scaling sum of promptly described view data 1 and described view data 2 is 1;
Described processing unit 202 is reduced into 176*144*1/2 with the size of view data 1 respectively, and the size of view data 2 is reduced into 176*144*1/2.
The view data 1 of the 176*144*1/2 size after described synthesis unit 203 will dwindle and the view data of 17,6*1,44*,1/2 2 synthetic one tunnel sizes are the view data of 176*144.
The embodiment of the invention is obtained the view data of local terminal by at least two cameras, and the multiway images data of obtaining are synthesized processing, has realized the disposable transmission simultaneously of multiway images, has promoted user experience.
See also Fig. 6, be the structural representation of second embodiment of the synthetic processing module of terminal shown in Figure 2;
As described above, 20 pairs of described view data of obtaining of described synthetic processing module are synthesized the main purpose of handling: the multiway images data are synthesized one tunnel view data, particularly, its synthetic mode of handling can be multiple, it can adopt the existing various synthetic processing mode that exists, and comprises adopting corresponding composite software to synthesize the mode of handling.Fig. 6 shows the another kind of embodiment of the synthetic processing mode of described synthetic processing module 20.
As shown in Figure 6, described synthetic processing module 20 comprises: the major-minor unit 204 that is provided with, ratio is provided with unit 201, processing unit 202 and synthesis unit 203.Wherein, described ratio is provided with unit 201, and processing unit 202 is identical with each unit embodiment illustrated in fig. 4 with synthesis unit 203, does not give unnecessary details at this.
The described major-minor unit 204 that is provided with, the arbitrary camera that is used to be provided with local terminal is main camera, other cameras except that this camera are auxilliary camera; Wherein, described ratio is provided with the scaling that scaling that unit 201 is provided with for the view data of described main camera picked-up is provided with more than or equal to the view data for arbitrary auxilliary camera picked-up.
In the specific implementation, be that the view data that main camera absorbs is provided with suitable ratio but passing ratio is provided with unit 201, thereby the view data that main camera is absorbed is arranged in the important position of synthetic view data in synthetic processing procedure.
Illustrate that with an instantiation described synthetic processing module 20 carries out the synthetic detailed process of handling of multiway images data below.
See also Fig. 7, for synthetic processing module shown in Figure 6 20 is carried out the synthetic schematic diagram of handling of view data;
Suppose that portable terminal comprises camera 1 and 2 two cameras of camera, the size of this camera 1 picked-up local terminal is the view data 1 of 176*144, and the size of these camera 2 picked-up local terminals is the view data 2 of 176*144.
Describedly major-minorly unit 204 is set camera 1 is set is main camera, camera 2 is auxilliary camera, and certainly, its setting is also commutative, does not give unnecessary details at this.
It is 2/3 for view data 1 is provided with scaling that described ratio is provided with unit 201, for view data 2 is provided with scaling is 1/3, the scaling sum that is described view data 1 and described view data 2 is 1, and the scaling of described view data 1 is greater than the scaling of view data 2;
Described processing unit 202 is reduced into 176*144*2/3 with the size of view data 1 respectively, and the size of view data 2 is reduced into 176*144*1/3.
The view data 1 of the 176*144*2/3 size after described synthesis unit 203 will dwindle and the view data of 17,6*1,44*,1/3 2 synthetic one tunnel sizes are the view data of 176*144.
Be understandable that, the structure of Fig. 4 and two synthetic processing modules 20 shown in Figure 6 is only for for example, the synthetic processing mode of concrete image can be for multiple, in the embodiment of the invention, after described acquisition module 10 gets access to the multiway images data and transfers to described synthetic processing module 20, no matter described synthetic processing module 20 adopts the synthetic processing mode of which kind of image, and its purpose need reach: the multiway images data are synthesized one tunnel view data, transfer to subsequent module then and carry out respective handling.
The embodiment of the invention is obtained the view data of local terminal by at least two cameras, and the multiway images data of obtaining are synthesized processing, has realized the disposable transmission simultaneously of multiway images, has promoted user experience.
For clearer explanation the present invention, will describe in detail to the detailed process of terminal enforcement of the present invention below based on the multiway images transmission method of video calling.
See also Fig. 8, be the flow chart of first embodiment of the multiway images transmission method based on video calling of the present invention; Described method comprises:
S101 in video call process, obtains the view data of two-way at least of local terminal;
Usually, portable terminal possesses a plurality of cameras usually, such as: the TD mobile phone terminal comprises former and later two cameras, and described S101 adopts described former and later two cameras, the two-way view data of picked-up local terminal.When described terminal possessed the hardware configuration of a plurality of cameras, described S101 adopted these a plurality of cameras, absorbs the multiway images data respectively.
S102 synthesizes processing with the described view data of obtaining of two-way at least, generates one tunnel synthetic view data;
In the specific implementation, described S102 synthesizes the main purpose of handling to the described view data of obtaining: the multiway images data are synthesized one tunnel view data, particularly, its synthetic mode of handling can be multiple, it can adopt the existing various synthetic processing mode that exists, such as: after the two-way image can being dwindled, with about mode put together side by side, synthesize one tunnel view data, and the view data about marking is respectively from certain camera in this synthetic view data; Or after the two-way view data dwindled, put together in mode up and down, synthesize one tunnel view data, and in this synthetic view data mark view data up and down respectively from certain camera; In addition, the embodiment of the invention also can adopt corresponding composite software to carry out the synthetic processing of view data.
S103 is the view data of specific format with described synthetic coded image data;
In the specific implementation, described specific format is described terminal and carries out the form that the distant terminal of video calling is supported with described terminal, such as: two terminals of carrying out video calling are the TD mobile phone terminal, and then its coded data form is form H.263; Be understandable that data format herein is only for for example, it can also be AVI, H.264 waits data format, or other data formats of supporting of terminal.
S104, with the image data transmission of described specific format to carrying out the terminal of video calling with local terminal.
In the specific implementation, described S104 adopts the described encoded image data of baseband transmission, after the terminal of carrying out video calling with local terminal receives this view data, therefrom decode described synthetic image, and show described synthetic image, like this, the terminal of carrying out video calling with local terminal just can have been seen the picture material of at least two cameras.
Be understandable that, because in video call process, transmitting terminal is relative with receiving terminal, promptly in video call process, described terminal has been carried out the step of above-mentioned S101 to S104: with the multiway images data of local terminal synthesize processing, encode and transfer to carry out the terminal of video calling with local terminal after, promptly receive the view data of carrying out the specific format that terminal sent of video calling with local terminal; Local terminal decodes synthetic view data from the view data of the specific format of described reception, and in the described view data that decodes of local terminal demonstration, particularly, when the terminal of carrying out video calling with local terminal possesses at least two cameras, and when the view data that this at least two cameras absorbed is adopted the processing mode identical with local terminal, local terminal decodes synthetic view data from the view data of described specific format, and shows the view data that this is synthetic.Be understandable that, when the terminal of carrying out video calling with local terminal only had a camera, local terminal decoded the view data of this camera picked-up of a route, and shows this road view data, this process promptly with an existing single channel image data transmission scheme compatibility, do not give unnecessary details at this.In addition, because in order to improve efficiency of transmission, carry out the terminal of video calling when synthetic view data is encoded with local terminal, also can compress view data, processing such as packing, therefore, when local terminal is decoded to the view data of described specific format, can corresponding processing such as this specific view data decompresses, unpacks not given unnecessary details at this yet.
The embodiment of the invention is obtained the view data of local terminal by at least two cameras, the multiway images data of obtaining are synthesized processing, transfer to the terminal of video calling after view data after synthetic encoded, realized the disposable transmission simultaneously of multiway images, promoted user experience; In addition, the disposable view data that each camera is obtained is transmitted simultaneously, has avoided existing manual switchover camera to select the troublesome operation of image transmitted data, has further promoted user experience.
See also Fig. 9, be the flow chart of second embodiment of the multiway images transmission method based on video calling of the present invention, described method comprises:
S201, at least two cameras of local terminal obtain the view data of two-way at least of local terminal;
S202, local terminal shows the described view data of obtaining of two-way at least;
In the specific implementation, described S202 has realized the demonstration of local view data.
S203, arbitrary camera that local terminal is set is main camera, other cameras except that this camera are auxilliary camera;
In the specific implementation, suppose that portable terminal comprises camera 1 and 2 two cameras of camera, the size of this camera 1 picked-up local terminal is the view data 1 of 176*144, and the size of these camera 2 picked-up local terminals is the view data 2 of 176*144.
It is main camera that described S203 is provided with camera 1, and camera 2 is auxilliary camera, and certainly, its setting is also commutative, does not give unnecessary details at this.
S204 is respectively the described view data of obtaining everywhere scaling is set;
In the specific implementation, described S204 can carry out the setting of ratio according to user's the actual needs or the performance of terminal, does not give unnecessary details at this.Wherein, the scaling sum of each road view data of described setting is 1.
As above-mentioned, described S204 is that scaling is set is 2/3 to the view data 1 of main camera 1 picked-up, be that scaling is set is 1/3 for the view data 2 of auxilliary camera 2 picked-ups, the scaling sum that is described view data 1 and described view data 2 is 1, and the scaling of described view data 1 is greater than the scaling of view data 2;
S205 carries out described each road view data the convergent-divergent processing of picture size respectively according to scaling separately;
In the specific implementation, described S205 is reduced into 176*144*2/3 with the size of view data 1 respectively, and the size of view data 2 is reduced into 176*144*1/3.
S206 synthesizes one tunnel view data with described each the road view data after the convergent-divergent processing;
The view data 1 of the 176*144*2/3 size after described S206 will dwindle and the view data of 17,6*1,44*,1/3 2 synthetic one tunnel sizes are the view data of 176*144.
S207 is the view data of specific format with synthetic coded image data;
S208 transfers to described encoded image data the terminal of carrying out video calling with local terminal;
S209 carries out the terminal of video calling described image encoded data is decoded with local terminal, obtain described synthetic view data;
S210, the terminal of carrying out video calling with local terminal shows the described synthetic view data that decodes.
The embodiment of the invention can disposablely be transmitted the multiway images data simultaneously, has avoided existing manual switchover camera to select the troublesome operation of image transmitted data, has promoted user experience.
For clearer explanation the present invention, will illustrate that the multiway images transmission method based on video calling of the present invention describes in detail with instantiation below.
See also Figure 10, be the flow chart of the 3rd embodiment of the multiway images transmission method based on video calling of the present invention.
Suppose that terminal A dials the VP visual telephone or receive to listen a VP visual telephone, B sets up video calling with terminal, and terminal A and terminal B be the TD mobile phone terminal, and terminal A and terminal B include former and later two cameras.Described method comprises:
S301, camera before terminal A starts;
S302, the view data of described preceding camera picked-up terminal A;
S303, terminal A start the back camera;
S304, the view data of described back camera picked-up terminal A;
In the specific implementation, the step that terminal A carries out above-mentioned S301 and S303 can be simultaneously, and step that also can S303 was carried out before the step of S301 is carried out.
S305, terminal A show the two-way view data that described front camera and rear camera absorbs respectively;
Camera was main camera before S306, terminal A were provided with, and back camera is auxilliary camera;
The view data of camera and back camera shooting was provided with 2/3,1/3 scaling before S307, terminal A were respectively;
S308, terminal A are reduced into the picture size of the view data of preceding camera and back camera picked-up original 2/3 and 1/3 respectively;
S309, the described two-way view data after terminal A convergent-divergent is handled synthesizes one tunnel view data;
S310, terminal A is the view data of form H.263 with synthetic coded image data;
S311, terminal A with the image data transmission of described H.263 form to terminal B;
S312, the view data of the described H.263 form of terminal B decoding obtains described synthetic view data;
S313, terminal B show the described synthetic view data that decodes.
Description by the various embodiments described above, the embodiment of the invention is obtained the view data of local terminal by at least two cameras, the multiway images data of obtaining are synthesized processing, transfer to the terminal of video calling after view data after synthetic encoded, realize the disposable transmission simultaneously of multiway images, promoted user experience; In addition, the disposable view data that each camera is obtained of the present invention is transmitted simultaneously, has avoided existing manual switchover camera to select the troublesome operation of image transmitted data, has further promoted user experience.
One of ordinary skill in the art will appreciate that all or part of flow process that realizes in the foregoing description method, be to instruct relevant hardware to finish by computer program, described program can be stored in the computer read/write memory medium, this program can comprise the flow process as the embodiment of above-mentioned each side method when carrying out.Wherein, described storage medium can be magnetic disc, CD, read-only storage memory body (Read-Only Memory, ROM) or at random store memory body (Random Access Memory, RAM) etc.
Above disclosed only is preferred embodiment of the present invention, certainly can not limit the present invention's interest field with this, one of ordinary skill in the art will appreciate that all or part of flow process that realizes the foregoing description, and, still belong to the scope that invention is contained according to the equivalent variations that claim of the present invention is done.

Claims (10)

1. the multiway images transmission method based on video calling is characterized in that, comprising:
In video call process, obtain the view data of two-way at least of local terminal;
The described view data of obtaining of two-way is at least synthesized processing, generate one tunnel synthetic view data;
With described synthetic coded image data is the view data of specific format, and the image data transmission of described specific format is extremely carried out the terminal of video calling with local terminal.
2. the method for claim 1 is characterized in that, the described view data of two-path video at least comprises:
The view data that at least two cameras of local terminal absorb respectively.
3. method as claimed in claim 2 is characterized in that, described the described view data of obtaining of two-way is at least synthesized processing, generates one tunnel synthetic view data, comprising:
Be respectively described each road view data of obtaining scaling is set, wherein, the scaling sum of the various view data of described setting is 1;
Described each road view data is carried out the convergent-divergent processing of picture size respectively according to scaling separately;
Described each road view data after the convergent-divergent processing is synthesized one tunnel view data.
4. method as claimed in claim 3 is characterized in that, described each road view data that is respectively is provided with before the scaling, also comprises:
Arbitrary camera that local terminal is set is main camera, and other cameras except that this camera are auxilliary camera;
Wherein, the scaling that is provided with for the view data of described main camera picked-up is more than or equal to the scaling that be the view data setting of arbitrary auxilliary camera picked-up.
5. as each described method of claim 1-4, it is characterized in that, after the described view data of two-way at least of obtaining local terminal, also comprise:
Show the described view data of obtaining of two-way at least at local terminal.
6. a terminal is characterized in that, comprising:
Acquisition module is used at video call process, obtains the view data of two-way at least of local terminal;
Synthetic processing module is used for the view data that described acquisition module obtains is synthesized processing, generates one tunnel synthetic view data;
Coding module, the coded image data that is used for described synthetic processing module is generated is the view data of specific format;
Baseband module, be used for the image data transmission of the specific format behind the described coding module coding to the terminal of local terminal video calling.
7. terminal as claimed in claim 6 is characterized in that:
Described acquisition module comprises at least two cameras.
8. terminal as claimed in claim 7 is characterized in that, described synthetic processing module comprises:
Ratio is provided with the unit, is used to be respectively each road view data that described acquisition module obtains scaling is set, and wherein, the scaling sum of each road view data of described setting is 1;
Processing unit, the convergent-divergent that is used for the scaling that described each road view data is provided with the unit setting according to described ratio is respectively carried out picture size is handled;
Synthesis unit is used for described each the road view data after the described processing unit processes is synthesized one tunnel view data.
9. terminal as claimed in claim 8 is characterized in that, described synthetic processing module also comprises:
The major-minor unit that is provided with, the arbitrary camera that is used to be provided with local terminal is main camera, other cameras except that this camera are auxilliary camera;
Wherein, the unit is set is the scaling that scaling that the view data of described main camera picked-up is provided with is provided with more than or equal to the view data for arbitrary auxilliary camera picked-up to described ratio.
10. as each described terminal of claim 6-9, it is characterized in that, also comprise:
Receiver module is used at video call process, receives the view data of carrying out the specific format that the terminal of video calling sends with local terminal;
Decoder module, the described receiver module that is used to decode receives the view data of described specific format;
Display module is used to the view data of two-way at least that shows that described acquisition module obtains; Or, show the view data that described decoder module decodes.
CN 201010279102 2010-09-09 2010-09-09 Multipath image transmission method and terminal based on video call Pending CN101938623A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201010279102 CN101938623A (en) 2010-09-09 2010-09-09 Multipath image transmission method and terminal based on video call

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201010279102 CN101938623A (en) 2010-09-09 2010-09-09 Multipath image transmission method and terminal based on video call

Publications (1)

Publication Number Publication Date
CN101938623A true CN101938623A (en) 2011-01-05

Family

ID=43391727

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201010279102 Pending CN101938623A (en) 2010-09-09 2010-09-09 Multipath image transmission method and terminal based on video call

Country Status (1)

Country Link
CN (1) CN101938623A (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103428555A (en) * 2013-08-06 2013-12-04 乐视网信息技术(北京)股份有限公司 Multi-media file synthesis method, system and application method
CN104365088A (en) * 2012-06-08 2015-02-18 三星电子株式会社 Multiple channel communication using multiple cameras
CN104754192A (en) * 2013-12-26 2015-07-01 佳能株式会社 Imaging Apparatus And Method Of Controlling The Same
CN105657324A (en) * 2015-12-31 2016-06-08 宇龙计算机通信科技(深圳)有限公司 Method and device for processing video images, and terminals
WO2017092338A1 (en) * 2015-12-03 2017-06-08 乐视控股(北京)有限公司 Data transmission method and apparatus
CN107005703A (en) * 2016-09-09 2017-08-01 深圳市大疆创新科技有限公司 Method for encoding images and system
CN107071138A (en) * 2016-12-15 2017-08-18 北京佰人科技有限责任公司 The method and device of video calling
WO2017166360A1 (en) * 2016-04-01 2017-10-05 宇龙计算机通信科技(深圳)有限公司 Video calling method and device
CN108718378A (en) * 2013-09-12 2018-10-30 麦克赛尔株式会社 Device, video recorder and method
CN108924464A (en) * 2018-07-10 2018-11-30 腾讯科技(深圳)有限公司 Generation method, device and the storage medium of video file
CN111343502A (en) * 2020-03-30 2020-06-26 招商局金融科技有限公司 Video processing method, electronic device and computer readable storage medium
CN113315940A (en) * 2021-03-23 2021-08-27 海南视联通信技术有限公司 Video call method, device and computer readable storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004159014A (en) * 2002-11-05 2004-06-03 Nec Corp Digital camera attached mobile communication terminal
US20080095526A1 (en) * 2006-10-18 2008-04-24 Teng-Lung Chang Structure of photographic apparatus
CN201307872Y (en) * 2008-11-04 2009-09-09 宇龙计算机通信科技(深圳)有限公司 Multi-camera circuit

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004159014A (en) * 2002-11-05 2004-06-03 Nec Corp Digital camera attached mobile communication terminal
US20080095526A1 (en) * 2006-10-18 2008-04-24 Teng-Lung Chang Structure of photographic apparatus
CN201307872Y (en) * 2008-11-04 2009-09-09 宇龙计算机通信科技(深圳)有限公司 Multi-camera circuit

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10015440B2 (en) 2012-06-08 2018-07-03 Samsung Electronics Co., Ltd. Multiple channel communication using multiple cameras
CN104365088A (en) * 2012-06-08 2015-02-18 三星电子株式会社 Multiple channel communication using multiple cameras
CN103428555A (en) * 2013-08-06 2013-12-04 乐视网信息技术(北京)股份有限公司 Multi-media file synthesis method, system and application method
CN103428555B (en) * 2013-08-06 2018-08-10 乐视网信息技术(北京)股份有限公司 A kind of synthetic method of multimedia file, system and application process
CN108718378B (en) * 2013-09-12 2020-07-17 麦克赛尔株式会社 Image recording device and method
CN108718378A (en) * 2013-09-12 2018-10-30 麦克赛尔株式会社 Device, video recorder and method
CN104754192A (en) * 2013-12-26 2015-07-01 佳能株式会社 Imaging Apparatus And Method Of Controlling The Same
US9706109B2 (en) 2013-12-26 2017-07-11 Canon Kabushiki Kaisha Imaging apparatus having multiple imaging units and method of controlling the same
CN104754192B (en) * 2013-12-26 2018-01-05 佳能株式会社 Picture pick-up device and its control method
WO2017092338A1 (en) * 2015-12-03 2017-06-08 乐视控股(北京)有限公司 Data transmission method and apparatus
CN105657324A (en) * 2015-12-31 2016-06-08 宇龙计算机通信科技(深圳)有限公司 Method and device for processing video images, and terminals
WO2017166360A1 (en) * 2016-04-01 2017-10-05 宇龙计算机通信科技(深圳)有限公司 Video calling method and device
CN107005703A (en) * 2016-09-09 2017-08-01 深圳市大疆创新科技有限公司 Method for encoding images and system
US10972681B2 (en) 2016-09-09 2021-04-06 SZ DJI Technology Co., Ltd. Image encoding method and system
CN107071138A (en) * 2016-12-15 2017-08-18 北京佰人科技有限责任公司 The method and device of video calling
CN108924464A (en) * 2018-07-10 2018-11-30 腾讯科技(深圳)有限公司 Generation method, device and the storage medium of video file
CN108924464B (en) * 2018-07-10 2021-06-08 腾讯科技(深圳)有限公司 Video file generation method and device and storage medium
US11178358B2 (en) 2018-07-10 2021-11-16 Tencent Technology (Shenzhen) Company Limited Method and apparatus for generating video file, and storage medium
CN111343502A (en) * 2020-03-30 2020-06-26 招商局金融科技有限公司 Video processing method, electronic device and computer readable storage medium
CN113315940A (en) * 2021-03-23 2021-08-27 海南视联通信技术有限公司 Video call method, device and computer readable storage medium

Similar Documents

Publication Publication Date Title
CN101938623A (en) Multipath image transmission method and terminal based on video call
KR100735233B1 (en) System for providing personal broadcasting service
CN101583009B (en) Video terminal and method thereof for realizing interface content sharing
CN101697579B (en) Terminal with videophone function and method for adjusting video images thereof
CN102158681A (en) Method for coordinately shooting in videophone and mobile terminal
CN101237556A (en) Realization method, image display method and communication terminal for terminal with dual cameras
CN1783997A (en) Mobile multimedia terminal for digital video broadcast
CN102523501B (en) Synchronous playing method and system, mobile terminal, digital terminal and server
PL368751A1 (en) Multimedia broadcasting, broadcast services for cell phone and other users and modified sim card and related means for enabling such broadcast reception
CN102246468A (en) Networking method,server equipment,client equipment and network system
KR100783103B1 (en) Short message service apparatus and support method using the digital broadcasting
CN108933914B (en) Method and system for carrying out video conference by using mobile terminal
CN101729752A (en) Television system, communication control method thereof and terminal thereof
EP1746829A2 (en) Mobile communication terminal and method of video communications thereof
CN103096054A (en) Video image filtering processing method and device thereof
CN115250356A (en) Multi-camera switchable virtual camera of mobile phone
CN202095010U (en) 3rd generation (3G) or 4th generation (4G) television live broadcast vehicle with base station
CN101517649A (en) Video pattern thumbnails and method
CN101489190A (en) Mobile terminal, multimedia information sharing method and system thereof
CN106506326B (en) Video call method, terminal and system
CN102045580A (en) Method and system for processing video
KR20120009948A (en) Apparatus and method for generating a three-dimension image data in portable terminal
CN103297406A (en) Method for expanding screen of hand-held device
KR100722466B1 (en) Mobile communication terminal having an image call function using an overlay buffer and controlling method therefore
CN101848347B (en) Method for sharing CMMB video and mobile terminal providing sharing service

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20110105