CN106303361A - Image processing method, device, system and graphic process unit in video calling - Google Patents

Image processing method, device, system and graphic process unit in video calling Download PDF

Info

Publication number
CN106303361A
CN106303361A CN201510319896.4A CN201510319896A CN106303361A CN 106303361 A CN106303361 A CN 106303361A CN 201510319896 A CN201510319896 A CN 201510319896A CN 106303361 A CN106303361 A CN 106303361A
Authority
CN
China
Prior art keywords
image
client
video calling
parameter value
adjusted
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510319896.4A
Other languages
Chinese (zh)
Inventor
於聪
陶媛
严飞军
孙健康
裘钰钢
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nail Holding (cayman) Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201510319896.4A priority Critical patent/CN106303361A/en
Publication of CN106303361A publication Critical patent/CN106303361A/en
Pending legal-status Critical Current

Links

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

This application discloses the image processing method in a kind of video calling, in order to solve the inefficient problem existed for the existing mode carrying out image procossing of the video flowing of transmission in video calling.Method includes: GPU obtains pending image;Described pending image is the image in described video calling, or according to the image that generates of image in described video calling;During described video calling, according to Attribute tuning the first parameter value, the property value of pending image is adjusted.Disclosed herein as well is the image processing apparatus in a kind of video calling, system and graphic process unit.

Description

Image processing method, device, system and graphic process unit in video calling
Technical field
The application relates to image processing field, particularly relates to the image processing method in a kind of video calling, dress Put, system and graphic process unit.
Background technology
Video calling, is often referred to based on the Internet and mobile Internet, it is achieved pass the most in real time The voice made a gift to someone and a kind of communication mode of image.
Carry out video calling and need the terminal unit of at least two networkings.Can be by integrated at each terminal unit Software or the mode of third party software, it is achieved sound, the video flowing real-time Transmission between each terminal unit.Its In, terminal unit mentioned here, can be such as smart mobile phone, panel computer, intelligent television, individual Computer (Personal Computer, PC) etc..
In the prior art, carry out the video flowing of transmission between the terminal unit of video calling, be usually and do not have Standby any special-effect (such as atomizing effect, dim effect, rainbow effect, anaglyph, glass effects Deng) video flowing.According to prior art, if the image that user's expectation makes described video stream packets contain possess special Effect, or some other property value (such as picture size etc.) that expectation is to the image that described video stream packets contains Adjust, then need to be saved in video flowing this locality, and after video calling terminates, manually call image procossing Software (such as Photoshop), processes the image in video flowing.It should be noted that institute here The video flowing said, may include that the photographic head of the terminal unit that user uses gathers in video call process Video flowing, and/or with this terminal unit carry out video calling Correspondent Node send come video flowing.Here Described " special-effect " refer to that image is possessed, be different from the aobvious of the original image that camera collection arrives Show other display effects of effect.Usually, special-effect is the original image needing to arrive camera collection Property value (such as gray value, brightness value, transparence value, color-values etc.) be adjusted after could produce 's.
Obviously, due to needs user's manual engagement, can there is inefficient problem in above-mentioned processing mode.
Summary of the invention
The embodiment of the present application provides the image processing method in a kind of video calling, logical in order to solve for video The inefficient problem that in words, the existing mode carrying out image procossing of the video flowing of transmission exists.
The embodiment of the present application also provides for the image processing apparatus in a kind of video calling, in order to solve for video The inefficient problem that in call, the existing mode carrying out image procossing of the video flowing of transmission exists.
The embodiment of the present application also provides for the image processing system in a kind of video calling, in order to solve for video The inefficient problem that in call, the existing mode carrying out image procossing of the video flowing of transmission exists.
The embodiment of the present application also provides for a kind of graphic process unit (Graphics Processing Unit, GPU), In order to solve the effect existed for the existing mode carrying out image procossing of the video flowing of transmission in video calling The problem that rate is relatively low.
The embodiment of the present application employing following technical proposals:
A kind of image processing method in video calling, including:
GPU obtains pending image;Wherein, described pending image is the image in described video calling, The image that according to or, the image in described video calling generates;
GPU is during described video calling, according to Attribute tuning the first parameter value, to pending image Property value be adjusted;
Wherein, described video calling occurs between the first client and the second client;
Image in described video calling includes:
In this process, first client this locality camera collection to each two field picture of containing of video stream packets;
In this process, first client receive, the video stream packets that sent by the second client contains Each two field picture.
A kind of image processing method in video calling, including:
First client obtains the image in described video calling;
First client trigger graphic process unit GPU in this process according to Attribute tuning the first parameter value, The property value of the image in described video calling is adjusted;
Wherein, the image in described video calling, including at least one in following two kinds of images:
In this process, first client this locality camera collection to each two field picture of containing of video stream packets;
In this process, first client receive, the video stream packets that sent by the second client contains Each two field picture.
A kind of image processing method in video calling, including:
Server receives at least one client participating in video calling and sends out during described video calling Image in video calling that send, described;
Server obtains Attribute tuning the first parameter value;
The property value of the image in described video calling, according to Attribute tuning the first parameter value, is carried out by server Adjust;
Image after server will adjust is sent to participate in the client of described video calling;
Wherein, the image in described video calling includes:
In this process, by described at least one client this locality camera collection to video stream packets contain Each two field picture.
Image processing system in a kind of video calling, including graphic process unit GPU, wherein: GPU, uses In obtaining pending image, and during described video calling, according to Attribute tuning the first parameter value, The property value of pending image is adjusted;
Wherein, described pending image is the image in described video calling, or according to described video calling In image generate image;
Described video calling occurs between the first client and the second client;
Image in described video calling includes:
In this process, first client this locality camera collection to each two field picture of containing of video stream packets;
In this process, first client receive, the video stream packets that sent by the second client contains Each two field picture.
A kind of graphic process unit, described graphic process unit is positioned at first terminal equipment, described graphic process unit bag Include:
Image acquiring unit, is used for obtaining pending image;Wherein, described pending image is described video Image in call, or according to the image that generates of image in described video calling;
Adjustment unit, is used for during first terminal equipment and the second terminal unit carry out video calling, According to Attribute tuning the first parameter value, the property value of pending image is adjusted;
Wherein, at least one during the image in described video calling includes following two kinds of images:
In this process, first terminal equipment this locality camera collection to each two field picture of containing of video stream packets;
In this process, first terminal equipment receive, by second terminal unit send video stream packets The each two field picture contained.
A kind of image processing apparatus in video calling, including:
Image acquiring unit, for obtaining the image in described video calling;
Adjustment unit, is used for triggering graphic process unit GPU and joins according to Attribute tuning first in this process Numerical value, is adjusted the property value of the image in described video calling;
Wherein, the image in described video calling, including at least one in following two kinds of images:
In this process, first client this locality camera collection to each two field picture of containing of video stream packets;
In this process, first client receive, the video stream packets that sent by the second client contains Each two field picture.
A kind of image processing apparatus in video calling, including:
Image acquiring unit, for receiving at least one client participating in video calling at described video calling During send, image in described video calling;
Parameter value obtains unit, is used for obtaining Attribute tuning the first parameter value;
Adjustment unit, for obtaining, according to parameter value, Attribute tuning the first parameter value that unit obtains, to image The property value obtaining the image in the described video calling that unit receives is adjusted;
Transmitting element, the image after being adjusted by adjustment unit is sent to participate in the client of described video calling End;
Wherein, the image in described video calling includes:
In this process, by described at least one client this locality camera collection to video stream packets contain Each two field picture.
At least one technical scheme above-mentioned that the embodiment of the present application uses can reach following beneficial effect:
Due to during carrying out video calling, can be by GPU automatically according to Attribute tuning parameter value pair The property value of the image in video calling is adjusted, it is not necessary to user's manual operation, thus compared to existing In technology for the processing mode of the image in video calling, it is possible to increase for the figure in video calling The treatment effeciency of picture.
Accompanying drawing explanation
Accompanying drawing described herein is used for providing further understanding of the present application, constitutes the part of the application, The schematic description and description of the application is used for explaining the application, is not intended that the improper limit to the application Fixed.In the accompanying drawings:
Image processing method in a kind of video calling that Fig. 1 provides for the embodiment of the present application 1 realize flow process Schematic diagram;
The realization stream of the image processing method in a kind of video calling that Fig. 2 a provides for the embodiment of the present application 2 Journey schematic diagram;
Fig. 2 b is the schematic diagram of the various special-effect information of display on the first client end interface;
Fig. 2 c is the schematic diagram that the image in the video calling after adjusting is shown by the first client;
Fig. 2 d is a kind of interface schematic diagram that the first client is shown;
Image processing method in a kind of video calling that Fig. 3 provides for the embodiment of the present application 3 realize flow process Schematic diagram;
The concrete structure of the image processing system in a kind of video calling that Fig. 4 provides for the embodiment of the present application 4 Schematic diagram;
The concrete structure schematic diagram of a kind of GPU that Fig. 5 provides for the embodiment of the present application 5;
The concrete structure of the image processing apparatus in a kind of video calling that Fig. 6 provides for the embodiment of the present application 6 Schematic diagram;
The concrete structure of the image processing apparatus in a kind of video calling that Fig. 7 provides for the embodiment of the present application 7 Schematic diagram.
Detailed description of the invention
For making the purpose of the application, technical scheme and advantage clearer, specifically real below in conjunction with the application Execute example and technical scheme is clearly and completely described by corresponding accompanying drawing.Obviously, described Embodiment is only some embodiments of the present application rather than whole embodiments.Based on the enforcement in the application Example, the every other enforcement that those of ordinary skill in the art are obtained under not making creative work premise Example, broadly falls into the scope of the application protection.
Below in conjunction with accompanying drawing, describe the technical scheme that each embodiment of the application provides in detail.
Embodiment 1
For solving what the existing mode carrying out image procossing of the video flowing for transmitting in video calling existed Inefficient problem, the embodiment of the present application 1 provides the image processing method in a kind of video calling, the party Method realize schematic flow sheet as it is shown in figure 1, comprise the steps:
Step 11, GPU obtains pending image;
Pending image mentioned here, for the image in video calling;Or, for according in video calling Image generate image.
Wherein, video calling mentioned here typically occurs between at least two client.Such as occur Between first client and the second client.For ease of describing, in the embodiment of the present application 1, with video calling As a example by occurring between the first client and the second client, the method providing the embodiment of the present application 1 is entered Row is introduced.
In the embodiment of the present application, the first described client, may refer to install on the terminal device, use In the application realizing video calling;May also mean that the terminal unit itself that can carry out video calling.Typically Ground, this terminal unit possesses the hardware device supporting video calling, the most at least possesses photographic head, the most past Toward also possessing mike.This photographic head and mike can be provided in terminal unit, it is also possible to outside being It is connected to this terminal unit.When the first client is terminal unit itself, the first client described hereinafter The local photographic head of end, refers to the photographic head that this terminal unit possesses;When the first client sets for being arranged on terminal Standby upper, for realizing the application of video calling time, first client this locality photographic head described hereinafter, Refer to the photographic head that the terminal unit at this application place possesses.
For ease of describe, the embodiment of the present application all with the first client for install on the terminal device, be used for Illustrate as a example by realizing the application of video calling.
In the embodiment of the present application 1, the image in described video calling includes at least in following two kinds of images Kind:
During the first client and the second client carry out video calling, first client this locality shooting Each two field picture that the video stream packets that head collects contains;
During the first client and the second client carry out video calling, that the first client receives, Each two field picture that the video stream packets sent by the second client contains.
In the embodiment of the present application 1, this pending image that GPU obtains, the first client can be stored in Image in video calling local buffer, described.GPU can send receiving CPU After Image Acquisition instruction, from this image buffer, obtain the image that this video stream packets contains.
Or, this pending image that GPU obtains, can be to the figure in described video calling by CPU The image that picture generates after processing.Such as, the property value of the image in described video calling is carried out by CPU Adjust, obtain pending image and be sent to GPU or pending image is saved in image buffer Reinform GPU active obtaining.Specifically, CPU can be according to Attribute tuning the second parameter value, to described In image in video calling, the property value at least one region is adjusted, and obtains pending image and sends To GPU.
Specifically, CPU according to Attribute tuning the second parameter value, in the image in described video calling extremely The mode that the property value in a few region is adjusted may include that
CPU identifies the target possessing specific characteristic in the image in described video calling;
CPU is after identifying described target, according to Attribute tuning the second parameter value, to described target described In image in video calling, the property value of region is adjusted.
Wherein, specific characteristic mentioned here, can be, but not limited to as face characteristic.
In the embodiment of the present application, described attribute, refer to the attribute of image, including the brightness of image, gray scale, Transparency, definition, color, tone, saturation, form and aspect, color channel, level and contrast etc. In at least one.
Attribute tuning the second parameter value, may refer to each of the expected value of the attribute for image, such as image Individual (or part) pixel respective gray scale expected value, each respective color of (or part) pixel of image Expected value, etc.;Or, this Attribute tuning second parameter value, it is also possible to refer to the attribute for image The expectation of parameter value adjusts range value, such as image brightness expectation increase rate value " 10% ", For image definition expectation reduce range value " 50% ", for image each (or part) as The expectation of the respective gray value of element increases range value " 2 times ", etc..Due to either for the attribute of image Expected value, or for image attribute parameter value expectation adjust range value, follow-up all can be used for right The property value of the image in video calling is adjusted, so described expected value and described expectation are adjusted amplitude Primary system one named " Attribute tuning the second parameter value ".
Step 12, GPU is during described video calling, according to Attribute tuning the first parameter value, right The property value of pending image is adjusted.
Wherein, the definition of Attribute tuning the first parameter value mentioned here, and above for Attribute tuning The definition that two parameter values are given is identical, and here is omitted.
In the embodiment of the present application, can be that GPU compiles the program that can be performed by GPU so that GPU leads to Cross and run this program, it is achieved said method flow process.
For supporting that different video stream carries out different property values to be adjusted, and reaches the purpose being adjusted flexibly, one Planting in embodiment, GPU can use different Attribute tuning the first parameter values, it is achieved to different video stream It is adjusted.Such as, it is assumed that described Attribute tuning the first parameter value, including in the first set and the second set Attribute tuning the first parameter value comprised respectively, and the image in described video calling includes: described this locality is taken the photograph Each two field picture that the video stream packets collected as head contains and the described video stream packets sent by the second client The each two field picture contained.So, GPU is during described video calling, according to Attribute tuning the first parameter Value, the specific implementation being adjusted the property value of pending image may include that
GPU in this process, according to the first set, adjusts the video flowing that described local camera collection arrives The each two field picture comprised;
GPU in this process, according to the second set, adjusts the described video flowing sent by the second client The each two field picture comprised.
Wherein, the first set and the second set, can identical, part is identical or entirely different, this Depend on the adjustment demand of reality.
In the embodiment of the present application, the first set can be to be chosen finger by GPU according to the first effect received Order obtains, and the second set can be then to be chosen instruction by GPU according to the second effect received to obtain 's.Wherein, the first effect is chosen instruction and chosen instruction with the second effect can be to be inputed to CPU by user, And it is sent to GPU's by CPU;Can also be directly inputted to GPU by user.
In the embodiment of the present application, GPU is according to Attribute tuning the first parameter value, the property value to pending image The purpose being adjusted, can be, but not limited to make pending image possess special handling effect.Wherein, here Described special handling effect can be such as filter treatment effect.
It should be noted that filter, it it is the instrument instigating image to possess certain special-effect.Filter can wrap Include embossment filter, antimatter filter, stripping and slicing filter, water droplet filter, flame filter, pubescence filter, glass Filter, gradually tint light filter, noise filter, gently wave thousands of kinds of filter, Gypsum Fibrosum filter, wood grain filter etc. Filter.
In the embodiment of the present application, described " filter treatment effect ", refer to and by least one filter above-mentioned The effect that image effect that mirror can obtain after processing image is identical.
In the embodiment of the present application, when the image in described video calling includes what described local camera collection arrived During each two field picture that video stream packets contains, so that described local camera collection can be arrived by the second client Each two field picture of containing of video stream packets show, the method that the embodiment of the present application 1 provides can also enter one Step includes: GPU according to each image after the adjustment of Attribute tuning the first parameter value, is sent to second by CPU Client;Or, the video stream that described local camera collection is arrived by CPU is to the second client;Or Person, the video flowing that described local camera collection is arrived by CPU, and arrive for described local camera collection The effect of each two field picture that contains of video stream packets choose instruction, be sent to the second client.
It should be noted that use " CPU by GPU according to Attribute tuning the first parameter value adjust after each Image is sent to the second client " mode, it is not necessary to the second client carries out joining according to Attribute tuning first again Numerical value, to described local camera collection to video flowing be adjusted, such that it is able to save the second client Process resource.
In addition it should be noted that CPU by for described local camera collection to video stream packets contain each The effect of two field picture chooses instruction, is sent to the second client, it is therefore intended that, enable the second client root Corresponding Attribute tuning parameter value is obtained according to this instruction, and then according to the Attribute tuning parameter value obtained to described Local camera collection to the property value of each two field picture that contains of video stream packets be adjusted.
Use the method that the embodiment of the present application 1 provides, it is possible to achieve be automatically performed for video by GPU Image in call is adjusted, and the method is without user's manual operation, thus right compared in prior art For the processing mode of the image in video calling, it is possible to increase for the process of the image in video calling Efficiency.
Embodiment 2
For solving what the existing mode carrying out image procossing of the video flowing for transmitting in video calling existed Inefficient problem, the embodiment of the present application 2 provides the image processing method in a kind of video calling.The party Method realize schematic flow sheet as shown in Figure 2 a, comprise the steps:
Step 21, the first client obtains the image in video calling;
In the embodiment of the present application, the first described client, may refer to install on the terminal device, use In the application realizing video calling;May also mean that the terminal unit itself that can carry out video calling.Typically Ground, this terminal unit possesses the hardware device supporting video calling, the most at least possesses photographic head, the most past Toward also possessing mike.This photographic head and mike can be provided in terminal unit, it is also possible to outside being It is connected to this terminal unit.When the first client is terminal unit itself, the first client described hereinafter The local photographic head of end, refers to the photographic head that this terminal unit possesses;When the first client sets for being arranged on terminal Standby upper, for realizing the application of video calling time, first client this locality photographic head described hereinafter, Refer to the photographic head that the terminal unit at this application place possesses.
For ease of describe, the embodiment of the present application all with the first client for install on the terminal device, be used for Illustrate as a example by realizing the application of video calling.
Wherein, the image in described video calling, is the first client and video that the second client is carried out leads to Image in words, can include at least one in following two kinds of images:
During described video calling, the first client this locality camera collection to video stream packets contain Each two field picture;
During described video calling, that the first client receives, by regarding that the second client sends Frequently each two field picture that stream comprises.
Definition with the first client is similar, the second client mentioned here, may refer to be arranged on terminal On equipment, for realizing the application of video calling;May also mean that the terminal that can carry out video calling sets Standby own.Usually, this terminal unit possesses the hardware device supporting video calling, the most at least possesses and takes the photograph As head, the most also possesses mike.This photographic head and mike can be provided in terminal unit, This terminal unit can also be external in.
For ease of describe, the embodiment of the present application all with the second client for install on the terminal device, be used for Illustrate as a example by realizing the application of video calling.
In the embodiment of the present application, not to the first client and the number of the second client participating in described video calling Amount is defined.But for ease of describing, in the embodiment of the present application 2, all to participate in the of described video calling The quantity of one client and the second client is 1 and illustrates.
Step 22, the first client the first client and the second client carry out the process of video calling (after It is called for short described process) in, according to Attribute tuning the first parameter value, the genus to the image in described video calling Property value is adjusted.
For Attribute tuning first in the definition of Attribute tuning the first parameter value described herein, with embodiment 1 The definition of parameter value is identical, repeats no more.
For acquisition mode for Attribute tuning the first parameter value, in the embodiment of the present application, the first client Can be receive Image Adjusting instruction after, under the triggering of this instruction, obtain the attribute corresponding with this instruction Adjust the first parameter value.Such as, can to receive " brightness of image adjust instruction " such for the first client Image Adjusting instructs, and then, obtains " the expectation increase rate value of the brightness of image corresponding with this instruction ' 10% ' " such Attribute tuning the first parameter value.
In the embodiment of the present application, the first client can be in the process carrying out video calling with other client In receive Image Adjusting instruction, it is also possible to be to be received by before carrying out video calling with other client This instruction.Usually, if the first client is received by this before carrying out video calling with other client Instruction, then it can first determine follow-up which type of Attribute tuning the first parameter value that should use, but the most also This parameter value is not obtained, but after video calling starts, just obtain this Attribute tuning the first parameter Value.
In the embodiment of the present application, described attribute, refer to the attribute of image, including the brightness of image, gray scale, Transparency, definition, color, tone, saturation, form and aspect, color channel, level and contrast etc. In at least one.
In step 22, according to Attribute tuning the first parameter value, the attribute to the image in described video calling The mode that value is adjusted is specific as follows:
1, when Attribute tuning the first parameter value is for the expected value of the attribute of image, can be according to attribute Adjust the first parameter value, by the respective attributes value of each (or part) pixel of image, be adjusted to and attribute Adjust the first parameter value identical, or the difference being adjusted between Attribute tuning the first parameter value is less than presetting threshold Value.
Such as, Attribute tuning the first parameter value is each (or part) pixel respective gray scale expectation of image During value " 155 ", can be according to this parameter value " 155 ", by each (or part) pixel of image each Gray value be adjusted to 155.
2, range value is adjusted when the expectation of the parameter value that Attribute tuning the first parameter value is the attribute for image Time, can be according to Attribute tuning the first parameter value, by the respective attributes of each (or part) pixel of image Value increases or reduces corresponding amplitude.
Such as, when the expectation increase rate value that this Attribute tuning first parameter value is the brightness for image Time " 10% ", can be according to this expectation increase rate value " 10% ", on the basis of the original brightness of image, The overall brightness of image is improved 10%.
In the embodiment of the present application, according to Attribute tuning the first parameter value, to the image in described video calling Property value is adjusted, it may be possible to be only adjusted a certain property value of image, it is also possible to image At least two property value be adjusted, this depends on to enter according to Attribute tuning the first parameter value in image The factors such as the number of the property value of Row sum-equal matrix.Can be according to Attribute tuning the first parameter value in the embodiment of the present application The number of the parameter value being adjusted is not construed as limiting.
In the embodiment of the present application, the purpose that the image in described video calling is adjusted, mainly expectation The image in described video calling is made to possess special-effect.Wherein, special-effect mentioned here can but not It is limited to filter treatment effect.Use the said method that the embodiment of the present application provides, owing to regarding During frequency call, automatically according to Attribute tuning parameter value, the property value of the image in video calling is carried out Adjust, it is not necessary to user's manual operation, thus compared in prior art for the image in video calling For processing mode, it is possible to increase for the treatment effeciency of the image in video calling.
Hereinafter some the optional embodiments of the said method that the embodiment of the present application provides are described in detail.
In terminal unit in view of the first client place, often there is GPU, this GPU possesses necessarily Operational capability, can be the central processing unit (Central Processing Unit, CPU) of this terminal unit Share certain for figure or the processor active task of image, therefore, in the embodiment of the present application, in order to regard Frequently alleviating the operating pressure of CPU in communication process, a kind of implementation of above-mentioned steps 22 may include that First client triggering GPU is in this process according to Attribute tuning the first parameter value, in video calling The property value of image be adjusted.Correspondingly, a kind of implementation of above-mentioned steps 21 may include that First client triggers GPU and obtains the image in described video calling.
Wherein, this Attribute tuning first parameter value, GPU can be sent to by CPU, it is also possible to be By GPU after receiving the Image Adjusting instruction that CPU sends, according to this instruction from preserving Attribute tuning ginseng The memory space of numerical value calls.
One of feature of image in video calling, is often to comprise face in image.Wrap in image The face contained, user expects that the effect that face possesses is different from image other element and possesses greatly Effect, such as expectation face for other element in image, tone is the softest, etc..For Meeting this expectation of user, the method that the embodiment of the present application provides can also be modified further.Concrete and Speech, the first client can be during the first client and the second client carry out video calling, first root According to Attribute tuning the second parameter value, the property value at least one region in the image in described video calling is entered Row sum-equal matrix, the image after being adjusted;Then, the first client is entered in the first client and the second client During row video calling, according to Attribute tuning the first parameter value, the property value of the image after adjusting is entered Row sum-equal matrix.
Above-mentioned " at least one region in image ", can be, but not limited to as identify from image, tool The target region of standby specific characteristic.Such as can identify from image, possess face characteristic Target region, etc..
Additionally, the determining of the definition of Attribute tuning the second parameter value mentioned here and Attribute tuning the first parameter value Justice is identical, therefore repeats no more.Attribute tuning the second parameter value and Attribute tuning the first parameter value can be distinguished As the foundation that the different attribute of image is adjusted.Such as, Attribute tuning the second parameter value can be bright Degree expected value, for as adjusting the bright of image (especially certain region in image, such as face region) The foundation of degree;Attribute tuning the first parameter value can be then gray scale expected value, for (past as adjusting image Toward being entire image) the foundation of gray value.
In the embodiment of the present application, according to Attribute tuning the second parameter value, in the image in described video calling The adjustment that the property value at least one region is carried out, and according to Attribute tuning the first parameter value, after adjusting The adjustment that carries out of the property value of image, can have been shared out the work and help one another by CPU and GPU.
Such as, the first client can trigger CPU the first client and the second client carry out video lead to During words, according to Attribute tuning the second parameter value at least one district in the image in described video calling The property value in territory is adjusted, the image after being adjusted;Further, the first client triggers GPU again During first client and the second client carry out video calling, according to Attribute tuning the first parameter value, The property value of the image after adjusting is adjusted.
Adjusted by CPU and the GPU property value for the image in described video calling of having shared out the work and help one another Whole, either one live load in CPU and GPU can be avoided overweight.
In actual applications, adjustment image carried out according to Attribute tuning the second parameter value, often local Property.That is, according to Attribute tuning the second parameter value, it is often that certain regional area to image is (such as face Region) it is adjusted.And adjustment image carried out according to Attribute tuning the first parameter value, often Of overall importance.That is, according to Attribute tuning the first parameter value, often the whole region of image is adjusted. Therefore, according to the second parameter value in image, the property value at least one region is adjusted after, further according to genus Property adjust the first parameter value, the property value of image after adjusting is adjusted, so that certain of image Regional area, possesses the special-effect that other region of image does not possesses, thus in visual effect, permissible Make this regional area the most notable in whole image.
From above, the image in described video calling, during described video calling can be included in, First client this locality camera collection to each two field picture of containing of video stream packets, it is also possible to regard described in being included in During frequency call, it is each that video stream packets that the first client receives, that sent by the second client contains Two field picture.In actual applications, it is contemplated that user may expect each two field picture tool in both video flowings Standby different special-effect, so in the embodiment of the present application, can use different Attribute tuning parameter values, Respectively each two field picture in both video flowings is adjusted.
Specifically, it can be assumed that Attribute tuning the first parameter value as adjustment foundation can be by the first collection Close and the second set composition.Wherein, the first set and the second set are adjusted including at least an attribute respectively Whole first parameter value.First set and second gather can identical, part is identical or entirely different, this Depend on the adjustment demand of reality.
Based on the first set and the second set, the first client regards in the first client and the second client Frequency call during, can according to first set, adjust first client this locality camera collection to regard Frequently each two field picture that stream comprises;Additionally, the first client is in this process, can adjust according to the second set Each two field picture that the whole video stream packets sent by the second client contains.
Due to can be according to actual adjustment demand so that the video that first client this locality camera collection arrives Each two field picture that stream comprises and each two field picture that the video stream packets that the second client sends contains possess different spies Special effect fruit, such that it is able to realize being adjusted flexibly for different video stream, improves the experience of user.
In the embodiment of the present application, above-mentioned first set and the second set can be to choose finger according to different effects Order obtains.Such as, the first client when receiving the first effect and choosing instruction, can according to this first Effect chooses instruction, obtains above-mentioned first set;When receiving the second effect and choosing instruction, can basis This second effect chooses instruction, obtains above-mentioned second set.
Wherein, this first effect chooses instruction and the second effect is chosen instruction and be may each be use the first client User input the first client.Such as, this user can be from the first client circle as shown in Figure 2 b On face in the various special-effect information of display, choose the special-effect for above two video flowing respectively and believe Breath, thus trigger the first effect choose instruction and the second effect choose instruction.
In the embodiment of the present application, above two instruction may each be in the first client and the second client During carrying out video calling, user input.Such as, as shown in Figure 2 c, regard described in carrying out During frequency call, the first client a kind of interface schematic diagram shown.Wherein, big window is used to show Show, be that the second client sends the video flowing of coming;Use wicket to show, be that the first client is local The video flowing that camera collection arrives.Assume the video flowing now shown by big window, be after being adjusted, tool The video flowing of standby special-effect A, wicket the video flowing shown, be after being adjusted, possess special effect The really video flowing of B.So, if user now expects to be adjusted the display effect of two video flowings, then This interface can be touched, trigger the first client and show interface as shown in Figure 2 d.
In interface shown in Fig. 2 d, with the first icon of camera pattern, for first client this locality is used In the trigger button that the photographic head gathering video flowing switches over.If possessing shooting than first client this locality 1 and photographic head 2, and be currently used in that gather video flowing is photographic head 1, then user and by clicking on This icon, can trigger photographic head 1 quit work and trigger photographic head 2 proceed by gather video flowing behaviour Make.In this interface, with the second icon of receiver pattern, for terminate the first client and the second client it Between the trigger button of video calling.Additionally, with the 3rd icon of Magic wand pattern in this interface, be tactile Send out the icon that special-effect information is shown by the first client.User is by clicking on the 3rd icon, permissible Trigger the first client on screen, show interface as shown in Figure 2 b.
In the embodiment of the present application, above-mentioned both effects are chosen instruction and be may each be the use using the second client Family inputs the second client, and is sent to the first client by the second client.Use the second client User inputs both and instructs the mode of the second client, with the user using the first client input this two The mode planting instruction the first client is similar to, and here is omitted.Second client refers to receiving both After order, immediately both instructions can be sent to the first client;Or, the second client is receiving After both instructions, can be after the video calling between the first client and the second client start, just general Both instructions are sent to the first client.
Or, in both instructions, have a kind of instruction can be inputted first by the user using the first client Client, another kind of instruction can be then to be inputted the second client by the user using the second client, And it is sent to the first client by the second client.Such as, the first effect chooses instruction can be by using The user of the first client inputs the first client, and the second effect to choose instruction can be by using second The user of client inputs the second client, and is sent to the first client by the second client;Otherwise also Can.
In the embodiment of the present application, after the first client completes the adjustment of the image in video calling, permissible According to mode as shown in Figure 2 c, the image in the video calling after adjusting is shown.Wherein, relatively Big display window and less display window are respectively used to after display adjusts, previously described two kinds of videos Each two field picture of stream.
When the image in described video calling includes the video stream packets that first client this locality camera collection arrives During each two field picture contained, in one embodiment, in order to save the process resource of the second client, this Shen Please embodiment provide the method can further include: the first client will be joined according to Attribute tuning first Each image after numerical value adjustment, is sent to the second client.
In view of in order to ensure that the second client obtains the video flowing that first client this locality camera collection arrives Real-time, the first client can also directly by first client this locality camera collection to video flowing send out Give the second client.
Or, the video flowing that first client this locality camera collection can be arrived by the first client, Yi Jizhen The effect of each two field picture containing this video stream packets chooses instruction, and (the first effect as described in above chooses finger Make), it is sent to the second client, so that the second client can know the first client according to this instruction What kind of Attribute tuning parameter value end desirably employs is adjusted this video flowing.
It should be noted that the data exchange between the first client and the second client, can be based on The connection set up between one client and the second client is carried out, it is also possible to be maybe can be made by server Assist for equipment such as the intelligent routers that server uses.
Embodiment 3
For solving what the existing mode carrying out image procossing of the video flowing for transmitting in video calling existed Inefficient problem, the embodiment of the present application 3 provides the image processing method in a kind of video calling.The party The executive agent of each step of method can be different server, it is also possible to be same server.For ease of describing, As a example by hereinafter will being same server by the executive agent of each step, the method is introduced.
Specifically, the method realize schematic flow sheet as it is shown on figure 3, comprise the steps:
Step 31, server receives at least one client participating in video calling in the mistake of described video calling Image that send in journey, in described video calling;
Wherein, the image in described video calling, may include that during described video calling, by At least one client this locality camera collection described to each two field picture of containing of video stream packets.
Client mentioned here, its definition refers in embodiment 1 for the first client and the second client The definition of end, here is omitted.
Step 32, server obtains Attribute tuning parameter value;
Attribute tuning parameter value mentioned here, its definition refers in embodiment 1 for Attribute tuning first The definition of parameter value, here is omitted.
Server can obtain this Attribute tuning parameter value from the memory space of server local.Such as, Server can according to client send come effect choose instruction, from this memory space, obtain corresponding to The Attribute tuning parameter value of this instruction.
Or, server can also directly obtain client and send this Attribute tuning parameter value of coming.
Step 33, server is according to Attribute tuning the first parameter value, the genus to the image in described video calling Property value is adjusted;
In the embodiment of the present application, the property value of image is adjusted by server according to Attribute tuning the first parameter value The first client in whole specific implementation, with embodiment 1 according to Attribute tuning the first parameter value to figure The implementation that the property value of picture is adjusted is similar to, and here is omitted.
Server in the embodiment of the present application can also possess in the image in described video calling at least The function that the property value in one region is adjusted.Specifically, server can obtain Attribute tuning second Parameter value, thus the specific implementation of step 33 may include that
Server is according to Attribute tuning the second parameter value, at least one district in the image in described video calling The property value in territory is adjusted, the image after being adjusted;
Then, the property value of the image after adjusting, according to Attribute tuning the first parameter value, is adjusted by server Whole.
Wherein, server according to Attribute tuning the second parameter value, in the image in described video calling at least The specific implementation that the property value in one region is adjusted may include that video described in server identification leads to Image in words possesses the target of specific characteristic;Server after identifying the target possessing instruction features, According to Attribute tuning the second parameter value, to the genus of region in this target image in described video calling Property value is adjusted.
Especially, special characteristic mentioned here can be, but not limited to include: face characteristic.
In the embodiment of the present application, when server receive participate in video calling at least one client in institute Image that send during stating video calling, in described video calling, including at least one client described During at least two video flowing that end sends, if Attribute tuning the first parameter value includes difference at least two set Attribute tuning the first parameter value comprised, then, server can according to respectively according to set each described, The property value of each image that the corresponding video stream in described at least two video flowing comprises is adjusted, so that Described each image possesses corresponding special-effect.
Such as, if receiving two video flowings that at least one client sends, then, can be according to respectively Comprise the first set and the second set, each image that two video stream packets are contained of Attribute tuning the first parameter value Property value be adjusted, so that each image possesses corresponding special-effect.
Wherein, the first set is the most identical with the second set, depends on the adjustment demand of reality.
In the embodiment of the present application, above-mentioned each set can be to be sent out by according to the client participating in described video calling At least two effect sent here chooses what instruction determined.Such as, server can lead to according to participating in described video First effect of video flowing that first client of words sends, for first client this locality camera collection Choose instruction, determine the collection of adjustment foundation for the video flowing as first client this locality camera collection Close, additionally, send according to the second client participating in described video calling, local for the second client Second effect of the video flowing of camera collection chooses instruction, determines for as second client this locality shooting The set of the adjustment foundation of the video flowing that head gathers.
Step 34, the image after server will adjust is sent to participate in the client of described video calling.
Specifically, the image after adjusting can be only sent to send described video calling to server by server In at least one client described of image;Or, the image after adjusting can be only sent to by server Other client in addition at least one client described;Or, the image after adjusting can be sent out by server Give all clients participating in video calling;Etc..
Use the embodiment of the present application 3 provide said method, due to can during carrying out video calling, The property value of the image in video calling is adjusted automatically according to Attribute tuning parameter value by server, no Need user's manual operation, thus compared in prior art for the processing mode of the image in video calling For, it is possible to increase for the treatment effeciency of the image in video calling.
The method provided compared to embodiment 1, the method that the embodiment of the present application 3 provides can be replaced by server The adjustment of the property value for the part or all of image in video calling is realized for client, such that it is able to joint The about process resource of client.
Embodiment 4
For solving what the existing mode carrying out image procossing of the video flowing for transmitting in video calling existed Inefficient problem, the application executes example 4 and provides the image processing system in a kind of video calling, this system Structural representation as shown in Figure 4, including graphic process unit GPU.Optionally, this system can also include CPU.The function of this system components introduced below:
GPU, is used for obtaining pending image, and during described video calling, according to Attribute tuning First parameter value, is adjusted the property value of pending image.
Wherein, described video calling occurs between the first client and the second client.
Described pending image is the image in described video calling, or according to figure in described video calling As the image generated.
Image in described video calling includes:
In this process, first client this locality camera collection to each two field picture of containing of video stream packets;
In this process, first client receive, the video stream packets that sent by the second client contains Each two field picture.
In one embodiment, CPU may be used for according to Attribute tuning the second parameter value, to described video In image in call, the property value at least one region is adjusted, and obtains described pending image and sends To GPU.
In one embodiment, CPU may be used for identifying in the image in described video calling possess appointment The target of feature;After identifying described target, according to Attribute tuning the second parameter value, described target is existed In image in described video calling, the property value of region is adjusted obtaining described pending image.
In order to realize that different video stream is adjusted flexibly, in one embodiment, when Attribute tuning first Parameter value, including Attribute tuning the first parameter value comprised respectively in the first set and the second set;And video Image in call includes: described local camera collection to each two field picture of containing of video stream packets and described During each two field picture that the video stream packets sent by the second client contains, GPU specifically may be used for: GPU exists During described, according to the first set, adjust described local camera collection to each frame of containing of video stream packets Image;GPU in this process, according to the second set, adjusts the described video sent by the second client Each two field picture that stream comprises.
In one embodiment, above-mentioned first set can be according to the first effect received by GPU Choose what instruction obtained;Second set can be to be chosen instruction by GPU according to the second effect received to obtain Take.
In one embodiment, include that described local camera collection arrives when the image in described video calling Video stream packets contain each two field picture time, CPU can be also used for: is joined according to Attribute tuning first by GPU Each image after numerical value adjustment, is sent to the second client;Or the video that described local camera collection arrived Stream is sent to the second client;Or the video flowing that described this locality camera collection arrives, and for described this locality Camera collection to the effect of each two field picture that contains of video stream packets choose instruction, be sent to the second client.
Use this system that the embodiment of the present application 4 provides, it is possible to achieve be automatically performed for video by GPU Image in call is adjusted, and this system is without user's manual operation, thus right compared in prior art For the processing mode of the image in video calling, it is possible to increase for the process of the image in video calling Efficiency.
Embodiment 5
For solving what the existing mode carrying out image procossing of the video flowing for transmitting in video calling existed Inefficient problem, the embodiment of the present application 5 provides a kind of GPU.The structural representation of this GPU such as figure Shown in 5, including following function unit:
Image acquiring unit 51, is used for obtaining pending image.
Wherein, described pending image is the image in described video calling, or according to described video calling In image generate image.
Wherein, the video calling that described video calling is first terminal equipment and the second terminal unit is carried out.
This GPU that the embodiment of the present application 5 provides may be located in described first terminal equipment.
Adjustment unit 52, is used for during first terminal equipment and the second terminal unit carry out video calling, According to Attribute tuning the first parameter value, the property value of pending image is adjusted.
Wherein, at least one during the image in described video calling includes following two kinds of images:
In this process, first terminal equipment this locality camera collection to each two field picture of containing of video stream packets;
In this process, first terminal equipment receive, by second terminal unit send video stream packets The each two field picture contained.
In one embodiment, include that described local camera collection arrives when the image in described video calling Video stream packets contain each two field picture time, GPU can also include transmitting element.This transmitting element may be used for Each image after being adjusted according to Attribute tuning the first parameter value by adjustment unit 52, is sent to first terminal and sets CPU in Bei.
In one embodiment, when Attribute tuning the first parameter value, including in the first set and the second set Attribute tuning the first parameter value comprised respectively, and the image in described video calling includes: described this locality is taken the photograph Each two field picture that the video stream packets collected as head contains and the described video stream packets sent by the second client During each two field picture contained, adjustment unit 52 specifically may be used in this process, according to the first set, Adjust described local camera collection to each two field picture of containing of video stream packets;And, in this process, According to the second set, adjust each two field picture that the described video stream packets sent by the second client contains.
In one embodiment, the first set can be according to the first effect received by adjustment unit 52 Fruit chooses what instruction obtained;And the second set can be according to the second effect received by adjustment unit 52 Choose what instruction obtained.
Use the GPU that the embodiment of the present application provides, due to can be during carrying out video calling, by this The property value of the image in video calling is adjusted by GPU automatically according to Attribute tuning parameter value, it is not necessary to User's manual operation, thus compared in prior art for the processing mode of the image in video calling, The treatment effeciency for the image in video calling can be improved.
Embodiment 6
For solving what the existing mode carrying out image procossing of the video flowing for transmitting in video calling existed Inefficient problem, the embodiment of the present application 6 provides the image processing apparatus in a kind of video calling.This dress The concrete structure schematic diagram put as shown in Figure 6, obtains unit 61 and adjustment unit 62 including parameter value.With Under the functional realiey mode of each unit is described in detail.
Image acquiring unit 61, for obtaining the image in video calling;
Adjustment unit 62, is used for triggering graphic process unit GPU and carries out in the first client and the second client During video calling, according to Attribute tuning the first parameter value, the genus to the image in described video calling Property value is adjusted.
Wherein, the image in described video calling, including at least one in following two kinds of images:
In this process, first client this locality camera collection to each two field picture of containing of video stream packets;
In this process, first client receive, the video stream packets that sent by the second client contains Each two field picture.
In one embodiment, parameter value obtains unit 61, it is also possible to is used for obtaining Attribute tuning second and joins Numerical value.Thus adjustment unit 62, may be used for carrying out video calling in the first client and the second client During, obtain, according to parameter value, Attribute tuning the second parameter value that unit 61 obtains, described video is led to In image in words, the property value at least one region is adjusted, the image after being adjusted;The first visitor During family end and the second client carry out video calling, obtain, according to parameter value, the genus that unit 61 obtains Property adjust the first parameter value, the property value of image after adjusting is adjusted.
In one embodiment, adjustment unit 62 may be used for: triggers CPU in the first client and the During two clients carry out video calling, according to Attribute tuning the second parameter value, to described video calling In image in the property value at least one region be adjusted;Trigger GPU in the first client and second During client carries out video calling, according to Attribute tuning the first parameter value, to the image after adjusting Property value is adjusted.
In one embodiment, adjustment unit 62 may be used for: identifies the image in described video calling In possess the target of specific characteristic;After identifying described target, according to Attribute tuning the second parameter value, right In described target image in described video calling, the property value of region is adjusted.
Wherein, described special characteristic can be, but not limited to include: face characteristic.
In one embodiment, the first set and the second set are included when described Attribute tuning the first parameter value Middle Attribute tuning the first parameter value comprised respectively;Image in video calling includes: described local photographic head Each two field picture that the video stream packets collected contains and the described video stream packets sent by the second client contain During each two field picture, adjustment unit 62 specifically may be used for: regards in the first client and the second client During frequency call, according to the first set, adjust described local camera collection to video stream packets contain Each two field picture;During the first client and the second client carry out video calling, according to the second set, Adjust each two field picture that the described video stream packets sent by the second client contains.
In one embodiment, in order to realize the first set and the acquisition of the second set, the application implements This device provided in example can further include instruction reception unit and set acquiring unit.Wherein:
Instruction reception unit, for gathering according to first at adjustment unit 62, adjusts described local photographic head Before each two field picture that the video stream packets collected contains, receive the first effect and choose instruction, at adjustment unit 62 According to the second set, before adjusting each two field picture that the described video stream packets sent by the second client contains, receive Second effect chooses instruction.
Set acquiring unit, the first effect for receiving according to instruction reception unit is chosen instruction, is obtained institute State the first set;Choose instruction according to the second effect that instruction reception unit receives, obtain described second set.
In one embodiment, include that described local camera collection arrives when the image in described video calling Video stream packets contain each two field picture time, this device that the embodiment of the present application 6 provides can also include sending single Unit.
Wherein, this transmitting element, it is used for:
Each image after being adjusted by adjustment unit 62, is sent to the second client;Or by described local shooting The video stream that head collects gives the second client;Or the video flowing that described local camera collection arrived, And for described local camera collection to the effect of each two field picture that contains of video stream packets choose instruction, send out Give the second client.
Use the embodiment of the present application 6 provide this device, due to can during carrying out video calling, The property value of the image in video calling is adjusted automatically according to Attribute tuning parameter value by this device, no Need user's manual operation, thus compared in prior art for the processing mode of the image in video calling For, it is possible to increase for the treatment effeciency of the image in video calling.
Embodiment 7
For solving what the existing mode carrying out image procossing of the video flowing for transmitting in video calling existed Inefficient problem, the embodiment of the present application 7 provides the image processing apparatus in a kind of video calling.This dress Put and can be, but not limited to be server.
The concrete structure schematic diagram of this device is as it is shown in fig. 7, comprises following function unit:
Image acquiring unit 71, for receiving at least one client participating in video calling at video calling Image that send in process (the described process of rear title), in described video calling.
Wherein, the image in described video calling includes: in this process, by least one client described The local camera collection of end to each two field picture of containing of video stream packets.
Parameter value obtains unit 72, is used for obtaining Attribute tuning the first parameter value.
Adjustment unit 73, for obtaining, according to parameter value, Attribute tuning the first parameter value that unit 72 obtains, The property value of the image in the described video calling receive image acquiring unit 71 is adjusted.
Transmitting element 74, the image after being adjusted by adjustment unit 73 is sent to participate in described video calling Client.
In one embodiment, parameter value obtain unit 72 can be also used for obtain Attribute tuning second join Numerical value.Based on this Attribute tuning the second parameter value, adjustment unit 73 may be used for: obtains according to parameter value Attribute tuning the second parameter value that unit 72 obtains, at least one district in the image in described video calling The property value in territory is adjusted, the image after being adjusted;The genus that unit 72 obtains is obtained according to parameter value Property adjust the first parameter value, the property value of image after adjusting is adjusted.
In one embodiment, adjustment unit 73 is for described target image in described video calling The mode that the property value of middle region is adjusted may include that in the image identified in described video calling Possesses the target of specific characteristic;After identifying described target, according to Attribute tuning the second parameter value, to institute State the property value of region in target image in described video calling to be adjusted.Wherein, institute here The special characteristic said can be, but not limited to include face characteristic.
In one embodiment, if Attribute tuning the first parameter value includes comprising respectively at least two set Attribute tuning the first parameter value, and image acquiring unit 71 receive be participate in video calling at least At least two video flowing that one client sends in this process.So, adjustment unit 73 specifically may be used For respectively according to each set in described at least two set, respectively in described at least two video flowing The property value of each image that comprises of corresponding video stream be adjusted.
In one embodiment, in order to realize the acquisition to described each set, the embodiment of the present application 7 provides This device can also include:
Instruction reception unit, at adjustment unit 73 respectively according to described each set, respectively to described respectively Before the property value of image is adjusted, receives and participate at least two that the client transmission of described video calling comes Effect chooses instruction;
Set acquiring unit, chooses instruction for the described at least two effect received according to instruction reception unit, Obtain described at least two set.
Those skilled in the art are it should be appreciated that embodiments of the invention can be provided as method, system or meter Calculation machine program product.Therefore, the present invention can use complete hardware embodiment, complete software implementation or knot The form of the embodiment in terms of conjunction software and hardware.And, the present invention can use and wherein wrap one or more Computer-usable storage medium containing computer usable program code (include but not limited to disk memory, CD-ROM, optical memory etc.) form of the upper computer program implemented.
The present invention is with reference to method, equipment (system) and computer program product according to embodiments of the present invention The flow chart of product and/or block diagram describe.It should be understood that can by computer program instructions flowchart and / or block diagram in each flow process and/or flow process in square frame and flow chart and/or block diagram and/ Or the combination of square frame.These computer program instructions can be provided to general purpose computer, special-purpose computer, embedding The processor of formula datatron or other programmable data processing device is to produce a machine so that by calculating The instruction that the processor of machine or other programmable data processing device performs produces for realizing at flow chart one The device of the function specified in individual flow process or multiple flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions may be alternatively stored in and computer or the process of other programmable datas can be guided to set In the standby computer-readable memory worked in a specific way so that be stored in this computer-readable memory Instruction produce and include the manufacture of command device, this command device realizes in one flow process or multiple of flow chart The function specified in flow process and/or one square frame of block diagram or multiple square frame.
These computer program instructions also can be loaded in computer or other programmable data processing device, makes Sequence of operations step must be performed to produce computer implemented place on computer or other programmable devices Reason, thus the instruction performed on computer or other programmable devices provides for realizing flow chart one The step of the function specified in flow process or multiple flow process and/or one square frame of block diagram or multiple square frame.
In a typical configuration, calculating equipment includes one or more processor (CPU), input/defeated Outgoing interface, network interface and internal memory.
Internal memory potentially includes the volatile memory in computer-readable medium, random access memory (RAM) and/or the form such as Nonvolatile memory, such as read only memory (ROM) or flash memory (flash RAM). Internal memory is the example of computer-readable medium.
Computer-readable medium includes that removable media permanent and non-permanent, removable and non-can be by appointing Where method or technology realize information storage.Information can be computer-readable instruction, data structure, program Module or other data.The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), dynamic random access memory (DRAM), its The random access memory (RAM) of his type, read only memory (ROM), electrically erasable are read-only Memorizer (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette tape, tape magnetic Disk storage or other magnetic storage apparatus or any other non-transmission medium, can be used for storage can be calculated The information that equipment accesses.According to defining herein, computer-readable medium does not include temporary computer-readable matchmaker Body (transitory media), such as data signal and the carrier wave of modulation.
Also, it should be noted term " includes ", " comprising " or its any other variant are intended to non- Comprising of exclusiveness, so that include that the process of a series of key element, method, commodity or equipment not only wrap Include those key elements, but also include other key elements being not expressly set out, or also include for this process, The key element that method, commodity or equipment are intrinsic.In the case of there is no more restriction, statement " include One ... " key element that limits, it is not excluded that including the process of described key element, method, commodity or setting Other identical element is there is also in Bei.
The foregoing is only embodiments herein, be not limited to the application.For this area skill For art personnel, the application can have various modifications and variations.All institutes within spirit herein and principle Any modification, equivalent substitution and improvement etc. made, within the scope of should be included in claims hereof.

Claims (31)

1. the image processing method in a video calling, it is characterised in that including:
GPU obtains pending image;Wherein, described pending image is the image in described video calling, The image that according to or, the image in described video calling generates;
GPU is during described video calling, according to Attribute tuning the first parameter value, to pending image Property value be adjusted;
Wherein, described video calling occurs between the first client and the second client;
Image in described video calling includes:
In this process, first client this locality camera collection to each two field picture of containing of video stream packets;
In this process, first client receive, the video stream packets that sent by the second client contains Each two field picture.
2. the method for claim 1, it is characterised in that GPU mistake in described video calling Cheng Zhong, it is thus achieved that before pending image, described method also includes:
CPU is according to Attribute tuning the second parameter value, at least one region in the image in described video calling Property value be adjusted, obtain described pending image and be sent to GPU.
3. method as claimed in claim 2, it is characterised in that CPU is according to Attribute tuning the second parameter Value, is adjusted the property value at least one region in the image in described video calling, including:
CPU identifies the target possessing specific characteristic in the image in described video calling;
CPU is after identifying described target, according to Attribute tuning the second parameter value, to described target described In image in video calling, the property value of region is adjusted.
4. method as claimed in claim 3, it is characterised in that described specific characteristic includes: face is special Levy.
5. the method for claim 1, it is characterised in that described Attribute tuning the first parameter value, Including Attribute tuning the first parameter value comprised respectively in the first set and the second set;
Image in described video calling includes: described local camera collection to each frame of containing of video stream packets Each two field picture that image and the described video stream packets sent by the second client contain;Then
The property value of pending image in this process, according to Attribute tuning the first parameter value, is entered by GPU Row sum-equal matrix, including:
GPU in this process, according to the first set, adjusts the video flowing that described local camera collection arrives The each two field picture comprised;
GPU in this process, according to the second set, adjusts the described video flowing sent by the second client The each two field picture comprised.
6. method as claimed in claim 5, it is characterised in that:
GPU in this process, according to the first set, adjusts the video flowing that described local camera collection arrives Before each two field picture comprised, described method also includes: GPU receives the first effect and chooses instruction, and according to One effect chooses instruction, obtains described first set;
GPU in this process, according to the second set, adjusts the video flowing that described local camera collection arrives Before each two field picture comprised, described method also includes: GPU receives the second effect and chooses instruction, and according to Two effects choose instruction, obtain described second set.
7. the method as described in the arbitrary claim of claim 1~6, it is characterised in that when described video calling In image include described local camera collection to video stream packets contain each two field picture time, described method is also Including:
GPU according to each image after the adjustment of Attribute tuning the first parameter value, is sent to the second client by CPU End;Or
The video stream that described local camera collection is arrived by CPU is to the second client;Or
The video flowing that described local camera collection is arrived by CPU, and arrive for described local camera collection The effect of each two field picture that contains of video stream packets choose instruction, be sent to the second client.
8. the image processing method in a video calling, it is characterised in that including:
First client obtains the image in described video calling;
First client trigger graphic process unit GPU in this process according to Attribute tuning the first parameter value, The property value of the image in described video calling is adjusted;
Wherein, the image in described video calling, including at least one in following two kinds of images:
In this process, first client this locality camera collection to each two field picture of containing of video stream packets;
In this process, first client receive, the video stream packets that sent by the second client contains Each two field picture.
9. method as claimed in claim 8, it is characterised in that the first client in this process, According to Attribute tuning the first parameter value, the property value of the image in described video calling is adjusted, including:
First client in this process, according to Attribute tuning the second parameter value, in described video calling Image in the property value at least one region be adjusted, the image after being adjusted;
First client triggers GPU in this process, according to Attribute tuning the first parameter value, to adjustment After the property value of image be adjusted.
10. method as claimed in claim 9, it is characterised in that the first client in this process, According to Attribute tuning the second parameter value, to the property value at least one region in the image in described video calling It is adjusted, including:
First client trigger central processor CPU in this process according to Attribute tuning the second parameter value, The property value at least one region in image in described video calling is adjusted;
First client in this process, according to Attribute tuning the first parameter value, to the image after adjusting Property value is adjusted, including:
First client triggers GPU in this process according to Attribute tuning the first parameter value, after adjusting The property value of image be adjusted.
11. methods as described in claim 9 or 10, it is characterised in that join according to Attribute tuning second Numerical value, is adjusted the property value at least one region in the image in described video calling, including:
Identify the target possessing specific characteristic in the image in described video calling;
After identifying described target, according to Attribute tuning the second parameter value, to described target at described video In image in call, the property value of region is adjusted.
12. methods as claimed in claim 11, it is characterised in that described special characteristic includes: face Feature.
13. methods as claimed in claim 8, it is characterised in that described Attribute tuning the first parameter value, Including Attribute tuning the first parameter value comprised respectively in the first set and the second set;
Image in described video calling includes: described local camera collection to each frame of containing of video stream packets Each two field picture that image and the described video stream packets sent by the second client contain;Then
First client in this process, according to Attribute tuning the first parameter value, in described video calling The property value of image be adjusted, including:
First client in this process, according to the first set, adjusts what described local camera collection arrived Each two field picture that video stream packets contains;
First client in this process, is gathered according to second, is sent by the second client described in adjustment Each two field picture that video stream packets contains.
14. methods as claimed in claim 13, it is characterised in that:
First client according to the first set, adjust described local camera collection to video stream packets contain each Before two field picture, described method also includes: receives the first effect and chooses instruction, and chooses finger according to the first effect Order, obtains described first set;
First client is according to the second set, and it is each that the described video stream packets sent by the second client of adjustment contains Before two field picture, described method also includes: receives the second effect and chooses instruction, and chooses finger according to the second effect Order, obtains described second set.
15. methods as described in the arbitrary claim of claim 8~10,12~14, it is characterised in that when described Image in video calling include described local camera collection to video stream packets contain each two field picture time, institute Method of stating also includes:
First client will be sent to the second client according to each image after the adjustment of Attribute tuning the first parameter value End;Or
The video stream that described local camera collection is arrived by the first client is to the second client;Or
The video flowing that described local camera collection is arrived by the first client, and for described local photographic head The effect of each two field picture that the video stream packets collected contains chooses instruction, is sent to the second client.
Image processing method in 16. 1 kinds of video callings, it is characterised in that including:
Server receives at least one client participating in video calling and sends out during described video calling Image in video calling that send, described;
Server obtains Attribute tuning the first parameter value;
The property value of the image in described video calling, according to Attribute tuning the first parameter value, is carried out by server Adjust;
Image after server will adjust is sent to participate in the client of described video calling;
Wherein, the image in described video calling includes:
In this process, by described at least one client this locality camera collection to video stream packets contain Each two field picture.
17. methods as claimed in claim 16, it is characterised in that described method also includes:
Server obtains Attribute tuning the second parameter value;Then
The property value of the image in described video calling, according to Attribute tuning the first parameter value, is carried out by server Adjust, including:
Server is according to Attribute tuning the second parameter value, at least one district in the image in described video calling The property value in territory is adjusted, the image after being adjusted;
The property value of the image after adjusting, according to Attribute tuning the first parameter value, is adjusted by server.
18. methods as claimed in claim 16, it is characterised in that server is according to Attribute tuning second Parameter value, is adjusted the property value at least one region in the image in described video calling, including:
Image in video calling described in server identification possesses the target of specific characteristic;
Server is after identifying described target, according to Attribute tuning the second parameter value, to described target in institute State the property value of region in the image in video calling to be adjusted.
19. methods as claimed in claim 18, it is characterised in that described special characteristic includes: face Feature.
20. methods as claimed in claim 16, it is characterised in that described Attribute tuning the first parameter value, Including Attribute tuning the first parameter value comprised respectively at least two set;
Server receives at least one client participating in video calling and sends out during described video calling Image in video calling that send, described, including: server receives at least one visitor of participation video calling At least two video flowing that family end sends in this process;Then
The property value of the image in described video calling, according to Attribute tuning the first parameter value, is carried out by server Adjust, including:
Server is respectively according to each set in described at least two set, respectively to described at least two video The property value of each image that the corresponding video stream in stream comprises is adjusted.
21. methods as claimed in claim 20, it is characterised in that server is respectively according to described each collection Closing, before the property value to described each image is adjusted respectively, described method also includes:
The client of the server reception described video calling of participation sends at least two effect come and chooses instruction;
Server chooses instruction according to described at least two effect, obtains described at least two set.
Image processing system in 22. 1 kinds of video callings, including graphic process unit GPU, it is characterised in that:
GPU, is used for obtaining pending image, and during described video calling, according to Attribute tuning First parameter value, is adjusted the property value of pending image;
Wherein, described pending image is the image in described video calling, or according to described video calling In image generate image;
Described video calling occurs between the first client and the second client;
Image in described video calling includes:
In this process, first client this locality camera collection to each two field picture of containing of video stream packets;
In this process, first client receive, the video stream packets that sent by the second client contains Each two field picture.
23. the system as claimed in claim 22, it is characterised in that described system also includes central authorities' process Device CPU, wherein:
CPU, for according to Attribute tuning the second parameter value, in the image in described video calling at least one The property value in individual region is adjusted, and obtains described pending image and is sent to GPU.
24. systems as claimed in claim 23, it is characterised in that:
CPU, for identifying the target possessing specific characteristic in the image in described video calling;Identifying After described target, according to Attribute tuning the second parameter value, to described target image in described video calling The property value of middle region is adjusted.
25. 1 kinds of graphic process unit, described graphic process unit is positioned at first terminal equipment, it is characterised in that Described graphic process unit includes:
Image acquiring unit, is used for obtaining pending image;Wherein, described pending image is described video Image in call, or according to the image that generates of image in described video calling;
Adjustment unit, is used for during first terminal equipment and the second terminal unit carry out video calling, According to Attribute tuning the first parameter value, the property value of pending image is adjusted;
Wherein, at least one during the image in described video calling includes following two kinds of images:
In this process, first terminal equipment this locality camera collection to each two field picture of containing of video stream packets;
In this process, first terminal equipment receive, by second terminal unit send video stream packets The each two field picture contained.
Image processing apparatus in 26. 1 kinds of video callings, it is characterised in that including:
Image acquiring unit, for obtaining the image in described video calling;
Adjustment unit, is used for triggering graphic process unit GPU and joins according to Attribute tuning first in this process Numerical value, is adjusted the property value of the image in described video calling;
Wherein, the image in described video calling, including at least one in following two kinds of images:
In this process, first client this locality camera collection to each two field picture of containing of video stream packets;
In this process, first client receive, the video stream packets that sent by the second client contains Each two field picture.
27. devices as claimed in claim 26, it is characterised in that
Parameter value obtains unit, is additionally operable to obtain Attribute tuning the second parameter value;
Adjustment unit, in this process, obtains, according to parameter value, the Attribute tuning second that unit obtains Parameter value, is adjusted the property value at least one region in the image in described video calling, is adjusted Image after whole;Trigger graphic process unit GPU in this process, obtain unit according to parameter value and obtain Attribute tuning the first parameter value, the property value of image after adjusting is adjusted.
28. devices as claimed in claim 27, it is characterised in that
Adjustment unit, is used for: trigger central processor CPU in this process according to Attribute tuning second Parameter value, is adjusted the property value at least one region in the image in described video calling;Trigger The property value of the image after adjusting according to Attribute tuning the first parameter value, is adjusted by GPU in this process Whole.
Image processing apparatus in 29. 1 kinds of video callings, it is characterised in that including:
Image acquiring unit, for receiving at least one client participating in video calling at described video calling During send, image in described video calling;
Parameter value obtains unit, is used for obtaining Attribute tuning the first parameter value;
Adjustment unit, for obtaining, according to parameter value, Attribute tuning the first parameter value that unit obtains, to image The property value obtaining the image in the described video calling that unit receives is adjusted;
Transmitting element, the image after being adjusted by adjustment unit is sent to participate in the client of described video calling End;
Wherein, the image in described video calling includes:
In this process, by described at least one client this locality camera collection to video stream packets contain Each two field picture.
30. devices as claimed in claim 29, it is characterised in that parameter value obtains unit and is additionally operable to obtain Obtain Attribute tuning the second parameter value;
Adjustment unit, is used for: according to Attribute tuning the second parameter value, in the image in described video calling The property value at least one region is adjusted, the image after being adjusted;According to Attribute tuning the first parameter Value, is adjusted the property value of the image after adjusting.
31. devices as claimed in claim 30, it is characterised in that adjustment unit, are used for:
Identify the target possessing specific characteristic in the image in described video calling;
After identifying described target, according to Attribute tuning the second parameter value, to described target at described video In image in call, the property value of region is adjusted.
CN201510319896.4A 2015-06-11 2015-06-11 Image processing method, device, system and graphic process unit in video calling Pending CN106303361A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510319896.4A CN106303361A (en) 2015-06-11 2015-06-11 Image processing method, device, system and graphic process unit in video calling

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510319896.4A CN106303361A (en) 2015-06-11 2015-06-11 Image processing method, device, system and graphic process unit in video calling

Publications (1)

Publication Number Publication Date
CN106303361A true CN106303361A (en) 2017-01-04

Family

ID=57660181

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510319896.4A Pending CN106303361A (en) 2015-06-11 2015-06-11 Image processing method, device, system and graphic process unit in video calling

Country Status (1)

Country Link
CN (1) CN106303361A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018127091A1 (en) * 2017-01-09 2018-07-12 腾讯科技(深圳)有限公司 Image processing method and apparatus, relevant device and server
CN108307101A (en) * 2017-05-16 2018-07-20 腾讯科技(深圳)有限公司 A kind of image processing method and electronic equipment, server
CN108337465A (en) * 2017-02-09 2018-07-27 腾讯科技(深圳)有限公司 Method for processing video frequency and device
CN109361950A (en) * 2018-11-27 2019-02-19 Oppo广东移动通信有限公司 Method for processing video frequency, device, electronic equipment and storage medium
CN112911191A (en) * 2021-01-28 2021-06-04 联想(北京)有限公司 Video call quality adjusting method and device, electronic equipment and storage medium
CN113645476A (en) * 2021-08-06 2021-11-12 广州博冠信息科技有限公司 Picture processing method and device, electronic equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004072310A (en) * 2002-08-05 2004-03-04 Matsushita Electric Ind Co Ltd Tv telephone system
US20060268101A1 (en) * 2005-05-25 2006-11-30 Microsoft Corporation System and method for applying digital make-up in video conferencing
CN103430531A (en) * 2011-03-07 2013-12-04 株式会社理光 Video processing apparatus, video processing system, and video processing method
CN103841389A (en) * 2014-04-02 2014-06-04 北京奇艺世纪科技有限公司 Video playing method and player

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004072310A (en) * 2002-08-05 2004-03-04 Matsushita Electric Ind Co Ltd Tv telephone system
US20060268101A1 (en) * 2005-05-25 2006-11-30 Microsoft Corporation System and method for applying digital make-up in video conferencing
CN103430531A (en) * 2011-03-07 2013-12-04 株式会社理光 Video processing apparatus, video processing system, and video processing method
CN103841389A (en) * 2014-04-02 2014-06-04 北京奇艺世纪科技有限公司 Video playing method and player

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018127091A1 (en) * 2017-01-09 2018-07-12 腾讯科技(深圳)有限公司 Image processing method and apparatus, relevant device and server
CN108337465A (en) * 2017-02-09 2018-07-27 腾讯科技(深圳)有限公司 Method for processing video frequency and device
CN108337465B (en) * 2017-02-09 2021-05-14 腾讯科技(深圳)有限公司 Video processing method and device
CN108307101A (en) * 2017-05-16 2018-07-20 腾讯科技(深圳)有限公司 A kind of image processing method and electronic equipment, server
CN108307101B (en) * 2017-05-16 2020-01-10 腾讯科技(深圳)有限公司 Image processing method, electronic equipment and server
CN109361950A (en) * 2018-11-27 2019-02-19 Oppo广东移动通信有限公司 Method for processing video frequency, device, electronic equipment and storage medium
CN112911191A (en) * 2021-01-28 2021-06-04 联想(北京)有限公司 Video call quality adjusting method and device, electronic equipment and storage medium
CN113645476A (en) * 2021-08-06 2021-11-12 广州博冠信息科技有限公司 Picture processing method and device, electronic equipment and storage medium
CN113645476B (en) * 2021-08-06 2023-10-03 广州博冠信息科技有限公司 Picture processing method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN106303361A (en) Image processing method, device, system and graphic process unit in video calling
CN111641778B (en) Shooting method, device and equipment
US9055189B2 (en) Virtual circular conferencing experience using unified communication technology
US8803939B2 (en) Method and device for realizing videophone
CN105554429A (en) Video conversation display method and video conversation equipment
CN109948093B (en) Expression picture generation method and device and electronic equipment
CN105681728A (en) Video processing method and device
JP2018501573A (en) Image sharing method and apparatus, and terminal device
CN109964478A (en) A kind of image pickup method and electronic device
US20150095802A1 (en) Mechanism for compacting shared content in collaborative computing sessions
CN104965778A (en) Method and device for game test
EP2879375A1 (en) Techniques to reduce color artifacts in a digital image
CN107071333A (en) Method of video image processing and video image processing device
CN108234880A (en) A kind of image enchancing method and device
CN109191388A (en) A kind of dark image processing method and system
CN109963106B (en) Video image processing method and device, storage medium and terminal
WO2021128835A1 (en) Image processing method and device, video processing method and device, electronic apparatus and storage medium
CN106020846A (en) Desktop tool display method and device
US20180376212A1 (en) Modifying display region for people with vision impairment
CN105610698B (en) The treating method and apparatus of event result
CN112037127A (en) Privacy shielding method and device for video monitoring, storage medium and electronic device
CN105764372B (en) A kind of image pickup method and Intelligent bracelet
CN108293052A (en) Communication system
CN104079860A (en) Information processing method and electronic equipment
CN108933958B (en) Method, storage medium, equipment and system for realizing microphone connection preview at user side

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1233092

Country of ref document: HK

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20180815

Address after: 31119KY1 - 1205, Furong Road mailbox, 802 West Bay Road, Cayman Islands

Applicant after: Nail holding (Cayman) Limited

Address before: Cayman Islands Grand Cayman capital building a four storey No. 847 mailbox

Applicant before: Alibaba Group Holding Co., Ltd.

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20170104

REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1233092

Country of ref document: HK