CN107968927A - Image processing method and device - Google Patents
Image processing method and device Download PDFInfo
- Publication number
- CN107968927A CN107968927A CN201610913618.6A CN201610913618A CN107968927A CN 107968927 A CN107968927 A CN 107968927A CN 201610913618 A CN201610913618 A CN 201610913618A CN 107968927 A CN107968927 A CN 107968927A
- Authority
- CN
- China
- Prior art keywords
- video image
- video
- fluency
- clarity
- parameter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention provides a kind of image processing method and device, this method includes：Video image is sent to called equipment；The notification message that called equipment is fed back according to video image is received, wherein, notification message carries the clarity parameter of video image and/or the fluency parameter of video image；The clarity and/or fluency of video image in adjustment video call process are corresponded to according to clarity parameter and/or fluency parameter.By the invention it is possible to solve the problems, such as that the clarity and/or fluency of video image in video call process can not be adjusted in correlation technique in correlation technique.
Description
Technical field
The present invention relates to the communications field, in particular to a kind of image processing method and device.
Background technology
Popularization and mobile Internet 4G Long Term Evolutions (Long Term with intelligent terminal (for example, smart mobile phone)
Evolution, referred to as TE), IP multimedia subsystem (IPMultimedia Subsystem, referred to as IMS), remote control
The fast development of system (Remote Control System, referred to as RCS) technology, video call service are also smoothly come out as an article meeting
Generally used by people as basic service, the clarity of image quality and fluency are substantially for user in video call process
Ask.The algorithm used in video call process is largely H264 algorithms, and the new technology H.264 introduced brings higher compression
Than, while substantially increase the complexity of algorithm.But H264 agreements have the concept of hierarchical design, the video encoder of different scenes
Different technique algorithms can be used.For using baseline profile algorithms applied to simple scene, for application
In complicated scene using main profile either high profile algorithms.Limited by terminal handler and related hardware
To make, the H264 encoders used in terminal are always the encryption algorithm of baseline profile specifications, but with the place of terminal
The development of device and related hardware technology is managed, the video encoder of terminal will be not limited to the calculation based on baseline Profile
Method, it is possible to the encryption algorithm of main Profile specifications can be used.
But baseline profile algorithms no matter are used in correlation technique, or using main profile or
High profile algorithms, can not adjust the clarity and/or fluency of video image in video call process.
The content of the invention
An embodiment of the present invention provides a kind of image processing method and device, at least to solve correlation technique in correlation technique
In the problem of can not adjusting the clarity and/or fluency of video image in video call process.
According to one embodiment of present invention, there is provided a kind of image processing method, including：Video is sent to called equipment
Image；The notification message that called equipment is fed back according to the video image is received, wherein, the notification message carries described regard
The clarity parameter of frequency image and/or the fluency parameter of the video image；According to the clarity parameter and/or the stream
Smooth degree parameter corresponds to the clarity and/or fluency of video image in adjustment video call process.
Alternatively, it is described that adjustment video call process is corresponded to according to the clarity parameter and/or the fluency parameter
The clarity and/or fluency of middle video image include：Judge to regard in the video call process according to the clarity parameter
Whether the clarity of frequency image reaches first predetermined value, alternatively, judging the video call process according to the fluency parameter
Whether the fluency of middle video image reaches second predetermined value；It is corresponding to adjust the video in the case where judging result is no
The clarity and/or fluency of video image in communication process.
Alternatively, the clarity of video image includes in the adjustment video call process：Adjustment is used to control institute
State the predetermined adjusting parameter of the clarity of video image；The video calling is adjusted according to the predetermined adjusting parameter after the adjustment
During video image clarity.
Alternatively, the fluency of video image includes in the adjustment video call process：Regarded by adjusting described
The mode of the macro block division of frequency image, adjusts the fluency of video image in the video call process, wherein, a macro block bag
Include a luminance pixel block and two additional chroma pixel blocks.
Alternatively, in the macro block dividing mode by adjusting the video image, adjust and regarded in the video call process
After the fluency of frequency image, further include：Judge whether the fluency of the video image after adjustment reaches second predetermined value；Sentencing
In the case that disconnected result is no, by adjusting the mode of the scope of motion vector MV, video in the video call process is adjusted
The fluency of image, wherein, when the MV is inter prediction, in the current coding macro block and reference frame of the video image with institute
State the motion vector between the highest macro block of current coding macro block matching degree.
According to another embodiment of the invention, there is provided a kind of image processing apparatus, including：Sending module, for
Called equipment sends video image；Receiving module, the notification message fed back for receiving called equipment according to the video image,
Wherein, the notification message carries the clarity parameter of the video image and/or the fluency parameter of the video image；
Module is adjusted, for corresponding to video in adjustment video call process according to the clarity parameter and/or the fluency parameter
The clarity and/or fluency of image.
Alternatively, the adjustment module, is additionally operable to judge to regard in the video call process according to the clarity parameter
Whether the clarity of frequency image reaches first predetermined value, alternatively, judging the video call process according to the fluency parameter
Whether the fluency of middle video image reaches second predetermined value；And in the case where judging result is no, described in corresponding adjustment
The clarity and/or fluency of video image in video call process.
Alternatively, the adjustment module, is additionally operable to the predetermined adjustment that adjustment is used to control the clarity of the video image
Parameter；And the clarity of video image in the video call process is adjusted according to the predetermined adjusting parameter after the adjustment.
Alternatively, the adjustment module, is additionally operable to the mode of the macro block division by adjusting the video image, adjusts institute
The fluency of video image in video call process is stated, wherein, a macro block includes a luminance pixel block and additional two
Chroma pixel block.
Alternatively, the adjustment module, is additionally operable to, in the macro block dividing mode by adjusting the video image, adjust institute
Whether the fluency for stating the video image after adjustment after the fluency of video image, is judged in video call process reaches second
Predetermined value；And in the case where judging result is no, by adjusting the mode of the scope of motion vector MV, adjust the video
The fluency of video image in communication process, wherein, when the MV is inter prediction, the current coding macro block of the video image
And the motion vector in reference frame between the highest macro block of current coding macro block matching degree.
According to still another embodiment of the invention, a kind of storage medium is additionally provided.The storage medium is arranged to storage and uses
In the program code for performing following steps：Video image is sent to called equipment；Called equipment is received according to the video image
The notification message of feedback, wherein, the notification message carries the clarity parameter of the video image and/or the video figure
The fluency parameter of picture；Corresponded in adjustment video call process and regarded according to the clarity parameter and/or the fluency parameter
The clarity and/or fluency of frequency image.
Alternatively, storage medium is also configured to the program code that storage is used to perform following steps：It is described according to described clear
Clear degree parameter and/or the fluency parameter correspond to the clarity and/or fluency of video image in adjustment video call process
Including：It is predetermined to judge whether the clarity of video image in the video call process reaches first according to the clarity parameter
Value, alternatively, whether the fluency for judging video image in the video call process according to the fluency parameter reaches second
Predetermined value；In judging result in the case of no, it is corresponding adjust in the video call process clarity of video image and/or
Fluency.
Alternatively, storage medium is also configured to the program code that storage is used to perform following steps：Regarded described in the adjustment
The clarity of video image includes in frequency communication process：Adjustment is used for the predetermined adjustment ginseng for controlling the clarity of the video image
Number；The clarity of video image in the video call process is adjusted according to the predetermined adjusting parameter after the adjustment.
Alternatively, storage medium is also configured to the program code that storage is used to perform following steps：Regarded described in the adjustment
The fluency of video image includes in frequency communication process：The mode divided by adjusting the macro block of the video image, adjusts institute
The fluency of video image in video call process is stated, wherein, a macro block includes a luminance pixel block and additional two
Chroma pixel block.
Alternatively, storage medium is also configured to the program code that storage is used to perform following steps：By adjusting described
The macro block dividing mode of video image, adjusts in the video call process after the fluency of video image, further includes：Judge
Whether the fluency of the video image after adjustment reaches second predetermined value；In the case where judging result is no, by adjusting fortune
The mode of the scope of dynamic vector MV, adjusts the fluency of video image in the video call process, wherein, the MV is interframe
During prediction, in the current coding macro block and reference frame of the video image with the highest macro block of current coding macro block matching degree
Between motion vector.
By the present invention, video image is sent to called equipment；Receive the notice that called equipment is fed back according to video image
Message, wherein, notification message carries the clarity parameter of video image and/or the fluency parameter of video image；According to clear
Clear degree parameter and/or fluency parameter correspond to the clarity and/or fluency of video image in adjustment video call process.Due to
The clarity parameter of the video image sent by being called equipment and/or the fluency parameter of video image correspond to adjustment video and lead to
The clarity and/or fluency of video image during words.Therefore, can solve adjust in correlation technique in correlation technique
In video call process the problem of the clarity and/or fluency of video image.
Brief description of the drawings
Attached drawing described herein is used for providing a further understanding of the present invention, forms the part of the application, this hair
Bright schematic description and description is used to explain the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings：
Fig. 1 is a kind of hardware block diagram of the mobile terminal of image processing method of the embodiment of the present invention；
Fig. 2 is the flow chart of image processing method according to embodiments of the present invention；
Fig. 3 is the video calling mobile terminal schematic diagram according to embodiments of the present invention based on H264 codings；
Fig. 4 is H264 macro blocks according to embodiments of the present invention and the division schematic diagram of sub-block；
Fig. 5 is H264 encoder video call flow figures according to embodiments of the present invention；
Fig. 6 is the structure diagram of image processing apparatus according to embodiments of the present invention.
Embodiment
Come that the present invention will be described in detail below with reference to attached drawing and in conjunction with the embodiments.It should be noted that do not conflicting
In the case of, the feature in embodiment and embodiment in the application can be mutually combined.
It should be noted that term " first " in description and claims of this specification and above-mentioned attached drawing, "
Two " etc. be for distinguishing similar object, without for describing specific order or precedence.
Embodiment 1
The embodiment of the method that the embodiment of the present application 1 is provided can be in mobile terminal, terminal or similar fortune
Calculate and performed in device.Exemplified by running on mobile terminals, Fig. 1 is a kind of movement of image processing method of the embodiment of the present invention
The hardware block diagram of terminal.Handled as shown in Figure 1, mobile terminal 10 can include one or more (one is only shown in figure)
Device 102 (processor 102 can include but is not limited to the processing unit of Micro-processor MCV or programmable logic device FPGA etc.),
For storing the memory 104 of data and transmitting device 106 for communication function.Those of ordinary skill in the art can be with
Understand, the structure shown in Fig. 1 is only to illustrate, it does not cause to limit to the structure of above-mentioned electronic device.For example, mobile terminal 10
It may also include more either less components than shown in Fig. 1 or there is the configuration different from shown in Fig. 1.
Memory 104 can be used for the software program and module of storage application software, such as the image in the embodiment of the present invention
Corresponding programmed instruction/the module of processing method, processor 102 by operation be stored in software program in memory 104 and
Module, so as to perform various functions application and data processing, that is, realizes above-mentioned method.Memory 104 may include at a high speed with
Machine memory, may also include nonvolatile memory, as one or more magnetic storage device, flash memory or other it is non-easily
The property lost solid-state memory.In some instances, memory 104 can further comprise depositing relative to processor 102 is remotely located
Reservoir, these remote memories can pass through network connection to mobile terminal 10.The example of above-mentioned network is including but not limited to mutual
Networking, intranet, LAN, mobile radio communication and combinations thereof.
Transmitting device 106 is used to data are received or sent via a network.Above-mentioned network instantiation may include
The wireless network that the communication providers of mobile terminal 10 provide.In an example, transmitting device 106 includes a Network adaptation
Device (Network Interface Controller, NIC), its can be connected by base station with other network equipments so as to it is mutual
Networking is communicated.In an example, transmitting device 106 can be radio frequency (Radio Frequency, RF) module, it is used
In wirelessly being communicated with internet.
A kind of image processing method for running on above-mentioned mobile terminal is provided in the present embodiment, and Fig. 2 is according to this hair
The flow chart of the image processing method of bright embodiment, as shown in Fig. 2, the flow includes the following steps：
Step S202, video image is sent to called equipment；
Step S204, receives the notification message that called equipment is fed back according to video image, wherein, notification message, which carries, to be regarded
The clarity parameter of frequency image and/or the fluency parameter of video image；
Step S206, video image in adjustment video call process is corresponded to according to clarity parameter and/or fluency parameter
Clarity and/or fluency.
By above-mentioned steps, due to the clarity parameter and/or video image of the video image by being called equipment transmission
Fluency parameter correspond to adjustment video call process in video image clarity and/or fluency.Therefore, phase can be solved
The problem of clarity and/or fluency of video image in video call process can not be adjusted in the technology of pass in correlation technique.
Alternatively, video image in adjustment video call process is corresponded to according to clarity parameter and/or fluency parameter
Clarity and/or fluency include：Whether the clarity for judging video image in video call process according to clarity parameter reaches
To first predetermined value, alternatively, judging whether the fluency of video image in video call process reaches according to fluency parameter
Two predetermined values；In the case where judging result is no, the clarity and/or stream of video image in corresponding adjustment video call process
Smooth degree.
Alternatively, adjusting the clarity of video image in video call process includes：Adjustment is used to control video image
The predetermined adjusting parameter of clarity；According to after adjustment predetermined adjusting parameter adjustment video call process in video image it is clear
Degree.
Alternatively, adjusting the fluency of video image in video call process includes：By adjusting the macro block of video image
The mode of division, adjusts the fluency of video image in video call process, wherein, a macro block includes a luminance pixel block
With two additional chroma pixel blocks.
Alternatively, in the macro block dividing mode by adjusting video image, video image in video call process is adjusted
After fluency, further include：Judge whether the fluency of the video image after adjustment reaches second predetermined value；It is in judging result
In the case of no, by adjusting the mode of the scope of motion vector (Motion Vector, referred to as MV), video calling is adjusted
During video image fluency, wherein, when MV is inter prediction, in the current coding macro block and reference frame of video image with
Motion vector between the highest macro block of current coding macro block matching degree.
In order to facilitate above-described embodiment is understood, an embodiment of the present invention provides a kind of video calling shifting based on H264 codings
Dynamic terminal, is carried out in video call process on mobile terminals by user of the present invention, it is ensured that the image quality of clear and smooth, separately
If outer picture is unintelligible, user can reconcile video quality and picture fluency manually.Fig. 3 is according to embodiments of the present invention
Based on the video calling mobile terminal schematic diagram of H264 codings, as shown in figure 3, should be moved eventually based on the video calling of H264 codings
End includes：Visual telephone module, parameter configuration module, video adjustment module, network formats monitoring module, H264 encoder moulds
Block.
The function of visual telephone module is when initiating or answering visual telephone, to bottom one video call of transmission
Warning Mark.It is video calling scene to indicate current scene.
Parameter configuration module, this module preserve the parameter value that beginning of the encoder in coding needs to set with during.Parameter value
The big parameter value that can be divided into three kinds of specification algorithms, is BaselineProfile, Main Profile, High respectively
The parameter value of tri- kinds of specification algorithms of Profile.Every kind of specification algorithm includes Base Params and Dynamic Params parameters again
Composition.Base Params are the parameters that need to be set when encoder creates, this partial parameters value generally can all be set as minimum reference
Value.During Dynamic Params are encoder operation, the parameter of the setting carried out according to the change dynamic of video source, this
Parameter needs each frame to be configured before starting coding.When upper layer transfers Warning Mark show active user initiating or
Video calling is answered, then starts video encoder, and selects the parameter value of Base line.
Video adjustment module, the video pictures quality and fluency that user feeds back according to callee, user can pass through tune
The parameter of encoder is saved, adjusts video quality and fluency in video call process in real time.Adjustment parameter includes adjusting
EncodingPreset parameters, adjust the dividing mode of macro block, adjust the scope of MV (Motion vector).
Image quality in encodingPreset parameter major control video call process, can divide high, medium and low.When
When selecting high, Video coding clarity can be high, and corresponding bit stream data can be big, and compression ratio can be low.
By adjusting macro block dividing mode come accommodation frequency fluency.H264 agreements relatively before H263 and MPEG4 agreements, pressure
Shrinkage improves, but algorithm complex is also lifted very much, and it is that macro block division minimum can refine that most important one one, which is improved,
To 4X4, and it is 8X8 that the division of H263 macro blocks is most thin.H.264 macro block has polytype, and introduces the concept of sub-block, H264 macro blocks
Division has 7 kinds of partition modes, can be split according to 16X16,16X8,8X16,8X8：If selecting the macro block mode of 8X8,
Sub-macroblock segmentation can be carried out according to 8X4,4X8,4X4.The division of macro block and sub-block is as shown in Figure 4.
H.264 the division of macro block and sub-block：Divided during specific coding using what kind of macro block, be all to pass through tentative calculation
Method, different types are divided into each macro block, then calculate absolute error and value (Sum Absolute Difference, letter
Referred to as SAD), the division that optimum way carries out macro block is finally selected, various for H264 macro block classified types, every kind of algorithm is all time
Go through one time, then find optimal dividing method, it is so i.e. time-consuming, the fluency of video is not utilized.In video call process, picture
General fairly simple, main body is mainly personage, and in addition painting style change is general not too large, and it is eyes and face to change most,
Analyzed according further to code stream in video call process, 80% macro block division is all 1X1 in video call process, only
9% is possible to be divided into 16X16.So can be by adjusting macro block classified types, to be lifted or subtracted in video coding process
Delay the speed of coding, then coding rate is embodied in the fluency of video.
The fluency of video is adjusted by adjusting the scope of motion vector (Motion Vector, referred to as MV), MV is
During inter prediction, the motion vector in current coding macro block and reference frame between matching degree highest macro block.This matching degree is highest grand
Block search method, be exactly in reference frame one macroblock match of macro block calculate, then find out most matched macro block, such one
An a adaptation calculates, and influences the speed of coding.If in an encoding process, a fixed search range in macroblock prediction,
Matched macro block is searched in fixed scope, reduces adaptation times, is beneficial to lifting coding rate.The scope of MV can be set to several
A gear.For video calling by characteristics of pictures, as explained above, the change of the video call process painting style is simple, so each grand
Block need not match whole reference frame, matched macro block may can be found in the scope of very little, so encoding
When the scope of MV can be set to slightly lower gear, reduce the search range of matching macro block, reduce the scramble time, lifting coding speed
Degree, lifts video fluency.
Network formats monitoring module, mainly monitors the network formats of active user's registration, then feeds back to video adjusting
Module.Because network formats are different, network limits difference to video bandwidth, then adjusts the parameter of video calling
(encodingPreset, macro block dividing mode, MV scopes) section is then different.
H264 encoders, the configuration parameter adjusted in real time according to parameter configuration module and user to it is proactive come into come image
Data are encoded.
Fig. 5 is H264 encoder video call flow figures according to embodiments of the present invention, as shown in figure 5, the flow includes：
Step S502, user initiate or answer video calling, and the Warning Mark of a video calling can be transmitted to bottom.
It is video calling scene to indicate current scene.
Step S504, encoder configuration module receive upper layer transfers video Warning Mark, and option and installment mould is in the block
Baseline specification algorithms.
After step S506, Baseline specification algorithm determines, configuration codes device initial value, encoder initial value is Base
Params, this partial parameters are all set to minimum value.During Dynamic Params are encoder operation, according to video source
The parameter for the setting that change dynamic carries out, this parameter need each frame to be configured before starting coding.
Step S508, when the video image of called feedback calling party is unintelligible, goes to step S510, as called feedback master
When the video image for the side of crying is clear, step S520 is gone to.
Step S510, video adjustment module can adjust the value of encQuality in encoder in caller device,
EncQuality values are set to high, improve the picture quality in video coding process.
Step S512, when the video image of called equipment feedback calling party is not smooth, goes to step S514, when called anti-
When presenting the video image smoothness of calling party, step S520 is gone to.
Step S514, user can divide macro block and most carefully be set to 8X8, reduce the complexity of coding.
Step S516, when called feedback calling party video image fluency not enough, step S518 is gone to, when called
It is smooth to feed back the video image of calling party, goes to step S520.
Step S518, can adjust the scope of MV, and the scope of MV is high, medium and low third gear, if be currently it is most high-grade, can
To search out the most border of image, this value can be tuned into middle-grade.If image is smooth not enough, MV scopes can be set to low
Shelves.
Step S520, terminates.
Alternatively, after step S518, step S518a can also be included：If callee still feeds back video image
When not smooth, can check encQuality values, whether encQuality is high, if high, then in this value being adjusted to or
It is low.
In addition in step S510, S514, S518, S518a the adjusting of relevant parameter according to the current registered network of user
Difference, the scope of parameter regulation are different.When the network of user's registration is 4G, network limits video bandwidth, such as 1280X720@
Video bandwidth limitation during 30fps is 4M, and the algorithm of the Baseline specifications of user's selection at this time, then the value of encQuality can
With in being set to or low.Macro block division most can carefully be adjusted between 8X8 to 16X16, between the scope maximum of MV is low in
Adjust.
Through the above description of the embodiments, those skilled in the art can be understood that according to above-mentioned implementation
The method of example can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but very much
In the case of the former be more preferably embodiment.Based on such understanding, technical scheme is substantially in other words to existing
The part that technology contributes can be embodied in the form of software product, which is stored in a storage
In medium (such as ROM/RAM, magnetic disc, CD), including some instructions are used so that a station terminal equipment (can be mobile phone, calculate
Machine, server, or network equipment etc.) perform method described in each embodiment of the present invention.
Embodiment 2
A kind of image processing apparatus is additionally provided in the present embodiment, which is used for realization above-described embodiment and preferred reality
Mode is applied, had carried out repeating no more for explanation.As used below, term " module " can realize the soft of predetermined function
The combination of part and/or hardware.Although following embodiments described devices is preferably realized with software, hardware, or
The realization of the combination of software and hardware is also what may and be contemplated.
Fig. 6 is the structure diagram of image processing apparatus according to embodiments of the present invention, as shown in fig. 6, the device includes：
Sending module 62, for sending video image to called equipment；
Receiving module 64, is connected to above-mentioned sending module 62, is led to for receiving called equipment according to what video image was fed back
Know message, wherein, notification message carries the clarity parameter of video image and/or the fluency parameter of video image；
Module 66 is adjusted, is connected to above-mentioned receiving module 64, for according to clarity parameter and/or fluency parameter correspondence
Adjust the clarity and/or fluency of video image in video call process.
Alternatively, module 66 is adjusted, is additionally operable to judge the clear of video image in video call process according to clarity parameter
Whether clear degree reaches first predetermined value, alternatively, judging the fluency of video image in video call process according to fluency parameter
Whether second predetermined value is reached；And in the case where judging result is no, video image in corresponding adjustment video call process
Clarity and/or fluency.
Alternatively, module 66 is adjusted, is additionally operable to the predetermined adjusting parameter that adjustment is used to control the clarity of video image；With
And the clarity according to video image in the predetermined adjusting parameter adjustment video call process after adjustment.
Alternatively, module 66 is adjusted, the mode of the macro block division by adjusting video image is additionally operable to, adjusts video calling
During video image fluency, wherein, macro block includes a luminance pixel block and two additional chroma pixel blocks.
Alternatively, module 66 is adjusted, is additionally operable to, in the macro block dividing mode by adjusting video image, adjust video calling
During video image fluency after, judge whether the fluency of video image after adjustment reaches second predetermined value；With
And in the case where judging result is no, by adjusting the mode of the scope of motion vector MV, adjusts and regarded in video call process
The fluency of frequency image, wherein, when MV is inter prediction, in the current coding macro block and reference frame of video image with present encoding
Motion vector between the highest macro block of macroblock match degree.
It should be noted that above-mentioned modules can be realized by software or hardware, for the latter, Ke Yitong
In the following manner realization is crossed, but not limited to this：Above-mentioned module is respectively positioned in same processor；Alternatively, above-mentioned modules are with any
The form of combination is located in different processors respectively.
Embodiment 3
The embodiment of the present invention additionally provides a kind of storage medium.Alternatively, in the present embodiment, above-mentioned storage medium can
The program code for performing following steps to be arranged to storage to be used for：
S1, video image is sent to called equipment；
S2, receives the notification message that called equipment is fed back according to video image, wherein, notification message carries video image
Clarity parameter and/or video image fluency parameter；
S3, the clear of video image in adjustment video call process is corresponded to according to clarity parameter and/or fluency parameter
Degree and/or fluency.
Alternatively, storage medium is also configured to the program code that storage is used to perform following steps：Joined according to clarity
Number and/or fluency parameter, which correspond to the clarity of video image and/or fluency in adjustment video call process, to be included：
S1, it is predetermined to judge whether the clarity of video image in video call process reaches first according to clarity parameter
Value, alternatively, whether the fluency for judging video image in video call process according to fluency parameter reaches second predetermined value；
S2, in judging result in the case of no, in corresponding adjustment video call process the clarity of video image and/or
Fluency.
Alternatively, storage medium is also configured to the program code that storage is used to perform following steps：Adjust video calling
During the clarity of video image include：
S1, adjustment are used for the predetermined adjusting parameter for controlling the clarity of video image；
S2, according to the clarity of video image in the predetermined adjusting parameter adjustment video call process after adjustment.
Alternatively, storage medium is also configured to the program code that storage is used to perform following steps：Adjust video calling
During the fluency of video image include：
S1, by adjusting video image macro block divide mode, adjust video call process in video image smoothness
Degree, wherein, a macro block includes a luminance pixel block and two additional chroma pixel blocks.
Alternatively, storage medium is also configured to the program code that storage is used to perform following steps：By adjusting regarding
The macro block dividing mode of frequency image, adjust video call process in video image fluency after, further include：
S1, judges whether the fluency of the video image after adjustment reaches second predetermined value；
S2, in the case where judging result is no, by adjusting the mode of the scope of motion vector MV, adjusts video calling
During video image fluency, wherein, when MV is inter prediction, in the current coding macro block and reference frame of video image with
Motion vector between the highest macro block of current coding macro block matching degree.
Alternatively, in the present embodiment, above-mentioned storage medium can include but is not limited to：USB flash disk, read-only storage (ROM,
Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disc or
CD etc. is various can be with the medium of store program codes.
Alternatively, in the present embodiment, processor is performed according to stored program code in storage medium：Set to called
Preparation send video image；The notification message that called equipment is fed back according to video image is received, wherein, notification message carries video
The clarity parameter of image and/or the fluency parameter of video image；Corresponded to and adjusted according to clarity parameter and/or fluency parameter
The clarity and/or fluency of video image in whole video call process.
Alternatively, in the present embodiment, processor is performed according to stored program code in storage medium：According to clear
Degree parameter and/or fluency parameter, which correspond to the clarity of video image and/or fluency in adjustment video call process, to be included：Root
Whether the clarity for judging video image in video call process according to clarity parameter reaches first predetermined value, alternatively, according to stream
Smooth degree parameter judges whether the fluency of video image in video call process reaches second predetermined value；It is no in judging result
In the case of, the clarity and/or fluency of video image in corresponding adjustment video call process.
Alternatively, in the present embodiment, processor is performed according to stored program code in storage medium：Adjust video
The clarity of video image includes in communication process：Adjustment is used for the predetermined adjusting parameter for controlling the clarity of video image；Root
According to the clarity of video image in the predetermined adjusting parameter adjustment video call process after adjustment.
Alternatively, in the present embodiment, processor is performed according to stored program code in storage medium：Adjust video
The fluency of video image includes in communication process：The mode divided by adjusting the macro block of video image, adjusts video calling
During video image fluency, wherein, macro block includes a luminance pixel block and two additional chroma pixel blocks.
Alternatively, in the present embodiment, processor is performed according to stored program code in storage medium：Adjusted passing through
The macro block dividing mode of whole video image, adjust video call process in video image fluency after, further include：Judge to adjust
Whether the fluency of the video image after whole reaches second predetermined value；In the case where judging result is no, by adjusting movement
The mode of the scope of vector MV, adjusts the fluency of video image in video call process, wherein, when MV is inter prediction, depending on
Motion vector in the current coding macro block and reference frame of frequency image between the highest macro block of current coding macro block matching degree.
Alternatively, the specific example in the present embodiment may be referred to described in above-described embodiment and optional embodiment
Example, details are not described herein for the present embodiment.
Obviously, those skilled in the art should be understood that above-mentioned each module of the invention or each step can be with general
Computing device realize that they can be concentrated on single computing device, or be distributed in multiple computing devices and formed
Network on, alternatively, they can be realized with the program code that computing device can perform, it is thus possible to which they are stored
Performed in the storage device by computing device, and in some cases, can be with different from shown in order execution herein
The step of going out or describing, they are either fabricated to each integrated circuit modules respectively or by multiple modules in them or
Step is fabricated to single integrated circuit module to realize.Combined in this way, the present invention is not restricted to any specific hardware and software.
The foregoing is only a preferred embodiment of the present invention, is not intended to limit the invention, for the skill of this area
For art personnel, the invention may be variously modified and varied.Within the spirit and principles of the invention, that is made any repaiies
Change, equivalent substitution, improvement etc., should all be included in the protection scope of the present invention.
Claims (10)
- A kind of 1. image processing method, it is characterised in that including：Video image is sent to called equipment；The notification message that called equipment is fed back according to the video image is received, wherein, the notification message carries described regard The clarity parameter of frequency image and/or the fluency parameter of the video image；The clear of video image in adjustment video call process is corresponded to according to the clarity parameter and/or the fluency parameter Degree and/or fluency.
- It is 2. according to the method described in claim 1, it is characterized in that, described according to the clarity parameter and/or the smoothness Degree parameter, which corresponds to the clarity of video image and/or fluency in adjustment video call process, to be included：It is predetermined to judge whether the clarity of video image in the video call process reaches first according to the clarity parameter Value, alternatively, whether the fluency for judging video image in the video call process according to the fluency parameter reaches second Predetermined value；In the case where judging result is no, the corresponding clarity and/or stream for adjusting video image in the video call process Smooth degree.
- 3. according to the method described in claim 2, it is characterized in that, described adjust video image in the video call process Clarity includes：Adjustment is used for the predetermined adjusting parameter for controlling the clarity of the video image；The clarity of video image in the video call process is adjusted according to the predetermined adjusting parameter after the adjustment.
- 4. according to the method described in claim 2, it is characterized in that, described adjust video image in the video call process Fluency includes：The mode divided by adjusting the macro block of the video image, adjusts the smoothness of video image in the video call process Degree, wherein, a macro block includes a luminance pixel block and two additional chroma pixel blocks.
- 5. according to the method described in claim 4, it is characterized in that, in the macro block division side by adjusting the video image Formula, adjusts in the video call process after the fluency of video image, further includes：Judge whether the fluency of the video image after adjustment reaches second predetermined value；In the case where judging result is no, by adjusting the mode of the scope of motion vector MV, the video calling mistake is adjusted The fluency of video image in journey, wherein, when the MV is inter prediction, the current coding macro block of the video image and reference Motion vector in frame between the highest macro block of current coding macro block matching degree.
- A kind of 6. image processing apparatus, it is characterised in that including：Sending module, for sending video image to called equipment；Receiving module, the notification message fed back for receiving called equipment according to the video image, wherein, the notification message Carry the clarity parameter of the video image and/or the fluency parameter of the video image；Module is adjusted, for being corresponded to according to the clarity parameter and/or the fluency parameter in adjustment video call process The clarity and/or fluency of video image.
- 7. device according to claim 6, it is characterised in that the adjustment module, is additionally operable to be joined according to the clarity Number judges whether the clarity of video image in the video call process reaches first predetermined value, alternatively, according to the smoothness Degree parameter judges whether the fluency of video image in the video call process reaches second predetermined value；And in judging result In the case of no, the corresponding clarity and/or fluency for adjusting video image in the video call process.
- 8. device according to claim 7, it is characterised in that the adjustment module, it is described for controlling to be additionally operable to adjustment The predetermined adjusting parameter of the clarity of video image；And the video is adjusted according to the predetermined adjusting parameter after the adjustment and is led to The clarity of video image during words.
- 9. device according to claim 7, it is characterised in that the adjustment module, is additionally operable to by adjusting the video The mode of the macro block division of image, adjusts the fluency of video image in the video call process, wherein, a macro block includes One luminance pixel block and two additional chroma pixel blocks.
- 10. device according to claim 9, it is characterised in that the adjustment module, is additionally operable to regard by adjusting described The macro block dividing mode of frequency image, adjusts in the video call process after the fluency of video image, after judging adjustment Whether the fluency of video image reaches second predetermined value；And in the case where judging result is no, sweared by adjusting movement The mode of the scope of MV is measured, adjusts the fluency of video image in the video call process, wherein, the MV is inter prediction When, in the current coding macro block and reference frame of the video image between the highest macro block of current coding macro block matching degree Motion vector.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610913618.6A CN107968927A (en) | 2016-10-20 | 2016-10-20 | Image processing method and device |
| PCT/CN2017/106740 WO2018072716A1 (en) | 2016-10-20 | 2017-10-18 | Image processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610913618.6A CN107968927A (en) | 2016-10-20 | 2016-10-20 | Image processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107968927A true CN107968927A (en) | 2018-04-27 |
Family
ID=61996290
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610913618.6A Pending CN107968927A (en) | 2016-10-20 | 2016-10-20 | Image processing method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107968927A (en) |
| WO (1) | WO2018072716A1 (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101998102A (en) * | 2009-08-24 | 2011-03-30 | 中兴通讯股份有限公司 | Method for controlling video quality of mobile video telephone and mobile video telephone |
| CN102957844A (en) * | 2011-08-12 | 2013-03-06 | 索尼公司 | Image processing device, image processing method, and image processing program |
| CN104796706A (en) * | 2014-01-17 | 2015-07-22 | 深圳市中瀛鑫科技股份有限公司 | Video coding method and device |
| US20160198158A1 (en) * | 2015-01-05 | 2016-07-07 | Citrix Systems, Inc. | Efficient video block matching |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7808988B2 (en) * | 2006-02-10 | 2010-10-05 | Packet Video Corporation | System and method for connecting mobile devices |
| CN104253967A (en) * | 2014-09-26 | 2014-12-31 | 厦门亿联网络技术股份有限公司 | Real-time video communication transmission control method |
| CN105812706A (en) * | 2016-03-17 | 2016-07-27 | 掌赢信息科技（上海）有限公司 | Video call quality evaluation method and electronic device |
| CN105812711B (en) * | 2016-05-05 | 2019-06-28 | 广东小天才科技有限公司 | Method and system for optimizing image quality in video call process |
-
2016
- 2016-10-20 CN CN201610913618.6A patent/CN107968927A/en active Pending
-
2017
- 2017-10-18 WO PCT/CN2017/106740 patent/WO2018072716A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101998102A (en) * | 2009-08-24 | 2011-03-30 | 中兴通讯股份有限公司 | Method for controlling video quality of mobile video telephone and mobile video telephone |
| CN102957844A (en) * | 2011-08-12 | 2013-03-06 | 索尼公司 | Image processing device, image processing method, and image processing program |
| CN104796706A (en) * | 2014-01-17 | 2015-07-22 | 深圳市中瀛鑫科技股份有限公司 | Video coding method and device |
| US20160198158A1 (en) * | 2015-01-05 | 2016-07-07 | Citrix Systems, Inc. | Efficient video block matching |
Non-Patent Citations (1)
| Title |
|---|
| 闫敬文: "《数字图像处理 MATLAB版》", 28 February 2007 * |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018072716A1 (en) | 2018-04-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10212422B2 (en) | Method and apparatus for encoding video, and decoding method and apparatus | |
| JP6940587B2 (en) | Methods and equipment for the use of compact parallel codecs in multimedia communications | |
| CN102138325B (en) | Systems and methods for providing selectable video using scalable video coding | |
| CN103297415B (en) | For providing the method and equipment of communication session | |
| AU2017315417A1 (en) | Color gamut adaptation with feedback channel | |
| CN107210993A (en) | The method and system of the dynamic rate shaping of multimedia content flows in cordless communication network | |
| CN108614633A (en) | The method and mobile device of video streaming are asked from video server | |
| CN104685886A (en) | Apparatus and methods thereof for video processing | |
| CN107005698A (en) | Support the metadata prompting of best effort decoding | |
| CN110169062A (en) | Deblocking filtering control | |
| CN111464704B (en) | Method, server, terminal and storage medium for implementing color ring back tone service | |
| EP3195597A1 (en) | Methods, encoders and decoders for coding of video sequences | |
| CN107370980A (en) | Video switching method, apparatus and system | |
| Goswami et al. | Adaptive multi-resolution encoding for ABR streaming | |
| CN100384230C (en) | Motion picture receiving device, motion picture transmitting device, motion picture decoding method, and motion picture encoding method | |
| US11949858B2 (en) | Video throughput improvement using long term referencing, deep learning, and load balancing | |
| CN107968927A (en) | Image processing method and device | |
| CN100536558C (en) | Controlling method and system for long-range video frequency circuit | |
| Kobayashi et al. | A 4K/60p HEVC real-time encoding system with high quality HDR color representations | |
| CN112585921B (en) | Method and network element for providing event coordinated uplink network assistance | |
| CN104010155B (en) | Video telephone realization method and mobile terminal | |
| CN111953983A (en) | Video coding method and device | |
| KR20140097236A (en) | Processing device for the generation of 3d content versions and associated device for obtaining content | |
| CN101309388A (en) | Control method for call image quality of video telephone and mobile phone adopting the method | |
| WO2024096390A1 (en) | Method and device for performing media call service |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180427 |
|
| WD01 | Invention patent application deemed withdrawn after publication |