CN103974071A - Video coding method and equipment on basis of regions of interest - Google Patents
Video coding method and equipment on basis of regions of interest Download PDFInfo
- Publication number
- CN103974071A CN103974071A CN201310034633.XA CN201310034633A CN103974071A CN 103974071 A CN103974071 A CN 103974071A CN 201310034633 A CN201310034633 A CN 201310034633A CN 103974071 A CN103974071 A CN 103974071A
- Authority
- CN
- China
- Prior art keywords
- video
- interest
- area
- macro block
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a video coding method and equipment on basis of regions of interest. The video coding method includes an object detection step, wherein specified objects in input video frames are detected, and regions of interest and regions of no interest in the video frames are identified on the basis of the detected specified objects; a quantization parameter calculation step, wherein quantization parameter values of macro blocks in the identified regions of interest and regions of no interest are calculated; a macro block type selection step, wherein types of the macro blocks in the regions of interest and regions of no interest are selected on the basis of types of the video frames; a video coding step, wherein the video frames are coded on the basis of the calculated quantization parameter values of the macro blocks in the regions of interest and regions of no interest and the selected types of the macro blocks. According to the method and equipment, video compression can be achieved simply and efficiently, high resolution of the regions of interest is guaranteed, and meanwhile the regions of no interest cannot be too fuzzy to be distinguished.
Description
Technical field
Present disclosure relates to video processing technique, more specifically, relate to a kind of based on area-of-interest (Region-of-Interest, ROI) method for video coding and equipment, it can simply and efficiently realize video compression, keep the good video quality in the ROI region in frame of video, the video image that can not make non-area-of-interest (non-ROI) is simultaneously too fuzzy and cannot differentiate.
Background technology
In recent years, the application based on intelligent video processing has been widely used in various electronic installations, and major applications need to be sent to compressed video back-end server or other communication terminal for being further processed.Therefore, exist for the high request of video resolution and between the finite element network bandwidth of video quality, occur the problem of conflicting with having limited, thereby the new method for video coding of needs solve this contradiction.
Therefore, ROI concept has been proposed in video processing technique, to make application only pay close attention to the important area that user was concerned about or the object in frame of video, and for other region in frame of video or picture (, non-area-of-interest), can process cursorily and even ignore these regions.Be applied to ROI concept ordinary representation in video compression in the time of coding, the more bit of region allocation of more paying close attention to for the user in frame of video, and for example, distribute less bit for other region (, background, irrelevant object etc.), thereby realize reducing of encoded video streams.For example, in intelligent monitoring application, the region of people, automobile, face etc. may be ROI region and by high-visible the details of encoding to keep necessary with more bit conventionally, and some essential informations will be encoded only to provide in other non-ROI region with less bit.
In field of video encoding, a large amount of method for video coding based on ROI are there are.For example, according to disclosed method for video coding in following non-patent literature 1, by the macro block (macroblock) in the He FeiROI region, ROI region in frame of video, different quantization parameter values is set, can reduces the size of the video flowing after coding.But, in the method, for the set quantization parameter of macro block in He FeiROI region, ROI region is fixed value but not adaptive, therefore possibly cannot meet the requirement for video quality.
In addition,, according to disclosed method for video coding in following non-patent literature 2, reduce the size of the video flowing after coding by all limit the macro block (mb) type in He FeiROI region, ROI region wherein for each frame.But this may make as too fuzzy in the non-ROI region of background and cannot differentiate.
And in disclosed method for video coding in following non-patent literature 3, thereby the quantization parameter value that adopts improved rate control algorithm to calculate the macro block in He FeiROI region, ROI region is realized video compression, but this algorithm is more complicated.
Citing document
[non-patent literature 1]: Lino F, Lu í s C, Pedro A., " H.264/SVC ROIEncoding with Spatial Scalability ", Proceedings of InternationalConference on Signal Processing and Multimedia Applications.Porto, Portugal:[s.n.], 2008:212-215
[non-patent literature 2]: Taeyoung Na et al, " H.264|MPEG-4Part10AVC for Mobile Video Telephony Applications of A Fast Macroblock ModeDecision Scheme Using ROI-Based Coding of ", Applications of DigitalImage Processing XXXI, Andrew G.Tescher edits, Proceedings of the SPIE, Volume7073, pp.70730I-70730I-10 (2008)
[non-patent literature 3]: Sira Rao and Nikil Jayant, " Optimizing Algorithmsfor Region-of-Interest Video Compression, with Application to MobileTelehealth ", ICME, pp.513-516.IEEE, (2006)
Summary of the invention
Provide hereinafter about brief overview of the present invention, to the basic comprehension about some aspect of the present invention is provided.But, should be appreciated that this general introduction is not about exhaustive general introduction of the present invention.It is not that intention is used for determining key part of the present invention or pith, neither be intended to for limiting scope of the present invention.Its object is only that the form of simplifying provides about some concept of the present invention, using this as the preorder in greater detail providing after a while.
In view of above problem, the object of this invention is to provide a kind of simple and efficient method for video coding, its by the ROI region in frame of video and non-ROI region adaptivity the quantization parameter value of macro block is wherein set, and the type based on frame of video is selected the macro block (mb) type in He FeiROI region, ROI region, in realizing video compression, ensure the high-resolution in ROI region and can not make the video in non-ROI region too fuzzy and cannot differentiate.
According to an embodiment of the invention on the one hand, a kind of method for video coding based on area-of-interest is provided, comprise: object detection step, for detection of the special object in the frame of video of input, identify area-of-interest and the non-area-of-interest in frame of video with the special object based on being detected; Quantization parameter calculation procedure, for calculating the quantization parameter value of macro block of identified area-of-interest and non-area-of-interest; Macro block (mb) type is selected step, selects the type of the macro block of area-of-interest and non-area-of-interest for the type based on frame of video; And Video coding step, for quantization parameter value and the selected macro block (mb) type of the macro block of the area-of-interest based on calculated and non-area-of-interest, frame of video is encoded.
According to a preferred embodiment of the invention, select in step at macro block (mb) type, can be in frame of video be frame frame in the situation that, all select all macro block (mb) types for the area-of-interest in described frame of video and non-area-of-interest; And in the situation that frame of video is inter-frame, for the non-area-of-interest in frame of video, only select inter macroblocks type, and for the area-of-interest in frame of video, select all macro block (mb) types.
According to another preferred embodiment of the invention, in quantization parameter calculation procedure, can calculate according to the size of the area-of-interest in frame of video the quantization parameter value of the macro block in area-of-interest.
According to another preferred embodiment of the invention, in quantization parameter calculation procedure, the quantization parameter value that calculates the macro block in area-of-interest according to the size of the area-of-interest in frame of video further comprises that the ratio of the quantity of the macro block in quantity and the frame of video of the macro block based in area-of-interest calculates the quantization parameter value of the macro block in area-of-interest.
According to another preferred embodiment of the invention, this method for video coding also comprises: sampling step, for frame of video being sampled before object detection step, wherein, in object detection step, the area-of-interest in the frame of video after sampling by identification and non-area-of-interest are identified area-of-interest and the non-area-of-interest in frame of video.
According to an embodiment of the invention on the other hand, a kind of video encoder based on area-of-interest is also provided, comprise: subject detecting unit, be configured to detect the special object in the frame of video of inputting, identify area-of-interest and the non-area-of-interest in frame of video with the special object based on being detected; Quantization parameter computing unit, is configured to calculate the quantization parameter value of the macro block in area-of-interest and the non-area-of-interest identified; Macro block (mb) type selected cell, is configured to the type based on frame of video and selects the type of the macro block in described area-of-interest and non-area-of-interest; And video encoding unit, be configured to quantization parameter value and the selected macro block (mb) type of the macro block in area-of-interest and the non-area-of-interest based on calculated, frame of video is encoded.
Another according to an embodiment of the invention aspect, a kind of storage medium is also provided, this storage medium comprises machine-readable program code, in the time of executive program code on messaging device, this program code is carried out according to the method for video coding based on area-of-interest of the present invention messaging device.
In addition, according to an embodiment of the invention more on the one hand, a kind of program product is also provided, this program product comprises the executable instruction of machine, when carry out instruction on messaging device time, this instruction is carried out according to the method for video coding based on area-of-interest of the present invention messaging device.
Therefore, according to embodiments of the invention, by during macro block mode prediction processing according to frame type and for He FeiROI region, ROI region limit macro block (mb) type scope and by adopt different quantization parameter values for He FeiROI region, ROI region during quantification treatment, can simply and efficiently realize video compression, ensure the high video quality in ROI region, can not make the video in non-ROI region too fuzzy simultaneously, thereby be suitable for the application of perception of content (content-aware) Video coding, the recognition of face of for example gate control system, the long distance control system in parking lot etc.
In specification part below, provide other aspects of the embodiment of the present invention, wherein, describe in detail for disclosing fully the preferred embodiment of the embodiment of the present invention, and it is not applied to restriction.
Brief description of the drawings
The present invention can, by reference to given detailed description and being better understood by reference to the accompanying drawings hereinafter, wherein use same or analogous Reference numeral to represent identical or similar parts in institute's drawings attached.Described accompanying drawing comprises in this manual and forms a part for specification together with detailed description below, be used for further illustrating the preferred embodiments of the present invention and explain principle and advantage of the present invention.Wherein:
Fig. 1 illustrates the flow chart of the example of the method for video coding based on ROI according to an embodiment of the invention;
Fig. 2 is the schematic diagram of the example of the ROI region identification in the object detection step being illustrated in the method for video coding based on ROI shown in Fig. 1;
Fig. 3 is the schematic diagram that is illustrated in the example implementation of the macro block (mb) type selection step in the method for video coding based on ROI shown in Fig. 1;
Fig. 4 is the schematic diagram of the effect example that illustrates that the frame bit number compared with the method for video coding of the method for video coding based on ROI and prior art according to an embodiment of the invention reduces;
Fig. 5 illustrates the block diagram of the example of the functional configuration of the video encoder based on ROI according to an embodiment of the invention; And
Fig. 6 is the block diagram illustrating as the example arrangement of the personal computer of the messaging device adopting in embodiments of the invention.
Embodiment
In connection with accompanying drawing, example embodiment of the present invention is described hereinafter.All features of actual execution mode are not described for clarity and conciseness, in specification.But, should understand, in the process of any this practical embodiments of exploitation, must make much decisions specific to execution mode, to realize developer's objectives, for example, meet and those restrictive conditions of system and traffic aided, and these restrictive conditions may change to some extent along with the difference of execution mode.In addition,, although will also be appreciated that development is likely very complicated and time-consuming, concerning having benefited from those skilled in the art of present disclosure, this development is only routine task.
At this, also it should be noted is that, for fear of the details because of unnecessary fuzzy the present invention, only show in the accompanying drawings with according to the closely-related device structure of the solution of the present invention and/or treatment step, and omitted other details little with relation of the present invention.
Hereinafter with reference to Fig. 1 to Fig. 6, the method for video coding based on ROI and video encoder are according to an embodiment of the invention described.
First, with reference to Fig. 1, the handling process example of the method for video coding based on ROI is according to an embodiment of the invention described.
Particularly, with reference to Fig. 1, the method for video coding based on ROI comprises object detection step S114, quantization parameter calculation procedure S116, macro block (mb) type selection step S118 and Video coding step S120 according to an embodiment of the invention.Preferably, the method can also comprise denoising step S110 and sampling step S112.Below by the processing of describing in detail in each step.
First, in object detection step S114, can detect the special object in the frame of video of input, identify area-of-interest and the non-area-of-interest in frame of video with the special object based on being detected.Particularly, can adopt suitable object detection algorithm to carry out detected target object (for example, people, automobile etc.) according to the needs of practical application, thereby define the He FeiROI region, ROI region in frame of video based on detected object.These object detection algorithm can be the known any particular algorithms of field of video processing, are not described in detail in this.
Preferably, can also adopt such as filtering method etc. to carry out preliminary treatment to the original video frame of input, to remove the ambient noise that frame of video comprises and to improve video compression quality.In denoising step S110, can remove the noise that the frame of video of input comprises.Preferably, in order further to improve treatment effeciency, denoising step S110 and object detection step S114 can carry out concurrently.
In addition, in order to improve the efficiency of Video processing, can also before object detection step S114, first sample to the frame of video of input, to reduce the amount of calculation of object detection processing subsequently.Preferably, sample rate can be set according to the complexity of the object detection algorithm adopting in object detection step S114 by user.
Preferably, in object detection step S114, the He FeiROI region, ROI region in original video frame is identified in the He FeiROI region, ROI region in the frame of video after can sampling by identification.
Particularly, this process can describe in detail with reference to Fig. 2.To sampling after frame of video application detection algorithm with detect comprising special object, and the special object based on detected is identified the He FeiROI region, ROI region in the frame of video after sampling, to obtain positional information and the dimension information etc. in the ROI region in the frame of video after sampling.Then, by adjusting the size in the ROI region in the sampling rear video frame obtaining and its mapping being got back in the video of original input, (for example can obtain the information in the He FeiROI region, ROI region in original input video frame, position, size etc.), these information are processed the coding for subsequently.This is schematically illustrated in Fig. 2.
As example, owing to conventionally carrying out various processing with macro-block level in video processing technique, therefore here, ROI region can refer to the region that comprises all macro blocks that comprise object pixel.Correspondingly, as example, the ratio of the macro block sum that the number of macroblocks that the dimension information in the ROI region in input video can be comprised by ROI region and frame of video comprise represents, that is, and and k=N
rOI/ N
tOTAL.
Next,, after having obtained the relevant information in ROI region, can, in quantization parameter calculation procedure S116, calculate the quantization parameter value of the macro block in the He FeiROI region, ROI region of identifying in step S114.Preferably, can calculate according to the size in the ROI region in frame of video the quantization parameter value of the macro block in ROI region.
In Video compression, to well known to a person skilled in the art be, because ROI region is the region that user is concerned about, but not ROI region is the region (such as background etc.) that comprises inessential information, therefore while being desirably in Video coding, with more bit, ROI region is encoded to ensure the high-resolution of encoded video, thereby and with less bit, non-ROI region is encoded to reduce encoded video streams and met the requirement of finite element network bandwidth.
Therefore, in quantization parameter calculation procedure S116, calculate respectively the quantization parameter of the macro block in He FeiROI region, ROI region, to meet different Video coding requirements.
Below provide the concrete example of calculating the quantization parameter value of the macro block in He FeiROI region, ROI region.Particularly, for the macro block in non-ROI region, conventionally adopt the quantization parameter value as predetermined fixed constant.This fixed constant can preset according to the specific requirement for video quality.As example, this fixed constant can be here 45.
And for the macro block in ROI region, for control bit quantity, preferably, its quantization parameter value be not fix but can be according to the size in the ROI region in frame of video and upgrade adaptively.
Preferably, based on the size in ROI region calculate the macro block in ROI region quantization parameter value can by the total ratio of the number of macroblocks based in above-mentioned ROI region and the macro block in input video frame, (, k) quantization parameter value of the macro block in calculating ROI region be realized.This process for example can realize by following equation.
QP
ROI=Round(F+R*k) （1）
QP’
ROI=MIN(QP
ROI,C) （2）
Wherein, QP '
rOIrepresent the quantization parameter value of the macro block in ROI region, k represents the ratio of the quantity of the macro block in quantity and the frame of video of the macro block in above-mentioned ROI region, Round () represents rounding operation, MIN () represents to get the computing of minimum value, wherein F, R and C represent respectively base value, regulated value and the higher limit of the quantization parameter value of the macro block in ROI region, are predetermined constant.Preferably, as example, F can be that 22, R is 50, and C is 32.
Should understand, the computational methods that more than provide and numerical value are only for example is unrestricted, and those skilled in the art can adopt according to actual needs other numerical value or above-mentioned computing formula is modified, thereby only need meet the larger required bit number Video coding principle that resolution is lower less of encoding of quantization parameter value.
Next, in order further to reduce the required bit number of non-ROI regional code, thereby further reduce the size of encoded video streams, may be limited to the macro block (mb) type in non-ROI region in macroblock prediction processing.
Particularly, select in step S118 type that can be based on frame of video and select the type of the macro block in He FeiROI region, ROI region at macro block (mb) type.
As example, with reference to Fig. 3, select in step S118 at macro block (mb) type, can apply the type of following rule based on frame of video and select respectively the macro block (mb) type in He FeiROI region, ROI region: if frame of video is frame in frame, all select all macro block (mb) types for He FeiROI region, ROI region, this is to encode because frame in frame generally speaking needs more bit; And if frame of video is inter-frame, for the ROI region in frame of video, selects all macro block (mb) types to ensure high-resolution, and for the non-ROI region in frame of video, only select inter macroblocks type to reduce the required bit of coding.
About the definition of the macro block (mb) type in Video processing, can, referring to the relevant regulations in " RecommendationITU-T H.264; Series H:Audiovisual and Multimedia Systems; Infrastructure of Audiovisual Services-Coding of Moving Video(2009) ", be not described in detail in this.
Then, in Video coding step S120, the quantization parameter value of the macro block in can the He FeiROI region, ROI region based on calculating in quantization parameter calculation procedure S116 and select the macro block (mb) type of selecting in step S118 at macro block (mb) type, encodes to frame of video.Preferably, this coding method can be entropy coding, to realize lossless video compression.
Preferably, after frame of video has been carried out to denoising, can be to the frame of video after denoising in Video coding step S120.
Should understand, above-mentionedly select the rule of the macro block (mb) type in He FeiROI region, ROI region only for example is unrestricted based on frame type, and those skilled in the art can principle according to the present invention adopt other suitable rule to reduce the required bit number of coding.
Fig. 4 schematically shows the minimizing effect of the frame bit number compared with the method for video coding of the method for video coding based on ROI and prior art according to an embodiment of the invention.Wherein, in the curve chart shown in Fig. 4, abscissa represents number of frames, and ordinate represents bit number.
In this example, can be the video sequence that for example face for office detects for the example input video frame of testing, therefore can apply face detection engine and obtain ROI area information, and the sequence after coding is IPPPP pattern, wherein, I represents frame in frame, and P represents predictive frame.As can be seen from Figure 4, compared with the method for video coding of prior art, by the application method for video coding based on ROI according to an embodiment of the invention, greatly reduce the required bit number of encoding (about 30% to 40%), thereby can be in the case of the limited network bandwidth, desirable encode video image is sent to subscriber terminal equipment, that is, has not only ensured the high-resolution in ROI region but also can not make the too fuzzy video in non-ROI region.In addition, compared with prior art, simple and efficient according to the realization of the method for video coding based on ROI of the present invention, thus also reduce the cost of realizing of Video processing.
Although describe in detail according to the example of the method for video coding based on ROI of the embodiment of the present invention in conjunction with Fig. 1 to Fig. 4 above, but those skilled in the art is understood that, flow chart shown in the drawings is only exemplary, and can, according to the difference of practical application and specific requirement, said method flow process be revised accordingly.For example, as required, can adjust the execution sequence of some step in said method, or can save or add some treatment step.For example, in Fig. 1, be the optional step of carrying out in order to improve video quality and treatment effeciency with the denoising step S110 shown in dotted line frame and sampling step S112, and can in the situation that not comprising this two steps, realize according to method for video coding of the present invention.In addition, should be understood that above example is not construed as limiting the invention, the principle that those skilled in the art can be based on instructed, carries out suitable amendment and is applied to other application scenario said process.
Corresponding with the method for video coding based on ROI according to the embodiment of the present invention, embodiments of the invention also provide a kind of video encoder based on ROI.Describe in detail according to the functional configuration example of the video encoder based on ROI of the present invention hereinafter with reference to Fig. 5.
As shown in Figure 5, the video encoder 500 based on ROI according to the present invention can comprise subject detecting unit 514, quantization parameter computing unit 516, macro block (mb) type selected cell 518 and video encoding unit 520.Preferably, this video encoder 500 can also comprise denoising unit 510 and sampling unit 512.Describe the functional configuration example of unit in detail below with reference to Fig. 5.
Subject detecting unit 514 can be configured to detect the special object in the frame of video of inputting, and identifies the He FeiROI region, ROI region in frame of video with the special object based on being detected.Can adopt according to actual needs object detection algorithm well known in the art to carry out detected object.
Quantization parameter computing unit 516 can be configured to calculate the quantization parameter value of the macro block in the He FeiROI region, ROI region of identifying.
Particularly, for the non-ROI region in frame of video, its quantization parameter value can be predetermined fixed constant conventionally, can be for example 45 here.And for the ROI region in frame of video, for control bit quantity, its quantization parameter value be not fix but can be according to actual needs and adaptively modifying.Preferably, quantization parameter computing unit 516 can calculate according to the size in the ROI region in frame of video the quantization parameter value of the macro block in ROI region.
As example, the total ratio of the macro block in quantity and the frame of video of the macro block that quantization parameter computing unit 516 can be based in ROI region calculates the quantization parameter value of the macro block in ROI region.Concrete computational process can, referring to above in calculation equation (1) and (2) described in the method for video coding based on ROI of the embodiment of the present invention, not repeat them here.
Should be understood that computational methods given here and the concrete numerical value that adopts are only for example is unrestricted, and can modify according to actual needs.
Macro block (mb) type selected cell 518 can be configured to the type based on frame of video and select the type of the macro block in He FeiROI region, ROI region.This can further reduce the required bit number of non-ROI regional code, thereby further reduces the size of encoded video streams.
Particularly, the selection of macro block (mb) type can realize based on following simple rule: if frame of video is frame in frame, for He FeiROI region, ROI region, macro block (mb) type selected cell 518 can all be selected all macro block (mb) types; And if frame of video is inter-frame, for ROI region, macro block (mb) type selected cell 518 can be selected all macro block (mb) types, and for non-ROI region, macro block (mb) type selected cell 518 can only be selected inter macroblocks type.
Based on this rule, can, in the high-resolution while that ensures ROI region, reduce the required bit number of non-ROI regional code to reduce encoded video streams, and can not make the video image in non-ROI region too fuzzy.This rule be only in macro block mode prediction processing for selecting the Sample Rules of macro block (mb) type, and those skilled in the art can suitably revise it based on principle of the present invention.
The quantization parameter value of the macro block in the He FeiROI region, ROI region that video encoding unit 520 can be configured to calculate based on quantization parameter computing unit 516 and the selected macro block (mb) type of macro block (mb) type selected cell 518, encode to frame of video.Preferably, coding method can be entropy coding.
In addition,, in order to reduce ambient noise to improve video compression quality, original video frame can also be input in denoising unit 510 and accept denoising.
Particularly, denoising unit 510 can be configured to remove the noise that input video frame comprises, this for example can realize by filtering processing well known in the art.Preferably, in order to improve treatment effeciency, denoising unit 510 and subject detecting unit 514 can be configured to carry out concurrently processing separately, thereby video encoding unit 520 can be encoded to the video after denoising.
In addition,, for the amount of calculation of object detection processing that reduces subject detecting unit 514 is to improve the efficiency of Video processing, video input can also carried out to sampling processing to it before subject detecting unit 514.
Particularly, sampling unit 512 can be configured to input video frame to carry out sampling processing.Correspondingly, the He FeiROI region, ROI region in original video frame is identified in the He FeiROI region, ROI region in the frame of video of subject detecting unit 514 after can being configured to sample by identification.Can, referring to the description in conjunction with Fig. 2 in above embodiment of the method, not repeat them here with the specific implementation that obtains the ROI area information in original video frame by the mapping such as position and dimension information in ROI region in the frame of video after the sampling obtaining being got back in original video frame.
It should be noted that, the video encoder based on ROI described in the embodiment of the present invention is corresponding with preceding method embodiment, and therefore, the part not describing in detail in apparatus embodiments, refers to the introduction of relevant position in embodiment of the method, repeats no more here.
In addition, the 26S Proteasome Structure and Function of the above-mentioned video encoder 500 based on ROI configures only for example is unrestricted, and those skilled in the art can modify to said structure as required.For example, in Fig. 5 taking the denoising unit 510 shown in dotted line frame and sampling unit 512 as selectable unit.
In addition, should also be noted that above-mentioned series of processes and equipment also can be by software and/or firmware realizations.In the situation that realizing by software and/or firmware, from storage medium or network to the computer with specialized hardware structure, example general purpose personal computer 600 is as shown in Figure 6 installed the program that forms this software, and this computer, in the time that various program is installed, can be carried out various functions etc.
In Fig. 6, CPU (CPU) 601 carries out various processing according to the program of storage in read-only memory (ROM) 602 or from the program that storage area 608 is loaded into random-access memory (ram) 603.In RAM603, also store as required data required in the time that CPU601 carries out various processing etc.
CPU601, ROM602 and RAM603 are connected to each other via bus 604.Input/output interface 605 is also connected to bus 604.
Following parts are connected to input/output interface 605: importation 606, comprises keyboard, mouse etc.; Output 607, comprises display, such as cathode ray tube (CRT), liquid crystal display (LCD) etc., and loud speaker etc.; Storage area 608, comprises hard disk etc.; With communications portion 609, comprise that network interface unit is such as LAN card, modulator-demodulator etc.Communications portion 609 via network such as internet executive communication processing.
As required, driver 610 is also connected to input/output interface 605.Detachable media 611, such as disk, CD, magneto optical disk, semiconductor memory etc. are installed on driver 610 as required, is installed in storage area 608 computer program of therefrom reading as required.
In the situation that realizing above-mentioned series of processes by software, from network such as internet or storage medium are such as detachable media 611 is installed the program that forms softwares.
It will be understood by those of skill in the art that this storage medium is not limited to wherein having program stored therein shown in Fig. 6, distributes separately the detachable media 611 so that program to be provided to user with equipment.The example of detachable media 611 comprises disk (comprising floppy disk (registered trade mark)), CD (comprising compact disc read-only memory (CD-ROM) and digital universal disc (DVD)), magneto optical disk (comprising mini-disk (MD) (registered trade mark)) and semiconductor memory.Or storage medium can be hard disk comprising in ROM602, storage area 608 etc., wherein computer program stored, and be distributed to user together with comprising their equipment.
The step that also it is pointed out that the above-mentioned series of processes of execution can be carried out according to the order of explanation naturally in chronological order, but does not need necessarily to carry out according to time sequencing.Some step can walk abreast or carry out independently of one another.
Although described the present invention and advantage thereof in detail, be to be understood that in the case of not departing from the spirit and scope of the present invention that limited by appended claim and can carry out various changes, alternative and conversion.And, the term of the embodiment of the present invention " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thereby the process, method, article or the equipment that make to comprise a series of key elements not only comprise those key elements, but also comprise other key elements of clearly not listing, or be also included as the intrinsic key element of this process, method, article or equipment.The in the situation that of more restrictions not, the key element being limited by statement " comprising ... ", and be not precluded within process, method, article or the equipment that comprises described key element and also have other identical element.
According to embodiments of the invention, following remarks is also disclosed:
1. the method for video coding based on area-of-interest, comprising:
Object detection step, for detection of the special object in the frame of video of input, identifies area-of-interest and the non-area-of-interest in described frame of video with the special object based on being detected;
Quantization parameter calculation procedure, for calculating the quantization parameter value of macro block of identified area-of-interest and non-area-of-interest;
Macro block (mb) type is selected step, selects the type of the macro block of described area-of-interest and non-area-of-interest for the type based on described frame of video; And
Video coding step, for quantization parameter value and the selected macro block (mb) type of the macro block of the described area-of-interest based on calculated and non-area-of-interest, encodes to described frame of video.
2. according to the method for video coding described in remarks 1, wherein, select in step at described macro block (mb) type, be in frame frame in the situation that in described frame of video, all select all macro block (mb) types for the area-of-interest in described frame of video and non-area-of-interest; And in the situation that described frame of video is inter-frame, for the non-area-of-interest in described frame of video, only select inter macroblocks type, and for the area-of-interest in described frame of video, select all macro block (mb) types.
3. according to the method for video coding described in remarks 1, wherein, in described quantization parameter calculation procedure, calculate the quantization parameter value of the macro block in described area-of-interest according to the size of the area-of-interest in described frame of video.
4. according to the method for video coding described in remarks 3, wherein, in described quantization parameter calculation procedure, the quantization parameter value that calculates the macro block in described area-of-interest according to the size of the area-of-interest in described frame of video further comprises that the ratio of the quantity of the macro block in quantity and the described frame of video of the macro block based in described area-of-interest calculates the quantization parameter value of the macro block in described area-of-interest.
5. according to the method for video coding described in remarks 4, wherein, in described quantization parameter calculation procedure, calculate the quantization parameter value of the macro block in described area-of-interest based on following equation:
QP
ROI=Round(F+R*k)
QP’
ROI=MIN(QP
ROI,C)
Wherein, QP '
rOIrepresent the quantization parameter value of the macro block in described area-of-interest, k represents the ratio of the quantity of the macro block in quantity and the described frame of video of the macro block in described area-of-interest, Round () represents rounding operation, MIN () represents to get the computing of minimum value, wherein F, R and C represent respectively base value, regulated value and the higher limit of the quantization parameter value of the macro block in described area-of-interest, are predetermined constant.
6. according to the method for video coding described in remarks 5, wherein, F is that 22, R is 50, and C is 32.
7. according to the method for video coding described in remarks 1, also comprise:
Denoising step, the noise comprising for removing described frame of video,
Wherein, in described Video coding step, the frame of video after denoising is encoded.
8. according to the method for video coding described in remarks 7, wherein, described denoising step and described object detection step are carried out concurrently.
9. according to the method for video coding described in remarks 1, also comprise:
Sampling step, for before described object detection step, described frame of video being sampled,
Wherein, in described object detection step, the area-of-interest in the frame of video after sampling by identification and non-area-of-interest are identified area-of-interest and the non-area-of-interest in described frame of video.
10. according to the method for video coding described in any one in remarks 1-9, wherein, the quantization parameter value of the macro block in described non-area-of-interest is predetermined fixed constant.
11. according to the method for video coding described in remarks 10, and wherein, described fixed constant is 45.
12. according to the method for video coding described in any one in remarks 1-11, wherein, in described Video coding step, described frame of video is carried out to entropy coding.
13. 1 kinds of video encoders based on area-of-interest, comprising:
Subject detecting unit, is configured to detect the special object in the frame of video of inputting, and identifies area-of-interest and the non-area-of-interest in described frame of video with the special object based on being detected;
Quantization parameter computing unit, is configured to calculate the quantization parameter value of the macro block in area-of-interest and the non-area-of-interest identified;
Macro block (mb) type selected cell, is configured to the type based on described frame of video and selects the type of the macro block in described area-of-interest and non-area-of-interest; And
Video encoding unit, is configured to quantization parameter value and the selected macro block (mb) type of the macro block in described area-of-interest and the non-area-of-interest based on calculated, and described frame of video is encoded.
14. according to the video encoder described in remarks 13, wherein, it is in frame frame in the situation that described macro block (mb) type selected cell is further configured in described frame of video, all selects all macro block (mb) types for the area-of-interest in described frame of video and non-area-of-interest; And in the situation that described frame of video is inter-frame, for the non-area-of-interest in described frame of video, only select inter macroblocks type, and for the area-of-interest in described frame of video, select all macro block (mb) types.
15. according to the video encoder described in remarks 13, and wherein, described quantization parameter computing unit is further configured to calculate according to the size of the area-of-interest in described frame of video the quantization parameter value of the macro block in described area-of-interest.
16. according to the video encoder described in remarks 15, wherein, the ratio that described quantization parameter computing unit is further configured to the quantity of the macro block in quantity and the described frame of video of the macro block based in described area-of-interest calculates the quantization parameter value of the macro block in described area-of-interest.
17. according to the video encoder described in remarks 16, and wherein, described quantization parameter computing unit is further configured to calculate based on following equation the quantization parameter value of the macro block in described area-of-interest:
QP
ROI=Round(F+R*k)
QP’
ROI=MIN(QP
ROI,C)
Wherein, QP '
rOIrepresent the quantization parameter value of the macro block in described area-of-interest, k represents the ratio of the quantity of the macro block in quantity and the described frame of video of the macro block in described area-of-interest, Round () represents rounding operation, MIN () represents to get the computing of minimum value, wherein F, R and C represent respectively base value, regulated value and the higher limit of the quantization parameter value of the macro block in described area-of-interest, are predetermined constant.
18. according to the video encoder described in remarks 17, and wherein, F is that 22, R is 50, and C is 32.
19. according to the video encoder described in remarks 13, also comprises:
Denoising unit, is configured to remove the noise that described frame of video comprises,
Wherein, described video encoding unit is further configured to the frame of video after denoising to encode.
20. according to the video encoder described in remarks 19, and wherein, described denoising unit and described subject detecting unit are configured to carry out concurrently processing.
21. according to the video encoder described in remarks 13, also comprises:
Sampling unit, is configured to described frame of video to sample,
Wherein, area-of-interest and the non-area-of-interest in the frame of video of described subject detecting unit after being configured to sample by identification identified area-of-interest and the non-area-of-interest in described frame of video.
22. according to the video encoder described in any one in remarks 13-21, and wherein, the quantization parameter value of the macro block in described non-area-of-interest is predetermined fixed constant.
23. according to the video encoder described in remarks 22, and wherein, described fixed constant is 45.
24. according to the video encoder described in any one in remarks 13-23, and wherein, described video encoding unit is further configured to described frame of video to carry out entropy coding.
25. 1 kinds of storage mediums, described storage medium comprises machine-readable program code, when carry out described program code on messaging device time, described program code is carried out according to the method for video coding based on area-of-interest described in any one in remarks 1 to 12 described messaging device.
26. 1 kinds of program products, described program product comprises the executable instruction of machine, when carry out described instruction on messaging device time, described instruction is carried out according to the method for video coding based on area-of-interest described in any one in remarks 1 to 12 described messaging device.
Claims (10)
1. the method for video coding based on area-of-interest, comprising:
Object detection step, for detection of the special object in the frame of video of input, identifies area-of-interest and the non-area-of-interest in described frame of video with the special object based on being detected;
Quantization parameter calculation procedure, for calculating the quantization parameter value of macro block of identified area-of-interest and non-area-of-interest;
Macro block (mb) type is selected step, selects the type of the macro block of described area-of-interest and non-area-of-interest for the type based on described frame of video; And
Video coding step, for quantization parameter value and the selected macro block (mb) type of the macro block of the described area-of-interest based on calculated and non-area-of-interest, encodes to described frame of video.
2. method for video coding according to claim 1, wherein, selects in step at described macro block (mb) type, is in frame frame in the situation that in described frame of video, all selects all macro block (mb) types for the area-of-interest in described frame of video and non-area-of-interest; And in the situation that described frame of video is inter-frame, for the non-area-of-interest in described frame of video, only select inter macroblocks type, and for the area-of-interest in described frame of video, select all macro block (mb) types.
3. method for video coding according to claim 1, wherein, in described quantization parameter calculation procedure, calculates the quantization parameter value of the macro block in described area-of-interest according to the size of the area-of-interest in described frame of video.
4. method for video coding according to claim 3, wherein, in described quantization parameter calculation procedure, the quantization parameter value that calculates the macro block in described area-of-interest according to the size of the area-of-interest in described frame of video further comprises that the ratio of the quantity of the macro block in quantity and the described frame of video of the macro block based in described area-of-interest calculates the quantization parameter value of the macro block in described area-of-interest.
5. method for video coding according to claim 1, also comprises:
Sampling step, for before described object detection step, described frame of video being sampled,
Wherein, in described object detection step, the area-of-interest in the frame of video after sampling by identification and non-area-of-interest are identified area-of-interest and the non-area-of-interest in described frame of video.
6. the video encoder based on area-of-interest, comprising:
Subject detecting unit, is configured to detect the special object in the frame of video of inputting, and identifies area-of-interest and the non-area-of-interest in described frame of video with the special object based on being detected;
Quantization parameter computing unit, is configured to calculate the quantization parameter value of the macro block in area-of-interest and the non-area-of-interest identified;
Macro block (mb) type selected cell, is configured to the type based on described frame of video and selects the type of the macro block in described area-of-interest and non-area-of-interest; And
Video encoding unit, is configured to quantization parameter value and the selected macro block (mb) type of the macro block in described area-of-interest and the non-area-of-interest based on calculated, and described frame of video is encoded.
7. video encoder according to claim 6, wherein, it is in frame frame in the situation that described macro block (mb) type selected cell is further configured in described frame of video, all selects all macro block (mb) types for the area-of-interest in described frame of video and non-area-of-interest; And in the situation that described frame of video is inter-frame, for the non-area-of-interest in described frame of video, only select inter macroblocks type, and for the area-of-interest in described frame of video, select all macro block (mb) types.
8. video encoder according to claim 6, wherein, described quantization parameter computing unit is further configured to calculate according to the size of the area-of-interest in described frame of video the quantization parameter value of the macro block in described area-of-interest.
9. video encoder according to claim 8, wherein, the ratio that described quantization parameter computing unit is further configured to the quantity of the macro block in quantity and the described frame of video of the macro block based in described area-of-interest calculates the quantization parameter value of the macro block in described area-of-interest.
10. video encoder according to claim 6, also comprises:
Sampling unit, is configured to described frame of video to sample,
Wherein, area-of-interest and the non-area-of-interest in the frame of video of described subject detecting unit after being further configured to sample by identification identified area-of-interest and the non-area-of-interest in described frame of video.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310034633.XA CN103974071A (en) | 2013-01-29 | 2013-01-29 | Video coding method and equipment on basis of regions of interest |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310034633.XA CN103974071A (en) | 2013-01-29 | 2013-01-29 | Video coding method and equipment on basis of regions of interest |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103974071A true CN103974071A (en) | 2014-08-06 |
Family
ID=51243042
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310034633.XA Pending CN103974071A (en) | 2013-01-29 | 2013-01-29 | Video coding method and equipment on basis of regions of interest |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103974071A (en) |
Cited By (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104410860A (en) * | 2014-11-28 | 2015-03-11 | 北京航空航天大学 | Method for regulating quality of high-definition video containing ROI (region of interest) in real time |
| CN106131670A (en) * | 2016-07-12 | 2016-11-16 | 块互动（北京）科技有限公司 | A kind of adaptive video coding method and terminal |
| CN106651862A (en) * | 2016-11-15 | 2017-05-10 | 昂纳自动化技术（深圳）有限公司 | Multiple-connected-domain rapid merging algorithm and apparatus based on stroke coding |
| WO2017096824A1 (en) * | 2015-12-11 | 2017-06-15 | 乐视控股（北京）有限公司 | Bit rate control method and device for motion video |
| CN107371012A (en) * | 2017-07-04 | 2017-11-21 | 歌尔科技有限公司 | A kind of VR image procossings and display methods and device |
| CN109246434A (en) * | 2018-11-16 | 2019-01-18 | 联想(北京)有限公司 | Video coding, coding/decoding method and electronic equipment |
| CN109862356A (en) * | 2019-01-17 | 2019-06-07 | 中国科学院计算技术研究所 | A kind of method for video coding and system based on area-of-interest |
| CN110049324A (en) * | 2019-04-12 | 2019-07-23 | 深圳壹账通智能科技有限公司 | Method for video coding, system, equipment and computer readable storage medium |
| CN110072119A (en) * | 2019-04-11 | 2019-07-30 | 西安交通大学 | A kind of perception of content video adaptive transmission method based on deep learning network |
| CN110121885A (en) * | 2016-12-29 | 2019-08-13 | 索尼互动娱乐股份有限公司 | For having recessed video link using the wireless HMD video flowing transmission of VR, the low latency of watching tracking attentively |
| CN110572579A (en) * | 2019-09-30 | 2019-12-13 | 联想(北京)有限公司 | image processing method and device and electronic equipment |
| CN111131825A (en) * | 2019-10-28 | 2020-05-08 | 华为技术有限公司 | Video processing method and related device |
| CN111324793A (en) * | 2018-12-17 | 2020-06-23 | 地平线(上海)人工智能技术有限公司 | Method and device for controlling operation of storing data of region of interest |
| CN111414904A (en) * | 2019-01-08 | 2020-07-14 | 北京地平线机器人技术研发有限公司 | Method and apparatus for processing region of interest data |
| CN111918066A (en) * | 2020-09-08 | 2020-11-10 | 北京字节跳动网络技术有限公司 | Video encoding method, device, equipment and storage medium |
| WO2020243906A1 (en) * | 2019-06-04 | 2020-12-10 | SZ DJI Technology Co., Ltd. | Method, device, and storage medium for encoding video data base on regions of interests |
| CN112153317A (en) * | 2020-09-25 | 2020-12-29 | 杭州涂鸦信息技术有限公司 | Image quality control method, system and equipment thereof |
| CN112543372A (en) * | 2019-09-20 | 2021-03-23 | 珠海格力电器股份有限公司 | Method, device and storage medium for distributing video code rate |
| CN113011210A (en) * | 2019-12-19 | 2021-06-22 | 北京百度网讯科技有限公司 | Video processing method and device |
| CN114422788A (en) * | 2022-03-30 | 2022-04-29 | 浙江智慧视频安防创新中心有限公司 | Digital retina video joint coding method, decoding method, device and electronic equipment |
| WO2022213809A1 (en) * | 2021-04-07 | 2022-10-13 | 百果园技术(新加坡)有限公司 | Video coding method, apparatus and device, and storage medium |
| CN115988214A (en) * | 2022-12-01 | 2023-04-18 | 北京首都在线科技股份有限公司 | Video frame encoding method, video frame display method and device |
| CN116760988A (en) * | 2023-08-18 | 2023-09-15 | 瀚博半导体(上海)有限公司 | Video coding method and device based on human visual system |
| CN116886923A (en) * | 2023-06-19 | 2023-10-13 | 广州开得联软件技术有限公司 | Classroom video coding method, device, storage medium and equipment |
| WO2023240466A1 (en) * | 2022-06-14 | 2023-12-21 | Intel Corporation | Methods and apparatus to detect a region of interest based on variable rate shading |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1999059344A1 (en) * | 1998-05-12 | 1999-11-18 | Sgs-Thomson Microelectronics Asia Pacific (Pte) Ltd. | Conditional masking for video encoder |
| US20040151390A1 (en) * | 2003-01-31 | 2004-08-05 | Ryuichi Iwamura | Graphic codec for network transmission |
| CN101494785A (en) * | 2008-12-19 | 2009-07-29 | 无锡亿普得科技有限公司 | Method for encoding H.264 interesting region |
| CN102510496A (en) * | 2011-10-14 | 2012-06-20 | 北京工业大学 | Quick size reduction transcoding method based on region of interest |
| CN102595132A (en) * | 2012-02-17 | 2012-07-18 | 南京邮电大学 | Distributed video encoding and decoding method applied to wireless sensor network |
-
2013
- 2013-01-29 CN CN201310034633.XA patent/CN103974071A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1999059344A1 (en) * | 1998-05-12 | 1999-11-18 | Sgs-Thomson Microelectronics Asia Pacific (Pte) Ltd. | Conditional masking for video encoder |
| US20040151390A1 (en) * | 2003-01-31 | 2004-08-05 | Ryuichi Iwamura | Graphic codec for network transmission |
| CN101494785A (en) * | 2008-12-19 | 2009-07-29 | 无锡亿普得科技有限公司 | Method for encoding H.264 interesting region |
| CN102510496A (en) * | 2011-10-14 | 2012-06-20 | 北京工业大学 | Quick size reduction transcoding method based on region of interest |
| CN102595132A (en) * | 2012-02-17 | 2012-07-18 | 南京邮电大学 | Distributed video encoding and decoding method applied to wireless sensor network |
Cited By (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104410860A (en) * | 2014-11-28 | 2015-03-11 | 北京航空航天大学 | Method for regulating quality of high-definition video containing ROI (region of interest) in real time |
| CN104410860B (en) * | 2014-11-28 | 2017-08-15 | 北京航空航天大学 | A kind of method of high definition ROI videos real-time quality regulation |
| WO2017096824A1 (en) * | 2015-12-11 | 2017-06-15 | 乐视控股（北京）有限公司 | Bit rate control method and device for motion video |
| CN106131670A (en) * | 2016-07-12 | 2016-11-16 | 块互动（北京）科技有限公司 | A kind of adaptive video coding method and terminal |
| CN106131670B (en) * | 2016-07-12 | 2019-04-05 | 一块互动（北京）科技有限公司 | A kind of adaptive video coding method and terminal |
| CN106651862A (en) * | 2016-11-15 | 2017-05-10 | 昂纳自动化技术（深圳）有限公司 | Multiple-connected-domain rapid merging algorithm and apparatus based on stroke coding |
| CN110121885B (en) * | 2016-12-29 | 2023-07-25 | 索尼互动娱乐股份有限公司 | Concave video link for VR and low latency wireless HMD video streaming with gaze tracking |
| CN110121885A (en) * | 2016-12-29 | 2019-08-13 | 索尼互动娱乐股份有限公司 | For having recessed video link using the wireless HMD video flowing transmission of VR, the low latency of watching tracking attentively |
| CN107371012A (en) * | 2017-07-04 | 2017-11-21 | 歌尔科技有限公司 | A kind of VR image procossings and display methods and device |
| CN109246434A (en) * | 2018-11-16 | 2019-01-18 | 联想(北京)有限公司 | Video coding, coding/decoding method and electronic equipment |
| CN111324793A (en) * | 2018-12-17 | 2020-06-23 | 地平线(上海)人工智能技术有限公司 | Method and device for controlling operation of storing data of region of interest |
| CN111324793B (en) * | 2018-12-17 | 2024-02-23 | 地平线(上海)人工智能技术有限公司 | Method and device for controlling operation of storing data of region of interest |
| CN111414904B (en) * | 2019-01-08 | 2023-12-01 | 北京地平线机器人技术研发有限公司 | Method and device for processing data of region of interest |
| CN111414904A (en) * | 2019-01-08 | 2020-07-14 | 北京地平线机器人技术研发有限公司 | Method and apparatus for processing region of interest data |
| CN109862356A (en) * | 2019-01-17 | 2019-06-07 | 中国科学院计算技术研究所 | A kind of method for video coding and system based on area-of-interest |
| CN110072119A (en) * | 2019-04-11 | 2019-07-30 | 西安交通大学 | A kind of perception of content video adaptive transmission method based on deep learning network |
| WO2020207030A1 (en) * | 2019-04-12 | 2020-10-15 | 深圳壹账通智能科技有限公司 | Video encoding method, system and device, and computer-readable storage medium |
| CN110049324B (en) * | 2019-04-12 | 2022-10-14 | 深圳壹账通智能科技有限公司 | Video encoding method, system, device, and computer-readable storage medium |
| CN110049324A (en) * | 2019-04-12 | 2019-07-23 | 深圳壹账通智能科技有限公司 | Method for video coding, system, equipment and computer readable storage medium |
| WO2020243906A1 (en) * | 2019-06-04 | 2020-12-10 | SZ DJI Technology Co., Ltd. | Method, device, and storage medium for encoding video data base on regions of interests |
| CN112543372A (en) * | 2019-09-20 | 2021-03-23 | 珠海格力电器股份有限公司 | Method, device and storage medium for distributing video code rate |
| CN110572579A (en) * | 2019-09-30 | 2019-12-13 | 联想(北京)有限公司 | image processing method and device and electronic equipment |
| CN111131825A (en) * | 2019-10-28 | 2020-05-08 | 华为技术有限公司 | Video processing method and related device |
| CN113011210A (en) * | 2019-12-19 | 2021-06-22 | 北京百度网讯科技有限公司 | Video processing method and device |
| CN113011210B (en) * | 2019-12-19 | 2022-09-16 | 北京百度网讯科技有限公司 | Video processing method and device |
| US11659181B2 (en) | 2019-12-19 | 2023-05-23 | Beijing Baidu Netcom Science And Technology Co., Ltd. | Method and apparatus for determining region of interest |
| CN111918066A (en) * | 2020-09-08 | 2020-11-10 | 北京字节跳动网络技术有限公司 | Video encoding method, device, equipment and storage medium |
| CN112153317A (en) * | 2020-09-25 | 2020-12-29 | 杭州涂鸦信息技术有限公司 | Image quality control method, system and equipment thereof |
| WO2022213809A1 (en) * | 2021-04-07 | 2022-10-13 | 百果园技术(新加坡)有限公司 | Video coding method, apparatus and device, and storage medium |
| CN114422788A (en) * | 2022-03-30 | 2022-04-29 | 浙江智慧视频安防创新中心有限公司 | Digital retina video joint coding method, decoding method, device and electronic equipment |
| WO2023240466A1 (en) * | 2022-06-14 | 2023-12-21 | Intel Corporation | Methods and apparatus to detect a region of interest based on variable rate shading |
| CN115988214A (en) * | 2022-12-01 | 2023-04-18 | 北京首都在线科技股份有限公司 | Video frame encoding method, video frame display method and device |
| CN116886923A (en) * | 2023-06-19 | 2023-10-13 | 广州开得联软件技术有限公司 | Classroom video coding method, device, storage medium and equipment |
| CN116760988A (en) * | 2023-08-18 | 2023-09-15 | 瀚博半导体(上海)有限公司 | Video coding method and device based on human visual system |
| CN116760988B (en) * | 2023-08-18 | 2023-11-10 | 瀚博半导体(上海)有限公司 | Video coding method and device based on human visual system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103974071A (en) | Video coding method and equipment on basis of regions of interest | |
| US8817884B2 (en) | Techniques for perceptual encoding of video frames | |
| US8934544B1 (en) | Efficient motion estimation in hierarchical structure | |
| US20110047155A1 (en) | Multimedia encoding method and device based on multimedia content characteristics, and a multimedia decoding method and device based on multimedia | |
| JP2007503757A (en) | Mode decision for intermediate prediction in video coding | |
| CN1941911A (en) | Parameterization for fading compensation | |
| Zhang et al. | Video compression artifact reduction via spatio-temporal multi-hypothesis prediction | |
| Wang et al. | End-to-end compression towards machine vision: Network architecture design and optimization | |
| CN103051891B (en) | The method and apparatus for determining the saliency value of the block for the video frame that block prediction encodes in data flow | |
| CN105208394B (en) | A kind of real-time digital image compression prediction technique and system | |
| Wang et al. | Semantic-aware video compression for automotive cameras | |
| WO2022062369A1 (en) | Point cloud encoding and decoding method and system, and point cloud encoder and point cloud decoder | |
| WO2022133753A1 (en) | Point cloud encoding and decoding methods and systems, point cloud encoder, and point cloud decoder | |
| KR20150045819A (en) | Method and apparatus for video encoding conducting motion compensation, method and apparatus for video decoding conducting motion compensation | |
| CN111654696B (en) | Intra-frame multi-reference-line prediction method and device, storage medium and terminal | |
| Yang et al. | Efficient screen content intra coding based on statistical learning | |
| Lu et al. | A fast HEVC intra-coding algorithm based on texture homogeneity and spatio-temporal correlation | |
| CN116567246A (en) | AVC coding method and device | |
| CN108683915B (en) | Method and device for writing dQP value and electronic equipment | |
| Chai et al. | Fpga-based ROI encoding for HEVC video bitrate reduction | |
| KR20130086294A (en) | Video rate control based on transform-coefficients histogram | |
| CN1338235A (en) | Method and device for video compress encoding based on division | |
| JP6069009B2 (en) | Image decoding apparatus and image decoding program | |
| US20240048709A1 (en) | Methods and systems for temporal resampling for multi-task machine vision | |
| WO2023051551A1 (en) | Method, apparatus, and medium for point cloud coding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140806 |