CN109493304A - A kind of image processing method and device - Google Patents

A kind of image processing method and device Download PDF

Info

Publication number
CN109493304A
CN109493304A CN201710824066.6A CN201710824066A CN109493304A CN 109493304 A CN109493304 A CN 109493304A CN 201710824066 A CN201710824066 A CN 201710824066A CN 109493304 A CN109493304 A CN 109493304A
Authority
CN
China
Prior art keywords
picture
user terminal
layer pictures
decoded
pictures data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710824066.6A
Other languages
Chinese (zh)
Other versions
CN109493304B (en
Inventor
应玉龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201710824066.6A priority Critical patent/CN109493304B/en
Priority to PCT/CN2018/105131 priority patent/WO2019052452A1/en
Publication of CN109493304A publication Critical patent/CN109493304A/en
Application granted granted Critical
Publication of CN109493304B publication Critical patent/CN109493304B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/40—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the invention discloses a kind of image processing method and devices, wherein method includes: to send the first layer picture acquisition request for the dimension information for carrying display area to server, so that the target hierarchy picture that server matches according to the selection of first layer picture acquisition request with dimension information；The base layer pictures data in the target hierarchy picture that server is sent are received, and by hierarchical picture decoder, base layer pictures data are decoded, and decoded base layer pictures data are shown；Receive the enhancement-layer pictures data in the target hierarchy picture that server is sent, and enhancement-layer pictures data are decoded by hierarchical picture decoder, and decoded enhancement-layer pictures data and decoded base layer pictures data are synthesized, and show synthesized image data out.Using the present invention, it can avoid picture display area and be in space state for a long time, image display effect also can be improved.

Description

A kind of image processing method and device
Technical field
The present invention relates to Internet technical field more particularly to a kind of image processing methods and device.
Background technique
With the development of mobile internet, the downloading flow of terminal device increases substantially, in user's downloading flow, picture stream Amount occupies very big accounting.A large amount of picture also brings very big pressure to network transmission bandwidth load.Therefore, if user is in net Network state is not the lower higher picture of mounted mass in very stable situation, then it is too long to will lead to image data transmission time, in turn The picture display area of user terminal is caused to be in space state for a long time.Although, can be with by the lower picture of lower mounted mass Solve the problems, such as that image data transmission time is too long, but the lower picture of quality may result in image content and excessively obscure, Seriously affect display effect.
Summary of the invention
The embodiment of the present invention provides a kind of image processing method and device, can avoid picture display area for a long time In space state, image display effect also can be improved.
First aspect present invention provides a kind of image processing method, comprising:
The first layer picture acquisition request for carrying the dimension information of display area is sent to server, so that the service The target hierarchy picture that device matches according to first layer picture acquisition request selection with the dimension information；
The base layer pictures data in the target hierarchy picture that the server is sent are received, and pass through hierarchical picture Decoder is decoded the base layer pictures data, and shows to decoded base layer pictures data；
The enhancement-layer pictures data in the target hierarchy picture that the server is sent are received, and pass through the layering Sub-picture decoder is decoded the enhancement-layer pictures data, and will be after decoded enhancement-layer pictures data and the decoding Base layer pictures data synthesized, and show it is synthesized go out image data.
Wherein, further includes:
The operation system information of user terminal is obtained, and sends the decoding for carrying the operation system information of the user terminal Device acquisition request is to the server, so that the server is searched and the user terminal according to the decoder acquisition request The hierarchical picture decoder that matches of operation system information；
Receive the hierarchical picture decoding to match with the operation system information of the user terminal that the server is sent Device.
Wherein, it is described send carry display area dimension information first layer picture acquisition request to server it Before, further includes:
The dimension information of display area is obtained, and judges whether the dimension information meets the adaptive condition of hierarchical picture；
It is unsatisfactory for if being judged as, sends the second hierarchical picture acquisition request to the server, so that the server The base layer pictures number in the hierarchical picture with maximum resolution is successively sent according to the second hierarchical picture acquisition request According to enhancement-layer pictures data；
If being judged as satisfaction, the first layer picture acquisition for executing the dimension information for sending carrying display area is asked The step of seeking server.
Wherein, before the dimension information for obtaining display area, further includes:
Judge whether to support hierarchical picture format；
Do not supported if being judged as, send original image acquisition request to the server so that the server according to The original image acquisition request returns to original image；
The received original image is decoded by original decoded device, and shows decoded original graph Piece；
If being judged as support, execute it is described obtain display area dimension information the step of.
Second aspect of the present invention provides a kind of image processing method, comprising:
If receiving the first layer picture acquisition request of user terminal transmission, obtained according to the first layer picture The target point that the dimension information selection of the display area of the entrained user terminal of request matches with the dimension information Layer picture；
The base layer pictures data in the target hierarchy picture are sent to the user terminal, so that the user terminal By hierarchical picture decoder, the base layer pictures data are decoded, and to decoded base layer pictures data into Row display；
The enhancement-layer pictures data in the target hierarchy picture are sent to the user terminal, so that the user terminal The enhancement-layer pictures data are decoded by the hierarchical picture decoder, and by decoded enhancement-layer pictures data It is synthesized with the decoded base layer pictures data, and shows synthesized image data out.
Wherein, if the first layer picture acquisition request for receiving user terminal transmission, according to described first point Dimension information selection and the dimension information phase of the display area of the user terminal entrained by layer picture acquisition request The target hierarchy picture matched, comprising:
If receiving the first layer picture acquisition request of user terminal transmission, extracts the first layer picture and obtain The dimension information of the display area of the entrained user terminal of request；
In the hierarchical picture of multiple and different resolution ratio, the picture width that pixel wide is greater than in the dimension information is searched At least one hierarchical picture, as at least one hierarchical picture to be selected；
The hierarchical picture of lowest resolution at least one described hierarchical picture to be selected is determined as and the size The target hierarchy picture that information matches.
Wherein, further includes:
If receiving the second hierarchical picture acquisition request that the user sends, obtained according to second hierarchical picture It requests the selection in the hierarchical picture of multiple and different resolution ratio that there is the hierarchical picture of maximum resolution, and successively sends the tool There are base layer pictures data in the hierarchical picture of maximum resolution and enhancement-layer pictures data to the user terminal；
If receiving the original image acquisition request that the user sends, sent according to the original image acquisition request Original image is to the user terminal；
Wherein, the second hierarchical picture acquisition request is to detect that the dimension information is discontented with by the user terminal It is transmitted when the adaptive condition of sufficient hierarchical picture；The original image acquisition request is being detected not by the user terminal It is transmitted when support hierarchical picture format；The first layer picture acquisition request is by the user terminal detecting State dimension information meet it is transmitted when the adaptive condition of hierarchical picture.
Wherein, further includes:
Receive the decoder acquisition request that the user terminal is sent；It is whole that the decoder acquisition request carries the user The operation system information at end；
The hierarchical diagram to match with the operation system information of the user terminal is searched according to the decoder acquisition request Piece decoder, and the hierarchical picture decoder to match with the operation system information of the user terminal found out is sent To the user terminal.
Wherein, further includes:
Original image is obtained, the hierarchical picture decoder to match by the operation system information with server is to the original Beginning picture is decoded, and obtains decoded original image data；
By hierarchical picture encoder by the decoded original image data encoding be at least one resolution ratio point Layer picture；Each hierarchical picture includes base layer pictures data and at least one enhancement-layer pictures data.
Wherein, further includes:
Setting hierarchical picture decoder corresponding at least one operation system information；
Prediction mode in the hierarchical picture decoder and hierarchical picture encoder is optimized；The prediction mode Including coding unit division mode, predicting unit division mode, converter unit division mode, intra prediction direction selection mode；
Assembly code optimizing is carried out to the hierarchical picture decoder according to corresponding operation system information and code structure is excellent Change.
Wherein, the operation system information according to corresponding to carries out the prediction algorithm in the hierarchical picture decoder Optimization, comprising:
Memory space is set in the hierarchical picture decoder and selects the principle of optimality, the memory space selection optimization rule It then include the rule for setting register to the temporary memory space of highest priority, the register is and the hierarchical picture Operation system information corresponding to decoder is associated；
Calculation optimization rule is set in the hierarchical picture decoder, and the calculation optimization rule includes by matrix operation Circle logic be converted into carrying out the rule of operation based on vector gather instruction, the vector gather instruction is and the hierarchical picture solution Operation system information corresponding to code device is associated.
Third aspect present invention provides a kind of image processing method, comprising:
User terminal sends the first layer picture acquisition request for carrying the dimension information of display area to server；
The target that the server matches according to first layer picture acquisition request selection with the dimension information Hierarchical picture, and the base layer pictures data in the target hierarchy picture are sent to the user terminal；
The user terminal is decoded the base layer pictures data, and by hierarchical picture decoder to decoding Base layer pictures data afterwards are shown；
The server sends the enhancement-layer pictures data in the target hierarchy picture to the user terminal；
The user terminal is decoded the enhancement-layer pictures data by the hierarchical picture decoder, and will solution Enhancement-layer pictures data after code are synthesized with the decoded base layer pictures data, and show synthesized picture out Data.
Wherein, further includes:
The user terminal obtains the operation system information of user terminal, and sends the operation system for carrying the user terminal The decoder acquisition request for information of uniting is to the server；
The server searches the operation system information phase with the user terminal according to the decoder acquisition request The hierarchical picture decoder matched, and send and the hierarchical picture decoder that matches of operation system information of the user terminal to The user terminal.
Wherein, the user terminal send carry display area dimension information first layer picture acquisition request to Before server, further includes:
The user terminal obtains the dimension information of display area, and judges whether the dimension information meets hierarchical picture Adaptive condition；
It is unsatisfactory for if being judged as, the user terminal sends the second hierarchical picture acquisition request to the server；
The server successively sends the hierarchical diagram with maximum resolution according to the second hierarchical picture acquisition request Base layer pictures data and enhancement-layer pictures data in piece；
If being judged as satisfaction, executes the user terminal and send the first layer figure for carrying the dimension information of display area The step of piece acquisition request is to server.
Wherein, before the dimension information that the user terminal obtains display area, further includes:
The user terminal judges whether to support hierarchical picture format；
It is not supported if being judged as, the user terminal sends original image acquisition request to the server；
The server returns to original image according to the original image acquisition request；
The user terminal is decoded the received original image by original decoded device, and shows decoding Original image afterwards；
If being judged as support, the step of user terminal obtains the dimension information of display area is executed.
Wherein, the server matches according to first layer picture acquisition request selection with the dimension information Target hierarchy picture, comprising:
The server extracts the display area of the user terminal entrained by the first layer picture acquisition request Dimension information；
In the hierarchical picture of multiple and different resolution ratio, the picture width that pixel wide is greater than in the dimension information is searched At least one hierarchical picture, as at least one hierarchical picture to be selected；
The hierarchical picture of lowest resolution at least one described hierarchical picture to be selected is determined as and the size The target hierarchy picture that information matches.
Wherein, further includes:
The server obtains original image, is decoded by the hierarchical picture that the operation system information with server matches Device is decoded the original image, obtains decoded original image data；
The decoded original image data encoding is at least one by hierarchical picture encoder by the server The hierarchical picture of resolution ratio；Each hierarchical picture includes base layer pictures data and at least one enhancement-layer pictures data.
Wherein, further includes:
Hierarchical picture decoder corresponding at least one operation system information is arranged in the server；
The server optimizes the prediction mode in the hierarchical picture decoder and hierarchical picture encoder；Institute Stating prediction mode includes coding unit division mode, predicting unit division mode, converter unit division mode, intra prediction direction Selection mode；
The server according to corresponding operation system information to the hierarchical picture decoder carry out assembly code optimizing and Code structure optimization.
Wherein, the server is according to corresponding operation system information to the pre- measuring and calculating in the hierarchical picture decoder Method optimizes, comprising:
Memory space is set in the hierarchical picture decoder and selects the principle of optimality, the memory space selection optimization rule It then include the rule for setting register to the temporary memory space of highest priority, the register is and the hierarchical picture Operation system information corresponding to decoder is associated；
Calculation optimization rule is set in the hierarchical picture decoder, and the calculation optimization rule includes by matrix operation Circle logic be converted into carrying out the rule of operation based on vector gather instruction, the vector gather instruction is and the hierarchical picture solution Operation system information corresponding to code device is associated.
Fourth aspect present invention provides a kind of image data processing system, comprising:
Sending module, for send carry display area dimension information first layer picture acquisition request to service Device, so that the target point that the server matches according to first layer picture acquisition request selection with the dimension information Layer picture；
Receiving module, for receiving the base layer pictures data in the target hierarchy picture that the server is sent；
Display module is decoded, for being decoded to the base layer pictures data, and right by hierarchical picture decoder Decoded base layer pictures data are shown；
The receiving module is also used to receive the enhancement-layer pictures in the target hierarchy picture that the server is sent Data；
The decoding display module is also used to carry out the enhancement-layer pictures data by the hierarchical picture decoder Decoding, and decoded enhancement-layer pictures data and the decoded base layer pictures data are synthesized, and show institute The image data synthesized.
Wherein, the sending module, is also used to obtain the operation system information of user terminal, and sends and carry the user The decoder acquisition request of the operation system information of terminal is to the server, so that the server is obtained according to the decoder Request is taken to search the hierarchical picture decoder to match with the operation system information of the user terminal；
The receiving module is also used to receive the operation system information phase with the user terminal that the server is sent Matched hierarchical picture decoder.
Wherein, further includes:
First judgment module for obtaining the dimension information of display area, and judges whether the dimension information meets point The layer adaptive condition of picture；
The sending module is unsatisfactory for if being also used to the first judgment module and being judged as, sends the second hierarchical picture Acquisition request is to the server, so that the server is successively sent according to the second hierarchical picture acquisition request to be had most Base layer pictures data and enhancement-layer pictures data in the hierarchical picture of big resolution ratio；
Notification module notifies the sending module is sent to carry if being judged as satisfaction for the first judgment module The first layer picture acquisition request of the dimension information of display area is to server.
Wherein, further includes:
Second judgment module supports hierarchical picture format for judging whether；
The sending module is not supported if being also used to second judgment module and being judged as, sends original image acquisition The server is requested, so that the server returns to original image according to the original image acquisition request；
The decoding display module is also used to solve the received original image by original decoded device Code, and show decoded original image；
The notification module notifies described first to judge mould if being also used to second judgment module is judged as support Block obtains the dimension information of display area, and judges whether the dimension information meets the adaptive condition of hierarchical picture.
Fifth aspect present invention provides a kind of image data processing system, comprising:
Selecting module, if the first layer picture acquisition request for receiving user terminal transmission, according to described the Dimension information selection and the dimension information of the display area of the user terminal entrained by one hierarchical picture acquisition request The target hierarchy picture to match；
Sending module, for sending the base layer pictures data in the target hierarchy picture to the user terminal, with Make the user terminal by hierarchical picture decoder, the base layer pictures data is decoded, and to decoded base Plinth layer image data is shown；
The sending module, the enhancement-layer pictures data for being also used to send in the target hierarchy picture are whole to the user End, so that the user terminal is decoded the enhancement-layer pictures data by the hierarchical picture decoder, and will solution Enhancement-layer pictures data after code are synthesized with the decoded base layer pictures data, and show synthesized picture out Data.
Wherein, the selecting module, comprising:
Extraction unit extracts described the if the first layer picture acquisition request for receiving user terminal transmission The dimension information of the display area of the user terminal entrained by one hierarchical picture acquisition request；
Searching unit is believed in the hierarchical picture of multiple and different resolution ratio, searching pixel wide greater than the size At least one hierarchical picture of picture width in breath, as at least one hierarchical picture to be selected；
Determination unit, for determining the hierarchical picture of the lowest resolution at least one described hierarchical picture to be selected For the target hierarchy picture to match with the dimension information.
Wherein, the selecting module, if being also used to receive the second hierarchical picture acquisition request that the user sends, It is selected in the hierarchical picture of multiple and different resolution ratio according to the second hierarchical picture acquisition request with maximum resolution Hierarchical picture；
The sending module is also used to successively send the base layer pictures in the hierarchical picture with maximum resolution Data and enhancement-layer pictures data are to the user terminal；
The sending module, if being also used to receive the original image acquisition request that the user sends, according to Original image acquisition request sends original image to the user terminal；
Wherein, the second hierarchical picture acquisition request is to detect that the dimension information is discontented with by the user terminal It is transmitted when the adaptive condition of sufficient hierarchical picture；The original image acquisition request is being detected not by the user terminal It is transmitted when support hierarchical picture format；The first layer picture acquisition request is by the user terminal detecting State dimension information meet it is transmitted when the adaptive condition of hierarchical picture.
Wherein, further includes:
Receiving module, the decoder acquisition request sent for receiving the user terminal；The decoder acquisition request Carry the operation system information of the user terminal；
Decoder searching module, for searching the operating system with the user terminal according to the decoder acquisition request Hierarchical picture decoder that information matches, and will be found out and matched with the operation system information of the user terminal Hierarchical picture decoder is sent to the user terminal.
Wherein, further includes:
Decoder module, for obtaining original image, the hierarchical picture that is matched by the operation system information with server Decoder is decoded the original image, obtains decoded original image data；
Coding module is at least one for passing through hierarchical picture encoder for the decoded original image data encoding The hierarchical picture of kind resolution ratio；Each hierarchical picture includes base layer pictures data and at least one enhancement-layer pictures data.
Wherein, further includes:
Decoder setup module is decoded for hierarchical picture corresponding at least one operation system information to be arranged Device；
First optimal setting module, for the prediction mode in the hierarchical picture decoder and hierarchical picture encoder It optimizes；The prediction mode include coding unit division mode, predicting unit division mode, converter unit division mode, Intra prediction direction selection mode；
Second optimal setting module, for being carried out according to corresponding operation system information to the hierarchical picture decoder Assembly code optimizing and code structure optimization.
Wherein, the second optimal setting module, comprising:
First rule setting unit selects the principle of optimality for memory space to be arranged in the hierarchical picture decoder, The memory space selection principle of optimality includes setting register to the rule of the temporary memory space of highest priority, described Register is associated with operation system information corresponding to the hierarchical picture decoder；
Second Rule setting unit, for calculation optimization rule, the calculating to be arranged in the hierarchical picture decoder The principle of optimality includes the rule that the circle logic of matrix operation is converted into carrying out based on vector gather instruction operation, and the vector refers to It is associated with operation system information corresponding to the hierarchical picture decoder for enabling collection.
Sixth aspect present invention provides a kind of image data processing system, comprising: processor, memory and network connect Mouthful；
The processor is connected with memory, network interface, wherein network interface is for connecting server, the storage Device is for storing program code, and the processor is for calling said program code, to execute following operation:
The first layer picture acquisition request for carrying the dimension information of display area is sent to the server, so that described The target hierarchy picture that server matches according to first layer picture acquisition request selection with the dimension information；
The base layer pictures data in the target hierarchy picture that the server is sent are received, and pass through hierarchical picture Decoder is decoded the base layer pictures data, and shows to decoded base layer pictures data；
The enhancement-layer pictures data in the target hierarchy picture that the server is sent are received, and pass through the layering Sub-picture decoder is decoded the enhancement-layer pictures data, and will be after decoded enhancement-layer pictures data and the decoding Base layer pictures data synthesized, and show it is synthesized go out image data.
Seventh aspect present invention provides a kind of image data processing system, comprising: processor, memory and network connect Mouthful；
The processor is connected with memory, network interface, wherein network interface is described to deposit for connecting user terminal Reservoir is for storing program code, and the processor is for calling said program code, to execute following operation:
If the first layer picture acquisition request that the user terminal is sent is received, according to the first layer picture The mesh that the dimension information selection of the display area of the user terminal entrained by acquisition request matches with the dimension information Mark hierarchical picture；
The base layer pictures data in the target hierarchy picture are sent to the user terminal, so that the user terminal By hierarchical picture decoder, the base layer pictures data are decoded, and to decoded base layer pictures data into Row display；
The enhancement-layer pictures data in the target hierarchy picture are sent to the user terminal, so that the user terminal The enhancement-layer pictures data are decoded by the hierarchical picture decoder, and by decoded enhancement-layer pictures data It is synthesized with the decoded base layer pictures data, and shows synthesized image data out.
Eighth aspect present invention provides a kind of computer storage medium, and the computer storage medium is stored with computer Program, the computer program include program instruction, execute the present invention when the processor executes described program instruction and implement Method in example in first aspect.
Ninth aspect present invention provides a kind of computer storage medium, and the computer storage medium is stored with computer Program, the computer program include program instruction, execute the present invention when the processor executes described program instruction and implement Method in example in second aspect.
The embodiment of the present invention by send carry display area dimension information first layer picture acquisition request to take Business device, so that the target hierarchy picture that server matches according to the selection of first layer picture acquisition request with dimension information, then The base layer pictures data in the target hierarchy picture that server is sent are received, and by hierarchical picture decoder, to basal layer Image data is decoded, and is shown to decoded base layer pictures data, and receives the target point of server transmission Enhancement-layer pictures data in layer picture, and enhancement-layer pictures data are decoded by hierarchical picture decoder, and will solution Enhancement-layer pictures data after code are synthesized with decoded base layer pictures data, and show synthesized picture number out According to.It can be seen that although still can comparatively fast get base layer pictures data in the case where network state is unstable, make Display area can first display base layer image data content, avoid picture display area from being in space state for a long time, It is subsequent further to receive enhancement-layer pictures data, and enhancement-layer pictures data and base layer pictures data are synthesized, The higher picture of quality is obtained, so as to improve image display effect.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with It obtains other drawings based on these drawings.
Fig. 1 is a kind of schematic diagram of network architecture provided in an embodiment of the present invention；
Fig. 2 is a kind of time diagram of image processing method provided in an embodiment of the present invention；
Fig. 3 a is a kind of picture display schematic diagram of user terminal provided in an embodiment of the present invention；
Fig. 3 b is the picture display schematic diagram of another user terminal provided in an embodiment of the present invention；
Fig. 3 c is the picture display schematic diagram of another user terminal provided in an embodiment of the present invention；
Fig. 4 is the time diagram of another image processing method provided in an embodiment of the present invention；
Fig. 5 is a kind of flow diagram of the optimization method of decoder provided in an embodiment of the present invention；
Fig. 6 is a kind of structural schematic diagram of hierarchical picture decoder provided in an embodiment of the present invention；
Fig. 7 is a kind of flow diagram of image processing method provided in an embodiment of the present invention；
Fig. 8 is the flow diagram of another image processing method provided in an embodiment of the present invention；
Fig. 9 is a kind of structural schematic diagram of image data processing system provided in an embodiment of the present invention；
Figure 10 is the structural schematic diagram of another image data processing system provided in an embodiment of the present invention；
Figure 11 is the structural schematic diagram of another image data processing system provided in an embodiment of the present invention；
Figure 12 is the structural schematic diagram of another image data processing system provided in an embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
It referring to Figure 1, is a kind of schematic diagram of network architecture provided in an embodiment of the present invention.As shown in Figure 1, the network rack Structure may include: server 100, server 200 and multiple user terminals 300.Server 100 can be distinguished by internet Be connected to the network with multiple user terminals 300, server 200 can also by internet respectively with multiple user terminals 300 It is connected to the network.Wherein, as shown in Figure 1, multiple user terminals 300 may include computer, tablet computer, smart phone, The terminal devices such as laptop, palm PC, DTV and mobile internet device (MID), or can be terminal Client in equipment.Wherein, server 100 can be used for being arranged the corresponding hierarchical picture decoding of several operation systems Device, and set a variety of hierarchical picture decoders are online, multiple user terminals 300 are obtained by server 100 Get the hierarchical picture decoder to match with respective operating system.Wherein, original image can be encoded to more by server 200 The hierarchical picture of a different resolution, and in certain 300 request hierarchical picture of user terminal, server 200 can basis The hierarchical picture of the dimension information selection corresponding resolution of display area in the user terminal 300, and first send selected Base layer pictures data in hierarchical picture allow the user terminal 300 to first pass through the layering got from server 100 Sub-picture decoder decoded base layer image data, and then the user terminal 300 can first show the lower base layer pictures of quality Data are in space state to avoid picture display area for a long time；Subsequent server 200 can continue to send selected point Enhancement-layer pictures data in layer picture, so that the user terminal 300 is decoded by the hierarchical picture got from server 100 Device decodes enhancement-layer pictures data, and decoded enhancement-layer pictures data and decoded base layer pictures data are closed At the higher picture of quality being obtained, and show the higher picture of the quality, to improve image display effect.
Wherein, hierarchical picture may include base layer pictures data and at least one enhancement-layer pictures data, basal layer figure Sheet data refers to the low quality image data that can substantially show image content, i.e. the data volume of base layer pictures data is smaller, Allow to that base layer pictures data are comparatively fast transmitted to user terminal 300, enhancement-layer pictures data can refer to high-quality Therefore residual quantity between sheet data and base layer pictures data passes through superposition enhancement-layer pictures data and base layer pictures data Available higher-quality image data.When there is multiple enhancement-layer pictures data, one enhancement-layer pictures data of every superposition, The quality of picture will be made to rise a level, i.e. the display of picture is from obscuring a clearly progressive formation.Wherein, divide Layer sub-picture decoder can be used for a kind of decoder being decoded to hierarchical picture, i.e. hierarchical picture decoder can be to base Plinth layer image data is decoded, and can also be decoded to enhancement-layer pictures data, can also to enhancement-layer pictures data and Base layer pictures data are synthesized.
Optionally, the server 100 in Fig. 1 and server 200 can be merged into the same server, i.e. server 100 Performed function can be realized on the same server respectively with server 200.
Fig. 2 is referred to, is a kind of time diagram of image processing method provided in an embodiment of the present invention, this method May include:
S201, user terminal send carry display area dimension information first layer picture acquisition request to service Device；
Specifically, user terminal can first send the operation system for carrying user terminal to server before S201 step The decoder acquisition request for information of uniting allows server to search the operation system with user terminal according to decoder acquisition request The hierarchical picture decoder that system information matches, and then server can send use for the hierarchical picture decoder found out Family terminal.Wherein, operation system information may include microsoft system information, apple system information, Android system information etc. other Any one in operation system information.It can be seen that server can preset it is corresponding with several operation systems Hierarchical picture decoder, wherein server may include that server 100 in above-mentioned Fig. 1 corresponding embodiment and server 200 divide Other had function.Optionally, server can also carry out assembly code optimizing to hierarchical picture decoder and code structure optimizes, When user terminal using the hierarchical picture decoder after optimization when being decoded, the hierarchical picture decoder after the optimization will The register of more operating system using the user terminal is as temporary memory space as far as possible, and the hierarchical picture after the optimization Decoder will be more as far as possible the vector operation instruction of the operating system using the user terminal be decoded calculating.Therefore, lead to It crosses and carries out different assembly code optimizing and code structure optimization for different operating system, the use of various operating systems can be made The hierarchical picture decoder after optimization can be used in family terminal, to improve the decoding efficiency of hierarchical picture decoder.
Further, after user terminal gets corresponding hierarchical picture decoder, viewing area can also further be detected The dimension information in domain, and the first layer picture acquisition request for carrying the dimension information of display area is sent to server, to ask Seek corresponding hierarchical picture；Wherein, hierarchical picture can also be referred to as X5 picture.
S202, the target hierarchy figure that server matches according to the selection of first layer picture acquisition request with dimension information Piece；
Specifically, can extract the acquisition of first layer picture after server gets first layer picture acquisition request and ask The dimension information of the display area of user terminal in asking, and in the hierarchical picture of preset multiple and different resolution ratio, it searches Pixel wide is greater than at least one hierarchical picture of the picture width in dimension information, as at least one hierarchical diagram to be selected Piece, and the hierarchical picture of the lowest resolution at least one hierarchical picture to be selected is determined as matching with dimension information Target hierarchy picture.Wherein, certain original image can be encoded to the hierarchical picture of a variety of resolution ratio by server in advance, and target Hierarchical picture is the hierarchical picture of one of resolution ratio.Wherein, dimension information can be the display area of user terminal Width, server can by the pixel wide in the hierarchical picture of a variety of resolution ratio be greater than dimension information and with the number of dimension information It is worth adjacent hierarchical picture and is determined as target hierarchy picture.For example, some original image is corresponding with the hierarchical diagram of 3 kinds of resolution ratio Piece, the respectively hierarchical picture of 810 pixel wides, the hierarchical picture of 610 pixel wides, 410 pixel wides hierarchical picture, if Dimension information is 800 pixel wides, then will be determined as target hierarchy picture for the hierarchical picture of 810 pixel wides；If size is believed Breath is 600 pixel wides, then will be determined as target hierarchy picture for the hierarchical picture of 610 pixel wides；If dimension information is 400 Pixel wide then will be determined as target hierarchy picture for the hierarchical picture of 410 pixel wides.
Wherein, the detailed process that certain original image is encoded to the hierarchical picture of a variety of resolution ratio by server in advance can be with Are as follows: server solves the original image by hierarchical picture decoder corresponding with the operation system information of server Code, obtains the original image data that can support hierarchical picture format, i.e., decoded original image data, server passes through again Hierarchical picture encoder corresponding with the operating system of server encodes decoded original image data, generates more The hierarchical picture of kind resolution ratio.Wherein, hierarchical picture decoder and hierarchical picture encoder are all based on video encoding standard H.265 encoding and decoding are carried out.
S203, server send the base layer pictures data in target hierarchy picture to user terminal；
Specifically, server is after selecting target hierarchy picture, it can be first by the basal layer figure in target hierarchy picture Sheet data is sent to user terminal, wherein due to smaller (the i.e. sawtooth ratio of image content of the data volume of base layer pictures data It is more apparent), so the duration of transmission base layer pictures data can be shorter, allow user faster in the aobvious of user terminal Show display base layer image data on region, display area is avoided to be in space state for a long time.
S204, user terminal are decoded base layer pictures data, and by hierarchical picture decoder to decoded Base layer pictures data are shown；
Specifically, user terminal after receiving base layer pictures data, can pass through accessed hierarchical picture solution Code device is decoded base layer pictures data.Assembly code optimizing and code are carried out since hierarchical picture decoder has in server side Structure optimization, so user terminal is using the hierarchical picture decoder during being decoded, use that can be more as far as possible Register corresponding to the operating system of user terminal is as temporary memory space, and use user terminal that can also be more as far as possible Operating system corresponding to vector operation instruction be decoded calculating, so as to effectively improve decoding speed.
User terminal can directly put the base layer pictures data decoded after having decoded base layer pictures data Enter display area to be shown.Since the data volume of base layer pictures data is smaller, (i.e. the sawtooth of image content is brighter It is aobvious), so the duration of transmission base layer pictures data can be shorter, allow user faster in the viewing area of user terminal Display base layer image data on domain avoids display area from being in space state for a long time.
S205, server send the enhancement-layer pictures data in target hierarchy picture to user terminal；
Specifically, server after having sent the base layer pictures data in target hierarchy picture, can continue to send mesh The enhancement-layer pictures data in hierarchical picture are marked to user terminal.Alternatively, user terminal is after receiving base layer pictures data, Confirmation can be returned and receive instruction to server, so that server, which receives instruction triggers according to confirmation, executes enhancement-layer pictures data Transmission operation.Due to difference of the enhancement-layer pictures data between high-quality sheet data and base layer pictures data, so The data volume of enhancement-layer pictures data is also smaller, to can also equally shorten the transmission time of transmission enhancement-layer pictures data.
S206, user terminal are decoded enhancement-layer pictures data by hierarchical picture decoder, and will be decoded Enhancement-layer pictures data are synthesized with decoded base layer pictures data, and show synthesized image data out；
Specifically, after user terminal receives enhancement-layer pictures data, it can be by hierarchical picture decoder to enhancement layer Image data is decoded, can equally be mostly used in decoding process the corresponding register of the operating system of user terminal and to Amount operational order is decoded, to improve decoding speed.User terminal can will decode after decoding enhancement-layer pictures data Enhancement-layer pictures data afterwards are synthesized with decoded base layer pictures data, and show synthesized image data out, The clarity of synthesized image data out is higher than the clarity of base layer pictures data.
Optionally, it if the quantity of the enhancement-layer pictures data in target hierarchy picture in server side is greater than 1, services Device can continue to send next enhancement-layer pictures data to user terminal after having sent first enhancement-layer pictures data, So that user terminal continues to synthesize second enhancement-layer pictures data with the picture having been displayed, the conjunction being more clear At picture, and so on, server can successively send each enhancement-layer pictures data, and user terminal can be successively by each increasing Strong layer image data is synthesized in the picture having been displayed, so that picture shown in the display area of user terminal is in gradually clear Clear variation tendency.
It further, is that a kind of picture of user terminal provided in an embodiment of the present invention is aobvious please also refer to Fig. 3 a- Fig. 3 c Show schematic diagram.As shown in Figure 3a, picture shown by the display area 500 of user terminal 400 is the base in target hierarchy picture Plinth layer image data 600, from Fig. 3 a it is found that the display effect of base layer pictures data 600 has obvious crenellated phenomena, In, the resolution ratio of target hierarchy picture is 310*250, and target hierarchy picture include a base layer pictures data 600 and Two enhancement-layer pictures data, then the resolution ratio of base layer pictures data 600 shown by display area 500 is also 310*250. After server has sent base layer pictures data 600, it can continue to send one of enhancement-layer pictures data to user terminal 400, user terminal 400 to the enhancement-layer pictures data decode after, can by decoded enhancement-layer pictures data with have been displayed Base layer pictures data 600 synthesized, obtain synthesising picture 700 as shown in Figure 3b, and by the basal layer figure in Fig. 3 a Sheet data 600 is updated to synthesising picture 700 to get the synthesising picture 700 shown into display area 500 shown in Fig. 3 b, Wherein, the resolution ratio of synthesising picture 700 is also 310*250, but the clarity of synthesising picture 700 is higher than base layer pictures data 600.After server has sent one of enhancement-layer pictures data, it can continue to send another enhancement-layer pictures data to use Family terminal 400, user terminal 400 to the enhancement-layer pictures data decode after, can by decoded enhancement-layer pictures data with The synthesising picture 700 having been displayed is synthesized, and obtains final picture 800 as shown in Figure 3c, and by the synthesising picture in Fig. 3 b 700 are updated to final picture 800 to get the final picture 800 shown into display area 500 shown in Fig. 3 c, wherein most The resolution ratio of whole picture 800 is also 310*250, but the clarity of final picture 800 is higher than synthesising picture 700.It can be seen that In display area 500, the clarity of picture is the shown picture that is, in display area 500 in gradually clearly progressive formation It is to become synthesising picture 700 from base layer pictures data 600, then become final picture 800.
The embodiment of the present invention by send carry display area dimension information first layer picture acquisition request to take Business device, so that the target hierarchy picture that server matches according to the selection of first layer picture acquisition request with dimension information, then The base layer pictures data in the target hierarchy picture that server is sent are received, and by hierarchical picture decoder, to basal layer Image data is decoded, and is shown to decoded base layer pictures data, and receives the target point of server transmission Enhancement-layer pictures data in layer picture, and enhancement-layer pictures data are decoded by hierarchical picture decoder, and will solution Enhancement-layer pictures data after code are synthesized with decoded base layer pictures data, and show synthesized picture number out According to.It can be seen that although still can comparatively fast get base layer pictures data in the case where network state is unstable, make Display area can first display base layer image data content, avoid picture display area from being in space state for a long time, It is subsequent further to receive enhancement-layer pictures data, and enhancement-layer pictures data and base layer pictures data are synthesized, The higher picture of quality is obtained, so as to improve image display effect.And by server to each operation system information point Not corresponding hierarchical picture decoder carries out assembly code optimizing and code structure optimization, and the user of various operating systems can be made whole The hierarchical picture decoder after optimization can be used in end, to improve the decoding efficiency of hierarchical picture decoder.
Fig. 4 is referred to, is the time diagram of another image processing method provided in an embodiment of the present invention, the party Method may include:
S401, user terminal obtain the operation system information of user terminal, and send the operating system for carrying user terminal The decoder acquisition request of information is to server；
Specifically, can further obtain user terminal after user terminal starts the application program that can be used for showing picture Operation system information, and send the decoder acquisition request for the operation system information for carrying user terminal to server；Wherein, Operation system information may include other operation system informations such as microsoft system information, apple system information, Android system information In any one.
S402, server search the layering to match with the operation system information of user terminal according to decoder acquisition request Sub-picture decoder, and the hierarchical picture decoder that matches with the operation system information of user terminal is sent to user terminal；
Specifically, server searches point to match with the operation system information of user terminal according to decoder acquisition request Layer sub-picture decoder, and the hierarchical picture decoder that matches with the operation system information of user terminal is sent to user terminal. It can be seen that server can preset hierarchical picture decoder corresponding with several operation systems, wherein server It may include the function that server 100 and server 200 in above-mentioned Fig. 1 corresponding embodiment have respectively.Optionally, it services Device assembly code optimizing can also be carried out to hierarchical picture decoder and code structure optimizes, when point of user terminal after using optimization Layer sub-picture decoder be when being decoded, the behaviour using the user terminal that the hierarchical picture decoder after the optimization will be more as far as possible Make the register of system as temporary memory space, and the hierarchical picture decoder after the optimization will be more as far as possible using the use The vector operation instruction of the operating system of family terminal is decoded calculating.Therefore, by being carried out not for different operating system Same assembly code optimizing and code structure optimization, after can making the user terminal of various operating systems that optimization can be used Hierarchical picture decoder, to improve the decoding efficiency of hierarchical picture decoder.
S403, user terminal judge whether to support hierarchical picture format；
Specifically, can further judge whether user terminal is supported after user terminal gets hierarchical picture decoder Hierarchical picture format, that is, judge whether user terminal can decode hierarchical picture by hierarchical picture decoder.Wherein, hierarchical diagram Piece format can be the picture format including base layer pictures data He at least one enhancement-layer pictures data, i.e. a hierarchical diagram Piece may include base layer pictures data and at least one enhancement-layer pictures data, and base layer pictures data, which refer to, substantially to be shown Show the low quality image data of image content, enhancement-layer pictures data can refer to high-quality sheet data and base layer pictures number Residual quantity between.
Optionally, user terminal just can also first judge whether the user terminal supports hierarchical diagram before S401 step Piece format if being judged as support, then executes S401-S402, and the step of continuing to execute after S407；It is not propped up if being judged as The step of holding, then directly executing S404-S406.Therefore, the embodiment of the present invention does not limit the execution sequence of S403 step System.
S404 does not support that user terminal sends original image acquisition request to server if being judged as；
Specifically, do not supported if S403 is judged as, user terminal can further send original image acquisition request to Server.
S405, server return to original image according to original image acquisition request；
Specifically, server returns to original image according to original image acquisition request, further, server can be with root Original decoded device is sent to user terminal according to original image acquisition request.Alternatively, server can send hierarchical picture decoding While device is to user terminal, original decoded device is sent together to user terminal.Alternatively, the self-contained original decoded of user terminal Device, therefore, server, which may not need, sends original decoded device to user terminal.Wherein, original decoded device, which refers to, can be used for solving Code PNG (Portable Network Graphics, portable network figure), JPEG (Joint Photographic Experts Group, Joint Photographic Experts Group), GIF (Graphics Interchange Format, graphic interchange format) The decoder of the picture of equal formats.
S406, user terminal are decoded received original image by original decoded device, and after showing decoding Original image；
It, can be by original decoded device to being connect specifically, after user terminal gets original image and original decoded device The original image received is decoded, and decoded original image is shown on display area.
S407, if being judged as support, user terminal obtains the dimension information of display area, and whether judges dimension information Meet the adaptive condition of hierarchical picture；
Specifically, i.e. user terminal can be decoded hierarchical picture, then user terminal can if S403 is judged as support Further to obtain the dimension information of display area, and judge whether dimension information meets the adaptive condition of hierarchical picture.Wherein, Judge whether that the detailed process for meeting the adaptive condition of hierarchical picture may is that whether detecting size information is greater than preset size Threshold value, if more than can then determine that dimension information meets the adaptive condition of hierarchical picture, otherwise, it determines dimension information is unsatisfactory for The adaptive condition of hierarchical picture, and the step of jumping to S414-S415.
Optionally, before judging whether dimension information meets the adaptive condition of hierarchical picture, user's end can also be detected Whether configured self-adapted protocol if being detected as that self-adapted protocol is not configured can directly execute the step of S414-S415 at end Suddenly；If being detected as configured self-adapted protocol, it can execute and judge whether dimension information meets the adaptive condition of hierarchical picture The step of.Wherein, the agreement that self-adapted protocol can refer to while dispose jointly between user terminal and server, configured with certainly The user terminal for adapting to agreement can trigger execution judges the step of whether dimension information meets hierarchical picture adaptive condition, into And the step of triggering S408；And the server configured with self-adapted protocol can obtain the first layer picture in S408 step Request is identified and is responded, and then the step of triggering S409.
S408, if being judged as the adaptive condition that meets, user terminal sends the of the dimension information for carrying display area One hierarchical picture acquisition request is to server；
S409, the target hierarchy figure that server matches according to the selection of first layer picture acquisition request with dimension information Piece；
S410, server send the base layer pictures data in target hierarchy picture to user terminal；
S411, user terminal are decoded base layer pictures data, and by hierarchical picture decoder to decoded Base layer pictures data are shown；
S412, server send the enhancement-layer pictures data in target hierarchy picture to user terminal.
S413, user terminal are decoded enhancement-layer pictures data by hierarchical picture decoder, and will be decoded Enhancement-layer pictures data are synthesized with decoded base layer pictures data, and show synthesized image data out；
Wherein, the specific implementation of S408-S413 step may refer to the S201- in above-mentioned Fig. 2 corresponding embodiment S206 is not discussed here.
S414, if being judged as the adaptive condition that is unsatisfactory for, user terminal sends the second hierarchical picture acquisition request to clothes Business device；
Specifically, if S407 judges that dimension information is unsatisfactory for adaptive condition or user terminal detects to be not configured certainly Agreement is adapted to, then user terminal can further send the second hierarchical picture acquisition request to server, second hierarchical picture Acquisition request does not carry dimension information.
S415, server are successively sent in the hierarchical picture with maximum resolution according to the second hierarchical picture acquisition request Base layer pictures data and enhancement-layer pictures data.
Specifically, server can be according to the second hierarchical picture acquisition request, in the hierarchical diagram of preset a variety of resolution ratio The hierarchical picture with maximum resolution is obtained in piece, and sends the base layer pictures in the hierarchical picture with maximum resolution Data are to user terminal, so that user terminal is decoded and shows to it；Server is in the layering for having sent maximum resolution After base layer pictures data in picture, it can continue to send the enhancement-layer pictures number in the hierarchical picture with maximum resolution According to user terminal is arrived, so that user terminal is decoded the enhancement-layer pictures data, and by the decoded enhancement-layer pictures Data are synthesized with the base layer pictures data having been displayed, to show final high quality picture.Wherein, user terminal pair The decodings of base layer pictures data and enhancement-layer pictures data in hierarchical picture with maximum resolution and display it is specific Process may refer to S408-S413 step.
The embodiment of the present invention by send carry display area dimension information first layer picture acquisition request to take Business device, so that the target hierarchy picture that server matches according to the selection of first layer picture acquisition request with dimension information, then The base layer pictures data in the target hierarchy picture that server is sent are received, and by hierarchical picture decoder, to basal layer Image data is decoded, and is shown to decoded base layer pictures data, and receives the target point of server transmission Enhancement-layer pictures data in layer picture, and enhancement-layer pictures data are decoded by hierarchical picture decoder, and will solution Enhancement-layer pictures data after code are synthesized with decoded base layer pictures data, and show synthesized picture number out According to.It can be seen that although still can comparatively fast get base layer pictures data in the case where network state is unstable, make Display area can first display base layer image data content, avoid picture display area from being in space state for a long time, It is subsequent further to receive enhancement-layer pictures data, and enhancement-layer pictures data and base layer pictures data are synthesized, The higher picture of quality is obtained, so as to improve image display effect.And by server to each operation system information point Not corresponding hierarchical picture decoder carries out assembly code optimizing and code structure optimization, and the user of various operating systems can be made whole The hierarchical picture decoder after optimization can be used in end, to improve the decoding efficiency of hierarchical picture decoder.
It further, is a kind of stream of the optimization method of decoder provided in an embodiment of the present invention then please also refer to Fig. 5 Journey schematic diagram, method can execute before the S201 of above-mentioned Fig. 2 corresponding embodiment, or can be in the corresponding implementation of above-mentioned Fig. 4 It is executed before the S401 of example, method may include:
S501, setting hierarchical picture decoder corresponding at least one operation system information；
It is decoded specifically, server can preset hierarchical picture corresponding at least one operation system information Device.Server can also preset hierarchical picture encoder corresponding with the operating system of server, in order to which server can Original image to be encoded to the hierarchical picture of a variety of resolution ratio in advance by hierarchical picture encoder.
S502 optimizes the prediction mode in hierarchical picture decoder and preset hierarchical picture encoder；Prediction Mode includes coding unit division mode, predicting unit division mode, converter unit division mode, intra prediction direction selecting party Formula；
Specifically, server can be further to pre- in each hierarchical picture decoder and preset hierarchical picture encoder Survey mode optimizes, wherein prediction mode includes coding unit division mode, predicting unit division mode, converter unit stroke Divide mode, intra prediction direction selection mode.
Wherein, the process that server optimizes coding unit division mode can be with are as follows: using in time and space phase The depth information of the coding unit of pass quickly judges current CU (Coding Unit, coding unit) forced coding size, this is excellent The depth information of CU around change extraction former frame same position and present frame, the judgement section that diminution CU is divided, next pair Current CU divides depth and is predicted, improves predetermined speed that CU divides depth, and to avoid unnecessary calculating, reduction calculates multiple Miscellaneous degree.
Wherein, the process that server optimizes predicting unit division mode can be with are as follows: it is excellent that rate distortion is carried out at CU layers Before change, the principal element of simultaneously analyzing influence PU (Prediction Unit, predicting unit) model selection is obtained, to select The highest several modes of probability are used as candidate's PU partition mode out.Wherein, PU is the basic unit of prediction, and a CU may include one A or multiple PU, PU full-size are the sizes of CU.
Wherein, TU (Transform Unit, the predicting unit) distribution of the residual block of different texture characteristic is showed Certain rule: when the texture of residual block is more complex, and motion vector variation is more violent, TU selects large scale for optimal segmentation Possibility is very small；Conversely, TU always selects biggish segmentation when the texture of residual block is simpler.Therefore, server is to change Changing process that dividing elements mode optimizes can be with are as follows: in TU decision making algorithm, analyzes the texture of residual block, if line Reason is simpler, terminates the segmentation of TU in advance, which can be greatly reduced the encoding and decoding time.Wherein, TU is transform and quantization Basic unit, a CU may include one or more TU, and TU equally uses the recurrence partition structure of quaternary tree type, big than PU, But it is no more than the size of CU.
Wherein, the process that server optimizes intra prediction direction selection mode can be with are as follows: according to currently wait compile The possibility of the dividing condition prediction current block of the adjacent coded block in code region divides, and removes unnecessary coding unit size and pre- Survey mode decision process.Volume solution can be effectively reduced in the case where guaranteeing that coding quality and compression efficiency are basically unchanged in the optimization Code computation complexity, is substantially improved encoding and decoding operation efficiency.
It, can be with it can be seen that optimized by the prediction mode to hierarchical picture decoder and hierarchical picture encoder Code efficiency is improved when hierarchical picture encoder encodes hierarchical picture, hierarchical picture can also be decoded in hierarchical picture decoder Shi Tigao decoding efficiency.
S503 carries out assembly code optimizing to hierarchical picture decoder according to corresponding operation system information and code structure is excellent Change；
Specifically, server hierarchical picture decoder can also collect according to corresponding operation system information it is excellent Change and code structure optimization, i.e., the corresponding hierarchical picture decoder of different operation system informations carry out different assembly code optimizings Optimize with code structure.Assembly code optimizing and the detailed process of code structure optimization can be with are as follows: are arranged in hierarchical picture decoder Memory space selects the principle of optimality, and the memory space selection principle of optimality includes setting register to temporarily depositing for highest priority The rule in space is stored up, register is associated with operation system information corresponding to hierarchical picture decoder；And in hierarchical diagram Calculation optimization rule is set in piece decoder, and calculation optimization rule includes being converted into the circle logic of matrix operation based on vector Instruction set carries out the rule of operation, and vector gather instruction is associated with operation system information corresponding to hierarchical picture decoder 's.Therefore, user terminal is decoded using the hierarchical picture for being provided with the memory space selection principle of optimality and calculation optimization rule When device is decoded, register corresponding to the operating system using user terminal that can be more as far as possible is empty as interim storage Between, and can also be more as far as possible the operating system using user terminal corresponding to vector operation instruction be decoded calculating, from And it can effectively improve decoding speed.Wherein, vector operation instruction may include that vector data loads instruction, vector data interlocks Instruction, vector data exchange instruction and vector data store instruction.
Optionally, server can also carry out assembly code optimizing to hierarchical picture encoder, carry out to hierarchical picture encoder The mode of assembly code optimizing and the assembly code optimizing that hierarchical picture decoder is carried out be similar to.
It further, is that a kind of structure of hierarchical picture decoder provided in an embodiment of the present invention is shown please also refer to Fig. 6 It is intended to, as shown in fig. 6, hierarchical picture decoder may include Entropy Decoding (entropy decoding), IQ/IDCT (Inverse Quantization/Inverse Discrete Cosine Transform, inverse quantization/dissipate cosine transform), Deblocking Filter (deblocking filtering processing), Intra Prediction (intra prediction), Intra/Inter Mode Selection (frame Interior/inter mode decision), (Sample Adaptive Offset Filtering, sampling are adaptive inclined by SAO filtering Move filtering), Motion Compensation (MC, motion compensation), picture buffering (picture buffering).Wherein, Entropy Decoding can be used for reading image data, and parse data structure, which may include macro block Type, motion vector, reference frame, residual error etc.；IQ/IDCT can be used for converting to obtain sky the data after entropy decoding Between domain value；Deblocking Filter can be used for being filtered data；Intra Prediction can be used for Carry out the calculating of intra prediction；Intra/Inter Mode Selection can be used for selecting corresponding intra prediction and interframe The mode of prediction；SAO filtering can be used for reducing the sampling distortion of image, increase the clarity of image；Motion Compensation can be used for taking exercises compensation deals to subsequent frame image based on existing frame image data, optimize subsequent Decoded image.Wherein, picture buffering can refer to decoded image buffer.Wherein, with image decoding It carries out, can constantly there is new image to generate, therefore, can will decode image and be put into picture buffering, Jin Er When image output display, image data can be extracted from picture buffering according to sequencing, in mobile phone Screen rendering output.Wherein, Intra Prediction (i.e. the calculating of intra prediction) can be first when carrying out image decoding, Then further according to the image data in the data of intra prediction and picture buffering, Intra/Inter Mode is carried out The calculating of Selection.For example, Entropy Decoding processing first can be carried out to base layer pictures data, and it is being layered Other decoding process are carried out in sub-picture decoder further will be decoded to generate decoded base layer pictures data Base layer pictures data are put into picture buffering, and simultaneously that the output of decoded base layer pictures data is in one's hands Machine screen is shown；After subsequent decoding goes out enhancement-layer pictures data, can by decoded enhancement-layer pictures data with Decoded base layer pictures data in picture buffering merge, and will be decoded in mobile phone screen Base layer pictures data replace with the image data after merging.
Wherein, it is (all that the assembly code optimizing carried out to hierarchical picture decoder can refer specifically to the module called to high frequency time Such as Entropy Decoding, IQ/IDCT, Deblocking Filter, Intra Prediction, Intra/Inter Mode Selection, SAO filtering, Motion Compensation etc.) carry out depth assembly code optimizing.
The embodiment of the present invention is optimized by the prediction mode to hierarchical picture decoder and hierarchical picture encoder, can To effectively improve encoding and decoding speed；And assembly code optimizing and code structure optimization further are carried out to hierarchical picture decoder, Allow to register corresponding to the operating system using user terminal more as far as possible during decoded as temporarily depositing Store up space, and can also be more as far as possible the operating system using user terminal corresponding to vector operation instruction be decoded meter It calculates, so as to further increase decoding speed.
Fig. 7 is referred to, is a kind of flow diagram of image processing method provided in an embodiment of the present invention, the side Method may include:
S701, obtains the operation system information of user terminal, and sends the operation system information for carrying the user terminal Decoder acquisition request to the server so that the server is searched and the use according to the decoder acquisition request The hierarchical picture decoder that the operation system information of family terminal matches；
S702 receives the hierarchical picture to match with the operation system information of the user terminal that the server is sent Decoder；
S703 judges whether to support hierarchical picture format；
S704 is not supported if being judged as, sends original image acquisition request to the server, so that the server Original image is returned according to the original image acquisition request；
S705 is decoded the received original image by original decoded device, and shows decoded original Beginning picture；
S706 obtains the dimension information of display area if being judged as support, and judges whether the dimension information meets point The layer adaptive condition of picture；
S707 sends the first layer picture acquisition request for carrying the dimension information of display area if being judged as satisfaction To server, so that the server matched according to first layer picture acquisition request selection with the dimension information Target hierarchy picture；
S708 receives the base layer pictures data in the target hierarchy picture that the server is sent, and by dividing Layer sub-picture decoder, is decoded the base layer pictures data, and show to decoded base layer pictures data；
S709 receives the enhancement-layer pictures data in the target hierarchy picture that the server is sent, and passes through institute Hierarchical picture decoder is stated to be decoded the enhancement-layer pictures data, and by decoded enhancement-layer pictures data with it is described Decoded base layer pictures data are synthesized, and show synthesized image data out；
S710 is unsatisfactory for if being judged as, sends the second hierarchical picture acquisition request to the server, so that the clothes Business device successively sends the basal layer figure in the hierarchical picture with maximum resolution according to the second hierarchical picture acquisition request Sheet data and enhancement-layer pictures data；
Wherein, S701-S710 step describes all operations of user terminal side, S701-S710 step it is specific Implementation may refer to the specific descriptions in the S401-S415 in above-mentioned Fig. 4 corresponding embodiment to user terminal, here no longer It is repeated.
The embodiment of the present invention by send carry display area dimension information first layer picture acquisition request to take Business device, so that the target hierarchy picture that server matches according to the selection of first layer picture acquisition request with dimension information, then The base layer pictures data in the target hierarchy picture that server is sent are received, and by hierarchical picture decoder, to basal layer Image data is decoded, and is shown to decoded base layer pictures data, and receives the target point of server transmission Enhancement-layer pictures data in layer picture, and enhancement-layer pictures data are decoded by hierarchical picture decoder, and will solution Enhancement-layer pictures data after code are synthesized with decoded base layer pictures data, and show synthesized picture number out According to.It can be seen that although still can comparatively fast get base layer pictures data in the case where network state is unstable, make Display area can first display base layer image data content, avoid picture display area from being in space state for a long time, It is subsequent further to receive enhancement-layer pictures data, and enhancement-layer pictures data and base layer pictures data are synthesized, The higher picture of quality is obtained, so as to improve image display effect.
Fig. 8 is referred to, is the flow diagram of another image processing method provided in an embodiment of the present invention, it is described Method may include:
S801 obtains original image, the hierarchical picture decoder pair to match by the operation system information with server The original image is decoded, and obtains decoded original image data；
The decoded original image data encoding is at least one resolution ratio by hierarchical picture encoder by S802 Hierarchical picture；Each hierarchical picture includes base layer pictures data and at least one enhancement-layer pictures data；
Specifically, server is original to this by hierarchical picture decoder corresponding with the operation system information of server Picture is decoded, and obtains the original image data that can support hierarchical picture format, i.e., decoded original image data, clothes Business device again carries out decoded original image data by hierarchical picture encoder corresponding with the operating system of server Coding, generates the hierarchical picture of a variety of resolution ratio.Wherein, hierarchical picture decoder and hierarchical picture encoder are all based on video H.265, coding standard carries out encoding and decoding.
S803 receives the decoder acquisition request that the user terminal is sent；Described in the decoder acquisition request carries The operation system information of user terminal；
S804 searches point to match with the operation system information of the user terminal according to the decoder acquisition request Layer sub-picture decoder, and the hierarchical picture decoder to match with the operation system information of the user terminal that will be found out It is sent to the user terminal；
S805, if the first layer picture acquisition request of user terminal transmission is received, according to the first layer figure What the dimension information selection of the display area of the user terminal entrained by piece acquisition request matched with the dimension information Target hierarchy picture；
Wherein, if server receives the first layer picture acquisition request of user terminal transmission, alternatively bright clothes Business device reaches preset protocol with user terminal, which can refer to that user terminal can request adaptive hierarchical picture Agreement.
S806 sends the base layer pictures data in the target hierarchy picture to the user terminal, so that the use Family terminal is decoded the base layer pictures data, and by hierarchical picture decoder to decoded base layer pictures Data are shown；
S807 sends the enhancement-layer pictures data in the target hierarchy picture to the user terminal, so that the use Family terminal is decoded the enhancement-layer pictures data by the hierarchical picture decoder, and by decoded enhancement layer figure Sheet data is synthesized with the decoded base layer pictures data, and shows synthesized image data out；
S808, if the second hierarchical picture acquisition request that the user sends is received, according to second hierarchical diagram Piece acquisition request selects the hierarchical picture with maximum resolution in the hierarchical picture of multiple and different resolution ratio, and successively sends Base layer pictures data and enhancement-layer pictures data in the hierarchical picture with maximum resolution are to the user terminal；
S809 is asked if receiving the original image acquisition request that the user sends according to original image acquisition It asks and sends original image to the user terminal；
Wherein, the second hierarchical picture acquisition request is to detect that the dimension information is discontented with by the user terminal It is transmitted when the adaptive condition of sufficient hierarchical picture；The original image acquisition request is being detected not by the user terminal It is transmitted when support hierarchical picture format；The first layer picture acquisition request is by the user terminal detecting State dimension information meet it is transmitted when the adaptive condition of hierarchical picture.
Wherein, the specific implementation of S803-S809 step may refer to the S401- in above-mentioned Fig. 4 corresponding embodiment To the specific descriptions of server in S415, it is not discussed here.
Optionally, before the S801 the step of, the S501-S503 step in above-mentioned Fig. 5 corresponding embodiment can also be performed.
The embodiment of the present invention by send carry display area dimension information first layer picture acquisition request to take Business device, so that the target hierarchy picture that server matches according to the selection of first layer picture acquisition request with dimension information, then The base layer pictures data in the target hierarchy picture that server is sent are received, and by hierarchical picture decoder, to basal layer Image data is decoded, and is shown to decoded base layer pictures data, and receives the target point of server transmission Enhancement-layer pictures data in layer picture, and enhancement-layer pictures data are decoded by hierarchical picture decoder, and will solution Enhancement-layer pictures data after code are synthesized with decoded base layer pictures data, and show synthesized picture number out According to.It can be seen that although still can comparatively fast get base layer pictures data in the case where network state is unstable, make Display area can first display base layer image data content, avoid picture display area from being in space state for a long time, It is subsequent further to receive enhancement-layer pictures data, and enhancement-layer pictures data and base layer pictures data are synthesized, The higher picture of quality is obtained, so as to improve image display effect.And by server to each operation system information point Not corresponding hierarchical picture decoder carries out assembly code optimizing and code structure optimization, and the user of various operating systems can be made whole The hierarchical picture decoder after optimization can be used in end, to improve the decoding efficiency of hierarchical picture decoder.
Fig. 9 is referred to, is a kind of structural schematic diagram of image data processing system provided in an embodiment of the present invention, the image Data processing equipment 1 may include: sending module 11, receiving module 12, decoding display module 13；
The sending module 11, for send carry display area dimension information first layer picture acquisition request to Server, so that the mesh that the server matches according to first layer picture acquisition request selection with the dimension information Mark hierarchical picture；
The receiving module 12, for receiving the base layer pictures in the target hierarchy picture that the server is sent Data；
The decoding display module 13, for being solved to the base layer pictures data by hierarchical picture decoder Code, and decoded base layer pictures data are shown；
The receiving module 12 is also used to receive the enhancement layer figure in the target hierarchy picture that the server is sent Sheet data；
The decoding display module 13, be also used to by the hierarchical picture decoder to the enhancement-layer pictures data into Row decoding, and decoded enhancement-layer pictures data and the decoded base layer pictures data are synthesized, and shows Synthesized image data out.
Wherein, the sending module 11, is also used to obtain the operation system information of user terminal, and sends and carry the use The decoder acquisition request of the operation system information of family terminal is to the server, so that the server is according to the decoder Acquisition request searches the hierarchical picture decoder to match with the operation system information of the user terminal；
The receiving module 12 is also used to receive the operation system information with the user terminal that the server is sent The hierarchical picture decoder to match.
Further, as shown in figure 9, the image data processing system 1 can also include: first judgment module 14 and second Judgment module 15, notification module 16；
Whether the first judgment module 14 for obtaining the dimension information of display area, and judges the dimension information Meet the adaptive condition of hierarchical picture；
The sending module 11 is unsatisfactory for if being also used to the first judgment module 14 and being judged as, sends the second layering Picture acquisition request is to the server, so that the server successively sends tool according to the second hierarchical picture acquisition request There are the base layer pictures data and enhancement-layer pictures data in the hierarchical picture of maximum resolution；
The notification module 16 notifies the sending module if being judged as satisfaction for the first judgment module 14 11 send the first layer picture acquisition request for carrying the dimension information of display areas to server.
Second judgment module 15 supports hierarchical picture format for judging whether；
The sending module 11 is not supported if being also used to second judgment module 15 and being judged as, sends original image Acquisition request is to the server, so that the server returns to original image according to the original image acquisition request；
The decoding display module 13 is also used to solve the received original image by original decoded device Code, and show decoded original image；
The notification module 16 notifies described first to sentence if being also used to second judgment module 15 is judged as support Disconnected module 14 obtains the dimension information of display area, and judges whether the dimension information meets the adaptive condition of hierarchical picture.
Wherein, the sending module 11, the receiving module 12, the decoding display module 13, described first judge mould Block 14, second judgment module 15, the notification module 16 concrete function implementation to may refer to above-mentioned Fig. 4 corresponding real The specific descriptions in the S401-S415 in example to user terminal are applied, are not discussed here.
The embodiment of the present invention by send carry display area dimension information first layer picture acquisition request to take Business device, so that the target hierarchy picture that server matches according to the selection of first layer picture acquisition request with dimension information, then The base layer pictures data in the target hierarchy picture that server is sent are received, and by hierarchical picture decoder, to basal layer Image data is decoded, and is shown to decoded base layer pictures data, and receives the target point of server transmission Enhancement-layer pictures data in layer picture, and enhancement-layer pictures data are decoded by hierarchical picture decoder, and will solution Enhancement-layer pictures data after code are synthesized with decoded base layer pictures data, and show synthesized picture number out According to.It can be seen that although still can comparatively fast get base layer pictures data in the case where network state is unstable, make Display area can first display base layer image data content, avoid picture display area from being in space state for a long time, It is subsequent further to receive enhancement-layer pictures data, and enhancement-layer pictures data and base layer pictures data are synthesized, The higher picture of quality is obtained, so as to improve image display effect.
Referring to Figure 10, it is the structural schematic diagram of another image data processing system provided in an embodiment of the present invention, it should Image data processing system 2 may include: selecting module 21, sending module 22；
The selecting module 21, if the first layer picture acquisition request for receiving user terminal transmission, basis Dimension information selection and the ruler of the display area of the user terminal entrained by the first layer picture acquisition request The target hierarchy picture that very little information matches；
The sending module 22, it is whole to the user for sending the base layer pictures data in the target hierarchy picture End so that the user terminal by hierarchical picture decoder, is decoded the base layer pictures data, and to decoding after Base layer pictures data shown；
The sending module 22 is also used to send enhancement-layer pictures data in the target hierarchy picture to the user Terminal, so that the user terminal is decoded the enhancement-layer pictures data by the hierarchical picture decoder, and will Decoded enhancement-layer pictures data are synthesized with the decoded base layer pictures data, and show synthesized figure out Sheet data.
Wherein, the selecting module 21, if being also used to receive the second hierarchical picture acquisition request that the user sends, Then select that there is maximum resolution in the hierarchical picture of multiple and different resolution ratio according to the second hierarchical picture acquisition request Hierarchical picture；
The sending module 22 is also used to successively send the basal layer figure in the hierarchical picture with maximum resolution Sheet data and enhancement-layer pictures data are to the user terminal；
The sending module 22, if being also used to receive the original image acquisition request that the user sends, according to institute It states original image acquisition request and sends original image to the user terminal；
Wherein, the second hierarchical picture acquisition request is to detect that the dimension information is discontented with by the user terminal It is transmitted when the adaptive condition of sufficient hierarchical picture；The original image acquisition request is being detected not by the user terminal It is transmitted when support hierarchical picture format；The first layer picture acquisition request is by the user terminal detecting State dimension information meet it is transmitted when the adaptive condition of hierarchical picture.
Further, as shown in Figure 10, which can also include: that receiving module 25, decoder are looked into Module 26, decoder module 23, coding module 24, decoder setup module 27, the optimization of the first optimal setting module 28, second is looked for set Set module 29；
The receiving module 25, the decoder acquisition request sent for receiving the user terminal；The decoder obtains Request is taken to carry the operation system information of the user terminal；
The decoder searching module 26, for searching the behaviour with the user terminal according to the decoder acquisition request The hierarchical picture decoder to match as system information, and the operation system information phase with the user terminal that will be found out Matched hierarchical picture decoder is sent to the user terminal.
The decoder module 23 is divided for obtaining original image by what the operation system information with server matched Layer sub-picture decoder is decoded the original image, obtains decoded original image data；
The coding module 24, for being by the decoded original image data encoding by hierarchical picture encoder The hierarchical picture of at least one resolution ratio；Each hierarchical picture includes base layer pictures data and at least one enhancement-layer pictures number According to.
The decoder setup module 27, for hierarchical picture corresponding at least one operation system information to be arranged Decoder；
The first optimal setting module 28, for pre- in the hierarchical picture decoder and hierarchical picture encoder Survey mode optimizes；The prediction mode includes coding unit division mode, predicting unit division mode, converter unit division Mode, intra prediction direction selection mode；
The second optimal setting module 29, for being decoded according to corresponding operation system information to the hierarchical picture Device carries out assembly code optimizing and code structure optimization.
Wherein, the selecting module 21, the sending module 22, the receiving module 25, the decoder searching module 26, the concrete function implementation of the decoder module 23 and the coding module 24 may refer to the corresponding implementation of above-mentioned Fig. 4 To the specific descriptions of server in S401-S415 in example, it is not discussed here.The decoder setup module 27, institute State the first optimal setting module 28 and the second optimal setting module 29 concrete function implementation may refer to it is above-mentioned S501-S503 in Fig. 5 corresponding embodiment, is not discussed here.
Further, as shown in Figure 10, the second optimal setting module 29 may include: the first rule setting unit 291, Second Rule setting unit 292；
The first rule setting unit 291, it is excellent for memory space selection to be arranged in the hierarchical picture decoder Change rule, the memory space selection principle of optimality includes setting register to the rule of the temporary memory space of highest priority Then, the register is associated with operation system information corresponding to the hierarchical picture decoder；
The Second Rule setting unit 292, for calculation optimization rule, institute to be arranged in the hierarchical picture decoder Stating calculation optimization rule includes the rule that the circle logic of matrix operation is converted into carrying out based on vector gather instruction operation, described Vector gather instruction is associated with operation system information corresponding to the hierarchical picture decoder.
Wherein, the first rule setting unit 291, Second Rule setting unit 292 concrete function implementation can join See the S503 in above-mentioned Fig. 5 corresponding embodiment, is not discussed here.
Further, as shown in Figure 10, the selecting module 21 may include: extraction unit 211, searching unit 212, really Order member 213；
The extraction unit 211, if the first layer picture acquisition request for receiving user terminal transmission, is extracted The dimension information of the display area of the user terminal entrained by the first layer picture acquisition request；
The searching unit 212, in the hierarchical picture of multiple and different resolution ratio, searching pixel wide greater than described At least one hierarchical picture of picture width in dimension information, as at least one hierarchical picture to be selected；
The determination unit 213, for by the layering of the lowest resolution at least one described hierarchical picture to be selected Picture is determined as the target hierarchy picture to match with the dimension information.
Wherein, the concrete function of the extraction unit 211, the searching unit 212 and the determination unit 213 is realized Mode may refer to the S202 in above-mentioned Fig. 2 corresponding embodiment, be not discussed here.
The embodiment of the present invention by send carry display area dimension information first layer picture acquisition request to take Business device, so that the target hierarchy picture that server matches according to the selection of first layer picture acquisition request with dimension information, then The base layer pictures data in the target hierarchy picture that server is sent are received, and by hierarchical picture decoder, to basal layer Image data is decoded, and is shown to decoded base layer pictures data, and receives the target point of server transmission Enhancement-layer pictures data in layer picture, and enhancement-layer pictures data are decoded by hierarchical picture decoder, and will solution Enhancement-layer pictures data after code are synthesized with decoded base layer pictures data, and show synthesized picture number out According to.It can be seen that although still can comparatively fast get base layer pictures data in the case where network state is unstable, make Display area can first display base layer image data content, avoid picture display area from being in space state for a long time, It is subsequent further to receive enhancement-layer pictures data, and enhancement-layer pictures data and base layer pictures data are synthesized, The higher picture of quality is obtained, so as to improve image display effect.And by server to each operation system information point Not corresponding hierarchical picture decoder carries out assembly code optimizing and code structure optimization, and the user of various operating systems can be made whole The hierarchical picture decoder after optimization can be used in end, to improve the decoding efficiency of hierarchical picture decoder.
Referring to Figure 11, it is the structural schematic diagram of another image data processing system provided in an embodiment of the present invention, such as Shown in Figure 11, described image data processing equipment 1000 can be applied to the user terminal 100 in above-mentioned Fig. 1 corresponding embodiment, Described image data processing equipment 1000 may include: processor 1001, memory 1005, network interface 1004, in addition, described Image data processing system 1000 can also include: user interface 1003 and at least one communication bus 1002.Wherein, it communicates Bus 1002 is for realizing the connection communication between these components.Wherein, optional user interface 1003 may include having for standard Line interface, wireless interface.Network interface 1004 optionally may include that (such as WI-FI connects standard wireline interface and wireless interface Mouthful).Memory 1005 can be high speed RAM memory, be also possible to non-labile memory (non-volatile Memory), a for example, at least magnetic disk storage.Memory 1005 optionally can also be that at least one is located remotely from aforementioned place Manage the storage device of device 1001.As shown in figure 11, as may include in a kind of memory 1005 of computer storage medium behaviour Make system, network communication module, Subscriber Interface Module SIM and equipment control application program.
In the image data processing system 1000 shown in Figure 11, network interface 1004 can provide network communication function, and Network interface 1004 can be connect with server；And user interface 1003 is mainly used for providing the interface of input for user；And locate Reason device 1001 can be used for that the equipment stored in memory 1005 is called to control application program, to realize:
The first layer picture acquisition request for carrying the dimension information of display area is sent to server, so that the service The target hierarchy picture that device matches according to first layer picture acquisition request selection with the dimension information；
The base layer pictures data in the target hierarchy picture that the server is sent are received, and pass through hierarchical picture Decoder is decoded the base layer pictures data, and shows to decoded base layer pictures data；
The enhancement-layer pictures data in the target hierarchy picture that the server is sent are received, and pass through the layering Sub-picture decoder is decoded the enhancement-layer pictures data, and will be after decoded enhancement-layer pictures data and the decoding Base layer pictures data synthesized, and show it is synthesized go out image data.
In one embodiment, following steps can also be performed in processor 1001:
The operation system information of user terminal is obtained, and sends the decoding for carrying the operation system information of the user terminal Device acquisition request is to the server, so that the server is searched and the user terminal according to the decoder acquisition request The hierarchical picture decoder that matches of operation system information；
Receive the hierarchical picture decoding to match with the operation system information of the user terminal that the server is sent Device.
In one embodiment, processor 1001 is executing the first layer figure for sending the dimension information for carrying display area Before piece acquisition request to server, following steps can also be performed:
The dimension information of display area is obtained, and judges whether the dimension information meets the adaptive condition of hierarchical picture；
It is unsatisfactory for if being judged as, sends the second hierarchical picture acquisition request to the server, so that the server The base layer pictures number in the hierarchical picture with maximum resolution is successively sent according to the second hierarchical picture acquisition request According to enhancement-layer pictures data；
If being judged as satisfaction, the first layer picture acquisition for executing the dimension information for sending carrying display area is asked The step of seeking server.
In one embodiment, processor 1001 can also be performed before executing the dimension information for obtaining display area Following steps:
Judge whether to support hierarchical picture format；
Do not supported if being judged as, send original image acquisition request to the server so that the server according to The original image acquisition request returns to original image；
The received original image is decoded by original decoded device, and shows decoded original graph Piece；
If being judged as support, execute it is described obtain display area dimension information the step of.
The embodiment of the present invention by send carry display area dimension information first layer picture acquisition request to take Business device, so that the target hierarchy picture that server matches according to the selection of first layer picture acquisition request with dimension information, then The base layer pictures data in the target hierarchy picture that server is sent are received, and by hierarchical picture decoder, to basal layer Image data is decoded, and is shown to decoded base layer pictures data, and receives the target point of server transmission Enhancement-layer pictures data in layer picture, and enhancement-layer pictures data are decoded by hierarchical picture decoder, and will solution Enhancement-layer pictures data after code are synthesized with decoded base layer pictures data, and show synthesized picture number out According to.It can be seen that although still can comparatively fast get base layer pictures data in the case where network state is unstable, make Display area can first display base layer image data content, avoid picture display area from being in space state for a long time, It is subsequent further to receive enhancement-layer pictures data, and enhancement-layer pictures data and base layer pictures data are synthesized, The higher picture of quality is obtained, so as to improve image display effect.
Referring to Figure 12, it is the structural schematic diagram of another image data processing system provided in an embodiment of the present invention.Such as Shown in Figure 12, described image data processing equipment 2000 can be applied to server, which may include above-mentioned Fig. 1 corresponding The institute of server 100 and server 200 in embodiment is functional.Described image data processing equipment 2000 may include: place Device 2001, network interface 2003, memory 2004 are managed, in addition, described image data processing equipment 2000 can also include: at least One communication bus 2002.Wherein, communication bus 2002 is for realizing the connection communication between these components.Network interface 2003 It may include optionally standard wireline interface and wireless interface (such as WI-FI interface).Memory 2004 can be high-speed RAM and deposit Reservoir is also possible to non-labile memory (non-volatile memory), for example, at least a magnetic disk storage.It deposits Reservoir 2004 optionally can also be that at least one is located remotely from the storage device of aforementioned processor 2001.As shown in figure 12, make To may include operating system, network communication module, Subscriber Interface Module SIM in a kind of memory 2004 of computer storage medium And equipment controls application program.
In the image data processing system 2000 shown in Figure 12, the network interface 2003 is used to carry out with user terminal Communication；And processor 2001 can be used for that the equipment stored in memory 2004 is called to control application program, to realize:
If receiving the first layer picture acquisition request of user terminal transmission, obtained according to the first layer picture The target point that the dimension information selection of the display area of the entrained user terminal of request matches with the dimension information Layer picture；
The base layer pictures data in the target hierarchy picture are sent to the user terminal, so that the user terminal By hierarchical picture decoder, the base layer pictures data are decoded, and to decoded base layer pictures data into Row display；
The enhancement-layer pictures data in the target hierarchy picture are sent to the user terminal, so that the user terminal The enhancement-layer pictures data are decoded by the hierarchical picture decoder, and by decoded enhancement-layer pictures data It is synthesized with the decoded base layer pictures data, and shows synthesized image data out.
In one embodiment, if the processor 2001 is executing the first layer picture for receiving user terminal transmission Acquisition request, then the size of the display area of the user terminal according to entrained by the first layer picture acquisition request is believed When the target hierarchy picture that breath selection matches with the dimension information, following steps can be specifically executed:
If receiving the first layer picture acquisition request of user terminal transmission, extracts the first layer picture and obtain The dimension information of the display area of the entrained user terminal of request；
In the hierarchical picture of multiple and different resolution ratio, the picture width that pixel wide is greater than in the dimension information is searched At least one hierarchical picture, as at least one hierarchical picture to be selected；
The hierarchical picture of lowest resolution at least one described hierarchical picture to be selected is determined as and the size The target hierarchy picture that information matches.
In one embodiment, following steps can also be performed in the processor 2001:
If receiving the second hierarchical picture acquisition request that the user sends, obtained according to second hierarchical picture It requests the selection in the hierarchical picture of multiple and different resolution ratio that there is the hierarchical picture of maximum resolution, and successively sends the tool There are base layer pictures data in the hierarchical picture of maximum resolution and enhancement-layer pictures data to the user terminal；
If receiving the original image acquisition request that the user sends, sent according to the original image acquisition request Original image is to the user terminal；
Wherein, the second hierarchical picture acquisition request is to detect that the dimension information is discontented with by the user terminal It is transmitted when the adaptive condition of sufficient hierarchical picture；The original image acquisition request is being detected not by the user terminal It is transmitted when support hierarchical picture format；The first layer picture acquisition request is by the user terminal detecting State dimension information meet it is transmitted when the adaptive condition of hierarchical picture.
In one embodiment, following steps can also be performed in the processor 2001:
Receive the decoder acquisition request that the user terminal is sent；It is whole that the decoder acquisition request carries the user The operation system information at end；
The hierarchical diagram to match with the operation system information of the user terminal is searched according to the decoder acquisition request Piece decoder, and the hierarchical picture decoder to match with the operation system information of the user terminal found out is sent To the user terminal.
In one embodiment, following steps can also be performed in the processor 2001:
Original image is obtained, the hierarchical picture decoder to match by the operation system information with server is to the original Beginning picture is decoded, and obtains decoded original image data；
By hierarchical picture encoder by the decoded original image data encoding be at least one resolution ratio point Layer picture；Each hierarchical picture includes base layer pictures data and at least one enhancement-layer pictures data.
In one embodiment, following steps can also be performed in the processor 2001:
Setting hierarchical picture decoder corresponding at least one operation system information；
Prediction mode in the hierarchical picture decoder and hierarchical picture encoder is optimized；The prediction mode Including coding unit division mode, predicting unit division mode, converter unit division mode, intra prediction direction selection mode；
Assembly code optimizing is carried out to the hierarchical picture decoder according to corresponding operation system information and code structure is excellent Change.
In one embodiment, the processor 2001 is being executed according to corresponding operation system information to the layering When sub-picture decoder carries out assembly code optimizing and code structure optimization, following steps can be specifically executed:
Memory space is set in the hierarchical picture decoder and selects the principle of optimality, the memory space selection optimization rule It then include the rule for setting register to the temporary memory space of highest priority, the register is and the hierarchical picture Operation system information corresponding to decoder is associated；
Calculation optimization rule is set in the hierarchical picture decoder, and the calculation optimization rule includes by matrix operation Circle logic be converted into carrying out the rule of operation based on vector gather instruction, the vector gather instruction is and the hierarchical picture solution Operation system information corresponding to code device is associated.
The embodiment of the present invention by send carry display area dimension information first layer picture acquisition request to take Business device, so that the target hierarchy picture that server matches according to the selection of first layer picture acquisition request with dimension information, then The base layer pictures data in the target hierarchy picture that server is sent are received, and by hierarchical picture decoder, to basal layer Image data is decoded, and is shown to decoded base layer pictures data, and receives the target point of server transmission Enhancement-layer pictures data in layer picture, and enhancement-layer pictures data are decoded by hierarchical picture decoder, and will solution Enhancement-layer pictures data after code are synthesized with decoded base layer pictures data, and show synthesized picture number out According to.It can be seen that although still can comparatively fast get base layer pictures data in the case where network state is unstable, make Display area can first display base layer image data content, avoid picture display area from being in space state for a long time, It is subsequent further to receive enhancement-layer pictures data, and enhancement-layer pictures data and base layer pictures data are synthesized, The higher picture of quality is obtained, so as to improve image display effect.And by server to each operation system information point Not corresponding hierarchical picture decoder carries out assembly code optimizing and code structure optimization, and the user of various operating systems can be made whole The hierarchical picture decoder after optimization can be used in end, to improve the decoding efficiency of hierarchical picture decoder.
In addition, it need to be noted that: the embodiment of the invention also provides a kind of computer storage medium, and the meter Computer program performed by the image data processing system 1 being mentioned above, and the calculating are stored in calculation machine storage medium Machine program includes program instruction, when the processor executes described program instruction, is able to carry out embodiment corresponding to Fig. 7 above In description to described image data processing method therefore will no longer repeat here.In addition, to using same procedure Beneficial effect description, is also no longer repeated.For undisclosed in computer storage medium embodiment according to the present invention Technical detail please refers to the description of embodiment of the present invention method.
In addition, it need to be noted that: the embodiment of the invention also provides another computer storage medium, and it is described Computer program performed by the image data processing system 2 being mentioned above, and the meter are stored in computer storage medium Calculation machine program includes program instruction, when the processor executes described program instruction, is able to carry out the corresponding implementation of Fig. 8 above Therefore description in example to described image data processing method will be repeated no longer here.In addition, to same procedure is used Beneficial effect description, also no longer repeated.For not disclosed in computer storage medium embodiment according to the present invention Technical detail, please refer to the description of embodiment of the present invention method.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with Relevant hardware is instructed to complete by computer program, the program can be stored in a computer-readable storage medium In, the program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, the storage medium can be magnetic Dish, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random Access Memory, RAM) etc..
The above disclosure is only the preferred embodiments of the present invention, cannot limit the right model of the present invention with this certainly It encloses, therefore equivalent changes made in accordance with the claims of the present invention, is still within the scope of the present invention.

Claims (14)

1. a kind of image processing method characterized by comprising
The first layer picture acquisition request for carrying the dimension information of display area is sent to server, so that the server root The target hierarchy picture to match according to first layer picture acquisition request selection with the dimension information；
The base layer pictures data in the target hierarchy picture that the server is sent are received, and are decoded by hierarchical picture Device is decoded the base layer pictures data, and shows to decoded base layer pictures data；
The enhancement-layer pictures data in the target hierarchy picture that the server is sent are received, and pass through the hierarchical picture Decoder is decoded the enhancement-layer pictures data, and by decoded enhancement-layer pictures data and the decoded base Plinth layer image data is synthesized, and shows synthesized image data out.
2. a kind of image processing method characterized by comprising
If the first layer picture acquisition request of user terminal transmission is received, according to the first layer picture acquisition request The target hierarchy figure that the dimension information selection of the display area of the entrained user terminal matches with the dimension information Piece；
The base layer pictures data in the target hierarchy picture are sent to the user terminal, so that the user terminal passes through Hierarchical picture decoder is decoded the base layer pictures data, and shows to decoded base layer pictures data Show；
The enhancement-layer pictures data in the target hierarchy picture are sent to the user terminal, so that the user terminal passes through The hierarchical picture decoder is decoded the enhancement-layer pictures data, and by decoded enhancement-layer pictures data and institute It states decoded base layer pictures data to be synthesized, and shows synthesized image data out.
3. method according to claim 2, which is characterized in that if the first layer picture for receiving user terminal transmission Acquisition request, then the size of the display area of the user terminal according to entrained by the first layer picture acquisition request is believed The target hierarchy picture that breath selection matches with the dimension information, comprising:
If receiving the first layer picture acquisition request of user terminal transmission, the first layer picture acquisition request is extracted The dimension information of the display area of the entrained user terminal；
In the hierarchical picture of multiple and different resolution ratio, pixel wide is searched extremely greater than the picture width in the dimension information A few hierarchical picture, as at least one hierarchical picture to be selected；
The hierarchical picture of lowest resolution at least one described hierarchical picture to be selected is determined as and the dimension information The target hierarchy picture to match.
4. method as claimed in claim 3, which is characterized in that further include:
If the second hierarchical picture acquisition request that the user sends is received, according to the second hierarchical picture acquisition request Selection has the hierarchical picture of maximum resolution in the hierarchical picture of multiple and different resolution ratio, and successively sends described with most Base layer pictures data and enhancement-layer pictures data in the hierarchical picture of big resolution ratio are to the user terminal；
If receiving the original image acquisition request that the user sends, sent according to the original image acquisition request original Picture is to the user terminal；
Wherein, the second hierarchical picture acquisition request is to detect that the dimension information is unsatisfactory for point by the user terminal It is transmitted when the layer adaptive condition of picture；The original image acquisition request is not supported by the user terminal detecting It is transmitted when hierarchical picture format；The first layer picture acquisition request is to detect the ruler by the user terminal Very little information meets transmitted when the adaptive condition of hierarchical picture.
5. method according to claim 2, which is characterized in that further include:
Receive the decoder acquisition request that the user terminal is sent；The decoder acquisition request carries the user terminal Operation system information；
The hierarchical picture solution to match with the operation system information of the user terminal is searched according to the decoder acquisition request Code device, and the hierarchical picture decoder to match with the operation system information of the user terminal found out is sent to institute State user terminal.
6. method according to claim 2, which is characterized in that further include:
Original image is obtained, the hierarchical picture decoder to match by the operation system information with server is to the original graph Piece is decoded, and obtains decoded original image data；
By hierarchical picture encoder by the decoded original image data encoding be at least one resolution ratio hierarchical diagram Piece；Each hierarchical picture includes base layer pictures data and at least one enhancement-layer pictures data.
7. method as claimed in claim 5, which is characterized in that further include:
Setting hierarchical picture decoder corresponding at least one operation system information；
Prediction mode in the hierarchical picture decoder and hierarchical picture encoder is optimized；The prediction mode includes Coding unit division mode, predicting unit division mode, converter unit division mode, intra prediction direction selection mode；
Assembly code optimizing is carried out to the hierarchical picture decoder according to corresponding operation system information and code structure optimizes.
8. the method for claim 7, which is characterized in that the operation system information according to corresponding to is to the layering Sub-picture decoder carries out assembly code optimizing and code structure optimization, comprising:
Memory space is set in the hierarchical picture decoder and selects the principle of optimality, the memory space selects principle of optimality packet The rule for setting register to the temporary memory space of highest priority is included, the register is decoded with the hierarchical picture Operation system information corresponding to device is associated；
Calculation optimization rule is set in the hierarchical picture decoder, and the calculation optimization rule includes following matrix operation At the rule for carrying out operation based on vector gather instruction, the vector gather instruction is and the hierarchical picture decoder ring logical transition Corresponding operation system information is associated.
9. a kind of image data processing system characterized by comprising
Sending module, for sending the first layer picture acquisition request for carrying the dimension information of display area to server, with The target hierarchy figure for making the server be matched according to first layer picture acquisition request selection with the dimension information Piece；
Receiving module, for receiving the base layer pictures data in the target hierarchy picture that the server is sent；
Display module is decoded, for being decoded to the base layer pictures data, and to decoding by hierarchical picture decoder Base layer pictures data afterwards are shown；
The receiving module is also used to receive the enhancement-layer pictures number in the target hierarchy picture that the server is sent According to；
The decoding display module is also used to solve the enhancement-layer pictures data by the hierarchical picture decoder Code, and decoded enhancement-layer pictures data and the decoded base layer pictures data are synthesized, and show and closed At the image data gone out.
10. a kind of image data processing system characterized by comprising
Selecting module, if the first layer picture acquisition request for receiving user terminal transmission, according to described first point Dimension information selection and the dimension information phase of the display area of the user terminal entrained by layer picture acquisition request The target hierarchy picture matched；
Sending module, for sending the base layer pictures data in the target hierarchy picture to the user terminal, so that institute User terminal is stated by hierarchical picture decoder, the base layer pictures data are decoded, and to decoded basal layer Image data is shown；
The sending module, is also used to send enhancement-layer pictures data in the target hierarchy picture to the user terminal, So that the user terminal is decoded the enhancement-layer pictures data by the hierarchical picture decoder, and will be after decoding Enhancement-layer pictures data synthesized with the decoded base layer pictures data, and show it is synthesized go out picture number According to.
11. a kind of image data processing system characterized by comprising processor, memory and network interface；
The processor is connected with memory, network interface, wherein network interface is used for connecting server, the memory In storage program code, the processor is for calling said program code, to execute following operation:
The first layer picture acquisition request for carrying the dimension information of display area is sent to the server, so that the service The target hierarchy picture that device matches according to first layer picture acquisition request selection with the dimension information；
The base layer pictures data in the target hierarchy picture that the server is sent are received, and are decoded by hierarchical picture Device is decoded the base layer pictures data, and shows to decoded base layer pictures data；
The enhancement-layer pictures data in the target hierarchy picture that the server is sent are received, and pass through the hierarchical picture Decoder is decoded the enhancement-layer pictures data, and by decoded enhancement-layer pictures data and the decoded base Plinth layer image data is synthesized, and shows synthesized image data out.
12. a kind of image data processing system characterized by comprising processor, memory and network interface；
The processor is connected with memory, network interface, wherein network interface is for connecting user terminal, the memory For storing program code, the processor is for calling said program code, to execute following operation:
If receiving the first layer picture acquisition request that the user terminal is sent, obtained according to the first layer picture The target point that the dimension information selection of the display area of the entrained user terminal of request matches with the dimension information Layer picture；
The base layer pictures data in the target hierarchy picture are sent to the user terminal, so that the user terminal passes through Hierarchical picture decoder is decoded the base layer pictures data, and shows to decoded base layer pictures data Show；
The enhancement-layer pictures data in the target hierarchy picture are sent to the user terminal, so that the user terminal passes through The hierarchical picture decoder is decoded the enhancement-layer pictures data, and by decoded enhancement-layer pictures data and institute It states decoded base layer pictures data to be synthesized, and shows synthesized image data out.
13. a kind of computer storage medium, which is characterized in that the computer storage medium is stored with computer program, described Computer program includes program instruction, and side as described in claim 1 is executed when the processor executes described program instruction Method.
14. a kind of computer storage medium, which is characterized in that the computer storage medium is stored with computer program, described Computer program includes program instruction, is executed when the processor executes described program instruction such as any one of claim 2-8 The method.
CN201710824066.6A 2017-09-13 2017-09-13 Image data processing method and device Active CN109493304B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201710824066.6A CN109493304B (en) 2017-09-13 2017-09-13 Image data processing method and device
PCT/CN2018/105131 WO2019052452A1 (en) 2017-09-13 2018-09-12 Image data processing method, user terminal, server and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710824066.6A CN109493304B (en) 2017-09-13 2017-09-13 Image data processing method and device

Publications (2)

Publication Number Publication Date
CN109493304A true CN109493304A (en) 2019-03-19
CN109493304B CN109493304B (en) 2022-11-08

Family

ID=65687963

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710824066.6A Active CN109493304B (en) 2017-09-13 2017-09-13 Image data processing method and device

Country Status (2)

Country Link
CN (1) CN109493304B (en)
WO (1) WO2019052452A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112242946A (en) * 2019-07-16 2021-01-19 沃兹艾普公司 Method and system for transmitting images in chunks
CN115914750A (en) * 2022-11-10 2023-04-04 深圳创维－Rgb电子有限公司 Picture display method and device, display equipment and storage medium
US11646983B1 (en) 2019-07-16 2023-05-09 Whatsapp Llc Methods and systems for transmitting an image with thumbnail data

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103518374A (en) * 2011-06-10 2014-01-15 联发科技股份有限公司 Method and apparatus of scalable video coding
US20160007034A1 (en) * 2013-02-22 2016-01-07 Thomson Licensing Coding and decoding methods of a picture block, corresponding devices and data stream
US20160029029A1 (en) * 2013-04-04 2016-01-28 Electronics And Telecommunications Research Institute Image encoding/decoding method and device
CN105681818A (en) * 2016-01-07 2016-06-15 中国联合网络通信集团有限公司 Picture cloud storage method and device
CN105847345A (en) * 2016-03-21 2016-08-10 深圳市茁壮网络股份有限公司 Picture merging display method and device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101098311B (en) * 2006-06-29 2010-10-13 腾讯科技（深圳）有限公司 Picture live transmission method and device in instant communication
US9338204B2 (en) * 2013-01-25 2016-05-10 Mobitv, Inc. Prioritized side channel delivery for download and store media
SG10201912804TA (en) * 2013-12-26 2020-02-27 Univ Singapore Technology & Design A method and apparatus for reducing data bandwidth between a cloud server and a thin client

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103518374A (en) * 2011-06-10 2014-01-15 联发科技股份有限公司 Method and apparatus of scalable video coding
US20160007034A1 (en) * 2013-02-22 2016-01-07 Thomson Licensing Coding and decoding methods of a picture block, corresponding devices and data stream
US20160029029A1 (en) * 2013-04-04 2016-01-28 Electronics And Telecommunications Research Institute Image encoding/decoding method and device
CN105681818A (en) * 2016-01-07 2016-06-15 中国联合网络通信集团有限公司 Picture cloud storage method and device
CN105847345A (en) * 2016-03-21 2016-08-10 深圳市茁壮网络股份有限公司 Picture merging display method and device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112242946A (en) * 2019-07-16 2021-01-19 沃兹艾普公司 Method and system for transmitting images in chunks
US11646983B1 (en) 2019-07-16 2023-05-09 Whatsapp Llc Methods and systems for transmitting an image with thumbnail data
CN115914750A (en) * 2022-11-10 2023-04-04 深圳创维－Rgb电子有限公司 Picture display method and device, display equipment and storage medium

Also Published As

Publication number Publication date
CN109493304B (en) 2022-11-08
WO2019052452A1 (en) 2019-03-21

Similar Documents

Publication Publication Date Title
JP6854888B2 (en) Video coding methods, computer equipment and storage media
JP6837965B2 (en) Coding device and decoding device
CN103650509B (en) Adaptive configuration of reference frame buffer based on camera and background motion
CN104754356B (en) The method and apparatus determined for the motion vector in Video coding or decoding
CN107968945B (en) Method for decoding video and method for encoding video
CN111681167A (en) Image quality adjusting method and device, storage medium and electronic equipment
CN103918255A (en) Method and device for encoding a depth map of multi viewpoint video data, and method and device for decoding the encoded depth map
CN106464879A (en) System and method for highly content adaptive quality restoration filtering for video coding
CN103858431A (en) Multiview video data encoding method and device, and decoding method and device
CN107667528A (en) Method and system for the adaptive reference frame buffer of coding and decoding video
CN109493304A (en) A kind of image processing method and device
CN104541510A (en) Inter prediction method in which reference picture lists can be changed and apparatus for same
CN103875249A (en) Method for multiview video prediction encoding and device for same, and method for multiview video prediction decoding and device for same
CN107396112A (en) A kind of coding method and device, computer installation, readable storage medium storing program for executing
WO2011125051A1 (en) Method for accessing a spatio-temporal part of a compressed video sequence
CN109429064A (en) A kind of method and apparatus handling video data
CN105340274A (en) Depth map encoding method and apparatus thereof, and depth map decoding method and an apparatus thereof
CN113965751A (en) Screen content coding method, device, equipment and storage medium
CN112839224B (en) Prediction mode selection method and device, video coding equipment and storage medium
CN114157868B (en) Video frame coding mode screening method and device and electronic equipment
CN110677676A (en) Video encoding method and apparatus, video decoding method and apparatus, and storage medium
JP7310148B2 (en) Media encoding method and apparatus
CN116918329A (en) Video frame compression and video frame decompression method and device
CN110636293A (en) Video encoding method, video decoding method, video encoding apparatus, video decoding apparatus, storage medium, and electronic apparatus
CN116760986B (en) Candidate motion vector generation method, candidate motion vector generation device, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant