WO2019052452A1 - 一种图像数据处理方法、用户终端、服务器和存储介质 - Google Patents

一种图像数据处理方法、用户终端、服务器和存储介质 Download PDF

Info

Publication number
WO2019052452A1
WO2019052452A1 PCT/CN2018/105131 CN2018105131W WO2019052452A1 WO 2019052452 A1 WO2019052452 A1 WO 2019052452A1 CN 2018105131 W CN2018105131 W CN 2018105131W WO 2019052452 A1 WO2019052452 A1 WO 2019052452A1
Authority
WO
WIPO (PCT)
Prior art keywords
picture
layered
user terminal
server
acquisition request
Prior art date
Application number
PCT/CN2018/105131
Other languages
English (en)
French (fr)
Inventor
应玉龙
Original Assignee
腾讯科技（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技（深圳）有限公司 filed Critical 腾讯科技（深圳）有限公司
Publication of WO2019052452A1 publication Critical patent/WO2019052452A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/40—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering

Definitions

  • the present application relates to the field of Internet technologies, and in particular, to an image data processing method, a user terminal, a server, and a storage medium.
  • the download traffic of terminal devices has increased substantially, and the user traffic has a large proportion of image traffic.
  • a large number of pictures also put a lot of pressure on the network transmission bandwidth load. Therefore, if the user downloads a picture with a higher quality when the network status is not stable, the picture data transmission time is too long, and the picture display area of the user terminal is in a blank state for a long time.
  • downloading a lower quality image can solve the problem that the image data transmission time is too long, a low quality image may cause the image content to be too blurred, which seriously affects the display effect.
  • an image data processing method a user terminal, a server, and a storage medium are provided.
  • An image data processing method is performed on a user terminal, and the method includes:
  • a user terminal comprising: a processor, a memory, and a network interface;
  • the processor is coupled to a memory, a network interface, wherein the network interface is for connecting to a server, the memory is for storing computer readable instructions, the computer readable instructions being executed by the processor, such that the processor Perform the following steps
  • a computer storage medium storing computer readable instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of an image data processing method.
  • An image data processing method is performed on a server, the method comprising:
  • a server includes: a processor, a memory, and a network interface
  • the processor is coupled to a memory, a network interface, wherein the network interface is for connecting to a user terminal, the memory is for storing computer readable instructions, the computer readable instructions being executed by the processor to cause the processing Perform the following steps:
  • the size information of the display area of the user terminal carried by the first layered image acquisition request is selected to match the size information.
  • a computer storage medium storing computer readable instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of an image data processing method.
  • An image data processing system comprising: a user terminal and a server;
  • the user terminal is configured to send a first layered picture acquisition request that carries size information of the display area to the server;
  • the server is configured to select a target layered picture that matches the size information according to the first layered picture acquisition request, and send the base layer picture data in the target layered picture to the user terminal;
  • the user terminal is further configured to decode the base layer picture data by using a layered picture decoder, and display the decoded base layer picture data;
  • the server is further configured to send the enhancement layer picture data in the target layered picture to the user terminal;
  • the user terminal is further configured to decode the enhancement layer picture data by using the layered picture decoder, and synthesize the decoded enhancement layer picture data and the decoded base layer picture data, and display the The synthesized picture data.
  • FIG. 1 is a schematic diagram of a network architecture provided by an embodiment of the present application.
  • FIG. 2 is a timing diagram of an image data processing method provided by an embodiment of the present application.
  • FIG. 3 is a schematic diagram of a picture display of a user terminal according to an embodiment of the present application.
  • FIG. 3b is a schematic diagram of a picture display of another user terminal according to an embodiment of the present disclosure.
  • FIG. 3 is a schematic diagram of a picture display of another user terminal according to an embodiment of the present application.
  • FIG. 4 is a timing diagram of another image data processing method provided by an embodiment of the present application.
  • FIG. 5 is a schematic flowchart of a method for optimizing a decoder according to an embodiment of the present disclosure
  • FIG. 6 is a schematic structural diagram of a layered picture decoder according to an embodiment of the present disclosure.
  • FIG. 7 is a schematic flowchart diagram of an image data processing method according to an embodiment of the present application.
  • FIG. 8 is a schematic flowchart diagram of another image data processing method according to an embodiment of the present application.
  • FIG. 9 is a schematic structural diagram of a user terminal according to an embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of a server according to an embodiment of the present application.
  • FIG. 11 is a schematic structural diagram of a user terminal according to an embodiment of the present application.
  • FIG. 12 is a schematic structural diagram of a server according to an embodiment of the present application.
  • FIG. 1 is a schematic diagram of a network architecture provided by an embodiment of the present application.
  • the network architecture may include a server 100, a server 200, and a plurality of user terminals 300.
  • the server 100 can respectively perform network connection with a plurality of user terminals 300 via the Internet
  • the server 200 can also perform network connection with a plurality of user terminals 300 via the Internet.
  • the plurality of user terminals 300 may include terminal devices such as a computer, a tablet computer, a smart phone, a notebook computer, a palmtop computer, a digital television, and a mobile internet device (MID), or may be a client in the terminal device. .
  • MID mobile internet device
  • the server 100 may be configured to set a layered picture decoder corresponding to each of the multiple operating systems, and bring the set multiple layered picture decoders online, so that the plurality of user terminals 300 can obtain and operate through the server 100.
  • the system matches the layered picture decoder.
  • the server 200 may encode the original picture into a plurality of layered pictures of different resolutions, and when the user terminal 300 requests to acquire the layered picture, the server 200 may select corresponding according to the size information of the display area in the user terminal 300.
  • the user terminal 300 can first decode the base layer picture data by using the layered picture decoder acquired from the server 100, and then The user terminal 300 may first display the base layer picture data of lower quality to prevent the picture display area from being blank for a long time; then the server 200 may continue to transmit the enhancement layer picture data in the selected layered picture, so that the user terminal 300
  • the enhanced layer picture data is decoded by the layered picture decoder acquired from the server 100, and the decoded enhancement layer picture data is combined with the decoded base layer picture data to obtain a picture with higher quality, and the quality is displayed. High picture to improve the picture display.
  • the layered picture may include base layer picture data and at least one enhancement layer picture data, where the base layer picture data refers to low quality picture data that can substantially display picture content, that is, the amount of data of the base layer picture data is small, so that The base layer picture data is quickly transmitted to the user terminal 300, and the enhancement layer picture data may refer to a difference between the high quality picture data and the base layer picture data. Therefore, by superimposing the enhancement layer picture data and the base layer picture data, it is possible to obtain more High quality image data. When there are multiple enhancement layer image data, each overlay of the enhancement layer image data will increase the quality of the image by one level, that is, the display of the image is a gradual process from blur to clear.
  • the layered picture decoder is a type of decoder that can be used to decode the layered picture, that is, the layered picture decoder can decode the base layer picture data, and can also decode the enhancement layer picture data, or The enhancement layer picture data and the base layer picture data are synthesized.
  • the server 100 and the server 200 in FIG. 1 may be merged into the same server, that is, the functions performed by the server 100 and the server 200 respectively may be implemented on the same server.
  • FIG. 2 is a timing diagram of an image data processing method provided by an embodiment of the present application, and the method may include:
  • the user terminal sends a first layered picture acquisition request that carries size information of the display area to the server.
  • the user terminal may first send a decoder acquisition request that carries the operating system information of the user terminal to the server, so that the server may search for a layered picture that matches the operating system information of the user terminal according to the decoder acquisition request.
  • the decoder, and the server can then send the found layered picture decoder to the user terminal.
  • the operating system information may include any one of other operating system information such as Microsoft system information, Apple system information, and Android system information.
  • the server can pre-set a layered picture decoder corresponding to each of the multiple operating systems, wherein the server can include the functions respectively provided by the server 100 and the server 200 in the corresponding embodiment of FIG. 1 described above.
  • the server can also perform assembly optimization and code structure optimization on the layered picture decoder.
  • the optimized layered picture decoder will try to The register corresponding to the operating system of the user terminal is used as a temporary storage space, and the optimized layered picture decoder will use the vector operation instruction corresponding to the operating system of the user terminal to perform decoding calculation as much as possible. Therefore, by performing different assembly optimization and code structure optimization for different operating systems, the user terminal of various operating systems can use the optimized layered picture decoder to improve the decoding efficiency of the layered picture decoder. .
  • the user terminal may further detect the size information of the display area, and send a first layered picture acquisition request carrying the size information of the display area to the server to request the corresponding point.
  • Layer image among them, layered image can also be called X5 image.
  • the server selects a target layered picture that matches the size information according to the first layered picture acquisition request.
  • the server may extract the size information of the display area of the user terminal in the first layer image acquisition request, and in a preset plurality of layered pictures with different resolutions. Finding at least one layered picture whose pixel width is larger than the width of the picture in the size information, using the found at least one layered picture as the at least one layered picture to be selected, and the lowest resolution in the at least one layered picture to be selected.
  • the layered picture is determined to be a target layered picture that matches the size information.
  • the server may encode an original picture into a layered picture of multiple resolutions in advance, and the target layered picture is a layered picture of one of the resolutions.
  • the size information may be a width of a display area of the user terminal, and the server may determine a layered picture in which the pixel width in the multi-resolution layered picture is larger than the size information, and the layered picture adjacent to the value of the size information.
  • Layer the picture for the target For example, an original picture corresponds to a layered picture having three resolutions, which are a layered picture of 810 pixels wide, a layered picture of 610 pixels wide, and a layered picture of 410 pixels wide, if the size information is 800 pixels wide.
  • the layered picture with a width of 810 pixels is determined as the target layered picture; if the size information is 600 pixels, the layered picture with a width of 610 pixels is determined as the target layered picture; if the size information is 400 pixels wide , the layered picture of 410 pixels width is determined as the target layered picture.
  • the specific process of the server pre-coding a certain original image into a plurality of resolution layered pictures may be: the server decodes the original picture by using a layered picture decoder corresponding to the operating system information of the server, thereby obtaining support
  • Layer picture The layered picture decoder and the layered picture encoder are both coded and decoded based on the video coding standard H.265.
  • the server sends the base layer picture data in the target layered picture to the user terminal.
  • the server may first send the base layer picture data in the target layered picture to the user terminal, where the data amount of the base layer picture data is relatively small (ie, the sawtooth comparison of the picture content) Obviously, the duration of transmitting the base layer picture data is relatively short, so that the user can display the base layer picture data on the display area of the user terminal faster, so as to avoid the display area being in a blank state for a long time.
  • the user terminal decodes the base layer picture data by using a layered picture decoder, and displays the decoded base layer picture data.
  • the user terminal may decode the base layer picture data by using the obtained layered picture decoder. Since the layered picture decoder has assembly optimization and code structure optimization on the server side, the user terminal can use the register corresponding to the operating system of the user terminal as much as possible in the process of decoding using the layered picture decoder.
  • the temporary storage space can also be decoded and calculated by using the vector operation instruction corresponding to the operating system of the user terminal as much as possible, thereby effectively improving the decoding speed.
  • the user terminal After decoding the base layer picture data, the user terminal can directly display the decoded base layer picture data into the display area for display. Since the data volume of the base layer picture data is relatively small (that is, the sawtooth of the picture content is relatively obvious), the duration of transmitting the base layer picture data is relatively short, so that the user can display the base layer picture data on the display area of the user terminal faster. To avoid the display area being blank for a long time.
  • the server sends the enhancement layer picture data in the target layered picture to the user terminal.
  • the server may continue to send the enhancement layer picture data in the target layered picture to the user terminal.
  • the user terminal may return an acknowledge receipt instruction to the server, so that the server triggers the sending operation of the enhancement layer picture data according to the acknowledge receipt instruction. Since the enhancement layer picture data is the difference between the high quality picture data and the base layer picture data, the data amount of the enhancement layer picture data is also small, so that the transmission time of the transmission enhancement layer picture data can also be shortened.
  • the user terminal decodes the enhancement layer picture data by using a layered picture decoder, and synthesizes the decoded enhancement layer picture data and the decoded base layer picture data, and displays the synthesized picture data.
  • the user terminal may decode the enhancement layer picture data by using a layered picture decoder, and in the decoding process, the user terminal corresponding to the operating system corresponding to the register and the vector operation instruction may be used for decoding. To increase the decoding speed.
  • the user terminal may synthesize the decoded enhancement layer picture data and the decoded base layer picture data, and display the synthesized picture data, and the synthesized picture data has a sharpness. Higher than the clarity of the base layer image data.
  • the server may continue to send the next enhancement layer picture data to the user terminal after sending the first enhancement layer picture data. So that the user terminal continues to synthesize the second enhancement layer picture data and the displayed picture to obtain a clearer composite picture, and so on, the server can sequentially send the enhancement layer picture data, and the user terminal can sequentially The enhancement layer picture data is synthesized into the displayed picture, so that the picture displayed in the display area of the user terminal has a gradually clear trend.
  • FIG. 3a - FIG. 3c is a schematic diagram of a picture display of a user terminal according to an embodiment of the present application.
  • the picture displayed by the display area 500 of the user terminal 400 is the base layer picture data 600 in the target layered picture.
  • the display effect of the base layer picture data 600 has a relatively obvious sawtooth phenomenon.
  • the target layered picture has a resolution of 310*250, and the target layered picture includes one base layer picture data 600 and two enhancement layer picture data, and the resolution of the base layer picture data 600 displayed by the display area 500 is also It is 310*250.
  • the server may continue to send one of the enhancement layer picture data to the user terminal 400.
  • the user terminal 400 may decode the enhanced layer picture data and the displayed basis.
  • the layer picture data 600 is synthesized to obtain a composite picture 700 as shown in FIG. 3b, and the base layer picture data 600 in FIG. 3a is updated to the composite picture 700, that is, the synthesis shown in the display area 500 shown in FIG. 3b is obtained.
  • the picture 700 wherein the resolution of the composite picture 700 is also 310*250, but the resolution of the composite picture 700 is higher than the base layer picture data 600.
  • the server may continue to send another enhancement layer picture data to the user terminal 400.
  • the user terminal 400 may display the decoded enhancement layer picture data and the displayed
  • the composite picture 700 is synthesized to obtain a final picture 800 as shown in FIG. 3c, and the composite picture 700 in FIG. 3b is updated to the final picture 800, that is, the final picture 800 displayed in the display area 500 shown in FIG. 3c is obtained.
  • the resolution of the final picture 800 is also 310*250, but the final picture 800 has higher definition than the composite picture 700. It can be seen that in the display area 500, the sharpness of the picture is a gradually clear gradual process, that is, the picture displayed in the display area 500 is changed from the base layer picture data 600 to the composite picture 700, and then becomes the final picture 800. .
  • the embodiment of the present application obtains a request to the server by sending a first layered picture carrying the size information of the display area, so that the server selects a target layered picture that matches the size information according to the first layered picture acquisition request, and then the sending server sends the target layered picture.
  • the target layer layer image data in the layered picture, and through the layered picture decoder decodes the base layer picture data, and displays the decoded base layer picture data, and receives the target layered picture sent by the server.
  • the enhancement layer picture data, and the enhancement layer picture data is decoded by the layered picture decoder, and the decoded enhancement layer picture data is combined with the decoded base layer picture data, and the synthesized picture data is displayed.
  • the base layer picture data can be obtained relatively quickly, so that the display area can display the content of the base layer picture data first, and the picture display area is prevented from being blank for a long time. Further receiving the enhancement layer picture data, and synthesizing the enhancement layer picture data and the base layer picture data to obtain a picture with higher quality, thereby improving the picture display effect.
  • the assembly optimization and code structure optimization of the layered picture decoder corresponding to each operating system information by the server can enable the user terminal of various operating systems to use the optimized layered picture decoder to improve layering. The decoding efficiency of the picture decoder.
  • FIG. 4 is a timing diagram of another image data processing method provided by an embodiment of the present application.
  • the method may include:
  • the user terminal acquires operating system information of the user terminal, and sends a decoder that carries the operating system information of the user terminal to obtain a request to the server.
  • the operating system information of the user terminal may be further obtained, and a decoder that carries the operating system information of the user terminal is sent to the server; wherein the operating system information may include Microsoft. Any of other operating system information such as system information, Apple system information, and Android system information.
  • the server searches for a layered picture decoder that matches the operating system information of the user terminal according to the decoder acquisition request, and sends a layered picture decoder that matches the operating system information of the user terminal to the user terminal.
  • the server searches for a layered picture decoder that matches the operating system information of the user terminal according to the decoder acquisition request, and sends a layered picture decoder that matches the operating system information of the user terminal to the user terminal.
  • the server can pre-set a layered picture decoder corresponding to each of the multiple operating systems, wherein the server can include the functions respectively provided by the server 100 and the server 200 in the corresponding embodiment of FIG. 1 described above.
  • the server can also perform assembly optimization and code structure optimization on the layered picture decoder.
  • the optimized layered picture decoder When the user terminal decodes using the optimized layered picture decoder, the optimized layered picture decoder will try to The register corresponding to the operating system of the user terminal is used as a temporary storage space, and the optimized layered picture decoder will use the vector operation instruction corresponding to the operating system of the user terminal to perform decoding calculation as much as possible. Therefore, by performing different assembly optimization and code structure optimization for different operating systems, the user terminal of various operating systems can use the optimized layered picture decoder to improve the decoding efficiency of the layered picture decoder. .
  • the user terminal determines whether the layered picture format is supported.
  • the user terminal may further determine whether the user terminal supports the layered picture format, that is, whether the user terminal can decode the layered picture by using the layered picture decoder.
  • the layered picture format may be a picture format including base layer picture data and at least one enhancement layer picture data, that is, one layered picture may include base layer picture data and at least one enhancement layer picture data, and the base layer picture data refers to The low-quality picture data of the picture content is roughly displayed, and the enhancement layer picture data may refer to the difference between the high-quality picture data and the base layer picture data.
  • the user terminal may first determine whether the user terminal supports the layered picture format. If it is determined to be supported, perform S401-S402 again, and continue to perform the steps after S407; if the determination is not For support, the steps of S404-S406 are directly executed. Therefore, the embodiment of the present application does not limit the execution order of the step S403.
  • the user terminal sends a original picture acquisition request to the server.
  • the user terminal may further send an original picture acquisition request to the server.
  • the server returns an original picture according to the original picture acquisition request.
  • the server returns the original image according to the original image acquisition request. Further, the server may further send the original decoder to the user terminal according to the original image acquisition request. Alternatively, the server may send the original decoder to the user terminal while transmitting the layered picture decoder to the user terminal. Alternatively, the user terminal itself carries the original decoder, so the server may not need to send the original decoder to the user terminal.
  • the original decoder refers to a picture that can be used to decode PNG (Portable Network Graphics), JPEG (Joint Photographic Experts Group), GIF (Graphics Interchange Format), and the like. Decoder.
  • the user terminal decodes the received original picture by using an original decoder, and displays the decoded original picture.
  • the original image is decoded by the original decoder, and the decoded original image is displayed on the display area.
  • the user terminal acquires the size information of the display area, and determines whether the size information satisfies the layered picture adaptation condition.
  • the user terminal can further obtain the size information of the display area, and determine whether the size information satisfies the layered picture adaptation condition.
  • the specific process of determining whether the layered picture adaptive condition is met may be: detecting whether the size information is greater than a preset size threshold. If greater than, determining that the size information satisfies the layered picture adaptive condition; otherwise, determining the size information is not The step of satisfying the layered picture adaptation condition and jumping to S414-S415.
  • the steps of S414-S415 may be directly performed; Detecting that the adaptive protocol is configured, it is possible to perform the step of determining whether the size information satisfies the layered picture adaptation condition.
  • the adaptive protocol may refer to a protocol that is jointly deployed between the user terminal and the server.
  • the user terminal configured with the adaptive protocol may trigger the step of determining whether the size information satisfies the layered picture adaptive condition, and then triggers the step of S408.
  • the server configured with the adaptive protocol may identify and respond to the first hierarchical picture acquisition request in step S408, thereby triggering the step of S409.
  • the user terminal sends a first hierarchical picture acquisition request carrying the size information of the display area to the server.
  • the server selects a target layered picture that matches the size information according to the first layered picture acquisition request.
  • the server sends the base layer picture data in the target layered picture to the user terminal.
  • the user terminal decodes the base layer picture data by using a layered picture decoder, and displays the decoded base layer picture data.
  • the server sends the enhancement layer picture data in the target layered picture to the user terminal.
  • S413 The user terminal decodes the enhancement layer picture data by using a layered picture decoder, and synthesizes the decoded enhancement layer picture data and the decoded base layer picture data, and displays the synthesized picture data;
  • the user terminal sends a second hierarchical picture acquisition request to the server.
  • the user terminal may further send the second layer image acquisition request to the server, where the second layer image acquisition request is sent. Size information is not carried.
  • the server sequentially sends the base layer picture data and the enhancement layer picture data in the layered picture with the maximum resolution according to the second layered picture acquisition request.
  • the server may obtain the layered picture with the maximum resolution in the preset multiple-resolution layered picture according to the second layered picture acquisition request, and send the basic layer in the layered picture with the maximum resolution.
  • Layer picture data is sent to the user terminal, so that the user terminal decodes and displays the same; after the server sends the base layer picture data in the layered picture of the maximum resolution, the server can continue to send the enhancement in the layered picture with the largest resolution.
  • Layer picture data is sent to the user terminal, so that the user terminal decodes the enhancement layer picture data, and synthesizes the decoded enhancement layer picture data and the displayed base layer picture data to display the final high quality picture.
  • the steps of the steps of S408-S413 can be referred to.
  • the embodiment of the present application obtains a request to the server by sending a first layered picture carrying the size information of the display area, so that the server selects a target layered picture that matches the size information according to the first layered picture acquisition request, and then the sending server sends the target layered picture.
  • the target layer layer image data in the layered picture, and through the layered picture decoder decodes the base layer picture data, and displays the decoded base layer picture data, and receives the target layered picture sent by the server.
  • the enhancement layer picture data, and the enhancement layer picture data is decoded by the layered picture decoder, and the decoded enhancement layer picture data is combined with the decoded base layer picture data, and the synthesized picture data is displayed.
  • the base layer picture data can be obtained relatively quickly, so that the display area can display the content of the base layer picture data first, and the picture display area is prevented from being blank for a long time. Further receiving the enhancement layer picture data, and synthesizing the enhancement layer picture data and the base layer picture data to obtain a picture with higher quality, thereby improving the picture display effect.
  • the assembly optimization and code structure optimization of the layered picture decoder corresponding to each operating system information by the server can enable the user terminal of various operating systems to use the optimized layered picture decoder to improve layering. The decoding efficiency of the picture decoder.
  • FIG. 5 is a schematic flowchart of a method for optimizing a decoder according to an embodiment of the present disclosure.
  • the method may be performed before S201 in the foregoing embodiment of FIG. 2, or may be corresponding to FIG. 4 above. Executed before S401 of the embodiment, the method may include:
  • the server may preset a layered picture decoder corresponding to at least one operating system information.
  • the server may also preset a layered picture encoder corresponding to the operating system of the server, so that the server can pre-encode the original picture into a layered picture of multiple resolutions through the layered picture encoder.
  • the prediction mode includes a coding unit division manner, a prediction unit division manner, a transformation unit division manner, and an intra prediction direction selection manner.
  • the server may further optimize a prediction manner in each layered picture decoder and a preset layered picture encoder, where the prediction manner includes a coding unit division manner, a prediction unit division manner, a transformation unit division manner, and a frame. Internal prediction direction selection method.
  • the process of optimizing the coding unit division manner by the server may be: using the depth information of the coding unit in time and space to quickly determine the current CU (Coding Unit) optimal coding size, and the optimization extracts the previous frame.
  • the same location and the depth information of the CU around the current frame are reduced, and the determination interval of the CU partition is reduced to predict the current CU partition depth, and the prediction speed of the CU partition depth is increased to avoid unnecessary calculation and reduce computational complexity.
  • the process of optimizing the prediction unit division manner by the server may be: before the rate distortion optimization in the CU layer, acquiring and analyzing the main factors affecting the PU (Prediction Unit) mode selection, thereby selecting the highest probability.
  • the mode is used as a candidate PU partition mode.
  • the PU is a basic unit of prediction, and one CU may include one or more PUs, and the maximum size of the PU is the size of the CU.
  • the distribution of TU (Transform Unit) of the residual block with different texture characteristics presents a certain rule: when the texture of the residual block is more complex and the motion vector changes more severely, the TU selects the large size as the best segmentation. The possibility is very small; conversely, when the texture of the residual block is simpler, the TU always chooses a larger segmentation. Therefore, the process of optimizing the transform unit partitioning manner by the server may be: analyzing the texture of the residual block in the TU decision algorithm, and if the texture is simple, the TU partitioning is terminated early, and the optimization can greatly reduce the encoding and decoding time.
  • the TU is a basic unit of transform and quantization.
  • a CU may include one or more TUs.
  • the TU also adopts a quad-tree recursive partition structure, which is larger than the PU but does not exceed the size of the CU.
  • the process of optimizing the intra prediction direction selection mode by the server may be: predicting possible partitioning of the current block according to the division condition of the coded block adjacent to the current to-be-coded area, and removing unnecessary coding unit size and prediction mode decision process. .
  • This optimization can effectively reduce the computational complexity of codec and greatly improve the efficiency of codec operation while ensuring that the coding quality and compression efficiency are basically unchanged.
  • the coding efficiency can be improved when the layered picture encoder encodes the layered picture, and the layered picture decoder can also be used to decode the layered layer. Improve the decoding efficiency when the picture is used.
  • S503 Perform assembly optimization and code structure optimization on the layered picture decoder according to the corresponding operating system information.
  • the server may further perform assembly optimization and code structure optimization on the layered picture decoder according to the corresponding operating system information, that is, a layered picture decoder corresponding to different operating system information, performing different assembly optimization and code structure optimization.
  • the specific process of assembly optimization and code structure optimization may be: setting a storage space selection optimization rule in a layered picture decoder, and the storage space selection optimization rule includes a rule for setting a register to a highest priority temporary storage space, and the register is divided into points.
  • the calculation optimization rule includes converting the loop logic of the matrix operation into a rule based on the vector instruction set, the vector instruction The set is associated with the operating system information corresponding to the layered picture decoder. Therefore, when the user terminal decodes using the layered picture decoder provided with the storage space selection optimization rule and the calculation optimization rule, the register corresponding to the operating system of the user terminal can be used as the temporary storage space as much as possible, and The vector operation instruction corresponding to the operating system of the user terminal is used for decoding calculation, so that the decoding speed can be effectively improved.
  • the vector operation instruction may include a vector data load instruction, a vector data interleave instruction, a vector data exchange instruction, and a vector data storage instruction.
  • the server can also perform assembly optimization on the layered picture encoder, and the assembly optimization of the layered picture encoder is similar to the assembly optimization of the layered picture decoder.
  • the layered picture decoder may include Entropy Decoding, IQ/ IDCT (Inverse Quantization/Inverse Discrete Cosine Transform), Deblocking Filter (Deblocking Filter Processing), Intra Prediction (Intra Prediction), Intra/Inter Mode Selection (Intra/Inter Mode Selection), SAO filtering (Sample Adaptive Offset Filtering), Motion Compensation (MC, motion compensation), picture buffering (picture buffer).
  • Entropy Decoding can be used to read picture data and parse out the data structure, which can include macroblock type, motion vector, reference frame, residual, etc.
  • IQ/IDCT can be used for entropy decoded data. Transform to obtain the value of the spatial domain; Deblocking Filter can be used to filter the data; Intra Prediction can be used to calculate the intra prediction; Intra/Inter Mode Selection can be used to select the corresponding intra prediction and inter prediction The mode can be used to reduce the sampling distortion of the image and increase the sharpness of the image; the Motion Compensation can be used to perform motion compensation processing on the subsequent frame image based on the existing frame image data, and optimize the subsequently decoded image.
  • picture buffering can refer to the decoded image buffer. Among them, as the image decoding progresses, new image generation will continue to occur.
  • the decoded image can be placed in the picture buffering, and when the image is output and displayed, the image data can be extracted from the picture buffering in order.
  • the Intra Prediction ie, the calculation of the intra prediction
  • the calculation of the Intra/Inter Mode Selection is performed according to the intra predicted data and the image data in the picture buffering.
  • the Entropy Decoding processing may be performed on the base layer picture data, and other decoding processes are performed in the layered picture decoder to generate the decoded base layer picture data, and further, the decoded base layer picture data is put into the picture.
  • Buffering and simultaneously output the decoded base layer picture data to the mobile phone screen for display; after subsequently decoding the enhancement layer picture data, the decoded enhancement layer picture data and the decoded base layer picture in picture buffering may be decoded.
  • the data is merged, and the decoded base layer picture data in the mobile phone screen is replaced with the merged picture data.
  • the assembly optimization performed on the layered picture decoder may specifically refer to a module called high frequency (such as Entropy Decoding, IQ/IDCT, Deblocking Filter, Intra Prediction, Intra/Inter Mode Selection, SAO filtering, Motion Compensation, etc.). ) Perform in-depth assembly optimization.
  • high frequency such as Entropy Decoding, IQ/IDCT, Deblocking Filter, Intra Prediction, Intra/Inter Mode Selection, SAO filtering, Motion Compensation, etc.
  • the embodiment of the present application can optimize the prediction mode of the layered picture decoder and the layered picture encoder to effectively improve the encoding and decoding speed; and further optimize the layered picture decoder for assembly optimization and code structure, so that In the process of decoding, the register corresponding to the operating system of the user terminal is used as the temporary storage space as much as possible, and the vector operation instruction corresponding to the operating system of the user terminal can be used as much as possible for decoding calculation, thereby further improving the decoding speed. .
  • FIG. 7 is a schematic flowchart diagram of an image data processing method according to an embodiment of the present application, where the method may include:
  • S702. Receive a layered picture decoder that is sent by the server and that matches operating system information of the user terminal.
  • the received original picture is decoded by an original decoder, and the decoded original picture is displayed.
  • S708 Receive base layer picture data in the target layered picture sent by the server, and decode the base layer picture data by using a layered picture decoder, and display the decoded base layer picture data. .
  • S709 Receive enhancement layer picture data in the target layered picture sent by the server, and decode the enhancement layer picture data by using the layered picture decoder, and decode the enhanced layer picture data with The decoded base layer picture data is synthesized, and the synthesized picture data is displayed.
  • the steps S701-S710 describe all the operations on the user terminal side.
  • the steps S701-S710 refer to the detailed description of the user terminal in S401-S415 in the corresponding embodiment of FIG. 4, which is not performed here. Narration.
  • the embodiment of the present application obtains a request to the server by sending a first layered picture carrying the size information of the display area, so that the server selects a target layered picture that matches the size information according to the first layered picture acquisition request, and then the sending server sends the target layered picture.
  • the target layer layer image data in the layered picture, and through the layered picture decoder decodes the base layer picture data, and displays the decoded base layer picture data, and receives the target layered picture sent by the server.
  • the enhancement layer picture data, and the enhancement layer picture data is decoded by the layered picture decoder, and the decoded enhancement layer picture data is combined with the decoded base layer picture data, and the synthesized picture data is displayed.
  • the base layer picture data can be obtained relatively quickly, so that the display area can display the content of the base layer picture data first, and the picture display area is prevented from being blank for a long time. Further receiving the enhancement layer picture data, and synthesizing the enhancement layer picture data and the base layer picture data to obtain a picture with higher quality, thereby improving the picture display effect.
  • FIG. 8 is a schematic flowchart diagram of another image data processing method according to an embodiment of the present disclosure, where the method may include:
  • the decoded original picture data is encoded into a layered picture of at least one resolution by a layered picture encoder; each layered picture includes base layer picture data and at least one enhancement layer picture data.
  • the server decodes the original picture by using a layered picture decoder corresponding to the operating system information of the server, and obtains original picture data that can support the layered picture format, that is, the decoded original picture data, and the server passes the
  • the layered picture encoder corresponding to the operating system of the server encodes the decoded original picture data to generate a layered picture of multiple resolutions.
  • the layered picture decoder and the layered picture encoder are both coded and decoded based on the video coding standard H.265.
  • the decoder acquisition request carries operating system information of the user terminal.
  • the size information of the display area of the user terminal carried by the first layer image acquisition request is selected to match the size information.
  • Target layered image If the first layer image acquisition request sent by the user terminal is received, the size information of the display area of the user terminal carried by the first layer image acquisition request is selected to match the size information. Target layered image.
  • the server may also indicate that the server has reached a preset protocol with the user terminal, and the preset protocol may refer to a protocol that the user terminal may request an adaptive layered picture. .
  • the second layer picture acquisition request is sent by the user terminal when detecting that the size information does not satisfy the layered picture adaptation condition; the original picture acquisition request is performed by the user terminal And detecting, when the layered picture format is not supported, the first layered picture acquisition request is sent by the user terminal when detecting that the size information satisfies a layered picture adaptation condition.
  • the steps S501-S503 in the foregoing embodiment of FIG. 5 may also be performed.
  • the embodiment of the present application obtains a request to the server by sending a first layered picture carrying the size information of the display area, so that the server selects a target layered picture that matches the size information according to the first layered picture acquisition request, and then the sending server sends the target layered picture.
  • the target layer layer image data in the layered picture, and through the layered picture decoder decodes the base layer picture data, and displays the decoded base layer picture data, and receives the target layered picture sent by the server.
  • the enhancement layer picture data, and the enhancement layer picture data is decoded by the layered picture decoder, and the decoded enhancement layer picture data is combined with the decoded base layer picture data, and the synthesized picture data is displayed.
  • the base layer picture data can be obtained relatively quickly, so that the display area can display the content of the base layer picture data first, and the picture display area is prevented from being blank for a long time. Further receiving the enhancement layer picture data, and synthesizing the enhancement layer picture data and the base layer picture data to obtain a picture with higher quality, thereby improving the picture display effect.
  • the assembly optimization and code structure optimization of the layered picture decoder corresponding to each operating system information by the server can enable the user terminal of various operating systems to use the optimized layered picture decoder to improve layering. The decoding efficiency of the picture decoder.
  • FIG. 9 is a schematic structural diagram of a user terminal according to an embodiment of the present application.
  • the user terminal 1 may include: a sending module 11, a receiving module 12, and a decoding display module 13;
  • the sending module 11 is configured to send a first layered picture obtaining request that carries size information of the display area to the server, so that the server selects the matching with the size information according to the first layered picture obtaining request.
  • Target layered picture
  • the receiving module 12 is configured to receive base layer picture data in the target layered picture sent by the server;
  • the decoding display module 13 is configured to decode the base layer image data by using a layered picture decoder, and display the decoded base layer picture data;
  • the receiving module 12 is further configured to receive enhancement layer picture data in the target layered picture sent by the server;
  • the decoding display module 13 is further configured to decode the enhancement layer picture data by using the layered picture decoder, and synthesize the decoded enhancement layer picture data and the decoded base layer picture data, And display the synthesized picture data.
  • the sending module 11 is further configured to acquire operating system information of the user terminal, and send a decoder acquiring the operating system information of the user terminal to the server, so that the server is configured according to the decoder. Obtaining a request to find a layered picture decoder that matches operating system information of the user terminal;
  • the receiving module 12 is further configured to receive a layered picture decoder that is sent by the server and that matches operating system information of the user terminal.
  • the user terminal 1 may further include: a first determining module 14 and a second determining module 15, and a notification module 16;
  • the first determining module 14 is configured to acquire size information of the display area, and determine whether the size information satisfies a layered picture adaptive condition;
  • the sending module 11 is further configured to: if the first determining module 14 determines that the first determining module 14 is not satisfied, send a second layered picture obtaining request to the server, so that the server obtains according to the second layered picture. Requesting to sequentially send base layer picture data and enhancement layer picture data in a layered picture having the largest resolution;
  • the notification module 16 is configured to notify the sending module 11 to send a first layered picture acquisition request carrying size information of the display area to the server, if the first determining module 14 determines that the content is satisfied.
  • the second determining module 15 is configured to determine whether a layered picture format is supported.
  • the sending module 11 is further configured to: if the second determining module 15 determines that it is not supported, send an original picture obtaining request to the server, so that the server returns an original picture according to the original picture obtaining request;
  • the decoding display module 13 is further configured to decode the received original picture by using an original decoder, and display the decoded original picture;
  • the notification module 16 is further configured to notify the first determining module 14 to obtain size information of the display area, and determine whether the size information satisfies the layered picture adaptation. condition.
  • FIG. 4 is a detailed description of the user terminal in S401-S415 in the embodiment, and details are not described herein again.
  • the embodiment of the present application obtains a request to the server by sending a first layered picture carrying the size information of the display area, so that the server selects a target layered picture that matches the size information according to the first layered picture acquisition request, and then the sending server sends the target layered picture.
  • the target layer layer image data in the layered picture, and through the layered picture decoder decodes the base layer picture data, and displays the decoded base layer picture data, and receives the target layered picture sent by the server.
  • the enhancement layer picture data, and the enhancement layer picture data is decoded by the layered picture decoder, and the decoded enhancement layer picture data is combined with the decoded base layer picture data, and the synthesized picture data is displayed.
  • the base layer picture data can be obtained relatively quickly, so that the display area can display the content of the base layer picture data first, and the picture display area is prevented from being blank for a long time. Further receiving the enhancement layer picture data, and synthesizing the enhancement layer picture data and the base layer picture data to obtain a picture with higher quality, thereby improving the picture display effect.
  • FIG. 10 is a schematic structural diagram of another server according to an embodiment of the present application.
  • the server 2 may include: a selection module 21, a sending module 22;
  • the selecting module 21 is configured to select, according to the size information of the display area of the user terminal that is carried by the first layered picture acquisition request, if the first layer image acquisition request sent by the user terminal is received a target layered picture in which the size information matches;
  • the sending module 22 is configured to send the base layer picture data in the target layered picture to the user terminal, so that the user terminal decodes the base layer picture data by using a layered picture decoder. And displaying the decoded base layer picture data;
  • the sending module 22 is further configured to send the enhancement layer picture data in the target layered picture to the user terminal, so that the user terminal performs the enhancement layer picture data by using the layered picture decoder. Decoding, and synthesizing the decoded enhancement layer picture data with the decoded base layer picture data, and displaying the synthesized picture data.
  • the selecting module 21 is further configured to: when receiving the second layered image obtaining request sent by the user, selecting, according to the second layered image obtaining request, a plurality of layered pictures of different resolutions a layered picture with maximum resolution;
  • the sending module 22 is further configured to sequentially send the base layer picture data and the enhancement layer picture data in the layered picture with the maximum resolution to the user terminal;
  • the sending module 22 is further configured to: if the original image obtaining request sent by the user is received, send the original image to the user terminal according to the original image obtaining request;
  • the second layer picture acquisition request is sent by the user terminal when detecting that the size information does not satisfy the layered picture adaptation condition; the original picture acquisition request is performed by the user terminal And detecting, when the layered picture format is not supported, the first layered picture acquisition request is sent by the user terminal when detecting that the size information satisfies a layered picture adaptation condition.
  • the server 2 may further include: a receiving module 25, a decoder searching module 26, a decoding module 23, an encoding module 24, a decoder setting module 27, a first optimization setting module 28, and a second optimization.
  • the receiving module 25 is configured to receive a decoder acquisition request sent by the user terminal, where the decoder acquisition request carries operating system information of the user terminal;
  • the decoder search module 26 is configured to search for a layered picture decoder that matches the operating system information of the user terminal according to the decoder acquisition request, and search the operating system of the user terminal A layered picture decoder that matches the information is sent to the user terminal.
  • the decoding module 23 is configured to obtain an original picture, and decode the original picture by using a layered picture decoder that matches operating system information of the server, to obtain decoded original picture data;
  • the encoding module 24 is configured to encode the decoded original picture data into a layered picture of at least one resolution by using a layered picture encoder; each layered picture includes base layer picture data and at least one enhancement layer Image data.
  • the decoder setting module 27 is configured to set a layered picture decoder corresponding to at least one operating system information respectively;
  • the first optimization setting module 28 is configured to optimize a prediction manner in the layered picture decoder and the layered picture encoder; the prediction manner includes a coding unit division manner, a prediction unit division manner, and a transformation unit division. Mode, intra prediction direction selection mode;
  • the second optimization setting module 29 is configured to perform assembly optimization and code structure optimization on the layered picture decoder according to the corresponding operating system information.
  • the specific function implementation manners of the selection module 21, the sending module 22, the receiving module 25, the decoder searching module 26, the decoding module 23, and the encoding module 24 can be referred to the foregoing FIG. A detailed description of the server in S401-S415 in the embodiment is not described herein again.
  • the specific function implementation manners of the decoder setting module 27, the first optimization setting module 28, and the second optimization setting module 29, refer to S501-S503 in the corresponding embodiment of FIG. 5, and details are not described herein.
  • the second optimization setting module 29 may include: a first rule setting unit 291 and a second rule setting unit 292;
  • the first rule setting unit 291 is configured to set a storage space selection optimization rule in the layered picture decoder, where the storage space selection optimization rule includes a rule for setting a register as a highest priority temporary storage space.
  • the register is associated with operating system information corresponding to the layered picture decoder;
  • the second rule setting unit 292 is configured to set a calculation optimization rule in the layered picture decoder, where the calculation optimization rule includes converting a loop logic of the matrix operation into a rule based on a vector instruction set, where The vector instruction set is associated with operating system information corresponding to the layered picture decoder.
  • the selection module 21 may include: an extracting unit 211, a searching unit 212, and a determining unit 213;
  • the extracting unit 211 is configured to: if the first layered image obtaining request sent by the user terminal is received, extract the size information of the display area of the user terminal that is carried by the first hierarchical image acquiring request;
  • the searching unit 212 is configured to search, in a plurality of layered pictures of different resolutions, at least one layered picture whose pixel width is greater than a picture width in the size information, as at least one layered picture to be selected;
  • the determining unit 213 is configured to determine a layered picture of the lowest resolution in the at least one layer to be selected as a target layered picture that matches the size information.
  • the embodiment of the present application obtains a request to the server by sending a first layered picture carrying the size information of the display area, so that the server selects a target layered picture that matches the size information according to the first layered picture acquisition request, and then the sending server sends the target layered picture.
  • the target layer layer image data in the layered picture, and through the layered picture decoder decodes the base layer picture data, and displays the decoded base layer picture data, and receives the target layered picture sent by the server.
  • the enhancement layer picture data, and the enhancement layer picture data is decoded by the layered picture decoder, and the decoded enhancement layer picture data is combined with the decoded base layer picture data, and the synthesized picture data is displayed.
  • the base layer picture data can be obtained relatively quickly, so that the display area can display the content of the base layer picture data first, and the picture display area is prevented from being blank for a long time. Further receiving the enhancement layer picture data, and synthesizing the enhancement layer picture data and the base layer picture data to obtain a picture with higher quality, thereby improving the picture display effect.
  • the assembly optimization and code structure optimization of the layered picture decoder corresponding to each operating system information by the server can enable the user terminal of various operating systems to use the optimized layered picture decoder to improve layering. The decoding efficiency of the picture decoder.
  • FIG. 11 is a schematic structural diagram of a user terminal according to an embodiment of the present disclosure.
  • the user terminal 1000 may be applied to the user terminal 100 in the foregoing embodiment of FIG.
  • the processor 1001, the memory 1005, and the network interface 1004, further include the user interface 1003 and at least one communication bus 1002.
  • the communication bus 1002 is used to implement connection communication between these components.
  • the optional user interface 1003 can include a standard wired interface and a wireless interface.
  • the network interface 1004 can optionally include a standard wired interface, a wireless interface (such as a WI-FI interface).
  • the memory 1005 may be a high speed RAM memory or a non-volatile memory such as at least one disk memory.
  • the memory 1005 can also optionally be at least one storage device located remotely from the aforementioned processor 1001. As shown in FIG. 11, an operating system, a network communication module, a user interface module, and a device control application may be included in the memory 1005 as a computer storage medium.
  • the network interface 1004 can provide a network communication function, and the network interface 1004 can be connected to the server; and the user interface 1003 is mainly used to provide an input interface for the user; the memory 1005 stores a computer.
  • the processor 1001 executes the following steps:
  • the processor 1001 when the computer readable instructions are executed by the processor 1001, the processor 1001 can also perform the following steps:
  • the processor 1001 when the computer readable instructions are executed by the processor 1001, the processor 1001 can also perform the following steps:
  • the step of transmitting the first hierarchical picture acquisition request carrying the size information of the display area to the server is performed.
  • the processor 1001 when the computer readable instructions are executed by the processor 1001, the processor 1001 can also perform the following steps:
  • the step of acquiring the size information of the display area is performed.
  • the embodiment of the present application obtains a request to the server by sending a first layered picture carrying the size information of the display area, so that the server selects a target layered picture that matches the size information according to the first layered picture acquisition request, and then the sending server sends the target layered picture.
  • the target layer layer image data in the layered picture, and through the layered picture decoder decodes the base layer picture data, and displays the decoded base layer picture data, and receives the target layered picture sent by the server.
  • the enhancement layer picture data, and the enhancement layer picture data is decoded by the layered picture decoder, and the decoded enhancement layer picture data is combined with the decoded base layer picture data, and the synthesized picture data is displayed.
  • the base layer picture data can be obtained relatively quickly, so that the display area can display the content of the base layer picture data first, and the picture display area is prevented from being blank for a long time. Further receiving the enhancement layer picture data, and synthesizing the enhancement layer picture data and the base layer picture data to obtain a picture with higher quality, thereby improving the picture display effect.
  • FIG. 12 is a schematic structural diagram of a server provided by an embodiment of the present application.
  • the server 2000 can be applied to a server, which can include all the functions of the server 100 and the server 200 in the above-described embodiment of FIG.
  • the server 2000 may include a processor 2001, a network interface 2003, and a memory 2004. Further, the server 2000 may further include: at least one communication bus 2002. Among them, the communication bus 2002 is used to implement connection communication between these components.
  • the network interface 2003 can optionally include a standard wired interface, a wireless interface (such as a WI-FI interface).
  • the memory 2004 may be a high speed RAM memory or a non-volatile memory such as at least one disk memory.
  • the memory 2004 can optionally also be at least one storage device located remotely from the aforementioned processor 2001. As shown in FIG. 12, an operating system, a network communication module, a user interface module, and a device control application may be included in the memory 2004 as a computer storage medium.
  • the network interface 2003 is for communicating with a user terminal; computer readable instructions stored in the memory 2004, when the computer readable instructions are executed by the processor 2001, cause the processor 2001 to execute the following step:
  • the computer readable instructions are executed by the processor 2001, if receiving the first layered picture acquisition request sent by the user terminal, according to the first layered picture acquisition request, the user terminal
  • the processor 2001 is specifically configured to perform the following steps:
  • the size information of the display area of the user terminal carried by the first layer image acquisition request is extracted;
  • the layered picture of the lowest resolution in the at least one layer to be selected is determined as the target layered picture that matches the size information.
  • the processor 2001 when the computer readable instructions are executed by the processor 2001, the processor 2001 can also perform the following steps:
  • the second layered picture acquisition request sent by the user is received, selecting a layered picture having a maximum resolution in a plurality of layered pictures of different resolutions according to the second layered picture acquisition request, and sequentially Transmitting the base layer picture data and the enhancement layer picture data in the layered picture with the maximum resolution to the user terminal;
  • the second layer picture acquisition request is sent by the user terminal when detecting that the size information does not satisfy the layered picture adaptation condition; the original picture acquisition request is performed by the user terminal And detecting, when the layered picture format is not supported, the first layered picture acquisition request is sent by the user terminal when detecting that the size information satisfies a layered picture adaptation condition.
  • the processor 2001 when the computer readable instructions are executed by the processor 2001, the processor 2001 can also perform the following steps:
  • the decoder acquiring request carries operating system information of the user terminal
  • the processor 2001 when the computer readable instructions are executed by the processor 2001, the processor 2001 can also perform the following steps:
  • the decoded original picture data is encoded into a layered picture of at least one resolution by a layered picture encoder; each layered picture includes base layer picture data and at least one enhancement layer picture data.
  • the processor 2001 when the computer readable instructions are executed by the processor 2001, the processor 2001 can also perform the following steps:
  • the prediction mode includes a coding unit division manner, a prediction unit division manner, a transformation unit division manner, and an intra prediction direction selection manner;
  • the layered picture decoder is subjected to assembly optimization and code structure optimization according to the corresponding operating system information.
  • the computer readable instructions are caused by the processor 2001 to perform the step of performing assembly optimization and code structure optimization on the layered picture decoder according to the corresponding operating system information, such that the processor 2001 Specifically perform the following steps:
  • the storage space selection optimization rule including a rule of setting a register as a highest priority temporary storage space, the register being the hierarchical picture decoder Corresponding to the operating system information;
  • the calculation optimization rule comprising converting a loop logic of the matrix operation into a rule based on a vector instruction set, the vector instruction set being decoded with the layered picture
  • the operating system information corresponding to the device is associated with it.
  • the embodiment of the present application obtains a request to the server by sending a first layered picture carrying the size information of the display area, so that the server selects a target layered picture that matches the size information according to the first layered picture acquisition request, and then the sending server sends the target layered picture.
  • the target layer layer image data in the layered picture, and through the layered picture decoder decodes the base layer picture data, and displays the decoded base layer picture data, and receives the target layered picture sent by the server.
  • the enhancement layer picture data, and the enhancement layer picture data is decoded by the layered picture decoder, and the decoded enhancement layer picture data is combined with the decoded base layer picture data, and the synthesized picture data is displayed.
  • the base layer picture data can be obtained relatively quickly, so that the display area can display the content of the base layer picture data first, and the picture display area is prevented from being blank for a long time. Further receiving the enhancement layer picture data, and synthesizing the enhancement layer picture data and the base layer picture data to obtain a picture with higher quality, thereby improving the picture display effect.
  • the assembly optimization and code structure optimization of the layered picture decoder corresponding to each operating system information by the server can enable the user terminal of various operating systems to use the optimized layered picture decoder to improve layering. The decoding efficiency of the picture decoder.
  • the embodiment of the present application further provides a computer storage medium, and the computer storage medium stores computer readable instructions executed by the user terminal mentioned above, and the computer readable
  • the instructions include program instructions, and when the processor executes the program instructions, the description of the image data processing method in the embodiment corresponding to FIG. 7 can be performed, and therefore, no further description is made herein.
  • the description of the beneficial effects of the same method will not be repeated.
  • the embodiment of the present application further provides another computer storage medium, and the computer storage medium stores computer readable instructions executed by the foregoing mentioned server, and the computer readable
  • the instructions include program instructions, and when the processor executes the program instructions, the description of the image data processing method in the embodiment corresponding to FIG. 8 can be performed, and thus, no further description is made herein.
  • the description of the beneficial effects of the same method will not be repeated.
  • the embodiment of the computer storage medium involved in the present application refer to the description of the method embodiment of the present application.
  • Non-volatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory.
  • Volatile memory can include random access memory (RAM) or external cache memory.
  • RAM is available in a variety of formats, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronization chain.
  • SRAM static RAM
  • DRAM dynamic RAM
  • SDRAM synchronous DRAM
  • DDRSDRAM double data rate SDRAM
  • ESDRAM enhanced SDRAM
  • Synchlink DRAM SLDRAM
  • Memory Bus Radbus
  • RDRAM Direct RAM
  • DRAM Direct Memory Bus Dynamic RAM
  • RDRAM Memory Bus Dynamic RAM

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

一种图像数据处理方法，包括：发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器，以使服务器根据第一分层图片获取请求选择与尺寸信息相匹配的目标分层图片；接收服务器发送的目标分层图片中的基础层图片数据，并通过分层图片解码器，对基础层图片数据进行解码，并对解码后的基础层图片数据进行显示；接收服务器发送的目标分层图片中的增强层图片数据，并通过分层图片解码器对增强层图片数据进行解码，并将解码后的增强层图片数据与解码后的基础层图片数据进行合成，并显示所合成出的图片数据。

Description

一种图像数据处理方法、用户终端、服务器和存储介质
本申请要求于2017年09月13日提交中国专利局，申请号为2017108240666，发明名称为“一种图像数据处理方法以及装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及互联网技术领域，尤其涉及一种图像数据处理方法、用户终端、服务器和存储介质。
背景技术
随着移动互联网的发展，终端设备的下载流量大幅增长，用户下载流量中，图片流量占据很大占比。大量的图片也给网络传输带宽负载带来了很大的压力。因此，若用户在网络状态不是很稳定的情况下，下载质量较高的图片，则会导致图片数据传输时间过长，进而导致用户终端的图片显示区域长时间处于空白状态。虽然通过下载质量较低的图片，可以解决图片数据传输时间过长的问题，但是质量较低的图片可能会导致图片内容过于模糊，严重影响显示效果。
发明内容
根据本申请的各种实施例，提供一种图像数据处理方法、用户终端、服务器和存储介质。
一种图像数据处理方法，执行于用户终端，所述方法包括：
发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器，以使所述服务器根据所述第一分层图片获取请求选择与所述尺寸信息相匹配的目标分层图片；
接收所述服务器发送的所述目标分层图片中的基础层图片数据，并通过分层图片解码器，对所述基础层图片数据进行解码，并对解码后的基础层图片数据进行显示；
接收所述服务器发送的所述目标分层图片中的增强层图片数据，并通过所 述分层图片解码器对所述增强层图片数据进行解码，并将解码后的增强层图片数据与所述解码后的基础层图片数据进行合成，并显示所合成出的图片数据。
一种用户终端，所述终端包括：处理器、存储器以及网络接口；
所述处理器与存储器、网络接口相连，其中，网络接口用于连接服务器，所述存储器用于存储计算机可读指令，所述计算机可读指令被所述处理器执行时，使得所述处理器执行以下步骤
发送携带显示区域的尺寸信息的第一分层图片获取请求到所述服务器，以使所述服务器根据所述第一分层图片获取请求选择与所述尺寸信息相匹配的目标分层图片；
接收所述服务器发送的所述目标分层图片中的基础层图片数据，并通过分层图片解码器，对所述基础层图片数据进行解码，并对解码后的基础层图片数据进行显示；
接收所述服务器发送的所述目标分层图片中的增强层图片数据，并通过所述分层图片解码器对所述增强层图片数据进行解码，并将解码后的增强层图片数据与所述解码后的基础层图片数据进行合成，并显示所合成出的图片数据。
一种计算机存储介质，所述计算机存储介质存储有计算机可读指令，所述程序指令被一个或多个处理器执行时，使得所述一个或多个处理器执行图像数据处理方法的步骤。
一种图像数据处理方法，执行于服务器，所述方法包括：
若接收到用户终端发送的第一分层图片获取请求，则根据所述第一分层图片获取请求所携带的所述用户终端的显示区域的尺寸信息选择与所述尺寸信息相匹配的目标分层图片；
发送所述目标分层图片中的基础层图片数据到所述用户终端，以使所述用户终端通过分层图片解码器，对所述基础层图片数据进行解码，并对解码后的基础层图片数据进行显示；
发送所述目标分层图片中的增强层图片数据到所述用户终端，以使所述用户终端通过所述分层图片解码器对所述增强层图片数据进行解码，并将解码后的增强层图片数据与所述解码后的基础层图片数据进行合成，并显示所合成出的图片数据。
一种服务器，包括：处理器、存储器以及网络接口；
所述处理器与存储器、网络接口相连，其中，网络接口用于连接用户终端，所述存储器用于存储计算机可读指令，所述计算机可读指令被所述处理器执行时，使得所述处理器执行以下步骤：
若接收到所述用户终端发送的第一分层图片获取请求，则根据所述第一分层图片获取请求所携带的所述用户终端的显示区域的尺寸信息选择与所述尺寸信息相匹配的目标分层图片；
发送所述目标分层图片中的基础层图片数据到所述用户终端，以使所述用户终端通过分层图片解码器，对所述基础层图片数据进行解码，并对解码后的基础层图片数据进行显示；
发送所述目标分层图片中的增强层图片数据到所述用户终端，以使所述用户终端通过所述分层图片解码器对所述增强层图片数据进行解码，并将解码后的增强层图片数据与所述解码后的基础层图片数据进行合成，并显示所合成出的图片数据。
一种计算机存储介质，所述计算机存储介质存储有计算机可读指令，所述程序指令被一个或多个处理器执行时，使得所述一个或多个处理器执行图像数据处理方法的步骤。
一种图像数据处理系统，所述系统包括：用户终端和服务器；
所述用户终端用于发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器；
所述服务器用于根据所述第一分层图片获取请求选择与所述尺寸信息相匹配的目标分层图片，并发送所述目标分层图片中的基础层图片数据到所述用户终端；
所述用户终端还用于通过分层图片解码器，对所述基础层图片数据进行解码，并对解码后的基础层图片数据进行显示；
所述服务器还用于发送所述目标分层图片中的增强层图片数据到所述用户终端；
所述用户终端还用于通过所述分层图片解码器对所述增强层图片数据进行解码，并将解码后的增强层图片数据与所述解码后的基础层图片数据进行合成， 并显示所合成出的图片数据。
本申请的一个或多个实施例的细节在下面的附图和描述中提出。本申请的其它特征和优点将从说明书、附图以及权利要求书变得明显。
附图说明
为了更清楚地说明本申请实施例中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本申请实施例提供的一种网络架构的示意图；
图2是本申请实施例提供的一种图像数据处理方法的时序示意图；
图3a是本申请实施例提供的一种用户终端的图片显示示意图；
图3b是本申请实施例提供的另一种用户终端的图片显示示意图；
图3c是本申请实施例提供的又一种用户终端的图片显示示意图；
图4是本申请实施例提供的另一种图像数据处理方法的时序示意图；
图5是本申请实施例提供的一种解码器的优化方法的流程示意图；
图6是本申请实施例提供的一种分层图片解码器的结构示意图；
图7是本申请实施例提供的一种图像数据处理方法的流程示意图；
图8是本申请实施例提供的另一种图像数据处理方法的流程示意图；
图9是本申请实施例提供的一种用户终端的结构示意图；
图10是本申请实施例提供的一种服务器的结构示意图；
图11是本申请实施例提供的一种用户终端的结构示意图；
图12是本申请实施例提供的一种服务器的结构示意图。
具体实施方式
为了使本申请的目的、技术方案及优点更加清楚明白，以下结合附图及实施例，对本申请进行进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本申请，并不用于限定本申请。
请参见图1，是本申请实施例提供的一种网络架构的示意图。如图1所示，该网络架构可以包括：服务器100、服务器200以及多个用户终端300。服务器 100可以通过互联网分别与多个用户终端300进行网络连接，服务器200也可以通过互联网分别与多个用户终端300进行网络连接。其中，由图1可知，多个用户终端300可以包括计算机、平板电脑、智能手机、笔记本电脑、掌上电脑、数字电视以及移动互联网设备(MID)等终端设备，或者可以为终端设备中的客户端。其中，服务器100可以用于设置多种操作系统分别对应的分层图片解码器，并将所设置的多种分层图片解码器上线，使得多个用户终端300可以通过服务器100获取到与各自操作系统相匹配的分层图片解码器。其中，服务器200可以将原始图片编码为多个不同分辨率的分层图片，并在某用户终端300请求获取分层图片时，服务器200可以根据该用户终端300中的显示区域的尺寸信息选择相应分辨率的分层图片，并先发送所选择的分层图片中的基础层图片数据，使得该用户终端300可以先通过从服务器100获取到的分层图片解码器解码基础层图片数据，进而该用户终端300可以先显示质量较低的基础层图片数据，以避免图片显示区域长时间处于空白状态；随后服务器200可以继续发送所选择的分层图片中的增强层图片数据，使得该用户终端300通过从服务器100获取到的分层图片解码器解码增强层图片数据，并将解码后的增强层图片数据与解码后的基础层图片数据进行合成，得到质量较高的图片，并显示该质量较高的图片，以提高图片显示效果。
其中，分层图片可以包括基础层图片数据和至少一个增强层图片数据，基础层图片数据是指可以大致显示图片内容的低质量图片数据，即基础层图片数据的数据量较小，使得可以较快将基础层图片数据传输至用户终端300，增强层图片数据可以是指高质量图片数据与基础层图片数据之间的差量，因此，通过叠加增强层图片数据和基础层图片数据可以得到更高质量的图片数据。当有多个增强层图片数据时，每叠加一个增强层图片数据，就会使图片的质量上升一个层次，即图片的显示是从模糊到清晰的一个渐变过程。其中，分层图片解码器是可以用于对分层图片进行解码的一种解码器，即分层图片解码器可以对基础层图片数据进行解码，也可以对增强层图片数据进行解码，也可以对增强层图片数据和基础层图片数据进行合成。
可选的，图1中的服务器100和服务器200可以合并为同一个服务器，即服务器100和服务器200分别所执行的功能可以在同一个服务器上实现。
请参见图2，是本申请实施例提供的一种图像数据处理方法的时序示意图， 该方法可以包括：
S201，用户终端发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器。
具体的，在S201步骤之前，用户终端可以先向服务器发送携带用户终端的操作系统信息的解码器获取请求，使得服务器可以根据解码器获取请求查找与用户终端的操作系统信息相匹配的分层图片解码器，进而服务器可以将所查找出的分层图片解码器发送到用户终端。其中，操作系统信息可以包括微软系统信息、苹果系统信息、安卓系统信息等其他操作系统信息中的任意一种。由此可见，服务器可以预先设置与多种操作系统分别对应的分层图片解码器，其中，服务器可以包括上述图1对应实施例中的服务器100和服务器200分别所具备的功能。可选的，服务器还可以对分层图片解码器进行汇编优化和代码结构优化，当用户终端在使用优化后的分层图片解码器进行解码时，该优化后的分层图片解码器将会尽量多的采用该用户终端的操作系统所对应的寄存器作为临时存储空间，且该优化后的分层图片解码器将会尽量多的采用该用户终端的操作系统所对应的向量运算指令进行解码计算。因此，通过针对不同的操作系统进行不同的汇编优化和代码结构优化，可以使得各种操作系统的用户终端均可以使用到优化后的分层图片解码器，以提高分层图片解码器的解码效率。
进一步的，用户终端获取到相应的分层图片解码器后，还可以进一步检测显示区域的尺寸信息，并发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器，以请求相应的分层图片；其中，分层图片也可以称之为X5图片。
S202，服务器根据第一分层图片获取请求选择与尺寸信息相匹配的目标分层图片。
具体的，服务器获取到第一分层图片获取请求后，可以提取第一分层图片获取请求中的用户终端的显示区域的尺寸信息，并在预设的多个不同分辨率的分层图片中，查找像素宽度大于尺寸信息中的图片宽度的至少一个分层图片，将查找到的至少一个分层图片作为至少一个待选择分层图片，并将至少一个待选择分层图片中的最低分辨率的分层图片确定为与尺寸信息相匹配的目标分层图片。其中，服务器可以预先将某原始图片编码为多种分辨率的分层图片，而目标分层图片即为其中一种分辨率的分层图片。其中，尺寸信息可以是用户终端的显示区域的宽度，服务器可以将多种分辨率的分层图片中的像素宽度大于 尺寸信息的分层图片，以及与尺寸信息的数值相邻的分层图片确定为目标分层图片。例如，某个原始图片对应有3种分辨率的分层图片，分别为810像素宽度的分层图片、610像素宽度的分层图片、410像素宽度的分层图片，若尺寸信息为800像素宽度，则将为810像素宽度的分层图片确定为目标分层图片；若尺寸信息为600像素宽度，则将为610像素宽度的分层图片确定为目标分层图片；若尺寸信息为400像素宽度，则将为410像素宽度的分层图片确定为目标分层图片。
其中，服务器预先将某原始图片编码为多种分辨率的分层图片的具体过程可以为：服务器通过与服务器的操作系统信息相对应的分层图片解码器对该原始图片进行解码，得到可以支持分层图片格式的原始图片数据，即解码后的原始图片数据，服务器再通过与服务器的操作系统相对应的分层图片编码器对解码后的原始图片数据进行编码，生成多种分辨率的分层图片。其中，分层图片解码器和分层图片编码器均是基于视频编码标准H.265进行编解码。
S203，服务器发送目标分层图片中的基础层图片数据到用户终端。
具体的，服务器在选择出目标分层图片后，可以先将目标分层图片中的基础层图片数据发送到用户终端，其中，由于基础层图片数据的数据量比较小(即图片内容的锯齿比较明显)，所以传输基础层图片数据的时长会比较短，使得用户可以较快的在用户终端的显示区域上显示基础层图片数据，避免显示区域长时间处于空白状态。
S204，用户终端通过分层图片解码器，对基础层图片数据进行解码，并对解码后的基础层图片数据进行显示。
具体的，用户终端在接收到基础层图片数据后，可以通过所获取到的分层图片解码器对基础层图片数据进行解码。由于分层图片解码器在服务器侧有进行汇编优化和代码结构优化，所以用户终端在使用该分层图片解码器进行解码的过程中，可以尽量多的采用用户终端的操作系统所对应的寄存器作为临时存储空间，且还可以尽量多的采用用户终端的操作系统所对应的向量运算指令进行解码计算，从而可以有效提高解码速度。
用户终端在解码完基础层图片数据后，即可直接将所解码出的基础层图片数据放入显示区域进行显示。由于基础层图片数据的数据量比较小(即图片内容的锯齿比较明显)，所以传输基础层图片数据的时长会比较短，使得用户可以 较快的在用户终端的显示区域上显示基础层图片数据，避免显示区域长时间处于空白状态。
S205，服务器发送目标分层图片中的增强层图片数据到用户终端。
具体的，服务器在发送完目标分层图片中的基础层图片数据后，即可继续发送目标分层图片中的增强层图片数据到用户终端。或者，用户终端在接收到基础层图片数据后，可以返回确认接收指令到服务器，使得服务器根据确认接收指令触发执行增强层图片数据的发送操作。由于增强层图片数据为高质量图片数据与基础层图片数据之间的差值，所以增强层图片数据的数据量也较小，从而也可以同样缩短传输增强层图片数据的传输时间。
S206，用户终端通过分层图片解码器对增强层图片数据进行解码，并将解码后的增强层图片数据与解码后的基础层图片数据进行合成，并显示所合成出的图片数据。
具体的，用户终端接收到增强层图片数据后，可以通过分层图片解码器对增强层图片数据进行解码，在解码过程中同样可以多采用用户终端的操作系统对应的寄存器和向量运算指令进行解码，以提高解码速度。用户终端在解码出增强层图片数据后，可以将解码后的增强层图片数据与解码后的基础层图片数据进行合成，并显示所合成出的图片数据，所合成出的图片数据的清晰度要高于基础层图片数据的清晰度。
可选的，若服务器侧中的目标分层图片中的增强层图片数据的数量大于1，则服务器可以在发送完第一个增强层图片数据后，继续发送下一个增强层图片数据到用户终端，使得用户终端继续将第二个增强层图片数据与已显示的图片进行合成，得到更加清晰的合成图片，以此类推，服务器可以依次发送完各增强层图片数据，而用户终端可以依次将各增强层图片数据合成到已显示的图片中，使得用户终端的显示区域中所显示的图片呈逐渐清晰的变化趋势。
进一步的，请一并参见图3a-图3c，是本申请实施例提供的一种用户终端的图片显示示意图。如图3a所示，用户终端400的显示区域500所显示的图片为目标分层图片中的基础层图片数据600，从图3a可知，基础层图片数据600的显示效果具有较明显的锯齿现象，其中，目标分层图片的分辨率为310*250，且目标分层图片包括一个基础层图片数据600以及两个增强层图片数据，则显示区域500所显示的基础层图片数据600的分辨率也为310*250。服务器发送完 基础层图片数据600后，可以继续发送其中一个增强层图片数据到用户终端400，用户终端400对该增强层图片数据解码后，可以将解码后的增强层图片数据与已显示的基础层图片数据600进行合成，得到如图3b所示的合成图片700，并将图3a中的基础层图片数据600更新为合成图片700，即得到图3b所示的显示区域500中所显示的合成图片700，其中，合成图片700的分辨率也为310*250，但合成图片700的清晰度高于基础层图片数据600。服务器发送完其中一个增强层图片数据后，可以继续发送另一个增强层图片数据到用户终端400，用户终端400对该增强层图片数据解码后，可以将解码后的增强层图片数据与已显示的合成图片700进行合成，得到如图3c所示的最终图片800，并将图3b中的合成图片700更新为最终图片800，即得到图3c所示的显示区域500中所显示的最终图片800，其中，最终图片800的分辨率也为310*250，但最终图片800的清晰度高于合成图片700。由此可见，在显示区域500中，图片的清晰度是呈逐渐清晰的渐变过程，即显示区域500中所显示的图片是从基础层图片数据600变为合成图片700，再变为最终图片800。
本申请实施例通过发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器，以使服务器根据第一分层图片获取请求选择与尺寸信息相匹配的目标分层图片，再接收服务器发送的目标分层图片中的基础层图片数据，并通过分层图片解码器，对基础层图片数据进行解码，并对解码后的基础层图片数据进行显示，并接收服务器发送的目标分层图片中的增强层图片数据，并通过分层图片解码器对增强层图片数据进行解码，并将解码后的增强层图片数据与解码后的基础层图片数据进行合成，并显示所合成出的图片数据。由此可见，尽管在网络状态不稳定的情况下，依然可以较快获取到基础层图片数据，使得显示区域可以先显示基础层图片数据的内容，避免图片显示区域长时间处于空白状态，后续可以进一步接收增强层图片数据，并对增强层图片数据和基础层图片数据进行合成，得到质量较高的图片，从而可以提高图片显示效果。而且通过服务器对各操作系统信息分别对应的分层图片解码器进行汇编优化和代码结构优化，可以使得各种操作系统的用户终端均可以使用到优化后的分层图片解码器，以提高分层图片解码器的解码效率。
请参见图4，是本申请实施例提供的另一种图像数据处理方法的时序示意图，该方法可以包括：
S401，用户终端获取用户终端的操作系统信息，并发送携带用户终端的操作系统信息的解码器获取请求到服务器。
具体的，用户终端启动可用于显示图片的应用程序后，可以进一步获取用户终端的操作系统信息，并发送携带用户终端的操作系统信息的解码器获取请求到服务器；其中，操作系统信息可以包括微软系统信息、苹果系统信息、安卓系统信息等其他操作系统信息中的任意一种。
S402，服务器根据解码器获取请求查找与用户终端的操作系统信息相匹配的分层图片解码器，并发送与用户终端的操作系统信息相匹配的分层图片解码器到用户终端。
具体的，服务器根据解码器获取请求查找与用户终端的操作系统信息相匹配的分层图片解码器，并发送与用户终端的操作系统信息相匹配的分层图片解码器到用户终端。由此可见，服务器可以预先设置与多种操作系统分别对应的分层图片解码器，其中，服务器可以包括上述图1对应实施例中的服务器100和服务器200分别所具备的功能。可选的，服务器还可以对分层图片解码器进行汇编优化和代码结构优化，当用户终端在使用优化后的分层图片解码器进行解码时，该优化后的分层图片解码器将会尽量多的采用该用户终端的操作系统所对应的寄存器作为临时存储空间，且该优化后的分层图片解码器将会尽量多的采用该用户终端的操作系统所对应的向量运算指令进行解码计算。因此，通过针对不同的操作系统进行不同的汇编优化和代码结构优化，可以使得各种操作系统的用户终端均可以使用到优化后的分层图片解码器，以提高分层图片解码器的解码效率。
S403，用户终端判断是否支持分层图片格式；
具体的，用户终端获取到分层图片解码器后，可以进一步判断用户终端是否支持分层图片格式，即判断用户终端是否能够通过分层图片解码器解码分层图片。其中，分层图片格式可以是包括基础层图片数据和至少一个增强层图片数据的图片格式，即一个分层图片可以包括基础层图片数据和至少一个增强层图片数据，基础层图片数据是指可以大致显示图片内容的低质量图片数据，增强层图片数据可以是指高质量图片数据与基础层图片数据之间的差量。
可选的，用户终端也可以在S401步骤之前，就先判断该用户终端是否支持分层图片格式，若判断为支持，则再执行S401-S402，并继续执行S407之后的 步骤；若判断为不支持，则直接执行S404-S406的步骤。因此，本申请实施例并不对S403步骤的执行顺序进行限制。
S404，若判断为不支持，则用户终端发送原始图片获取请求到服务器。
具体的，若S403判断为不支持，则用户终端可以进一步发送原始图片获取请求到服务器。
S405，服务器根据原始图片获取请求返回原始图片。
具体的，服务器根据原始图片获取请求返回原始图片，进一步的，服务器还可以根据原始图片获取请求发送原始解码器到用户终端。或者，服务器可以在发送分层图片解码器到用户终端的同时，一并发送原始解码器到用户终端。或者，用户终端自身携带原始解码器，因此，服务器可以无需发送原始解码器到用户终端。其中，原始解码器是指可以用于解码PNG(Portable Network Graphics，便携式网络图形)、JPEG(Joint Photographic Experts Group，联合图像专家小组)、GIF(Graphics Interchange Format，图像互换格式)等格式的图片的解码器。
S406，用户终端通过原始解码器对所接收到的原始图片进行解码，并显示解码后的原始图片。
具体的，用户终端获取到原始图片和原始解码器后，即可通过原始解码器对所接收到的原始图片进行解码，并将解码后的原始图片显示到显示区域上。
S407，若判断为支持，则用户终端获取显示区域的尺寸信息，并判断尺寸信息是否满足分层图片自适应条件。
具体的，若S403判断为支持，即用户终端可以对分层图片进行解码，则用户终端可以进一步获取显示区域的尺寸信息，并判断尺寸信息是否满足分层图片自适应条件。其中，判断是否满足分层图片自适应条件的具体过程可以是：检测尺寸信息是否大于预设的尺寸阈值，若大于，则可以确定尺寸信息满足分层图片自适应条件，否则，确定尺寸信息不满足分层图片自适应条件，且跳转到S414-S415的步骤。
可选的，在判断尺寸信息是否满足分层图片自适应条件之前，还可以检测用户终端是否已配置自适应协议，若检测为未配置自适应协议，则可以直接执行S414-S415的步骤；若检测为已配置自适应协议，则可以执行判断尺寸信息是否满足分层图片自适应条件的步骤。其中，自适应协议可以指同时在用户终 端和服务器之间共同部署的协议，配置有自适应协议的用户终端可以触发执行判断尺寸信息是否满足分层图片自适应条件的步骤，进而触发S408的步骤；而配置有自适应协议的服务器可以对S408步骤中的第一分层图片获取请求进行识别和响应，进而触发S409的步骤。
S408，若判断为满足自适应条件，则用户终端发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器。
S409，服务器根据第一分层图片获取请求选择与尺寸信息相匹配的目标分层图片。
S410，服务器发送目标分层图片中的基础层图片数据到用户终端。
S411，用户终端通过分层图片解码器，对基础层图片数据进行解码，并对解码后的基础层图片数据进行显示。
S412，服务器发送目标分层图片中的增强层图片数据到用户终端。
S413，用户终端通过分层图片解码器对增强层图片数据进行解码，并将解码后的增强层图片数据与解码后的基础层图片数据进行合成，并显示所合成出的图片数据；
其中，S408-S413步骤的具体实现方式可以参见上述图2对应实施例中的S201-S206，这里不再进行赘述。
S414，若判断为不满足自适应条件，则用户终端发送第二分层图片获取请求到服务器。
具体的，若S407判断出尺寸信息不满足自适应条件，或用户终端检测出未配置自适应协议，则用户终端可以进一步发送第二分层图片获取请求到服务器，该第二分层图片获取请求未携带尺寸信息。
S415，服务器根据第二分层图片获取请求依次发送具有最大分辨率的分层图片中的基础层图片数据和增强层图片数据。
具体的，服务器可以根据第二分层图片获取请求，在预设的多种分辨率的分层图片中获取具有最大分辨率的分层图片，并发送具有最大分辨率的分层图片中的基础层图片数据到用户终端，使得用户终端对其进行解码和显示；服务器在发送完最大分辨率的分层图片中的基础层图片数据后，可以继续发送具有最大分辨率的分层图片中的增强层图片数据到用户终端，使得用户终端对该增强层图片数据进行解码，并将解码后的该增强层图片数据与已显示的基础层图 片数据进行合成，以显示出最终的高质量图片。其中，用户终端对具有最大分辨率的分层图片中的基础层图片数据和增强层图片数据的解码和显示的具体过程均可以参见S408-S413步骤。
本申请实施例通过发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器，以使服务器根据第一分层图片获取请求选择与尺寸信息相匹配的目标分层图片，再接收服务器发送的目标分层图片中的基础层图片数据，并通过分层图片解码器，对基础层图片数据进行解码，并对解码后的基础层图片数据进行显示，并接收服务器发送的目标分层图片中的增强层图片数据，并通过分层图片解码器对增强层图片数据进行解码，并将解码后的增强层图片数据与解码后的基础层图片数据进行合成，并显示所合成出的图片数据。由此可见，尽管在网络状态不稳定的情况下，依然可以较快获取到基础层图片数据，使得显示区域可以先显示基础层图片数据的内容，避免图片显示区域长时间处于空白状态，后续可以进一步接收增强层图片数据，并对增强层图片数据和基础层图片数据进行合成，得到质量较高的图片，从而可以提高图片显示效果。而且通过服务器对各操作系统信息分别对应的分层图片解码器进行汇编优化和代码结构优化，可以使得各种操作系统的用户终端均可以使用到优化后的分层图片解码器，以提高分层图片解码器的解码效率。
进一步的，再请一并参见图5，是本申请实施例提供的一种解码器的优化方法的流程示意图，方法可以在上述图2对应实施例的S201之前执行，或者可以在上述图4对应实施例的S401之前执行，方法可以包括：
S501，设置与至少一种操作系统信息分别对应的分层图片解码器；
具体的，服务器可以预先设置与至少一种操作系统信息分别对应的分层图片解码器。服务器还可以预先设置与服务器的操作系统对应的分层图片编码器，以便于服务器可以通过分层图片编码器将原始图片预先编码为多种分辨率的分层图片。
S502，对分层图片解码器和预设的分层图片编码器中的预测方式进行优化；预测方式包括编码单元划分方式、预测单元划分方式、变换单元划分方式、帧内预测方向选择方式。
具体的，服务器可以进一步对各分层图片解码器和预设的分层图片编码器中的预测方式进行优化，其中，预测方式包括编码单元划分方式、预测单元划 分方式、变换单元划分方式、帧内预测方向选择方式。
其中，服务器对编码单元划分方式进行优化的过程可以为：利用在时间和空间相关的编码单元的深度信息来快速判断当前CU(Coding Unit，编码单元)最佳编码尺寸，该优化提取前一帧相同位置以及当前帧的周围的CU的深度信息，缩小CU划分的判定区间，来对当前CU划分深度进行预测，提高CU划分深度的预测速度，以避免不必要的计算，降低计算复杂度。
其中，服务器对预测单元划分方式进行优化的过程可以为：在CU层进行率失真优化之前，获取并分析影响PU(Prediction Unit，预测单元)模式选择的主要因素，从而选择出概率最高的几种模式作为候选PU划分模式。其中，PU是预测的基本单元，一个CU可包含一个或多个PU，PU最大尺寸是CU的尺寸。
其中，对于不同纹理特性的残差块的TU(Transform Unit，预测单元)分布呈现出一定的规律：当残差块的纹理较复杂，运动矢量变化较剧烈时，TU选择大尺寸为最佳分割的可能性非常小；反之，当残差块的纹理较简单时，TU总是选择较大的分割。因此，服务器对变换单元划分方式进行优化的过程可以为：在TU决策算法中，对残差块的纹理进行分析，若纹理较简单，提前终止TU的分割，该优化能够大幅降低编解码时间。其中，TU是变换和量化的基本单元，一个CU可包含一个或多个TU，TU同样采用四叉树型的递归划分结构，可比PU大，但不超过CU的大小。
其中，服务器对帧内预测方向选择方式进行优化的过程可以为：根据与当前待编码区域相邻的已编码块的划分情况预测当前块的可能划分，去除不必要编码单元尺寸和预测模式决策过程。该优化在保证编码质量和压缩效率基本不变的情况下，能有效降低编解码计算复杂度，大幅提升编解码运算效率。
由此可见，通过对分层图片解码器和分层图片编码器的预测方式进行优化，可以在分层图片编码器编码分层图片时提高编码效率，也可以在分层图片解码器解码分层图片时提高解码效率。
S503，根据所对应的操作系统信息对分层图片解码器进行汇编优化和代码结构优化。
具体的，服务器还可以根据所对应的操作系统信息对分层图片解码器进行汇编优化和代码结构优化，即不同的操作系统信息对应的分层图片解码器，进行不同的汇编优化和代码结构优化。汇编优化和代码结构优化的具体过程可以 为：在分层图片解码器中设置存储空间选择优化规则，存储空间选择优化规则包括将寄存器设置为最高优先级的临时存储空间的规则，寄存器是与分层图片解码器所对应的操作系统信息相关联的；并在分层图片解码器中设置计算优化规则，计算优化规则包括将矩阵运算的循环逻辑转换成基于向量指令集进行运算的规则，向量指令集是与分层图片解码器所对应的操作系统信息相关联的。因此，用户终端在使用设置有存储空间选择优化规则和计算优化规则的分层图片解码器进行解码时，可以尽量多的采用用户终端的操作系统所对应的寄存器作为临时存储空间，且还可以尽量多的采用用户终端的操作系统所对应的向量运算指令进行解码计算，从而可以有效提高解码速度。其中，向量运算指令可以包括向量数据装载指令、向量数据交错指令、向量数据交换指令和向量数据存储指令。
可选的，服务器也可以对分层图片编码器进行汇编优化，对分层图片编码器进行的汇编优化与对分层图片解码器进行的汇编优化的方式是相类似的。
进一步的，请一并参见图6，是本申请实施例提供的一种分层图片解码器的结构示意图，如图6所示，分层图片解码器可以包括Entropy Decoding(熵解码)、IQ/IDCT(Inverse Quantization/Inverse Discrete Cosine Transform，反量化/离散余弦变换)、Deblocking Filter(去块滤波处理)、Intra Prediction(帧内预测)、Intra/Inter Mode Selection(帧内/帧间模式选择)、SAO filtering(Sample Adaptive Offset Filtering，样点自适应补偿滤波)、Motion Compensation(MC，运动补偿)、picture buffering(图片缓冲)。其中，Entropy Decoding可以用于读取图片数据，并解析出数据结构，该数据结构可以包括宏块类型、运动矢量、参考帧、残差等等；IQ/IDCT可以用于对熵解码后的数据进行变换以得到空间域的值；Deblocking Filter可以用于对数据进行滤波处理；Intra Prediction可以用于进行帧内预测的计算；Intra/Inter Mode Selection可以用于选择对应的帧内预测和帧间预测的模式；SAO filtering可以用于降低图像的取样失真，增加图像的清晰度；Motion Compensation可以用于基于已有的帧图像数据对后续的帧图像做运动补偿处理，优化后续解码的图像。其中，picture buffering可以指解码后的图像缓冲区。其中，随着图像解码的进行，会不断有新的图像生成，因此，可以将已解码图像放到picture buffering中，进而在图像输出显示的时候，可以按照先后顺序从picture buffering中提取图像数据，以在手机屏幕 渲染输出。其中，在进行图像解码时可以先做Intra Prediction(即帧内预测的计算)，然后再根据帧内预测的数据、和picture buffering中的图像数据，进行Intra/Inter Mode Selection的计算。例如，可以先对基础层图片数据进行Entropy Decoding处理，并在分层图片解码器中进行其他的解码处理，以生成解码后的基础层图片数据，进一步将解码后的基础层图片数据放入picture buffering中，并同时将解码后的基础层图片数据输出到手机屏幕进行显示；在后续解码出增强层图片数据后，可以将解码后的增强层图片数据与picture buffering中的解码后的基础层图片数据进行合并，并将手机屏幕中的解码后的基础层图片数据替换为合并后的图片数据。
其中，对分层图片解码器所进行的汇编优化可以具体指对高频次调用的模块(诸如Entropy Decoding、IQ/IDCT、Deblocking Filter、Intra Prediction、Intra/Inter Mode Selection、SAO filtering、Motion Compensation等)进行深度的汇编优化。
本申请实施例通过对分层图片解码器和分层图片编码器的预测方式进行优化，可以有效提高编解码速度；而且再进一步对分层图片解码器进行汇编优化和代码结构优化，使得可以在解码的过程中尽量多的采用用户终端的操作系统所对应的寄存器作为临时存储空间，且还可以尽量多的采用用户终端的操作系统所对应的向量运算指令进行解码计算，从而可以进一步提高解码速度。
请参见图7，是本申请实施例提供的一种图像数据处理方法的流程示意图，所述方法可以包括：
S701，获取用户终端的操作系统信息，并发送携带所述用户终端的操作系统信息的解码器获取请求到所述服务器，以使所述服务器根据所述解码器获取请求查找与所述用户终端的操作系统信息相匹配的分层图片解码器。
S702，接收所述服务器发送的与所述用户终端的操作系统信息相匹配的分层图片解码器。
S703，判断是否支持分层图片格式。
S704，若判断为不支持，则发送原始图片获取请求到所述服务器，以使所述服务器根据所述原始图片获取请求返回原始图片。
S705，通过原始解码器对所接收到的所述原始图片进行解码，并显示解码后的原始图片。
S706，若判断为支持，获取显示区域的尺寸信息，并判断所述尺寸信息是 否满足分层图片自适应条件。
S707，若判断为满足，则发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器，以使所述服务器根据所述第一分层图片获取请求选择与所述尺寸信息相匹配的目标分层图片。
S708，接收所述服务器发送的所述目标分层图片中的基础层图片数据，并通过分层图片解码器，对所述基础层图片数据进行解码，并对解码后的基础层图片数据进行显示。
S709，接收所述服务器发送的所述目标分层图片中的增强层图片数据，并通过所述分层图片解码器对所述增强层图片数据进行解码，并将解码后的增强层图片数据与所述解码后的基础层图片数据进行合成，并显示所合成出的图片数据。
S710，若判断为不满足，则发送第二分层图片获取请求到所述服务器，以使所述服务器根据所述第二分层图片获取请求依次发送具有最大分辨率的分层图片中的基础层图片数据和增强层图片数据。
其中，S701-S710步骤描述的是用户终端一侧的所有操作，S701-S710步骤的具体实现方式可以参见上述图4对应实施例中的S401-S415中对用户终端的具体描述，这里不再进行赘述。
本申请实施例通过发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器，以使服务器根据第一分层图片获取请求选择与尺寸信息相匹配的目标分层图片，再接收服务器发送的目标分层图片中的基础层图片数据，并通过分层图片解码器，对基础层图片数据进行解码，并对解码后的基础层图片数据进行显示，并接收服务器发送的目标分层图片中的增强层图片数据，并通过分层图片解码器对增强层图片数据进行解码，并将解码后的增强层图片数据与解码后的基础层图片数据进行合成，并显示所合成出的图片数据。由此可见，尽管在网络状态不稳定的情况下，依然可以较快获取到基础层图片数据，使得显示区域可以先显示基础层图片数据的内容，避免图片显示区域长时间处于空白状态，后续可以进一步接收增强层图片数据，并对增强层图片数据和基础层图片数据进行合成，得到质量较高的图片，从而可以提高图片显示效果。
请参见图8，是本申请实施例提供的另一种图像数据处理方法的流程示意图，所述方法可以包括：
S801，获取原始图片，通过与服务器的操作系统信息相匹配的分层图片解码器对所述原始图片进行解码，得到解码后的原始图片数据。
S802，通过分层图片编码器将所述解码后的原始图片数据编码为至少一种分辨率的分层图片；各分层图片均包括基础层图片数据和至少一个增强层图片数据。
具体的，服务器通过与服务器的操作系统信息相对应的分层图片解码器对该原始图片进行解码，得到可以支持分层图片格式的原始图片数据，即解码后的原始图片数据，服务器再通过与服务器的操作系统相对应的分层图片编码器对解码后的原始图片数据进行编码，生成多种分辨率的分层图片。其中，分层图片解码器和分层图片编码器均是基于视频编码标准H.265进行编解码。
S803，接收所述用户终端发送的解码器获取请求；所述解码器获取请求携带所述用户终端的操作系统信息。
S804，根据所述解码器获取请求查找与所述用户终端的操作系统信息相匹配的分层图片解码器，并将所查找出的与所述用户终端的操作系统信息相匹配的分层图片解码器发送至所述用户终端。
S805，若接收到用户终端发送的第一分层图片获取请求，则根据所述第一分层图片获取请求所携带的所述用户终端的显示区域的尺寸信息选择与所述尺寸信息相匹配的目标分层图片。
其中，若服务器接收到用户终端发送的第一分层图片获取请求，则也可以说明服务器已与用户终端达成预设协议，该预设协议可以指用户终端可以请求自适应的分层图片的协议。
S806，发送所述目标分层图片中的基础层图片数据到所述用户终端，以使所述用户终端通过分层图片解码器，对所述基础层图片数据进行解码，并对解码后的基础层图片数据进行显示。
S807，发送所述目标分层图片中的增强层图片数据到所述用户终端，以使所述用户终端通过所述分层图片解码器对所述增强层图片数据进行解码，并将解码后的增强层图片数据与所述解码后的基础层图片数据进行合成，并显示所合成出的图片数据。
S808，若接收到所述用户发送的第二分层图片获取请求，则根据所述第二分层图片获取请求在多个不同分辨率的分层图片中选择具有最大分辨率的分层 图片，并依次发送所述具有最大分辨率的分层图片中的基础层图片数据和增强层图片数据到所述用户终端。
S809，若接收到所述用户发送的原始图片获取请求，则根据所述原始图片获取请求发送原始图片到所述用户终端。
其中，所述第二分层图片获取请求是由所述用户终端在检测到所述尺寸信息不满足分层图片自适应条件时所发送的；所述原始图片获取请求是由所述用户终端在检测到不支持分层图片格式时所发送的；所述第一分层图片获取请求是由所述用户终端在检测到所述尺寸信息满足分层图片自适应条件时所发送的。
其中，S803-S809步骤的具体实现方式可以参见上述图4对应实施例中的S401-S415中对服务器的具体描述，这里不再进行赘述。
可选的，在S801的步骤之前，还可以执行上述图5对应实施例中的S501-S503步骤。
本申请实施例通过发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器，以使服务器根据第一分层图片获取请求选择与尺寸信息相匹配的目标分层图片，再接收服务器发送的目标分层图片中的基础层图片数据，并通过分层图片解码器，对基础层图片数据进行解码，并对解码后的基础层图片数据进行显示，并接收服务器发送的目标分层图片中的增强层图片数据，并通过分层图片解码器对增强层图片数据进行解码，并将解码后的增强层图片数据与解码后的基础层图片数据进行合成，并显示所合成出的图片数据。由此可见，尽管在网络状态不稳定的情况下，依然可以较快获取到基础层图片数据，使得显示区域可以先显示基础层图片数据的内容，避免图片显示区域长时间处于空白状态，后续可以进一步接收增强层图片数据，并对增强层图片数据和基础层图片数据进行合成，得到质量较高的图片，从而可以提高图片显示效果。而且通过服务器对各操作系统信息分别对应的分层图片解码器进行汇编优化和代码结构优化，可以使得各种操作系统的用户终端均可以使用到优化后的分层图片解码器，以提高分层图片解码器的解码效率。
请参见图9，是本申请实施例提供的一种用户终端的结构示意图，下述每个模块可全部或部分通过软件、硬件或其组合实现。该用户终端1可以包括：发送模块11、接收模块12、解码显示模块13；
所述发送模块11，用于发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器，以使所述服务器根据所述第一分层图片获取请求选择与所述尺寸信息相匹配的目标分层图片；
所述接收模块12，用于接收所述服务器发送的所述目标分层图片中的基础层图片数据；
所述解码显示模块13，用于通过分层图片解码器，对所述基础层图片数据进行解码，并对解码后的基础层图片数据进行显示；
所述接收模块12，还用于接收所述服务器发送的所述目标分层图片中的增强层图片数据；
所述解码显示模块13，还用于通过所述分层图片解码器对所述增强层图片数据进行解码，并将解码后的增强层图片数据与所述解码后的基础层图片数据进行合成，并显示所合成出的图片数据。
其中，所述发送模块11，还用于获取用户终端的操作系统信息，并发送携带所述用户终端的操作系统信息的解码器获取请求到所述服务器，以使所述服务器根据所述解码器获取请求查找与所述用户终端的操作系统信息相匹配的分层图片解码器；
所述接收模块12，还用于接收所述服务器发送的与所述用户终端的操作系统信息相匹配的分层图片解码器。
进一步的，如图9所示，该用户终端1还可以包括：第一判断模块14和第二判断模块15、通知模块16；
所述第一判断模块14，用于获取显示区域的尺寸信息，并判断所述尺寸信息是否满足分层图片自适应条件；
所述发送模块11，还用于若所述第一判断模块14判断为不满足，则发送第二分层图片获取请求到所述服务器，以使所述服务器根据所述第二分层图片获取请求依次发送具有最大分辨率的分层图片中的基础层图片数据和增强层图片数据；
所述通知模块16，用于若所述第一判断模块14判断为满足，则通知所述发送模块11发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器。
所述第二判断模块15，用于判断是否支持分层图片格式；
所述发送模块11，还用于若所述第二判断模块15判断为不支持，则发送原 始图片获取请求到所述服务器，以使所述服务器根据所述原始图片获取请求返回原始图片；
所述解码显示模块13，还用于通过原始解码器对所接收到的所述原始图片进行解码，并显示解码后的原始图片；
所述通知模块16，还用于若所述第二判断模块15判断为支持，则通知所述第一判断模块14获取显示区域的尺寸信息，并判断所述尺寸信息是否满足分层图片自适应条件。
其中，所述发送模块11、所述接收模块12、所述解码显示模块13、所述第一判断模块14、所述第二判断模块15、所述通知模块16的具体功能实现方式可以参见上述图4对应实施例中的S401-S415中对用户终端的具体描述，这里不再进行赘述。
本申请实施例通过发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器，以使服务器根据第一分层图片获取请求选择与尺寸信息相匹配的目标分层图片，再接收服务器发送的目标分层图片中的基础层图片数据，并通过分层图片解码器，对基础层图片数据进行解码，并对解码后的基础层图片数据进行显示，并接收服务器发送的目标分层图片中的增强层图片数据，并通过分层图片解码器对增强层图片数据进行解码，并将解码后的增强层图片数据与解码后的基础层图片数据进行合成，并显示所合成出的图片数据。由此可见，尽管在网络状态不稳定的情况下，依然可以较快获取到基础层图片数据，使得显示区域可以先显示基础层图片数据的内容，避免图片显示区域长时间处于空白状态，后续可以进一步接收增强层图片数据，并对增强层图片数据和基础层图片数据进行合成，得到质量较高的图片，从而可以提高图片显示效果。
请参见图10，是本申请实施例提供的另一种服务器的结构示意图，下述每个模块可全部或部分通过软件、硬件或其组合实现。该服务器2可以包括：选择模块21、发送模块22；
所述选择模块21，用于若接收到用户终端发送的第一分层图片获取请求，则根据所述第一分层图片获取请求所携带的所述用户终端的显示区域的尺寸信息选择与所述尺寸信息相匹配的目标分层图片；
所述发送模块22，用于发送所述目标分层图片中的基础层图片数据到所述用户终端，以使所述用户终端通过分层图片解码器，对所述基础层图片数据进 行解码，并对解码后的基础层图片数据进行显示；
所述发送模块22，还用于发送所述目标分层图片中的增强层图片数据到所述用户终端，以使所述用户终端通过所述分层图片解码器对所述增强层图片数据进行解码，并将解码后的增强层图片数据与所述解码后的基础层图片数据进行合成，并显示所合成出的图片数据。
其中，所述选择模块21，还用于若接收到所述用户发送的第二分层图片获取请求，则根据所述第二分层图片获取请求在多个不同分辨率的分层图片中选择具有最大分辨率的分层图片；
所述发送模块22，还用于依次发送所述具有最大分辨率的分层图片中的基础层图片数据和增强层图片数据到所述用户终端；
所述发送模块22，还用于若接收到所述用户发送的原始图片获取请求，则根据所述原始图片获取请求发送原始图片到所述用户终端；
其中，所述第二分层图片获取请求是由所述用户终端在检测到所述尺寸信息不满足分层图片自适应条件时所发送的；所述原始图片获取请求是由所述用户终端在检测到不支持分层图片格式时所发送的；所述第一分层图片获取请求是由所述用户终端在检测到所述尺寸信息满足分层图片自适应条件时所发送的。
进一步的，如图10所示，该服务器2还可以包括：接收模块25、解码器查找模块26、解码模块23、编码模块24、解码器设置模块27、第一优化设置模块28、第二优化设置模块29；
所述接收模块25，用于接收所述用户终端发送的解码器获取请求；所述解码器获取请求携带所述用户终端的操作系统信息；
所述解码器查找模块26，用于根据所述解码器获取请求查找与所述用户终端的操作系统信息相匹配的分层图片解码器，并将所查找出的与所述用户终端的操作系统信息相匹配的分层图片解码器发送至所述用户终端。
所述解码模块23，用于获取原始图片，通过与服务器的操作系统信息相匹配的分层图片解码器对所述原始图片进行解码，得到解码后的原始图片数据；
所述编码模块24，用于通过分层图片编码器将所述解码后的原始图片数据编码为至少一种分辨率的分层图片；各分层图片均包括基础层图片数据和至少一个增强层图片数据。
所述解码器设置模块27，用于设置与至少一种操作系统信息分别对应的分层图片解码器；
所述第一优化设置模块28，用于对所述分层图片解码器和分层图片编码器中的预测方式进行优化；所述预测方式包括编码单元划分方式、预测单元划分方式、变换单元划分方式、帧内预测方向选择方式；
所述第二优化设置模块29，用于根据所对应的操作系统信息对所述分层图片解码器进行汇编优化和代码结构优化。
其中，所述选择模块21、所述发送模块22、所述接收模块25、所述解码器查找模块26、所述解码模块23以及所述编码模块24的具体功能实现方式可以参见上述图4对应实施例中的S401-S415中对服务器的具体描述，这里不再进行赘述。所述解码器设置模块27、所述第一优化设置模块28以及所述第二优化设置模块29的具体功能实现方式可以参见上述图5对应实施例中的S501-S503，这里不再进行赘述。
进一步的，如图10所示，所述第二优化设置模块29可以包括：第一规则设置单元291、第二规则设置单元292；
所述第一规则设置单元291，用于在所述分层图片解码器中设置存储空间选择优化规则，所述存储空间选择优化规则包括将寄存器设置为最高优先级的临时存储空间的规则，所述寄存器是与所述分层图片解码器所对应的操作系统信息相关联的；
所述第二规则设置单元292，用于在所述分层图片解码器中设置计算优化规则，所述计算优化规则包括将矩阵运算的循环逻辑转换成基于向量指令集进行运算的规则，所述向量指令集是与所述分层图片解码器所对应的操作系统信息相关联的。
其中，第一规则设置单元291、第二规则设置单元292的具体功能实现方式可以参见上述图5对应实施例中的S503，这里不再进行赘述。
进一步的，如图10所示，所述选择模块21可以包括：提取单元211、查找单元212、确定单元213；
所述提取单元211，用于若接收到用户终端发送的第一分层图片获取请求，则提取所述第一分层图片获取请求所携带的所述用户终端的显示区域的尺寸信息；
所述查找单元212，用于在多个不同分辨率的分层图片中，查找像素宽度大于所述尺寸信息中的图片宽度的至少一个分层图片，作为至少一个待选择分层图片；
所述确定单元213，用于将所述至少一个待选择分层图片中的最低分辨率的分层图片确定为与所述尺寸信息相匹配的目标分层图片。
其中，所述提取单元211、所述查找单元212以及所述确定单元213的具体功能实现方式可以参见上述图2对应实施例中的S202，这里不再进行赘述。
本申请实施例通过发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器，以使服务器根据第一分层图片获取请求选择与尺寸信息相匹配的目标分层图片，再接收服务器发送的目标分层图片中的基础层图片数据，并通过分层图片解码器，对基础层图片数据进行解码，并对解码后的基础层图片数据进行显示，并接收服务器发送的目标分层图片中的增强层图片数据，并通过分层图片解码器对增强层图片数据进行解码，并将解码后的增强层图片数据与解码后的基础层图片数据进行合成，并显示所合成出的图片数据。由此可见，尽管在网络状态不稳定的情况下，依然可以较快获取到基础层图片数据，使得显示区域可以先显示基础层图片数据的内容，避免图片显示区域长时间处于空白状态，后续可以进一步接收增强层图片数据，并对增强层图片数据和基础层图片数据进行合成，得到质量较高的图片，从而可以提高图片显示效果。而且通过服务器对各操作系统信息分别对应的分层图片解码器进行汇编优化和代码结构优化，可以使得各种操作系统的用户终端均可以使用到优化后的分层图片解码器，以提高分层图片解码器的解码效率。
请参见图11，是本申请实施例提供的用户终端的结构示意图，如图11所示，所述用户终端1000可以应用于上述图1对应实施例中的用户终端100，所述用户终端1000可以包括：处理器1001、存储器1005、网络接口1004，此外，所述用户终端1000还可以包括：用户接口1003，和至少一个通信总线1002。其中，通信总线1002用于实现这些组件之间的连接通信。其中，可选用户接口1003可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1005可以是高速RAM存储器，也可以是非不稳定的存储器(non-volatile memory)，例如至少一个磁盘存储器。存储器1005可选的还可以是至少一个位于远离前述处理器1001的存储装置。如 图11所示，作为一种计算机存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及设备控制应用程序。
在图11所示的用户终端1000中，网络接口1004可提供网络通讯功能，且网络接口1004可以与服务器连接；而用户接口1003主要用于为用户提供输入的接口；存储器1005中存储有计算机可读指令，计算机可读指令被所述处理器1001执行时，使得处理器1001执行以下步骤：
发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器，以使所述服务器根据所述第一分层图片获取请求选择与所述尺寸信息相匹配的目标分层图片；
接收所述服务器发送的所述目标分层图片中的基础层图片数据，并通过分层图片解码器，对所述基础层图片数据进行解码，并对解码后的基础层图片数据进行显示；
接收所述服务器发送的所述目标分层图片中的增强层图片数据，并通过所述分层图片解码器对所述增强层图片数据进行解码，并将解码后的增强层图片数据与所述解码后的基础层图片数据进行合成，并显示所合成出的图片数据。
在一个实施例中，计算机可读指令被处理器1001执行时，使得处理器1001还可以执行以下步骤：
获取用户终端的操作系统信息，并发送携带所述用户终端的操作系统信息的解码器获取请求到所述服务器，以使所述服务器根据所述解码器获取请求查找与所述用户终端的操作系统信息相匹配的分层图片解码器；
接收所述服务器发送的与所述用户终端的操作系统信息相匹配的分层图片解码器。
在一个实施例中，计算机可读指令被处理器1001时，使得处理器1001还可以执行以下步骤：
获取显示区域的尺寸信息，并判断所述尺寸信息是否满足分层图片自适应条件；
若判断为不满足，则发送第二分层图片获取请求到所述服务器，以使所述服务器根据所述第二分层图片获取请求依次发送具有最大分辨率的分层图片中的基础层图片数据和增强层图片数据；
若判断为满足，则执行所述发送携带显示区域的尺寸信息的第一分层图片 获取请求到服务器的步骤。
在一个实施例中，计算机可读指令被处理器1001执行时，使得处理器1001还可以执行以下步骤：
判断是否支持分层图片格式；
若判断为不支持，则发送原始图片获取请求到所述服务器，以使所述服务器根据所述原始图片获取请求返回原始图片；
通过原始解码器对所接收到的所述原始图片进行解码，并显示解码后的原始图片；
若判断为支持，则执行所述获取显示区域的尺寸信息的步骤。
本申请实施例通过发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器，以使服务器根据第一分层图片获取请求选择与尺寸信息相匹配的目标分层图片，再接收服务器发送的目标分层图片中的基础层图片数据，并通过分层图片解码器，对基础层图片数据进行解码，并对解码后的基础层图片数据进行显示，并接收服务器发送的目标分层图片中的增强层图片数据，并通过分层图片解码器对增强层图片数据进行解码，并将解码后的增强层图片数据与解码后的基础层图片数据进行合成，并显示所合成出的图片数据。由此可见，尽管在网络状态不稳定的情况下，依然可以较快获取到基础层图片数据，使得显示区域可以先显示基础层图片数据的内容，避免图片显示区域长时间处于空白状态，后续可以进一步接收增强层图片数据，并对增强层图片数据和基础层图片数据进行合成，得到质量较高的图片，从而可以提高图片显示效果。
请参见图12，是本申请实施例提供的服务器的结构示意图。如图12所示，所述服务器2000可以应用于服务器，该服务器可以包括上述图1对应实施例中的服务器100和服务器200的所有功能。所述服务器2000可以包括：处理器2001、网络接口2003、存储器2004，此外，所述服务器2000还可以包括：至少一个通信总线2002。其中，通信总线2002用于实现这些组件之间的连接通信。网络接口2003可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器2004可以是高速RAM存储器，也可以是非不稳定的存储器(non-volatile memory)，例如至少一个磁盘存储器。存储器2004可选的还可以是至少一个位于远离前述处理器2001的存储装置。如图12所示，作为一种计算机存储介质的存储器2004中可以包括操作系统、网络通信模块、用户接口模块以及设备控 制应用程序。
在图12所示的服务器2000中，所述网络接口2003用于与用户终端进行通信；存储器2004中存储的计算机可读指令，计算机可读指令被处理器2001执行时，使得处理器2001执行以下步骤：
若接收到用户终端发送的第一分层图片获取请求，则根据所述第一分层图片获取请求所携带的所述用户终端的显示区域的尺寸信息选择与所述尺寸信息相匹配的目标分层图片；
发送所述目标分层图片中的基础层图片数据到所述用户终端，以使所述用户终端通过分层图片解码器，对所述基础层图片数据进行解码，并对解码后的基础层图片数据进行显示；
发送所述目标分层图片中的增强层图片数据到所述用户终端，以使所述用户终端通过所述分层图片解码器对所述增强层图片数据进行解码，并将解码后的增强层图片数据与所述解码后的基础层图片数据进行合成，并显示所合成出的图片数据。
在一个实施例中，计算机可读指令被处理器2001在执行若接收到用户终端发送的第一分层图片获取请求，则根据所述第一分层图片获取请求所携带的所述用户终端的显示区域的尺寸信息选择与所述尺寸信息相匹配的目标分层图片的步骤时，使得处理器2001具体执行以下步骤：
若接收到用户终端发送的第一分层图片获取请求，则提取所述第一分层图片获取请求所携带的所述用户终端的显示区域的尺寸信息；
在多个不同分辨率的分层图片中，查找像素宽度大于所述尺寸信息中的图片宽度的至少一个分层图片，作为至少一个待选择分层图片；
将所述至少一个待选择分层图片中的最低分辨率的分层图片确定为与所述尺寸信息相匹配的目标分层图片。
在一个实施例中，计算机可读指令被处理器2001执行时，使得处理器2001还可以执行以下步骤：
若接收到所述用户发送的第二分层图片获取请求，则根据所述第二分层图片获取请求在多个不同分辨率的分层图片中选择具有最大分辨率的分层图片，并依次发送所述具有最大分辨率的分层图片中的基础层图片数据和增强层图片数据到所述用户终端；
若接收到所述用户发送的原始图片获取请求，则根据所述原始图片获取请求发送原始图片到所述用户终端；
其中，所述第二分层图片获取请求是由所述用户终端在检测到所述尺寸信息不满足分层图片自适应条件时所发送的；所述原始图片获取请求是由所述用户终端在检测到不支持分层图片格式时所发送的；所述第一分层图片获取请求是由所述用户终端在检测到所述尺寸信息满足分层图片自适应条件时所发送的。
在一个实施例中，计算机可读指令被处理器2001执行时，使得处理器2001还可以执行以下步骤：
接收所述用户终端发送的解码器获取请求；所述解码器获取请求携带所述用户终端的操作系统信息；
根据所述解码器获取请求查找与所述用户终端的操作系统信息相匹配的分层图片解码器，并将所查找出的与所述用户终端的操作系统信息相匹配的分层图片解码器发送至所述用户终端。
在一个实施例中，计算机可读指令被处理器2001执行时，使得处理器2001还可以执行以下步骤：
获取原始图片，通过与服务器的操作系统信息相匹配的分层图片解码器对所述原始图片进行解码，得到解码后的原始图片数据；
通过分层图片编码器将所述解码后的原始图片数据编码为至少一种分辨率的分层图片；各分层图片均包括基础层图片数据和至少一个增强层图片数据。
在一个实施例中，计算机可读指令被处理器2001执行时，使得处理器2001还可以执行以下步骤：
设置与至少一种操作系统信息分别对应的分层图片解码器；
对所述分层图片解码器和分层图片编码器中的预测方式进行优化；所述预测方式包括编码单元划分方式、预测单元划分方式、变换单元划分方式、帧内预测方向选择方式；
根据所对应的操作系统信息对所述分层图片解码器进行汇编优化和代码结构优化。
在一个实施例中，所述计算机可读指令被处理器2001在执行根据所对应的操作系统信息对所述分层图片解码器进行汇编优化和代码结构优化的步骤时， 使得所述处理器2001具体执行以下步骤：
在所述分层图片解码器中设置存储空间选择优化规则，所述存储空间选择优化规则包括将寄存器设置为最高优先级的临时存储空间的规则，所述寄存器是与所述分层图片解码器所对应的操作系统信息相关联的；
在所述分层图片解码器中设置计算优化规则，所述计算优化规则包括将矩阵运算的循环逻辑转换成基于向量指令集进行运算的规则，所述向量指令集是与所述分层图片解码器所对应的操作系统信息相关联的。
本申请实施例通过发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器，以使服务器根据第一分层图片获取请求选择与尺寸信息相匹配的目标分层图片，再接收服务器发送的目标分层图片中的基础层图片数据，并通过分层图片解码器，对基础层图片数据进行解码，并对解码后的基础层图片数据进行显示，并接收服务器发送的目标分层图片中的增强层图片数据，并通过分层图片解码器对增强层图片数据进行解码，并将解码后的增强层图片数据与解码后的基础层图片数据进行合成，并显示所合成出的图片数据。由此可见，尽管在网络状态不稳定的情况下，依然可以较快获取到基础层图片数据，使得显示区域可以先显示基础层图片数据的内容，避免图片显示区域长时间处于空白状态，后续可以进一步接收增强层图片数据，并对增强层图片数据和基础层图片数据进行合成，得到质量较高的图片，从而可以提高图片显示效果。而且通过服务器对各操作系统信息分别对应的分层图片解码器进行汇编优化和代码结构优化，可以使得各种操作系统的用户终端均可以使用到优化后的分层图片解码器，以提高分层图片解码器的解码效率。
此外，这里需要指出的是：本申请实施例还提供了一种计算机存储介质，且所述计算机存储介质中存储有前文提及的用户终端所执行的计算机可读指令，且所述计算机可读指令包括程序指令，当所述处理器执行所述程序指令时，能够执行前文图7所对应实施例中对所述图像数据处理方法的描述，因此，这里将不再进行赘述。另外，对采用相同方法的有益效果描述，也不再进行赘述。对于本申请所涉及的计算机存储介质实施例中未披露的技术细节，请参照本申请方法实施例的描述。
此外，这里需要指出的是：本申请实施例还提供了另一种计算机存储介质，且所述计算机存储介质中存储有前文提及的服务器所执行的计算机可读指令， 且所述计算机可读指令包括程序指令，当所述处理器执行所述程序指令时，能够执行前文图8所对应实施例中对所述图像数据处理方法的描述，因此，这里将不再进行赘述。另外，对采用相同方法的有益效果描述，也不再进行赘述。对于本申请所涉及的计算机存储介质实施例中未披露的技术细节，请参照本申请方法实施例的描述。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机可读指令来指令相关的硬件来完成，所述的程序可存储于一非易失性计算机可读取存储介质中，该程序在执行时，可包括如上述各方法的实施例的流程。其中，本申请所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用，均可包括非易失性和/或易失性存储器。非易失性存储器可包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦除可编程ROM(EEPROM)或闪存。易失性存储器可包括随机存取存储器(RAM)或者外部高速缓冲存储器。作为说明而非局限，RAM以多种形式可得，诸如静态RAM(SRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双数据率SDRAM(DDRSDRAM)、增强型SDRAM(ESDRAM)、同步链路(Synchlink)DRAM(SLDRAM)、存储器总线(Rambus)直接RAM(RDRAM)、直接存储器总线动态RAM(DRDRAM)、以及存储器总线动态RAM(RDRAM)等。
以上实施例的各技术特征可以进行任意的组合，为使描述简洁，未对上述实施例中的各个技术特征所有可能的组合都进行描述，然而，只要这些技术特征的组合不存在矛盾，都应当认为是本说明书记载的范围。
以上实施例仅表达了本申请的几种实施方式，其描述较为具体和详细，但并不能因此而理解为对发明专利范围的限制。应当指出的是，对于本领域的普通技术人员来说，在不脱离本申请构思的前提下，还可以做出若干变形和改进，这些都属于本申请的保护范围。因此，本申请专利的保护范围应以所附权利要求为准。

Claims (20)

  1. 一种图像数据处理方法，执行于用户终端，其特征在于，所述方法包括：
    发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器，以使所述服务器根据所述第一分层图片获取请求选择与所述尺寸信息相匹配的目标分层图片；
    接收所述服务器发送的所述目标分层图片中的基础层图片数据，并通过分层图片解码器，对所述基础层图片数据进行解码，并对解码后的基础层图片数据进行显示；
    接收所述服务器发送的所述目标分层图片中的增强层图片数据，并通过所述分层图片解码器对所述增强层图片数据进行解码，并将解码后的增强层图片数据与所述解码后的基础层图片数据进行合成，并显示所合成出的图片数据。
  2. 如权利要求1所述的方法，其特征在于，还包括：
    获取用户终端的操作系统信息，并发送携带所述用户终端的操作系统信息的解码器获取请求到所述服务器，以使所述服务器根据所述解码器获取请求查找与所述用户终端的操作系统信息相匹配的分层图片解码器；
    接收所述服务器发送的与所述用户终端的操作系统信息相匹配的分层图片解码器。
  3. 如权利要求1所述的方法，其特征在于，在所述发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器之前，还包括：
    获取显示区域的尺寸信息，并判断所述尺寸信息是否满足分层图片自适应条件；
    若判断为不满足，则发送第二分层图片获取请求到所述服务器，以使所述服务器根据所述第二分层图片获取请求依次发送具有最大分辨率的分层图片中的基础层图片数据和增强层图片数据；
    若判断为满足，则执行所述发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器的步骤。
  4. 如权利要求3所述的方法，其特征在于，在所述获取显示区域的尺寸信息之前，还包括：
    判断是否支持分层图片格式；
    若判断为不支持，则发送原始图片获取请求到所述服务器，以使所述服务器根据所述原始图片获取请求返回原始图片；
    通过原始解码器对所接收到的所述原始图片进行解码，并显示解码后的原始图片；
    若判断为支持，则执行所述获取显示区域的尺寸信息的步骤。
  5. 一种图像数据处理方法，执行于服务器，其特征在于，所述方法包括：
    若接收到用户终端发送的第一分层图片获取请求，则根据所述第一分层图片获取请求所携带的所述用户终端的显示区域的尺寸信息选择与所述尺寸信息相匹配的目标分层图片；
    发送所述目标分层图片中的基础层图片数据到所述用户终端，以使所述用户终端通过分层图片解码器，对所述基础层图片数据进行解码，并对解码后的基础层图片数据进行显示；
    发送所述目标分层图片中的增强层图片数据到所述用户终端，以使所述用户终端通过所述分层图片解码器对所述增强层图片数据进行解码，并将解码后的增强层图片数据与所述解码后的基础层图片数据进行合成，并显示所合成出的图片数据。
  6. 如权利要求5所述的方法，其特征在于，所述若接收到用户终端发送的第一分层图片获取请求，则根据所述第一分层图片获取请求所携带的所述用户终端的显示区域的尺寸信息选择与所述尺寸信息相匹配的目标分层图片，包括：
    若接收到用户终端发送的第一分层图片获取请求，则提取所述第一分层图片获取请求所携带的所述用户终端的显示区域的尺寸信息；
    在多个不同分辨率的分层图片中，查找像素宽度大于所述尺寸信息中的图片宽度的至少一个分层图片，作为至少一个待选择分层图片；
    将所述至少一个待选择分层图片中的最低分辨率的分层图片确定为与所述尺寸信息相匹配的目标分层图片。
  7. 如权利要求6所述的方法，其特征在于，还包括：
    若接收到所述用户发送的第二分层图片获取请求，则根据所述第二分层图 片获取请求在多个不同分辨率的分层图片中选择具有最大分辨率的分层图片，并依次发送所述具有最大分辨率的分层图片中的基础层图片数据和增强层图片数据到所述用户终端；
    若接收到所述用户发送的原始图片获取请求，则根据所述原始图片获取请求发送原始图片到所述用户终端；
    其中，所述第二分层图片获取请求是由所述用户终端在检测到所述尺寸信息不满足分层图片自适应条件时所发送的；所述原始图片获取请求是由所述用户终端在检测到不支持分层图片格式时所发送的；所述第一分层图片获取请求是由所述用户终端在检测到所述尺寸信息满足分层图片自适应条件时所发送的。
  8. 如权利要求5所述的方法，其特征在于，还包括：
    接收所述用户终端发送的解码器获取请求；所述解码器获取请求携带所述用户终端的操作系统信息；
    根据所述解码器获取请求查找与所述用户终端的操作系统信息相匹配的分层图片解码器，并将所查找出的与所述用户终端的操作系统信息相匹配的分层图片解码器发送至所述用户终端。
  9. 如权利要求5所述的方法，其特征在于，还包括：
    获取原始图片，通过与服务器的操作系统信息相匹配的分层图片解码器对所述原始图片进行解码，得到解码后的原始图片数据；
    通过分层图片编码器将所述解码后的原始图片数据编码为至少一种分辨率的分层图片；各分层图片均包括基础层图片数据和至少一个增强层图片数据。
  10. 如权利要求8所述的方法，其特征在于，还包括：
    设置与至少一种操作系统信息分别对应的分层图片解码器；
    对所述分层图片解码器和分层图片编码器中的预测方式进行优化；所述预测方式包括编码单元划分方式、预测单元划分方式、变换单元划分方式、帧内预测方向选择方式；
    根据所对应的操作系统信息对所述分层图片解码器进行汇编优化和代码结构优化。
  11. 如权利要求10所述的方法，其特征在于，所述根据所对应的操作系统信息对所述分层图片解码器进行汇编优化和代码结构优化，包括：
    在所述分层图片解码器中设置存储空间选择优化规则，所述存储空间选择优化规则包括将寄存器设置为最高优先级的临时存储空间的规则，所述寄存器是与所述分层图片解码器所对应的操作系统信息相关联的；
    在所述分层图片解码器中设置计算优化规则，所述计算优化规则包括将矩阵运算的循环逻辑转换成基于向量指令集进行运算的规则，所述向量指令集是与所述分层图片解码器所对应的操作系统信息相关联的。
  12. 一种用户终端，其特征在于，包括：处理器、存储器以及网络接口；
    所述处理器与存储器、网络接口相连，其中，网络接口用于连接服务器，所述存储器用于存储计算机可读指令，所述计算机可读指令被所述处理器执行时，使得所述处理器执行以下步骤：
    发送携带显示区域的尺寸信息的第一分层图片获取请求到所述服务器，以使所述服务器根据所述第一分层图片获取请求选择与所述尺寸信息相匹配的目标分层图片；
    接收所述服务器发送的所述目标分层图片中的基础层图片数据，并通过分层图片解码器，对所述基础层图片数据进行解码，并对解码后的基础层图片数据进行显示；
    接收所述服务器发送的所述目标分层图片中的增强层图片数据，并通过所述分层图片解码器对所述增强层图片数据进行解码，并将解码后的增强层图片数据与所述解码后的基础层图片数据进行合成，并显示所合成出的图片数据。
  13. 如权利要求12所述的用户终端，其特征在于，所述计算机可读指令被所述处理器执行时，使得所述处理器还执行以下步骤：
    获取用户终端的操作系统信息，并发送携带所述用户终端的操作系统信息的解码器获取请求到所述服务器，以使所述服务器根据所述解码器获取请求查找与所述用户终端的操作系统信息相匹配的分层图片解码器；
    接收所述服务器发送的与所述用户终端的操作系统信息相匹配的分层图片 解码器。
  14. 如权利要求12所述的用户终端，其特征在于，所述计算机可读指令被所述处理器执行时，使得所述处理器还执行以下步骤：
    获取显示区域的尺寸信息，并判断所述尺寸信息是否满足分层图片自适应条件；
    若判断为不满足，则发送第二分层图片获取请求到所述服务器，以使所述服务器根据所述第二分层图片获取请求依次发送具有最大分辨率的分层图片中的基础层图片数据和增强层图片数据；
    若判断为满足，则执行所述发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器的步骤。
  15. 如权利要求14所述的用户终端，其特征在于，所述计算机可读指令被所述处理器执行时，使得所述处理器还执行以下步骤：
    判断是否支持分层图片格式；
    若判断为不支持，则发送原始图片获取请求到所述服务器，以使所述服务器根据所述原始图片获取请求返回原始图片；
    通过原始解码器对所接收到的所述原始图片进行解码，并显示解码后的原始图片；
    若判断为支持，则执行所述获取显示区域的尺寸信息的步骤。
  16. 一种服务器，其特征在于，包括：处理器、存储器以及网络接口；
    所述处理器与存储器、网络接口相连，其中，网络接口用于连接用户终端，所述存储器用于存储计算机可读指令，所述计算机可读指令被所述处理器执行时，使得所述处理器执行以下步骤：
    若接收到所述用户终端发送的第一分层图片获取请求，则根据所述第一分层图片获取请求所携带的所述用户终端的显示区域的尺寸信息选择与所述尺寸信息相匹配的目标分层图片；
    发送所述目标分层图片中的基础层图片数据到所述用户终端，以使所述用户终端通过分层图片解码器，对所述基础层图片数据进行解码，并对解码后的基础层图片数据进行显示；
    发送所述目标分层图片中的增强层图片数据到所述用户终端，以使所述用户终端通过所述分层图片解码器对所述增强层图片数据进行解码，并将解码后的增强层图片数据与所述解码后的基础层图片数据进行合成，并显示所合成出的图片数据。
  17. 如权利要求16所述的服务器，其特征在于，所述计算机可读指令被所述处理器执行若接收到所述用户终端发送的第一分层图片获取请求，则根据所述第一分层图片获取请求所携带的所述用户终端的显示区域的尺寸信息选择与所述尺寸信息相匹配的目标分层图片的步骤时，使得所述处理器具体执行以下步骤：
    若接收到用户终端发送的第一分层图片获取请求，则提取所述第一分层图片获取请求所携带的所述用户终端的显示区域的尺寸信息；
    在多个不同分辨率的分层图片中，查找像素宽度大于所述尺寸信息中的图片宽度的至少一个分层图片，作为至少一个待选择分层图片；
    将所述至少一个待选择分层图片中的最低分辨率的分层图片确定为与所述尺寸信息相匹配的目标分层图片。
  18. 如权利要求17所述的服务器，其特征在于，所述计算机可读指令被所述处理器执行时，使得所述处理器还执行以下步骤：
    若接收到所述用户发送的第二分层图片获取请求，则根据所述第二分层图片获取请求在多个不同分辨率的分层图片中选择具有最大分辨率的分层图片，并依次发送所述具有最大分辨率的分层图片中的基础层图片数据和增强层图片数据到所述用户终端；
    若接收到所述用户发送的原始图片获取请求，则根据所述原始图片获取请求发送原始图片到所述用户终端；
    其中，所述第二分层图片获取请求是由所述用户终端在检测到所述尺寸信息不满足分层图片自适应条件时所发送的；所述原始图片获取请求是由所述用户终端在检测到不支持分层图片格式时所发送的；所述第一分层图片获取请求是由所述用户终端在检测到所述尺寸信息满足分层图片自适应条件时所发送的。
  19. 一种计算机存储介质，其特征在于，所述计算机存储介质存储有计算机可读指令，所述计算机可读指令包括程序指令，当所述处理器执行所述程序指令时执行如权利要求1-11任一项所述的方法。
  20. 一种图像数据处理系统，所述系统包括：用户终端和服务器；
    所述用户终端用于发送携带显示区域的尺寸信息的第一分层图片获取请求到服务器；
    所述服务器用于根据所述第一分层图片获取请求选择与所述尺寸信息相匹配的目标分层图片，并发送所述目标分层图片中的基础层图片数据到所述用户终端；
    所述用户终端还用于通过分层图片解码器，对所述基础层图片数据进行解码，并对解码后的基础层图片数据进行显示；
    所述服务器还用于发送所述目标分层图片中的增强层图片数据到所述用户终端；
    所述用户终端还用于通过所述分层图片解码器对所述增强层图片数据进行解码，并将解码后的增强层图片数据与所述解码后的基础层图片数据进行合成，并显示所合成出的图片数据。
PCT/CN2018/105131 2017-09-13 2018-09-12 一种图像数据处理方法、用户终端、服务器和存储介质 WO2019052452A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710824066.6A CN109493304B (zh) 2017-09-13 2017-09-13 一种图像数据处理方法以及装置
CN201710824066.6 2017-09-13

Publications (1)

Publication Number Publication Date
WO2019052452A1 true WO2019052452A1 (zh) 2019-03-21

Family

ID=65687963

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/105131 WO2019052452A1 (zh) 2017-09-13 2018-09-12 一种图像数据处理方法、用户终端、服务器和存储介质

Country Status (2)

Country Link
CN (1) CN109493304B (zh)
WO (1) WO2019052452A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102020118411A1 (de) * 2019-07-16 2021-01-21 Whatsapp Inc. Verfahren und systeme zum übertragen eines bildes in sätzen
US11646983B1 (en) 2019-07-16 2023-05-09 Whatsapp Llc Methods and systems for transmitting an image with thumbnail data
CN115914750A (zh) * 2022-11-10 2023-04-04 深圳创维－Rgb电子有限公司 图片显示方法、装置、显示设备及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101098311A (zh) * 2006-06-29 2008-01-02 腾讯科技（深圳）有限公司 一种即时通信中图片实时传输方法及其装置
US20140215017A1 (en) * 2013-01-25 2014-07-31 Mobitv, Inc. Prioritized side channel delivery for download and store media
CN105681818A (zh) * 2016-01-07 2016-06-15 中国联合网络通信集团有限公司 一种图片云存储方法及装置
US20160330493A1 (en) * 2013-12-26 2016-11-10 Singapore University Of Technology And Design A method and apparatus for reducing data bandwidth between a cloud server and a thin client

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2804375A1 (en) * 2013-02-22 2014-11-19 Thomson Licensing Coding and decoding methods of a picture block, corresponding devices and data stream
KR20140121315A (ko) * 2013-04-04 2014-10-15 한국전자통신연구원 참조 픽처 리스트를 이용한 다 계층 기반의 영상 부호화/복호화 방법 및 그 장치
CN105847345B (zh) * 2016-03-21 2019-01-22 深圳市茁壮网络股份有限公司 一种图片合并显示方法及装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101098311A (zh) * 2006-06-29 2008-01-02 腾讯科技（深圳）有限公司 一种即时通信中图片实时传输方法及其装置
US20140215017A1 (en) * 2013-01-25 2014-07-31 Mobitv, Inc. Prioritized side channel delivery for download and store media
US20160330493A1 (en) * 2013-12-26 2016-11-10 Singapore University Of Technology And Design A method and apparatus for reducing data bandwidth between a cloud server and a thin client
CN105681818A (zh) * 2016-01-07 2016-06-15 中国联合网络通信集团有限公司 一种图片云存储方法及装置

Also Published As

Publication number Publication date
CN109493304A (zh) 2019-03-19
CN109493304B (zh) 2022-11-08

Similar Documents

Publication Publication Date Title
JP6854888B2 (ja) ビデオ符号化方法、コンピュータ装置および記憶媒体
US8644381B2 (en) Apparatus for reference picture resampling generation and method thereof and video decoding system using the same
US9877034B2 (en) Pipelined video decoder system
WO2019001108A1 (zh) 视频处理的方法和装置
JP6605726B2 (ja) 直前のフレームの動きベクトルパーティショニング
CN107205149B (zh) 通过参考帧缓冲器跟踪的运动矢量参考选择
US11057628B2 (en) Effective intra encoding for screen data
KR20180054717A (ko) 동적 해상도 스위칭을 사용하는 실시간 비디오 인코더 레이트 제어
US8619862B2 (en) Method and device for generating an image data stream, method and device for reconstructing a current image from an image data stream, image data stream and storage medium carrying an image data stream
WO2019052452A1 (zh) 一种图像数据处理方法、用户终端、服务器和存储介质
GB2560548A (en) Video data processing system
CN110679150A (zh) 相同帧运动估计和补偿
US9204157B2 (en) Video compression searching reference frame in hybrid growing-window and sliding-window
CN107018416B (zh) 用于视频和图像压缩的自适应贴片数据大小编码
US10536726B2 (en) Pixel patch collection for prediction in video coding system
KR20130006578A (ko) 비표준 벡터 양자화 코더를 이용한 비디오 표준을 따르는 레지듀얼 코딩
CN114727116A (zh) 编码方法及装置
CN111108747B (zh) 获得信号的时间样本的目标表示
JPWO2019187096A1 (ja) 復号方法、復号装置、符号化装置及びプログラム
US11750800B1 (en) Encoder and associated signal processing method
US11956441B2 (en) Identifying long term reference frame using scene detection and perceptual hashing
US20220094931A1 (en) Low frequency non-separable transform and multiple transform selection deadlock prevention
US20230010681A1 (en) Bit-rate-based hybrid encoding on video hardware assisted central processing units
WO2024060213A1 (en) Viewport switch latency reduction in live streaming
WO2024016106A1 (en) Low-complexity enhancement video coding using multiple reference frames

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18857185

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18857185

Country of ref document: EP

Kind code of ref document: A1