WO2018129924A1 - 图像处理方法和电子设备 - Google Patents

图像处理方法和电子设备 Download PDF

Info

Publication number
WO2018129924A1
WO2018129924A1 PCT/CN2017/098442 CN2017098442W WO2018129924A1 WO 2018129924 A1 WO2018129924 A1 WO 2018129924A1 CN 2017098442 W CN2017098442 W CN 2017098442W WO 2018129924 A1 WO2018129924 A1 WO 2018129924A1
Authority
WO
WIPO (PCT)
Prior art keywords
image data
color depth
displayed
unit
image
Prior art date
Application number
PCT/CN2017/098442
Other languages
English (en)
French (fr)
Inventor
高博
董学
陈东
孙伟
时凌云
王秀荣
刘金星
陈相逸
陈小川
孙剑
Original Assignee
京东方科技集团股份有限公司
北京京东方光电科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司, 北京京东方光电科技有限公司 filed Critical 京东方科技集团股份有限公司
Priority to US15/745,034 priority Critical patent/US10645402B2/en
Publication of WO2018129924A1 publication Critical patent/WO2018129924A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
    • G09G5/006—Details of the interface to the display terminal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/64—Circuits for processing colour signals
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/02—Handling of images in compressed format, e.g. JPEG, MPEG
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
    • G09G2340/0428—Gradation resolution change
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2350/00—Solving problems of bandwidth in display systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124—Quantisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression

Definitions

  • Embodiments of the present invention relate to an image processing method and an electronic device using the image processing method.
  • an image processing method comprising: encoding image data to be displayed by a coding unit to generate encoded image data; transmitting the encoded image data to a display component via an interface component; a decoding unit in the display component decodes the encoded image data, the generated image data to be displayed for the display component to perform display, wherein the encoding unit encodes the image to be displayed having the first color depth as having The coded image data of the second color depth, the first color depth being greater than the second color depth.
  • an image processing method wherein the interface component is a mobile industry processor interface.
  • the image processing method further includes: generating, by the image processing unit, the image data to be displayed before encoding the image data to be displayed by the encoding unit; and inputting the image data to be displayed into the data buffer unit And outputting the image data to be displayed to the encoding unit frame by frame from the data buffer unit.
  • the image data is converted into the encoded image data having a corresponding color depth value in the second color depth.
  • an electronic device comprising: an image generation component having an encoding unit for encoding image data to be displayed to generate encoded image data; an interface component for transmitting the encoding therethrough Image data; and an image display component having a decoding unit for decoding the received encoded image data transmitted via the interface component to generate the image data to be displayed, wherein the encoding unit will have a first color depth
  • the image data to be displayed is encoded as the encoded image data having a second color depth, the first color depth being greater than the second color depth.
  • an electronic device according to another aspect of the present invention, wherein the interface component is a mobile industry processor interface.
  • an electronic device according to another aspect of the present invention, wherein the second color depth is 3/4 of the first color depth.
  • an electronic device wherein the image generation component further includes an image processing unit for generating the image data to be displayed; and a data buffer unit for receiving input by the image processing unit The image data to be displayed, and output the image data to be displayed to the encoding unit frame by frame; the image display component further includes an image display unit for based on the image to be displayed generated by the decoding unit Data, perform image display.
  • the electronic device further includes: a pre-compression unit, configured to receive the image data to be displayed from the data buffer unit on a frame-by-frame basis, and perform pre-compression on the image data to be displayed, The pre-compressed image data to be displayed is output to the encoding unit.
  • a pre-compression unit configured to receive the image data to be displayed from the data buffer unit on a frame-by-frame basis, and perform pre-compression on the image data to be displayed, The pre-compressed image data to be displayed is output to the encoding unit.
  • an electronic device wherein the encoding unit divides the first color depth into a plurality of first sub-color depth ranges, each of the plurality of first sub-color depth ranges corresponding to a respective color depth value in the second color depth; and converting the image data to be displayed having a color depth value within each of the plurality of first sub color depth ranges to have the second color depth The encoded image data of the corresponding color depth value.
  • An image processing method provided by the present invention and an electronic device using the same Performing color depth conversion on the image data to be displayed generated by the image generating component, converting the image data to be displayed with high color depth into encoded data of low color depth, and then transmitting the encoded data of low color depth to the display component by using an interface component. Decoded by the display component to restore the image data to be displayed with high color depth, thereby reducing the bandwidth required for transmitting the high resolution and high refresh rate display image, and reducing the transmission power consumption while realizing the image data transmission bandwidth limitation, and realizing the image High resolution display.
  • FIG. 1 is a block diagram illustrating an electronic device in accordance with a first embodiment of the present invention
  • FIG. 2 is a flow chart illustrating a first example of an image processing method according to a second embodiment of the present invention
  • FIG. 3 is a flowchart illustrating a second example of an image processing method according to a second embodiment of the present invention
  • FIG. 4 is a block diagram illustrating an electronic device in accordance with a third embodiment of the present invention.
  • FIG. 5 is a schematic view illustrating an electronic device according to a fourth embodiment of the present invention.
  • MIPI Mobile Industry Processor Interface
  • the current MIPI D-PHY bandwidth is difficult to meet the need for large data volume transmission required for high resolution high refresh rate display images. Accordingly, it is desirable to provide an image processing method for reducing the number of data transmissions and an electronic apparatus using the same that can reduce the bandwidth required for transmitting a high resolution high refresh rate display image and solve the image data transmission bandwidth Limiting the transmission power while reducing the high resolution display of the image.
  • FIG. 1 is a block diagram illustrating an electronic device in accordance with a first embodiment of the present invention.
  • an electronic device 10 according to an embodiment of the present invention includes an image generation component 100, an interface component 200, and an image display component 300.
  • the electronic device 10 according to an embodiment of the present invention includes, but is not limited to, a smart phone, a tablet computer, a personal computer, and the like as long as it is an electronic device capable of performing high-resolution image display.
  • FIG. 1 only shows components and units that are closely related to the present invention, and that electronic device 10 in accordance with embodiments of the present invention may also include other components and units, such as input components, sensing components, and the like.
  • the image generation component 100 includes an image processing unit 101, a data buffer unit 102, and an encoding unit 103.
  • the image processing unit 101 is configured to generate image data to be displayed.
  • the image processing unit 101 is an image processing unit (GPU) of the electronic device 10, such as a high resolution image having a 4K resolution 16.7M color.
  • the image data to be displayed generated by the image processing unit 101 is input to the data buffer unit 102.
  • the data buffer unit 102 is a frame buffer of the electronic device 10.
  • the data buffer unit 102 outputs the image data to be displayed to the encoding unit 103 frame by frame.
  • the encoding unit 103 is configured to encode the image data to be displayed to generate encoded image data.
  • the encoding unit 103 is a color depth encoder that performs color depth on the image data to be displayed. coding. That is, the image data to be displayed having the first color depth (for example, 16.7 M color) is encoded to generate encoded image data having a second color depth (for example, 512 colors).
  • the encoding unit 103 divides the first color depth into a plurality of first sub-color depth ranges, and each of the plurality of first sub-color depth ranges corresponds to a corresponding color depth value in the second color depth. Thereafter, the image data to be displayed having color depth values in each of the plurality of first sub-color depth ranges is converted into the encoded image data having a corresponding color depth value in the second color depth.
  • the encoding unit 103 is not limited to a color depth encoder, but may include any coding unit capable of achieving a reduction in the amount of data that needs to be transmitted via the interface component 200 afterwards.
  • the interface component 200 is configured to transmit the encoded image data therethrough.
  • the interface component 200 is a Mobile Industry Processor Interface (MIPI).
  • MIPI Mobile Industry Processor Interface
  • the image display component 300 includes a decoding unit 301 and an image display unit 302.
  • the decoding unit 301 is a decoding unit corresponding to the encoding unit 103, and is configured to decode the received encoded image data sent via the interface component 200 to generate the image data to be displayed.
  • the decoding unit 301 performs color depth decoding on encoded image data having a second color depth (for example, 512 colors) to obtain a scene having a first color depth (for example, 16.7 M color).
  • the image data to be displayed is described.
  • the image display unit 302 is configured to perform image display based on the image data to be displayed generated by the decoding unit.
  • the image display unit 302 is a display panel for performing high resolution image display.
  • the high color depth to be transmitted will be required.
  • the image data is converted at the AP end into low color depth image data with a significantly reduced amount of data, transmitted to the display panel end via an interface component such as MIPI, and restored to high color depth image data by performing color depth decoding on the display panel side.
  • the image data transmission bandwidth limitation is solved, and the transmission power consumption is reduced.
  • FIG. 2 is a flowchart illustrating a first example of an image processing method according to a second embodiment of the present invention. As shown in FIG. 2, a first example of an image processing method according to an embodiment of the present invention includes the following steps.
  • step S201 image data to be displayed is encoded by a coding unit to generate a coded image. data.
  • the image data to be displayed having a first color depth is encoded to generate encoded image data having a second color depth.
  • the second color depth is 3/4 of the first color depth.
  • step S202 the encoded image data is transmitted to the display component via the interface component.
  • the interface component is a mobile industry processor interface. Thereafter, the processing proceeds to step S203.
  • step S203 the encoded image data is decoded by the decoding unit to generate image data to be displayed.
  • the decoding unit performs color depth decoding on the encoded image data having the second color depth to obtain the image data to be displayed having the first color depth.
  • the first color depth may be divided into a plurality of first sub-color depth ranges, each of the plurality of first sub-color depth ranges corresponding to a corresponding color depth value in the second color depth. Thereafter, the image data to be displayed having color depth values in each of the plurality of first sub-color depth ranges is converted into the encoded image data having a corresponding color depth value in the second color depth.
  • FIG. 3 is a flowchart illustrating a second example of an image processing method according to a second embodiment of the present invention.
  • the second example shown in FIG. 3 differs from the first example shown in FIG. 2 in that it describes the complete image generation and display processing steps.
  • a second example of the image processing method according to an embodiment of the present invention includes the following steps.
  • step S301 image data to be displayed is generated by the image processing unit.
  • a high resolution image having a 4K resolution 16.7M color is generated by the image processing unit (GPU) of the electronic device as the image data to be displayed. Thereafter, the processing proceeds to step S302.
  • step S302 the image data to be displayed is input to the data buffer unit.
  • a high resolution image having a 4K resolution 16.7M color is input to a frame buffer of an electronic device. Thereafter, the processing proceeds to step S303.
  • step S303 the image data to be displayed is outputted frame by frame from the data buffer unit to the encoding unit. Thereafter, the processing proceeds to step S304.
  • Steps S304 to S306 are respectively the same as steps S201 to S203 described with reference to FIG. 2, and a repetitive description thereof will be omitted herein.
  • step S307 image display is performed by the image display unit based on the image data to be displayed.
  • the high color depth image data is converted at the AP end to a significantly reduced amount of data before the high resolution image is transmitted through the interface component.
  • Low color depth image data after which color depth decoding is performed by the display panel side
  • FIG. 4 is a block diagram illustrating an electronic device in accordance with a third embodiment of the present invention.
  • the electronic device 40 according to the third embodiment of the present invention is further configured with pre-compression in the image generation component 100 as compared with the electronic device 10 according to the first embodiment of the present invention described above with reference to FIG. Unit 104.
  • other components and units of the electronic device 40 according to the third embodiment of the present invention shown in FIG. 4 are respectively the same as the corresponding components and units of the electronic device 10 according to the first embodiment of the present invention described with reference to FIG. 1, And denoted by the same reference numerals.
  • the relevant repeated description will be omitted.
  • the electronic device 40 is further configured with a pre-compression unit 104 in the image generation component 100 such that before the image data to be displayed is sent to the coding unit,
  • the data buffer unit outputs the image data to be displayed to a pre-compression unit frame by frame, and performs pre-compression on the image data to be displayed by the pre-compression unit, and outputs the pre-compressed image data to be displayed to the Coding unit.
  • the pre-compression process performed by the pre-compression unit 104 includes, but is not limited to, compression based on the VESA algorithm, compression of the FBC algorithm, and the like.
  • the amount of data to be encoded may be reduced in advance, so that the encoding unit 103 performs
  • the coding overhead is smaller, faster, and at the same time reduces the amount of data that backend interface component 200 needs to transmit.
  • FIG. 5 is a schematic diagram illustrating an electronic device in accordance with an embodiment of the present invention.
  • an electronic device 50 according to an embodiment of the present invention is an electronic device such as a smart phone having an image generating component 501 for generating and encoding image data to be displayed and an image display component 503 for performing image display.
  • the image generation component 501 and the image display component 503 perform transmission of image data via the interface component 502.
  • the image display component 503 is, for example, a display component for implementing augmented reality/virtual reality.
  • the interface component 502 is a mobile industry processor interface.
  • Image display component 503 performs a corresponding decoding (eg, color depth decoding) to restore the original high resolution image. As such, the amount of data actually transmitted via the interface component 502 is reduced.
  • a corresponding decoding eg, color depth decoding
  • an image processing method by performing image data to be displayed generated by an image generation component Line color depth conversion, converting image data to be displayed with high color depth into coded data with low color depth, and then using the interface component to transmit the coded data of low color depth to the display component for decoding by the display component to restore high color depth
  • the image data is displayed, thereby reducing the bandwidth required for transmitting the high-resolution high refresh rate display image, and reducing the transmission power consumption while realizing the image data transmission bandwidth limitation, thereby realizing high-resolution display of the image.

Abstract

一种图像处理方法以及使用该图像处理方法的电子设备(10)。所述图像处理方法包括：通过编码单元(103)编码待显示图像数据，以生成编码图像数据；经由接口组件(200)将所述编码图像数据发送到显示组件(300)；以及通过所述显示组件(300)中的解码单元(301)解码所述编码图像数据，生成所述待显示图像数据用于所述显示组件(300)执行显示。该图像处理方法可以降低数据传输量。

Description

图像处理方法和电子设备 技术领域
本发明实施例涉及一种图像处理方法以及使用该图像处理方法的电子设备。
背景技术
随着诸如LCD的显示面板的发展，用于AR/VR的高分辨率显示技术不断进步。将由电子设备中诸如GPU的图像处理单元生成的用于高分辨率图像显示的图像数据传送到该电子设备中诸如LCD显示面板的图像显示单元的过程中，需要图像处理单元和图像显示单元之间存在满足高分辨率图像数据的很大传输带宽。
发明内容
根据本发明的一个方面，提供了一种图像处理方法，包括：通过编码单元编码待显示图像数据，以生成编码图像数据；经由接口组件将所述编码图像数据发送到显示组件；以及通过所述显示组件中的解码单元解码所述编码图像数据，生成所述待显示图像数据用于所述显示组件执行显示，其中所述编码单元将具有第一色深的所述待显示图像数据编码为具有第二色深的所述编码图像数据，所述第一色深大于所述第二色深。
此外，根据本发明的一个方面的图像处理方法，其中所述接口组件为移动产业处理器接口。
此外，根据本发明的一个方面的图像处理方法，其中所述第二色深为所述第一色深的3/4。
此外，根据本发明的一个方面的图像处理方法，还包括：在通过编码单元编码待显示图像数据之前，由图像处理单元生成所述待显示图像数据；将所述待显示图像数据输入数据缓冲单元；从所述数据缓冲单元逐帧输出所述待显示图像数据到所述编码单元。
此外，根据本发明的一个方面的图像处理方法，其中从所述数据缓冲单元逐帧输出所述待显示图像数据到所述编码单元包括：从所述数据缓冲单元逐帧输出所述待显示图像数据到预压缩单元；由所述预压缩单元对所述待显 示图像数据执行预压缩，将预压缩的所述待显示图像数据输出到所述编码单元。
此外，根据本发明的一个方面的图像处理方法，其中所述通过编码单元编码待显示图像数据包括：所述编码单元将所述第一色深划分为多个第一子色深范围，每个所述多个第一子色深范围对应于所述第二色深中的相应色深值；并且将具有每个所述多个第一子色深范围内的色深值的所述待显示图像数据转换为具有所述第二色深中的相应色深值的所述编码图像数据。
根据本发明的另一个方面，提供了一种电子设备，包括：图像生成组件，具有编码单元，用于编码待显示图像数据，以生成编码图像数据；接口组件，用于经由其发送所述编码图像数据；以及图像显示组件，具有解码单元，用于解码接收到的经由所述接口组件发送的所述编码图像数据，生成所述待显示图像数据，其中所述编码单元将具有第一色深的所述待显示图像数据编码为具有第二色深的所述编码图像数据，所述第一色深大于所述第二色深。
此外，根据本发明的另一个方面的电子设备，其中所述接口组件为移动产业处理器接口。
此外，根据本发明的另一个方面的电子设备，其中所述第二色深为所述第一色深的3/4。
此外，根据本发明的另一个方面的电子设备，其中所述图像生成组件还包含图像处理单元，用于生成所述待显示图像数据；以及数据缓冲单元，用于接收由所述图像处理单元输入的所述待显示图像数据，并且逐帧输出所述待显示图像数据到所述编码单元；所述图像显示组件还包含图像显示单元，用于基于由所述解码单元生成的所述待显示图像数据，执行图像显示。
此外，根据本发明的另一个方面的电子设备，还包括：预压缩单元，用于接收从所述数据缓冲单元逐帧输出所述待显示图像数据，对所述待显示图像数据执行预压缩，将预压缩的所述待显示图像数据输出到所述编码单元。
此外，根据本发明的另一个方面的电子设备，其中所述编码单元将所述第一色深划分为多个第一子色深范围，每个所述多个第一子色深范围对应于所述第二色深中的相应色深值；并且将具有每个所述多个第一子色深范围内的色深值的所述待显示图像数据转换为具有所述第二色深中的相应色深值的所述编码图像数据。
本发明提供的图像处理方法以及使用该图像处理方法的电子设备，通过 对于由图像生成组件生成的待显示图像数据执行色深转换，将高色深的待显示图像数据转换为低色深的编码数据，再利用接口组件将低色深的编码数据传输到显示组件以便由显示组件解码以恢复高色深的待显示图像数据，从而能够减少传输高分辨率高刷新率显示图像所需的带宽，并且在解决图像数据传输带宽限制的同时降低传输功耗，实现图像的高分辨显示。
要理解的是，前面的一般描述和下面的详细描述两者都是示例性的，并且意图在于提供要求保护的技术的进一步说明。
附图说明
通过结合附图对本发明实施例进行更详细的描述，本发明的上述以及其它目的、特征和优势将变得更加明显。附图用来提供对本发明实施例的进一步理解，并且构成说明书的一部分，与本发明实施例一起用于解释本发明，并不构成对本发明的限制。在附图中，相同的参考标号通常代表相同部件或步骤。
图1是图示根据本发明的第一实施例的电子设备的框图；
图2是图示根据本发明的第二实施例的图像处理方法的第一示例的流程图；
图3是图示根据本发明的第二实施例的图像处理方法的第二示例的流程图；
图4是图示根据本发明的第三实施例的电子设备的框图；以及
图5是图示根据本发明的第四实施例的电子设备的示意图。
具体实施方式
为了使得本发明的目的、技术方案和优点更为明显，下面将参照附图详细描述根据本发明的示例实施例。显然，所描述的实施例仅仅是本发明的一部分实施例，而不是本发明的全部实施例，应理解，本发明不受这里描述的示例实施例的限制。基于本发明中描述的本发明实施例，本领域技术人员在没有付出创造性劳动的情况下所得到的所有其它实施例都应落入本发明的保护范围之内。
以下，将参考附图详细描述本公开的实施例。首先，描述根据本发明实施例的电子设备。
目前，用于在诸如智能电话的电子设备中的各组件之间实现数据传输的接口规范包括移动产业处理器接口(MIPI)。然而，目前MIPI D-PHY带宽难以满足高分辨率高刷新率显示图像所需的大数据量传输的需要。因此，需要提供一种用于降低数据传数量的图像处理方法以及使用该图像处理方法的电子设备，其能够减少传输高分辨率高刷新率显示图像所需的带宽，并且在解决图像数据传输带宽限制的同时降低传输功耗，实现图像的高分辨显示。
图1是图示根据本发明的第一实施例的电子设备的框图。如图1所示，根据本发明实施例的电子设备10包括图像生成组件100、接口组件200以及图像显示组件300。根据本发明实施例的电子设备10包括但不限于智能电话、平板电脑、个人计算机等，只要其为能够执行高分辨率图像显示的电子设备。此外，容易理解的是，图1仅示出与本发明密切相关的组件和单元，根据本发明实施例的电子设备10还可以包括其他组件和单元，诸如输入组件、传感组件等。
具体地，图像生成组件100包括图像处理单元101、数据缓冲单元102和编码单元103。所述图像处理单元101用于生成待显示图像数据。在本发明的一个实施例中，所述图像处理单元101是所述电子设备10的图像处理单元(GPU)，所述待显示图像数据例如是具有4K分辨率16.7M色的高分辨率图像。
由所述图像处理单元101生成的所述待显示图像数据被输入数据缓冲单元102。在本发明的一个实施例中，所述数据缓冲单元102是所述电子设备10的帧缓冲器。所述数据缓冲单元102逐帧输出所述待显示图像数据到所述编码单元103。
所述编码单元103用于编码所述待显示图像数据，以生成编码图像数据。在本发明的一个实施例中，为了减小传输到之后的图像显示组件300用于显示的图像数据量，所述编码单元103为色深编码器，其对所述待显示图像数据执行色深编码。即，将具有第一色深(例如，16.7M色)的所述待显示图像数据编码生成具有第二色深(例如，512色)的编码图像数据。传输具有第一色深(例如，16.7M色)的所述待显示图像数据的数据传输带宽为53.7GB/s，而通过所述编码单元103将其编码为具有第二色深(例如，512色)的编码图像数据后，用于传输具有第二色深(例如，512色)的编码图 像数据的数据传输带宽下降为20GB/s。
更进一步地，在本发明的一个实施例中，所述编码单元103将所述第一色深划分为多个第一子色深范围，每个所述多个第一子色深范围对应于所述第二色深中的相应色深值。此后，将具有每个所述多个第一子色深范围内的色深值的所述待显示图像数据转换为具有所述第二色深中的相应色深值的所述编码图像数据。
容易理解的是，所述编码单元103不限于色深编码器，而是可以包括能够实现减小需要经由之后的所述接口组件200传输的数据量的任何编码单元。
所述接口组件200用于经由其发送所述编码图像数据。在本发明的一个实施例中，所述接口组件200为移动产业处理器接口(MIPI)。
所述图像显示组件300包括解码单元301和图像显示单元302。所述解码单元301是与所述编码单元103对应的解码单元，用于解码接收到的经由所述接口组件200发送的所述编码图像数据，生成所述待显示图像数据。在本发明的一个实施例中，所述解码单元301对具有第二色深(例如，512色)的编码图像数据执行色深解码，获得具有第一色深(例如，16.7M色)的所述待显示图像数据。所述图像显示单元302用于基于由所述解码单元生成的所述待显示图像数据，执行图像显示。本发明的一个实施例中，所述图像显示单元302是用于执行高分辨率图像显示的显示面板。
在如上参照图1描述的根据本发明实施例的电子设备10中，通过在AP端配置所述编码单元103，并且在显示面板端对应地配置所述解码单元301，将需要传输的高色深图像数据在AP端转换为数据量明显减小的低色深图像数据，经由诸如MIPI的接口组件将其传输到显示面板端，并且由显示面板端执行色深解码后恢复为高色深图像数据后执行显示，解决了图像数据传输带宽限制，同时降低传输功耗。
以下，将进一步参照附图描述由根据本发明实施例的电子设备执行的根据本发明实施例的图像处理方法。
图2是图示根据本发明的第二实施例的图像处理方法的第一示例的流程图。如图2所示，根据本发明实施例的图像处理方法的第一示例包括以下步骤。
在步骤S201中，通过编码单元编码待显示图像数据，以生成编码图像 数据。在本发明的一个实施例中，将具有第一色深的所述待显示图像数据编码生成具有第二色深的编码图像数据。所述第二色深为所述第一色深的3/4。此后，处理进到步骤S202。
在步骤S202中，经由接口组件将编码图像数据发送到显示组件。所述接口组件为移动产业处理器接口。此后，处理进到步骤S203。
在步骤S203中，通过解码单元解码编码图像数据，生成待显示图像数据。在本发明的一个实施例中，解码单对具有第二色深的编码图像数据执行色深解码，获得具有第一色深的所述待显示图像数据。如上所述，可以将所述第一色深划分为多个第一子色深范围，每个所述多个第一子色深范围对应于所述第二色深中的相应色深值。此后，将具有每个所述多个第一子色深范围内的色深值的所述待显示图像数据转换为具有所述第二色深中的相应色深值的所述编码图像数据。
图3是图示根据本发明的第二实施例的图像处理方法的第二示例的流程图。图3所示的第二示例与图2所示的第一示例不同在于其描述了完整的图像生成和显示处理步骤。如图3所示，根据本发明实施例的图像处理方法的第二示例包括以下步骤。
在步骤S301中，由图像处理单元生成待显示图像数据。在本发明的一个实施例中，由电子设备的图像处理单元(GPU)生成具有4K分辨率16.7M色的高分辨率图像作为所述待显示图像数据。此后，处理进到步骤S302。
在步骤S302中，将待显示图像数据输入数据缓冲单元。在本发明的一个实施例中，将具有4K分辨率16.7M色的高分辨率图像输入电子设备的帧缓冲器。此后，处理进到步骤S303。
在步骤S303中，从数据缓冲单元逐帧输出待显示图像数据到编码单元。此后，处理进到步骤S304。
步骤S304到步骤S306分别与参照图2描述的步骤S201到步骤S203相同，在此将省略其重复描述。在步骤S306中通过解码单元解码编码图像数据，生成待显示图像数据之后，处理进到步骤S307。
在步骤S307中，由图像显示单元基于待显示图像数据执行图像显示。
在如上参照图2和图3描述的根据本发明实施例的图像处理方法中，在将高分辨率图像通过接口组件传输之前，将高色深图像数据在AP端转换为数据量明显减小的低色深图像数据，此后由显示面板端执行色深解码后恢复 为高色深图像数据，从而解决了图像数据传输带宽限制，同时降低传输功耗。
图4是图示根据本发明的第三实施例的电子设备的框图。如图4所示，根据本发明的第三实施例的电子设备40与以上参照图1描述的根据本发明的第一实施例的电子设备10相比，在图像生成组件100中进一步配置预压缩单元104。此外，图4所示的根据本发明的第三实施例的电子设备40的其他组件和单元与参照图1描述的根据本发明的第一实施例的电子设备10的相应组件和单元分别相同，并且用相同的附图标记表示。在此，将省略相关的重复描述。
如图4所示，根据本发明的第三实施例的电子设备40通过在图像生成组件100中进一步配置有预压缩单元104，使得在将所述待显示图像数据到所述编码单元之前，从所述数据缓冲单元逐帧输出所述待显示图像数据到预压缩单元，由所述预压缩单元对所述待显示图像数据执行预压缩，将预压缩的所述待显示图像数据输出到所述编码单元。在本发明的实施例中，所述预压缩单元104执行的预压缩处理包括但不限于基于VESA算法的压缩、FBC算法的压缩等。通过配置预压缩单元104对对所述待显示图像数据执行预压缩，可以在由所述编码单元103编码所述待显示图像数据之前，预先减少需要编码的数据量，使得所述编码单元103执行的编码开销更小、速度更快，并且同时减少了后端接口组件200所需传输的数据量。
图5是图示根据本发明实施例的电子设备的示意图。如图5所示，根据本发明实施例的电子设备50为诸如智能电话的电子设备，其具有用于生成和编码待显示图像数据的图像生成组件501和执行图像显示的图像显示组件503，所述图像生成组件501和所述图像显示组件503经由接口组件502执行图像数据的传输。如图4示意性地示出的，所述图像显示组件503例如为用于实现增强现实/虚拟现实的显示组件。所述接口组件502为移动产业处理器接口。由所述图像生成组件501对例如具有4K分辨率16.7M色的高分辨率图像执行编码(例如，色深编码)后经由所述接口组件502传输到所述图像显示组件503，再由所述图像显示组件503执行对应的解码(例如，色深解码)以还原原始高分辨率图像。如此，实际经由所述接口组件502传输的数据量得以减少。
以上，参照附图描述了根据本发明实施例的图像处理方法以及使用该图像处理方法的电子设备，通过对于由图像生成组件生成的待显示图像数据执 行色深转换，将高色深的待显示图像数据转换为低色深的编码数据，再利用接口组件将低色深的编码数据传输到显示组件以便由显示组件解码以恢复高色深的待显示图像数据，从而能够减少传输高分辨率高刷新率显示图像所需的带宽，并且在解决图像数据传输带宽限制的同时降低传输功耗，实现图像的高分辨显示。
需要说明的是，在本说明书中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。
最后，还需要说明的是，上述一系列处理不仅包括以这里所述的顺序按时间序列执行的处理，而且包括并行或分别地、而不是按时间顺序执行的处理。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到本发明可借助软件加必需的硬件平台的方式来实现，当然也可以全部通过硬件来实施。基于这样的理解，本发明的技术方案对背景技术做出贡献的全部或者部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在存储介质中，如ROM/RAM、磁碟、光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例或者实施例的某些部分所述的方法。
以上对本发明进行了详细介绍，本文中应用了具体个例对本发明的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本发明的方法及其核心思想；同时，对于本领域的一般技术人员，依据本发明的思想，在具体实施方式及应用范围上均会有改变之处，综上所述，本说明书内容不应理解为对本发明的限制。
本申请要求于2017年1月13日提交的中国专利申请第201710026212.0的优先权，该中国专利申请的全文通过引用的方式结合于此以作为本申请的一部分。

Claims (12)

  1. 一种图像处理方法，包括：
    通过编码单元编码待显示图像数据，以生成编码图像数据；
    经由接口组件将所述编码图像数据发送到显示组件；以及
    通过所述显示组件中的解码单元解码所述编码图像数据，生成所述待显示图像数据用于所述显示组件执行显示，
    其中所述编码单元将具有第一色深的所述待显示图像数据编码为具有第二色深的所述编码图像数据，所述第一色深大于所述第二色深。
  2. 如权利要求1所述的图像处理方法，其中所述接口组件为移动产业处理器接口。
  3. 如权利要求1或2所述的图像处理方法，其中所述第二色深为所述第一色深的3/4。
  4. 如权利要求1或2所述的图像处理方法，还包括：
    在通过编码单元编码待显示图像数据之前，由图像处理单元生成所述待显示图像数据；
    将所述待显示图像数据输入数据缓冲单元；
    从所述数据缓冲单元逐帧输出所述待显示图像数据到所述编码单元。
  5. 如权利要求4所述的图像处理方法，其中从所述数据缓冲单元逐帧输出所述待显示图像数据到所述编码单元包括：
    从所述数据缓冲单元逐帧输出所述待显示图像数据到预压缩单元；
    由所述预压缩单元对所述待显示图像数据执行预压缩，将预压缩的所述待显示图像数据输出到所述编码单元。
  6. 如权利要求1或2所述的图像处理方法，其中所述通过编码单元编码待显示图像数据包括：
    所述编码单元将所述第一色深划分为多个第一子色深范围，每个所述多个第一子色深范围对应于所述第二色深中的相应色深值；并且
    将具有每个所述多个第一子色深范围内的色深值的所述待显示图像数据转换为具有所述第二色深中的相应色深值的所述编码图像数据。
  7. 一种电子设备，包括：
    图像生成组件，具有编码单元，用于编码待显示图像数据，以生成编码 图像数据；
    接口组件，用于经由其发送所述编码图像数据；以及
    图像显示组件，具有解码单元，用于解码接收到的经由所述接口组件发送的所述编码图像数据，生成所述待显示图像数据，
    其中所述编码单元将具有第一色深的所述待显示图像数据编码为具有第二色深的所述编码图像数据，所述第一色深大于所述第二色深。
  8. 如权利要求7所述的电子设备，其中所述接口组件为移动产业处理器接口。
  9. 如权利要求7或8所述的电子设备，其中所述第二色深为所述第一色深的3/4。
  10. 如权利要求7或8所述的电子设备，其中
    所述图像生成组件还包含
    图像处理单元，用于生成所述待显示图像数据；以及
    数据缓冲单元，用于接收由所述图像处理单元输入的所述待显示图像数据，并且逐帧输出所述待显示图像数据到所述编码单元；
    所述图像显示组件还包含
    图像显示单元，用于基于由所述解码单元生成的所述待显示图像数据，执行图像显示。
  11. 如权利要求10所述的电子设备，还包括：
    预压缩单元，用于接收从所述数据缓冲单元逐帧输出所述待显示图像数据，对所述待显示图像数据执行预压缩，将预压缩的所述待显示图像数据输出到所述编码单元。
  12. 如权利要求7或8所述的电子设备，其中所述编码单元将所述第一色深划分为多个第一子色深范围，每个所述多个第一子色深范围对应于所述第二色深中的相应色深值；并且将具有每个所述多个第一子色深范围内的色深值的所述待显示图像数据转换为具有所述第二色深中的相应色深值的所述编码图像数据。
PCT/CN2017/098442 2017-01-13 2017-08-22 图像处理方法和电子设备 WO2018129924A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/745,034 US10645402B2 (en) 2017-01-13 2017-08-22 Image processing method and electronic device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710026212.0A CN106713922B (zh) 2017-01-13 2017-01-13 图像处理方法和电子设备
CN201710026212.0 2017-01-13

Publications (1)

Publication Number Publication Date
WO2018129924A1 true WO2018129924A1 (zh) 2018-07-19

Family

ID=58908437

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/098442 WO2018129924A1 (zh) 2017-01-13 2017-08-22 图像处理方法和电子设备

Country Status (3)

Country Link
US (1) US10645402B2 (zh)
CN (1) CN106713922B (zh)
WO (1) WO2018129924A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106713922B (zh) * 2017-01-13 2020-03-06 京东方科技集团股份有限公司 图像处理方法和电子设备
TWI687088B (zh) * 2017-11-16 2020-03-01 宏達國際電子股份有限公司 適應性交錯影像捲繞的方法、系統以及記錄媒體
US11151748B2 (en) * 2018-07-13 2021-10-19 Electronics And Telecommunications Research Institute 3D point cloud data encoding/decoding method and apparatus
CN109285499B (zh) * 2018-12-05 2022-02-08 京东方科技集团股份有限公司 集成电路、显示装置和补偿方法
CN115696059A (zh) * 2021-07-28 2023-02-03 Oppo广东移动通信有限公司 图像处理方法、装置、存储介质及电子设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1669233A (zh) * 2002-10-01 2005-09-14 阿沃森特公司 视频压缩系统
CN101668107A (zh) * 2008-09-04 2010-03-10 中国移动通信集团公司 色深变换、传输色深变换后图像的方法、系统和装置
CN102547058A (zh) * 2011-12-31 2012-07-04 福建星网视易信息系统有限公司 Jpeg图像处理方法以及系统
US8548233B2 (en) * 2010-07-07 2013-10-01 Canon Kabushiki Kaisha Image processing apparatus and compression method therefor
CN103905827A (zh) * 2012-12-25 2014-07-02 联发科技股份有限公司 视频处理装置
CN106713922A (zh) * 2017-01-13 2017-05-24 京东方科技集团股份有限公司 图像处理方法和电子设备

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1589761A1 (en) * 2004-04-19 2005-10-26 Oplayo Oy A codec adapted to operate in rgb color space
GB2452765A (en) * 2007-09-14 2009-03-18 Dooworks Fz Co Combining multiple image streams by reducing the colour depth of each bit stream combining them onto a single stream
EP2328337A4 (en) * 2008-09-02 2011-08-10 Huawei Device Co Ltd 3D VIDEO COMMUNICATION, TRANSMISSION DEVICE, SYSTEM AND IMAGE RECONSTRUCTION, SYSTEM
US20100128802A1 (en) * 2008-11-24 2010-05-27 Yang-Hung Shih Video processing ciucuit and related method for merging video output streams with graphical stream for transmission
CN102339592A (zh) * 2011-09-29 2012-02-01 中山大学 一种基于lcd控制器的显存压缩方法
US20130162625A1 (en) * 2011-12-23 2013-06-27 Michael L. Schmit Displayed Image Improvement
US10110805B2 (en) * 2012-12-06 2018-10-23 Sandisk Technologies Llc Head mountable camera system
US20180048914A1 (en) * 2016-08-11 2018-02-15 Novatek Microelectronics Corp. Image processing method and related apparatus

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1669233A (zh) * 2002-10-01 2005-09-14 阿沃森特公司 视频压缩系统
CN101668107A (zh) * 2008-09-04 2010-03-10 中国移动通信集团公司 色深变换、传输色深变换后图像的方法、系统和装置
US8548233B2 (en) * 2010-07-07 2013-10-01 Canon Kabushiki Kaisha Image processing apparatus and compression method therefor
CN102547058A (zh) * 2011-12-31 2012-07-04 福建星网视易信息系统有限公司 Jpeg图像处理方法以及系统
CN103905827A (zh) * 2012-12-25 2014-07-02 联发科技股份有限公司 视频处理装置
CN106713922A (zh) * 2017-01-13 2017-05-24 京东方科技集团股份有限公司 图像处理方法和电子设备

Also Published As

Publication number Publication date
CN106713922B (zh) 2020-03-06
CN106713922A (zh) 2017-05-24
US10645402B2 (en) 2020-05-05
US20190014329A1 (en) 2019-01-10

Similar Documents

Publication Publication Date Title
WO2018129924A1 (zh) 图像处理方法和电子设备
TWI529656B (zh) Image display system and image processing method
US11893963B2 (en) Wireless programmable media processing system
CN103152573A (zh) 一种移动终端与智能电视间图像帧传输的方法及系统
US20220116627A1 (en) Method and apparatus in video coding for machines
GB2484736A (en) Connecting a display device via USB interface
US20210006766A1 (en) Methods and systems for color smoothing for point cloud compression
US10904579B2 (en) Method and apparatus for annealing iterative geometry smoothing
EP3828812A1 (en) Electronic apparatus and control method thereof
US20160005379A1 (en) Image Generation
JP6389279B2 (ja) ディスプレイインターフェースの帯域幅変調
CN102566960A (zh) 一种用于平板电脑的屏幕镜像无线传输装置
WO2018192231A1 (zh) 图像处理的方法、装置和终端设备
CN109413445B (zh) 一种视频传输方法及装置
KR20160082521A (ko) 크로마 하향 변환 및 상향 변환 처리
CN104156188A (zh) 一种高帧频红外场景生成与输出系统及方法
CN114979541A (zh) 一种视频显示系统
CN107077747B (zh) 远程显示的图形命令压缩
CN111669541A (zh) 预监画面显示方法及显示系统
US10025550B2 (en) Fast keyboard for screen mirroring
CN111435995B (zh) 用于生成动态图片的方法、装置和系统
US20240087173A1 (en) Base mesh coding by using surface reflection symmetry
JP2013031025A5 (zh)
US20230308669A1 (en) Predictive coding of boundary uv information for mesh compression
CN115063327B (zh) 图像处理方法和装置、以及视频处理方法和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17890862

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17890862

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 25.02.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17890862

Country of ref document: EP

Kind code of ref document: A1