WO2022033313A1

WO2022033313A1 - Image processing apparatus, and terminal

Info

Publication number: WO2022033313A1
Application number: PCT/CN2021/108961
Authority: WO
Inventors: 刁鸿浩
Original assignee: 北京芯海视界三维科技有限公司; 视觉技术创投私人有限公司
Priority date: 2020-08-11
Filing date: 2021-07-28
Publication date: 2022-02-17
Also published as: TW202209248A; CN114078075A

Abstract

An image processing apparatus (1), comprising: a receiving unit (01) configured to receive an image to be processed; a first processing unit (02) configured to perform first processing on said image, so as to obtain a first processed image; a first output unit (03) configured to output the first processed image; and at least one second output unit (04) configured to output an image obtained from at least one of the receiving unit (01) and the first processing unit (02). The image processing apparatus has the beneficial effects of improving image processing and transmission speeds.

Description

Image processing device and terminal

This application claims the priority of the Chinese patent application filed on August 11, 2020, with the application number of 202010799443.7 and the invention titled "An image processing device and terminal", the entire contents of which are incorporated into this application by reference middle.

technical field

The present application relates to the technical field of image processing, for example, to an image processing device and a terminal.

Background technique

At present, in the field of image processing, the image obtained by the image acquisition unit must first be sent to the application processor AP, the application processor processes the image, and sends the processed image to the display unit, and the display unit display is processed by the application processor. post image.

In the process of implementing the embodiments of the present disclosure, it is found that there are at least the following problems in the related art: before the image obtained by the image obtaining unit is displayed by the display unit, it needs to be processed by the application processor first, so that the data processed by the application processor If the amount is too large, it will eventually lead to a delay in image display, thereby reducing the user experience.

SUMMARY OF THE INVENTION

In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. This summary is not intended to be an extensive review, nor to identify key/critical elements or delineate the scope of protection of these embodiments, but rather serves as a prelude to the detailed description that follows.

Embodiments of the present disclosure provide an image processing apparatus and terminal, so as to solve the technical problem of reducing the user experience due to the excessive amount of data processed by the application processor, which eventually results in a delay in image display.

In some embodiments, the image processing apparatus includes:

a receiving unit, configured to receive the image to be processed;

a first processing unit, configured to perform first processing on the image to be processed to obtain a first processed image;

a first output unit configured to output the first processed image;

At least one second output unit configured to output images obtained from at least one of the receiving unit and the first processing unit.

In some embodiments, it further includes: a buffering unit configured to buffer the to-be-processed image received by the receiving unit;

a first processing unit, configured to perform a first process on the to-be-processed image obtained from the cache unit to obtain a first processed image;

At least one second output unit configured to output images obtained from at least one of the buffer unit and the first processing unit.

In some embodiments, the buffering unit includes at least one of an input register of the receiving unit and a receiving register of the first processing unit.

In some embodiments, the first processing unit is configured to perform visual processing on the image to be processed to obtain the first processed image.

In some embodiments, the first processing unit is configured to perform transparent transmission processing on the image to be processed.

In some embodiments, the first processing unit processes the image to be processed in at least one of the following ways:

Process the image to be processed in pixels;

Processes the image to be processed in row or column units.

In some embodiments, a pixel includes at least one of a single pixel and a matrix of pixels.

In some embodiments, the image to be processed obtained by the first processing unit and the image obtained by the at least one second output unit are both complete images.

In some embodiments, the first processed image output by the first output unit is used for display.

In some embodiments, the display is a local display or an off-site display.

In some embodiments, the image processing apparatus is capable of communicating with a processor configured to perform the second processing on the image output by the at least one second output unit.

In some embodiments, the second process is at least one of a storage process and an intelligent process.

In some embodiments, the intelligent processing includes at least one of artificial intelligence AI processing, augmented reality AR processing, virtual reality VR processing, and mixed reality MR processing.

In some embodiments, the image processing apparatus is capable of communicating with an initialization unit configured to: configure parameters for the units in the image processing apparatus.

In some embodiments, the image processing apparatus is capable of communicating with a display processing unit configured to pre-process the first processed image output from the first output unit before display.

In some embodiments, the image processing apparatus is capable of communicating with a display screen, the display screen being configured to obtain the first processed image from the first output unit and display the first processed image.

In some embodiments, the image processing device is capable of communicating with an image acquisition unit, the image acquisition unit being configured to acquire the image to be processed and to transmit the image to be processed to the receiving unit.

In some embodiments, the image processing device is disposed on the chip.

In some embodiments, the chip is a dedicated chip.

In some embodiments, the terminal includes: the above-mentioned image processing apparatus.

The image processing apparatus and terminal provided by the embodiments of the present disclosure can achieve the following technical effects:

The image to be processed received from the receiving unit is divided into at least two channels for output, one of which is output from the first output unit after being processed by the first processing unit; the other is output from at least one second output unit, improving the The speed of image processing and transmission is improved, thereby avoiding the delay caused by all images being processed by the application processor before being output, and reducing the problem of user experience.

The foregoing general description and the following description are exemplary and explanatory only and are not intended to limit the application.

Description of drawings

At least one embodiment is exemplified by the accompanying drawings, which are not intended to limit the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements. does not constitute a proportional limit, and where:

FIG. 1 is a schematic structural diagram of an image processing apparatus provided by an embodiment of the present disclosure;

FIG. 2 is a schematic structural diagram of another image processing apparatus provided by an embodiment of the present disclosure;

3 is a schematic structural diagram of a cache unit provided by an embodiment of the present disclosure;

FIG. 4 is a schematic structural diagram of another image processing apparatus provided by an embodiment of the present disclosure;

5 is a schematic structural diagram of another image processing apparatus provided by an embodiment of the present disclosure;

6 is a schematic structural diagram of another image processing apparatus provided by an embodiment of the present disclosure;

7 is a schematic structural diagram of another image processing apparatus provided by an embodiment of the present disclosure;

FIG. 8 is a schematic structural diagram of another image processing apparatus provided by an embodiment of the present disclosure;

9 is a schematic structural diagram of another image processing apparatus provided by an embodiment of the present disclosure;

10 is a schematic structural diagram of another image processing apparatus provided by an embodiment of the present disclosure;

FIG. 11 is a schematic structural diagram of a terminal provided by an embodiment of the present disclosure;

Reference number:

1: Image processing device; 01: Receiving unit; 02: First processing unit; 03: First output unit; 04: Second output unit; 05: Cache unit; 06: Processor; 07: Display processing unit; 08: Display screen; 09: Image acquisition unit; 10: Initialization unit; 11: Input register; 12: Receive register; 2: Terminal.

detailed description

In order to be able to understand the features and technical contents of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings, which are for reference only and are not used to limit the embodiments of the present disclosure. In the following technical description, for the convenience of explanation, numerous details are provided to provide a thorough understanding of the disclosed embodiments. However, at least one embodiment may be practiced without these details. In other instances, well-known structures and devices may be shown simplified in order to simplify the drawings.

An embodiment of the present disclosure provides an image processing apparatus 1. The structure of the image processing apparatus 1 is shown in FIG. 1. The image processing apparatus 1 includes:

A receiving unit 01, configured to receive an image to be processed;

The first processing unit 02 is configured to perform first processing on the image to be processed to obtain the first processed image;

a first output unit 03, configured to output the first processed image;

At least one second output unit 04 is configured to output images obtained from at least one of the receiving unit 01 and the first processing unit 02 .

In some embodiments, the receiving unit 01 may be a receiving interface for receiving images to be processed. Optionally, the image to be processed may be obtained by the image obtaining unit 09 , and the receiving unit 01 is configured to receive the image to be processed from the image obtaining unit 09 . In some embodiments, the image to be processed may be one image, or may be a certain frame of image in the video, and so on.

In some embodiments, the first processing unit 02 may obtain the image to be processed from the receiving unit 01, perform first processing on the image to be processed to obtain the first processed image, and the first output unit 03 obtains the first processed image, optionally, The first output unit 03 may also output the obtained first processed image.

In some embodiments, the above-mentioned "obtaining" may be active acquisition or passive reception. For example: the first processing unit 02 obtains the image to be processed from the receiving unit 01, which can be understood as: the first processing unit 02 actively obtains the image to be processed from the receiving unit 01; it can also be understood as: the receiving unit 01 sends the image to be processed to The first processing unit 02, the first processing unit 02 passively receives the image to be processed. "Acquiring" in the following embodiments can be understood as active acquisition or passive reception.

In some embodiments, the at least one second output unit 04 can obtain the image to be processed from the receiving unit 01, optionally, the at least one second output unit 04 can also obtain the first processed image from the first processing unit 02, or Optionally, the at least one second output unit 04 may also obtain images from the receiving unit 01 and the first processing unit 02 simultaneously. FIG. 1 exemplifies the case where the image processing apparatus 1 includes a second output unit 04 , and the second output unit 04 obtains the image to be processed from the receiving unit 01 .

In some embodiments, each of the at least one second output unit 04 may independently select to obtain an image from at least one of the receiving unit 01 and the first processing unit 02 .

The image processing apparatus 1 provided by the embodiment of the present disclosure divides the to-be-processed image received from the receiving unit 01 into at least two paths for output, wherein one path is processed by the first processing unit 02 and then output from the first output unit 03 ; the other way is output from at least one second output unit 04, which improves the image processing and transmission speed, thereby avoiding the delay caused by all images being processed by the application processor and then output, reducing the user experience degree issue.

In some embodiments, as shown in FIG. 2 , the image processing apparatus 1 further includes: a buffering unit 05, the buffering unit is configured to buffer the to-be-processed images received by the receiving unit 01;

The first processing unit 02 is configured to perform first processing on the to-be-processed image obtained from the cache unit 05 to obtain the first processed image;

At least one second output unit 04 is configured to output images obtained from at least one of the buffer unit 05 and the first processing unit 02 .

In some embodiments, the image processing apparatus 1 may further include a cache unit 05, and the cache unit 05 is configured to cache the to-be-processed images received by the receiving unit 01. Optionally, when the image processing apparatus 1 includes the cache unit 05 , the first processing unit 02 can obtain the image to be processed from the buffer unit 05; at least one second output unit 04 can obtain the image to be processed from the buffer unit 05; at least one second output unit 04 can obtain the image to be processed from the first processing unit 02 The first processed image is obtained from the at least one second output unit 04 ; the at least one second output unit 04 may also obtain the image from the buffer unit 05 and the first processing unit 02 at the same time. As shown in FIG. 3 , in some embodiments, the buffer unit 05 includes at least one of the input register 11 of the receiving unit 01 and the receiving register 12 of the first processing unit 02 . Optionally, the buffer unit 05 may include the input register 11 of the receiving unit 01, the buffer unit 05 may include the receiving register 12 of the first processing unit 02, and the buffer unit 05 may also include the input register 11 of the receiving unit 01 and the first processing unit. 02's receive register 12.

Optionally, the first processing unit 02 may perform different processing on the obtained images to be processed. For example, in some embodiments, the first processing unit 02 is configured to perform visual processing on the image to be processed to obtain the first processed image. For example, the visual processing of the image to be processed may be to enhance the color of the image to be processed. In some embodiments, the first processing unit 02 is configured to perform transparent transmission processing on the image to be processed. For example, it is directly transparently transmitted as a transmission channel.

In some embodiments, the first processing unit 02 processes the image to be processed in at least one of the following ways:

Process the image to be processed in pixels;

Processes the image to be processed in row or column units.

Optionally, when the first processing unit 02 processes the image to be processed, it can choose to process the image to be processed in units of pixels, and can choose to process the image to be processed in units of rows or columns; Units and the image to be processed are processed in row or column units.

Optionally, the pixels comprise at least one of a single pixel and a matrix of pixels. For example, a pixel may include a single pixel, a pixel may also include a matrix of pixels, and a pixel may include both a single pixel and a matrix of pixels. In some embodiments, the pixel matrix is, for example, an n×m matrix, wherein n and m are independently selected from integers of 1 or more, and n and m may be the same or different.

In some embodiments, the image to be processed obtained by the first processing unit 02 and the image obtained by the at least one second output unit 04 are both complete images. Optionally, the image to be processed obtained by the first processing unit 02 and the image to be processed obtained by the at least one second output unit 04 from the receiving unit 01 are both complete images. Optionally, the image to be processed obtained by the first processing unit 02 is the same as the image to be processed obtained by the at least one second output unit 04 from the receiving unit 01 .

In some embodiments, the first processed image output by the first output unit 03 is used for display. Optionally, the display is local display or off-site display.

In some embodiments, as shown in FIGS. 4 and 5 , the image processing apparatus 1 is capable of communicating with a processor 06 configured to perform second processing on an image output from the at least one second output unit 04 received.

Optionally, the image processing apparatus 1 can communicate with the processor 06, and the processor 06 can be connected with the at least one second output unit 04 to receive the image output by the at least one second output unit 04, and perform the second processing on the image. Optionally, the second processing is at least one of storage processing and intelligent processing. Optionally, the intelligent processing includes at least one of artificial intelligence AI processing, augmented reality AR processing, virtual reality VR processing and mixed reality MR processing.

In some embodiments, there may be one or more processors 06, as shown in FIG. 4, when there is one processor 06, one processor 06 may be connected to at least one second output unit 04 at the same time; as shown in FIG. 5 As shown, when there are multiple processors 06, different processors 06 can be selected to be connected to one or several second output units 04 independently of each other.

Optionally, each of the at least one second output unit 04 may be independently selected to correspond to one processor 06 or to correspond to a plurality of processors 06 .

Alternatively, the processor 06 may be an application processor.

In some embodiments, as shown in FIG. 6 , the image processing apparatus 1 can communicate with an initialization unit 10 , and the initialization unit 10 is configured to: configure parameters for the units in the image processing apparatus 1 .

Optionally, the initialization unit 10 can be connected with the units included in the image processing apparatus 1 to configure parameters for the units in the image processing apparatus 1 during initialization, and each unit in the image processing apparatus 1 works according to the configured parameters. .

Optionally, the parameter may be at least one of pixel size, pixel format, resolution, color gamut, and refresh frequency. Optionally, the pixel format may be at least one of a left-right format and a red-blue format.

In some embodiments, as shown in FIG. 7 , the image processing apparatus 1 is capable of communicating with a display processing unit 07 , which is configured to pre-display the first processed image output from the first output unit 03 before being displayed. deal with.

Optionally, the image processing apparatus 1 may communicate with the display processing unit 07, and the display processing unit 07 may be connected to the first output unit 03 for preprocessing the first processed image output from the first output unit 03 before display .

Optionally, the preprocessing is, for example, at least one of denoising processing and contrast stretching processing.

In some embodiments, the image processing apparatus 1 is capable of communicating with the display screen 08, the display screen 08 being configured to obtain the first processed image from the first output unit 03 and display the first processed image.

Optionally, as shown in FIG. 8 , the display screen 08 may be connected to the first output unit 03 to display the first processed image output by the first output unit 03 .

Optionally, as shown in FIG. 9 , the display screen 08 may also be connected to the display processing unit 07 to display the first processed image processed by the display processing unit 07 .

In some embodiments, as shown in FIG. 10 , the image processing apparatus 1 can communicate with the image obtaining unit 09 , and the image obtaining unit 09 is configured to obtain the image to be processed and transmit the image to be processed to the receiving unit 01 . Optionally, the image obtaining unit 09 is a camera device or a radar. The camera device is, for example, a camera.

In some embodiments, the image processing apparatus 1 is disposed on the chip. Optionally, the chip is a general-purpose chip or a dedicated chip. Optionally, the chip is an application specific integrated circuit (ASIC) chip.

As shown in FIG. 11 , an embodiment of the present disclosure provides a terminal 2 , where the terminal 2 includes the above-mentioned image processing apparatus 1 .

The foregoing description and drawings sufficiently illustrate the embodiments of the present disclosure to enable those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, process, and other changes. The examples are only representative of possible variations. Unless expressly required, individual components and functions are optional and the order of operations may vary. Portions and features of some embodiments may be included in or substituted for those of other embodiments. The scope of the disclosed embodiments includes the full scope of the claims, along with all available equivalents of the claims. When used in this application, although the terms "first," "second," etc. may be used in this application to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, without changing the meaning of the description, a first element could be termed a second element, and, similarly, a second element could be termed a first element, so long as all occurrences of "the first element" were consistently renamed and all occurrences of "the first element" were named consistently. The "second element" can be renamed consistently. The first element and the second element are both elements, but may not be the same element. Also, the terms used in this application are used to describe the embodiments only and not to limit the claims. As used in the description of the embodiments and the claims, the singular forms "a" (a), "an" (an) and "the" (the) are intended to include the plural forms as well, unless the context clearly dictates otherwise. . Similarly, the term "and/or" as used in this application is meant to include any and all possible combinations of one or more of the associated listings. Additionally, as used in this application, the term "comprise" and its variations "comprises" and/or including and/or the like refer to stated features, integers, steps, operations, elements, and/or The presence of a component does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and/or groupings of these. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, or device that includes the element. Herein, each embodiment may focus on the differences from other embodiments, and the same and similar parts between the various embodiments may refer to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method sections disclosed in the embodiments, reference may be made to the descriptions of the method sections for relevant parts.

Those skilled in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software may depend on the specific application and design constraints of the technical solution. Skilled artisans may use different methods for implementing the described functionality for each particular application, but such implementations should not be considered beyond the scope of the disclosed embodiments. Those skilled in the art can clearly understand that, for the convenience and brevity of the description, for the working process of the above-described systems, devices and units, reference may be made to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

In the embodiments disclosed herein, the disclosed methods and products (including but not limited to apparatuses, devices, etc.) may be implemented in other ways. For example, the apparatus embodiments described above are only illustrative. For example, the division of units may only be a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or may be Integration into another system, or some features can be ignored, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms. Units described as separate components may or may not be physically separated, and components shown as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. This embodiment may be implemented by selecting some or all of the units according to actual needs. In addition, each functional unit in the embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.

In the drawings, the width, length, thickness, etc. of structures such as elements or layers may be exaggerated for clarity and descriptiveness. When an element or layer or the like is referred to as being "disposed on" (or "mounted on," "laying on," "adhering to," "coating on," and the like) another element or layer "over" or "above" When referring to “on”, the element or layer and other structures may be directly “disposed on” “above” or “on” the above-mentioned another element or layer, or there may be intervening elements or layers between the above-mentioned another element or layer, etc. structure, even partially embedded in another element or layer as described above.

Claims

An image processing device, comprising:

a receiving unit, configured to receive the image to be processed;

a first processing unit, configured to perform first processing on the to-be-processed image to obtain a first processed image;

a first output unit configured to output the first processed image;

At least one second output unit configured to output images obtained from at least one of the receiving unit and the first processing unit.
The image processing apparatus according to claim 1, further comprising: a buffering unit configured to buffer the to-be-processed image received by the receiving unit;

the first processing unit, configured to perform first processing on the to-be-processed image obtained from the cache unit to obtain the first processed image;

The at least one second output unit is configured to output an image obtained from at least one of the buffer unit and the first processing unit.
The image processing apparatus according to claim 2, wherein the buffer unit includes at least one of an input register of the receiving unit and a receiving register of the first processing unit.
The image processing apparatus according to claim 1, wherein the first processing unit is configured to perform visual processing on the to-be-processed image to obtain the first processed image.
The image processing apparatus according to claim 1, wherein the first processing unit is configured to perform transparent transmission processing on the to-be-processed image.
The image processing apparatus according to claim 1, wherein the first processing unit processes the to-be-processed image in at least one of the following ways:

processing the to-be-processed image in units of pixels;

The to-be-processed image is processed in units of rows or columns.
6. The image processing apparatus of claim 6, wherein the pixels comprise at least one of a single pixel and a pixel matrix.
The image processing apparatus according to claim 1, wherein the image to be processed obtained by the first processing unit and the image obtained by the at least one second output unit are both complete images.
The image processing apparatus according to claim 1, wherein the first processed image output by the first output unit is used for display.
The image processing apparatus according to claim 9, wherein the display is local display or off-site display.
2. The image processing apparatus of claim 1 or 2, wherein the image processing apparatus is capable of communicating with a processor configured to perform a first step on the image output by the at least one second output unit. Second treatment.
The image processing apparatus according to claim 11, wherein the second processing is at least one of storage processing and intelligent processing.
The image processing apparatus according to claim 12, wherein the intelligent processing includes at least one of artificial intelligence (AI) processing, augmented reality (AR) processing, virtual reality (VR) processing and mixed reality (MR) processing.
The image processing apparatus of claim 1, wherein the image processing apparatus is capable of communicating with an initialization unit, the initialization unit configured to perform parameter configuration for units in the image processing apparatus.
The image processing apparatus of claim 1, wherein the image processing apparatus is capable of communicating with a display processing unit configured to display the first processed image output from the first output unit previous preprocessing.
The image processing apparatus of claim 1, wherein the image processing apparatus is capable of communicating with a display screen, the display screen being configured to obtain the first processed image from the first output unit, displaying the Describe the first processed image.
1. The image processing apparatus of claim 1, wherein the image processing apparatus is capable of communicating with an image obtaining unit, the image obtaining unit being configured to obtain the image to be processed and transmit the image to be processed to the the receiving unit.
The image processing apparatus according to any one of claims 1 to 17, wherein the image processing apparatus is provided in a chip.
The image processing apparatus according to claim 18, wherein the chip is a dedicated chip.
A terminal, comprising the image processing apparatus according to any one of claims 1 to 19.