CN108986028B - Method and system for processing high-resolution image - Google Patents
Method and system for processing high-resolution image Download PDFInfo
- Publication number
- CN108986028B CN108986028B CN201810684366.3A CN201810684366A CN108986028B CN 108986028 B CN108986028 B CN 108986028B CN 201810684366 A CN201810684366 A CN 201810684366A CN 108986028 B CN108986028 B CN 108986028B
- Authority
- CN
- China
- Prior art keywords
- interface
- image
- resolution
- resolution image
- chip
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 title claims abstract description 124
- 238000000034 method Methods 0.000 title claims abstract description 24
- 230000000694 effects Effects 0.000 claims abstract description 57
- 230000005540 biological transmission Effects 0.000 claims description 7
- 238000012805 post-processing Methods 0.000 abstract description 3
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
The invention provides a method and a system for processing a high-resolution image, wherein the system comprises a first chip and a second chip, the first chip comprises a first interface, a first processing unit and a second interface; the second chip comprises a third interface, a second processing unit and a fourth interface. The first processing chip receives the high-resolution image through the first interface, splits the high-resolution image and then sends the split high-resolution image to the second chip through the second interface. The second chip is a chip with the performance of processing the high-resolution image, the received split lower-resolution image is spliced into the high-resolution image again and processed, the image effect parameter corresponding to the processing result is sent to the first chip, and the first chip receives the image effect parameter and executes the corresponding image effect on the first-resolution image according to the image effect parameter. Thus, the first chip with lower performance can realize the post-processing operation of the super-resolution image.
Description
Technical Field
The present invention relates to the field of image processing, and in particular, to a method and system for high resolution image processing.
Background
With the development of science and technology and the progress of society, people also put forward higher requirements on photographing, which is mainly reflected in that a camera is required to be capable of shooting images with high resolution.
Currently, super-resolution cameras are widely used, and super-resolution (i.e. super-resolution) can be defined as resolution greater than 1080P. After the image collected by the super-resolution camera is transmitted to the super-resolution image processing system, because the hardware condition of part of post-processors is limited, the post-processors can only process the image with lower resolution, and the received super-resolution image is often not qualified. Therefore, it would be useful if an image processing system capable of processing only low resolution images could be made to process hyper-resolution images on the basis of unchanged hardware conditions.
Disclosure of Invention
Therefore, it is necessary to provide a technical solution for high-resolution image processing, which is used to solve the problem that a super-resolution image processing system cannot process a super-resolution image due to the limitation of hardware conditions.
To achieve the above object, the inventors provide a system for high resolution image processing, the system comprising a first chip and a second chip, the first chip comprising a first interface, a first processing unit and a second interface; the second chip comprises a third interface, a second processing unit and a fourth interface;
the first interface supports receiving a first resolution image, the second interface supports transmitting a second resolution image, the third interface supports receiving the second resolution image, and the fourth interface supports transmitting the first resolution image; the first resolution is greater than the second resolution;
the first processing unit is used for receiving the first resolution images through the first interface, cutting the first resolution images into a plurality of second resolution images according to the size relation between the first resolution and the second resolution, and sequentially sending the cut second resolution images to the third interface through the second interface;
the second processing unit is used for receiving the second resolution images through the third interface, splicing the received second resolution images into first resolution images again according to a cutting rule, performing first processing on the spliced first resolution images by adopting an image processing algorithm, obtaining image effect parameters according to a first image processing result, and sending the image effect parameters to the first interface through the fourth interface;
the first processing unit is used for receiving the image effect parameters through the second interface and executing corresponding image effects on the first resolution ratio image according to the image effect parameters.
Further, the first chip further includes a first storage unit, and the first processing unit is configured to store the first resolution image after the image effect is performed in the first storage unit.
Further, the image processing algorithm includes any one of an HDR image algorithm, a night scene image enhancement algorithm, a face recognition algorithm, an object recognition algorithm, and a human body recognition algorithm.
Further, the first interface and the third interface are MIPI-CSI receiving interfaces, and the second interface and the fourth interface are MIPI-CSI transmitting interfaces.
Further, the second interface and the fourth interface may not have matching transmission capabilities.
The inventor also provides a method of high resolution image processing, which is applied to a system of high resolution image processing, the system comprising a first chip and a second chip, the first chip comprising a first interface, a first processing unit and a second interface; the second chip comprises a third interface, a second processing unit and a fourth interface;
the first interface supports receiving a first resolution image, the second interface supports sending a second resolution image, the third interface supports receiving the second resolution image, and the fourth interface supports sending the first resolution image; the first resolution is greater than the second resolution;
the method comprises the following steps:
the first processing unit receives the first resolution image through the first interface, cuts the first resolution image into a plurality of second resolution images according to the size relation between the first resolution and the second resolution, and sequentially sends each cut second resolution image to the third interface through the second interface;
the second processing unit receives the second resolution image through the third interface, splices the received second resolution image into a first resolution image again according to a cutting rule, performs first processing on the spliced first resolution image by adopting an image processing algorithm, obtains an image effect parameter according to a first image processing result, and sends the image effect parameter to the first interface through the fourth interface;
the first processing unit receives the image effect parameters through the second interface and executes corresponding image effects on the first resolution image according to the image effect parameters.
Further, the first chip further includes a first storage unit, the method including:
the first processing unit stores the first resolution image after the image effect is executed in the first storage unit.
Further, the image processing algorithm comprises any one of an HDR image algorithm, a night scene image enhancement algorithm, a face recognition algorithm, an object recognition algorithm and a human body recognition algorithm.
Further, the first interface and the third interface are MIPI-CSI receiving interfaces, and the second interface and the fourth interface are MIPI-CSI transmitting interfaces.
Further, the second interface and the fourth interface may not have matching transmission capabilities.
Different from the prior art, the method and system for high resolution image processing according to the above technical solution include a first chip and a second chip, where the first chip includes a first interface, a first processing unit, and a second interface; the second chip comprises a third interface, a second processing unit and a fourth interface. The first processing chip receives the high-resolution image through the first interface, splits the high-resolution image and then sends the split high-resolution image to the second chip through the second interface. The second chip is a chip with the performance of processing the high-resolution image, the received split lower-resolution image is spliced into the high-resolution image again and processed, the image effect parameter corresponding to the processing result is sent to the first chip, and the first chip receives the image effect parameter and executes the corresponding image effect on the first-resolution image according to the image effect parameter. Thus, the first chip with lower performance can realize the post-processing operation of the super-resolution image.
Drawings
FIG. 1 is a schematic diagram of a system for high resolution image processing according to an embodiment of the present invention;
FIG. 2 is a flow diagram of a method of high resolution image processing according to an embodiment of the invention;
description of reference numerals:
101. a first chip;
111. a first interface; 112. a first processing unit; 113. a second interface;
102. a second chip;
121. a third interface; 122. a second processing unit; 123. a fourth interface;
103. super minute camera.
Detailed Description
To explain technical contents, structural features, and objects and effects of the technical solutions in detail, the following detailed description is given with reference to the accompanying drawings in conjunction with the embodiments.
Referring to fig. 1, a system for high resolution image processing according to an embodiment of the invention is shown. The system comprises a first chip 101 and a second chip 102, the first chip 101 comprising a first interface 111, a first processing unit 112 and a second interface 113; the second chip 102 includes a third interface 121, a second processing unit 122, and a fourth interface 123;
the first interface 111 supports receiving a first resolution image, the second interface 113 supports transmitting a second resolution image, the third interface 121 supports receiving a second resolution image, and the fourth interface 123 supports transmitting a first resolution image; the first resolution is greater than the second resolution.
The first processing unit and the second processing unit are electronic components having an image processing function, such as a DSP processor (digital signal processor). Preferably, the second processing unit has a better performance than the first processing unit, i.e. the second processing unit is capable of processing higher resolution images than the first processing unit, or is capable of processing images using more complex algorithms, such as AI algorithms.
In this embodiment, the first interface and the third interface are MIPI-CSI receiving interfaces, and the second interface and the fourth interface are MIPI-CSI transmitting interfaces. Specifically, the second interface and the fourth interface may not transmit capabilities. For example, the second interface is a transmission interface supporting a 1080P resolution image, and the fourth interface is a transmission interface supporting a 4K resolution image. In other embodiments, the second interface, the third interface, and the fourth interface may also be SPI interfaces. Preferably, the second interface is a MIPI-Tx/Rx multiplexing interface, that is, the second interface is used for both transmitting data and receiving data, so that the second interface receives the image effect parameters transmitted by the second chip.
The first processing unit 112 is configured to receive the first resolution image through the first interface 111, cut the first resolution image into a plurality of second resolution images according to a size relationship between the first resolution and the second resolution, and sequentially send each cut second resolution image to the third interface 121 through the second interface 113. In the present embodiment, the first resolution is 4K, the second resolution is 1080P, and the first processing unit splits the 4K image received by the super-resolution camera 103 into 4 1080P images. The rule of splitting is preferably to divide the received image by 4 equal parts.
The second processing unit 122 is configured to receive the second resolution image through the third interface 121, re-splice the received second resolution image into the first resolution image according to a cutting rule, perform first processing on the spliced first resolution image by using an image processing algorithm, obtain an image effect parameter according to a first image processing result, and send the image effect parameter to the first interface through the fourth interface 123;
the first processing unit 112 is configured to receive the image effect parameter through the second interface, and perform a corresponding image effect on the first resolution image according to the image effect parameter.
The image effect parameters correspond to an image processing algorithm, and in this embodiment, the image processing algorithm includes any one of an HDR image algorithm, a night view image enhancement algorithm, a face recognition algorithm, an object recognition algorithm, and a human body recognition algorithm.
Specifically, when the image processing algorithm is a night scene enhancement algorithm, the image effect parameter is a night scene enhancement effect, for example, a luminance value of a night scene image that needs to be enhanced;
when the image processing algorithm is an HDR (high dynamic range) image algorithm, the image effect parameter is an HDR effect image, e.g., luminance values that need to be enhanced to convert the image into the HDR image;
when the image processing algorithm is a face or object recognition algorithm, the image effect parameter is a coordinate and a weight value of a feature value of the face or object, for example, the image effect may be to frame a position of the face or object in the image.
In some embodiments, the first chip further includes a first storage unit, and the first processing unit is configured to store the first resolution image after the image effect is performed in the first storage unit. The first-resolution image may be displayed by the display unit, or may wait for further processing by other applications, such as compression processing.
As shown in fig. 2, the inventors further provide a method of high resolution image processing, which is applied to a system of high resolution image processing, the system comprising a first chip and a second chip, the first chip comprising a first interface, a first processing unit and a second interface; the second chip comprises a third interface, a second processing unit and a fourth interface;
the first interface supports receiving a first resolution image, the second interface supports sending a second resolution image, the third interface supports receiving the second resolution image, and the fourth interface supports sending the first resolution image; the first resolution is greater than the second resolution;
the method comprises the following steps:
firstly, in step S201, a first processing unit receives a first resolution image through a first interface, cuts the first resolution image into a plurality of second resolution images according to a size relationship between the first resolution and the second resolution, and sequentially sends each cut second resolution image to a third interface through a second interface;
then, in step S202, the second processing unit receives the second resolution image through the third interface, splices the received second resolution image into a first resolution image again according to a cutting rule, performs first processing on the spliced first resolution image by adopting an image processing algorithm, obtains an image effect parameter according to a first image processing result, and sends the image effect parameter to the first interface through the fourth interface;
then, step S203 is executed in which the first processing unit receives the image effect parameter through the second interface, and performs a corresponding image effect on the first resolution image according to the image effect parameter.
In some embodiments, the first chip further comprises a first memory cell, the method comprising: the first processing unit stores the first resolution image after the image effect is executed in the first storage unit. After the first processing unit acquires a corresponding instruction, corresponding operation is performed on the acquired image stored in the first storage unit, wherein the operation instruction includes but is not limited to display operation, compression operation, transmission operation and the like.
The method and system for processing high resolution images according to the above technical solution, the system includes a first chip and a second chip, the first chip includes a first interface, a first processing unit and a second interface; the second chip comprises a third interface, a second processing unit and a fourth interface. The first processing chip receives the high-resolution image through the first interface, splits the high-resolution image and then sends the split high-resolution image to the second chip through the second interface. The second chip is a chip with the performance of processing the high-resolution image, the received split lower-resolution image is spliced into the high-resolution image again and processed, the image effect parameter corresponding to the processing result is sent to the first chip, and the first chip receives the image effect parameter and executes the corresponding image effect on the first-resolution image according to the image effect parameter. Thus, the first chip with lower performance can realize the post-processing operation of the super-resolution image.
It should be noted that, although the above embodiments have been described herein, the invention is not limited thereto. Therefore, based on the innovative concepts of the present invention, the technical solutions of the present invention can be directly or indirectly applied to other related technical fields by making changes and modifications to the embodiments described herein, or by using equivalent structures or equivalent processes performed in the content of the present specification and the attached drawings, which are included in the scope of the present invention.
Claims (10)
1. A system for high resolution image processing, the system comprising a first chip and a second chip, the first chip comprising a first interface, a first processing unit and a second interface; the second chip comprises a third interface, a second processing unit and a fourth interface;
the first interface supports receiving a first resolution image, the second interface supports transmitting a second resolution image, the third interface supports receiving a second resolution image, and the fourth interface supports transmitting a first resolution image; the first resolution is greater than the second resolution;
the first processing unit is used for receiving the first resolution image through the first interface, cutting the first resolution image into a plurality of second resolution images according to the size relationship between the first resolution and the second resolution, and sequentially sending each cut second resolution image to the third interface through the second interface;
the second processing unit is used for receiving the second resolution images through the third interface, splicing the received second resolution images into the first resolution images again according to a cutting rule, performing first processing on the spliced first resolution images by adopting an image processing algorithm, obtaining image effect parameters according to a first image processing result, and sending the image effect parameters to the first interface through the fourth interface;
the first processing unit is used for receiving the image effect parameters through the second interface and executing corresponding image effects on the first resolution ratio image according to the image effect parameters.
2. The system for high resolution image processing according to claim 1, wherein the first chip further includes a first storage unit, and the first processing unit is configured to store the first resolution image after the image effect is performed in the first storage unit.
3. The system for high resolution image processing according to claim 1, wherein the image processing algorithm comprises any one of an HDR image algorithm, a night scene image enhancement algorithm, a face recognition algorithm, an object recognition algorithm, and a human body recognition algorithm.
4. The system of high resolution image processing according to claim 1, wherein the first interface and the third interface are MIPI-CSI receiving interfaces, and the second interface and the fourth interface are MIPI-CSI transmitting interfaces.
5. The system for high resolution image processing according to claim 1 or 4, wherein the second interface and the fourth interface are non-matching transmission capabilities.
6. A method for high resolution image processing is applied to a system for high resolution image processing, the system comprises a first chip and a second chip, the first chip comprises a first interface, a first processing unit and a second interface; the second chip comprises a third interface, a second processing unit and a fourth interface;
the first interface supports receiving a first resolution image, the second interface supports sending a second resolution image, the third interface supports receiving the second resolution image, and the fourth interface supports sending the first resolution image; the first resolution is greater than the second resolution;
the method comprises the following steps:
the first processing unit receives the first resolution image through the first interface, cuts the first resolution image into a plurality of second resolution images according to the size relation between the first resolution and the second resolution, and sequentially sends each cut second resolution image to the third interface through the second interface;
the second processing unit receives the second resolution images through the third interface, rejoins the received second resolution images into the first resolution images according to a cutting rule, performs first processing on the stitched first resolution images by adopting an image processing algorithm, obtains image effect parameters according to a first image processing result, and sends the image effect parameters to the first interface through the fourth interface;
the first processing unit receives the image effect parameters through the second interface and executes corresponding image effects on the first resolution image according to the image effect parameters.
7. The method of high resolution image processing according to claim 6, wherein the first chip further includes a first storage unit, the method comprising:
the first processing unit stores the first resolution image after the image effect is executed in the first storage unit.
8. The method of high resolution image processing according to claim 6, wherein the image processing algorithm comprises any one of an HDR image algorithm, a night scene image enhancement algorithm, a face recognition algorithm, an object recognition algorithm, a human body recognition algorithm.
9. The method of high resolution image processing according to claim 6, wherein the first interface and the third interface are MIPI-CSI receiving interfaces, and the second interface and the fourth interface are MIPI-CSI transmitting interfaces.
10. The method of high resolution image processing according to claim 6 or 9, wherein the second interface and the fourth interface are non-matching transmission capabilities.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810684366.3A CN108986028B (en) | 2018-06-28 | 2018-06-28 | Method and system for processing high-resolution image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810684366.3A CN108986028B (en) | 2018-06-28 | 2018-06-28 | Method and system for processing high-resolution image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108986028A CN108986028A (en) | 2018-12-11 |
| CN108986028B true CN108986028B (en) | 2022-12-16 |
Family
ID=64538761
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810684366.3A Active CN108986028B (en) | 2018-06-28 | 2018-06-28 | Method and system for processing high-resolution image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108986028B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114341925A (en) * | 2020-07-30 | 2022-04-12 | 华为技术有限公司 | Electronic system, camera module and system on chip |
| CN113963650B (en) * | 2021-10-11 | 2023-07-04 | Tcl华星光电技术有限公司 | Driving device and display apparatus |
| CN117151968B (en) * | 2023-10-25 | 2024-02-27 | 南京芯驰半导体科技有限公司 | Image processing method and device for vehicle, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006094237A (en) * | 2004-09-24 | 2006-04-06 | Fuji Xerox Co Ltd | Image processing device, image processing method and image processing program |
| JP2008085474A (en) * | 2006-09-26 | 2008-04-10 | Victor Co Of Japan Ltd | Image data processor |
| JP2009010626A (en) * | 2007-06-27 | 2009-01-15 | Toshiba Corp | Image processing device and image processing method |
| JP2010130701A (en) * | 2009-12-11 | 2010-06-10 | Toshiba Corp | Image processing device, receiving device and display device |
| CN105096249A (en) * | 2014-05-23 | 2015-11-25 | 北京大学 | Image processing method and image processing apparatus |
| DE102015115998A1 (en) * | 2014-09-29 | 2016-03-31 | Avaya Inc. | Segmented video codec for high-resolution, high-frame-rate video |
-
2018
- 2018-06-28 CN CN201810684366.3A patent/CN108986028B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006094237A (en) * | 2004-09-24 | 2006-04-06 | Fuji Xerox Co Ltd | Image processing device, image processing method and image processing program |
| JP2008085474A (en) * | 2006-09-26 | 2008-04-10 | Victor Co Of Japan Ltd | Image data processor |
| JP2009010626A (en) * | 2007-06-27 | 2009-01-15 | Toshiba Corp | Image processing device and image processing method |
| JP2010130701A (en) * | 2009-12-11 | 2010-06-10 | Toshiba Corp | Image processing device, receiving device and display device |
| CN105096249A (en) * | 2014-05-23 | 2015-11-25 | 北京大学 | Image processing method and image processing apparatus |
| DE102015115998A1 (en) * | 2014-09-29 | 2016-03-31 | Avaya Inc. | Segmented video codec for high-resolution, high-frame-rate video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108986028A (en) | 2018-12-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102375307B1 (en) | Method, apparatus, and system for sharing virtual reality viewport | |
| CN108986028B (en) | Method and system for processing high-resolution image | |
| EP3067746B1 (en) | Photographing method for dual-camera device and dual-camera device | |
| US10679426B2 (en) | Method and apparatus for processing display data | |
| KR102385365B1 (en) | Electronic device and method for encoding image data in the electronic device | |
| US9232177B2 (en) | Video chat data processing | |
| US11783447B2 (en) | Methods and apparatus for optimized stitching of overcapture content | |
| TWI818211B (en) | Eye positioning device and method and 3D display device and method | |
| KR20190082080A (en) | Multi-camera processor with feature matching | |
| CN101867721A (en) | Implement method, implement device and imaging device for wide dynamic images | |
| CN113658065B (en) | Image noise reduction method and device, computer readable medium and electronic equipment | |
| CN114429495A (en) | Three-dimensional scene reconstruction method and electronic equipment | |
| CN110650309B (en) | Video conference video image transmission method, terminal and readable storage medium | |
| KR102301940B1 (en) | Method and apparatus for image fusion | |
| EP4293619A1 (en) | Image processing method and related device | |
| US20180359430A1 (en) | Image processing device, image processing system, and non-transitory storage medium | |
| US9235905B2 (en) | Efficient screen image transfer | |
| CN113837918B (en) | Method and device for realizing rendering isolation by multiple processes | |
| WO2022000347A1 (en) | Image processing method, display processing apparatus, and computer readable storage medium | |
| CN113179375A (en) | Exposure processing method, exposure processing apparatus, electronic device, storage medium, and program product | |
| CN113592734B (en) | Image processing method and device and electronic equipment | |
| CN112738399A (en) | Image processing method and device and electronic equipment | |
| CN116723264B (en) | Method, apparatus and storage medium for determining target location information | |
| CN115913939B (en) | Real-time image data modification method and device in cloud desktop image transmission process | |
| WO2023036257A1 (en) | Image processing method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 350003 building 18, No.89, software Avenue, Gulou District, Fuzhou City, Fujian Province Applicant after: Ruixin Microelectronics Co.,Ltd. Address before: 350003 building 18, No.89, software Avenue, Gulou District, Fuzhou City, Fujian Province Applicant before: FUZHOU ROCKCHIP ELECTRONICS Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |