CN201044472Y - Image processing device - Google Patents

Image processing device Download PDF

Info

Publication number
CN201044472Y
CN201044472Y CN 200720149195 CN200720149195U CN201044472Y CN 201044472 Y CN201044472 Y CN 201044472Y CN 200720149195 CN200720149195 CN 200720149195 CN 200720149195 U CN200720149195 U CN 200720149195U CN 201044472 Y CN201044472 Y CN 201044472Y
Authority
CN
China
Prior art keywords
unit
data
imageing sensor
image
links
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN 200720149195
Other languages
Chinese (zh)
Inventor
郜文参
贡青
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Superpix Micro Technology Co Ltd
Original Assignee
Beijing Superpix Micro Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Superpix Micro Technology Co Ltd filed Critical Beijing Superpix Micro Technology Co Ltd
Priority to CN 200720149195 priority Critical patent/CN201044472Y/en
Application granted granted Critical
Publication of CN201044472Y publication Critical patent/CN201044472Y/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Abstract

The utility model relates to a device for processing images which comprises an embedded processor, wherein, the embedded processor is connected with an image sensor and is used for collection and compression of image data and at least one of the playback processings. The device for processing images of the utility model is used for collection and compression of image data and at least one of the playback processings, reduces the volume of the system, decreases the cost of the system, and can flexibly process the image data.

Description

A kind of device of image processing
Technical field
The utility model relates to the electronic communication field, relates in particular to a kind of device of image processing.
Background technology
Along with Development of Multimedia Technology, need electronic equipment that multimedia services such as abundant image, sound are provided; And embedded system is because the advantage of little, the power saving of its volume, feature richness, and is widely used in the various electronic equipments.
In order to realize the image applications of embedded system, existing method comprises: at first, with view data through the dedicated processes circuit (such as hardware circuit module or special DSP (digital signal processor)) gather and compress processing, afterwards, signal after will handling again is sent to flush bonding processor, by flush bonding processor the file after compressing is carried out playback process (that is, generating image from information).
The structure chart of the image processing of existing realization embedded system as shown in Figure 1, comprise: imageing sensor, the dedicated processes circuit of processing is gathered and compressed to view data, i.e. special chip (such as ASIC (application-specific integrated circuit (ASIC)) or dsp chip) and the flush bonding processor that the file after the compression carried out playback process.Wherein, imageing sensor links to each other with flush bonding processor by serial data, serial clock and special chip, and special chip links to each other with flush bonding processor with imageing sensor by master clock, pixel clock, data/address bus, row, field synchronization bus.
This special chip has very high arithmetic speed, is used under the situation that does not need flush bonding processor to intervene, carry out IMAQ, finishing the collection of view data rapidly, and the view data of gathering compressed processing, with the image data transmission after the compression to flush bonding processor.Some special chip also can be used as coprocessor, with the flush bonding processor concurrent working, carries out the complex image computing.
Collection and the compression of adopting the dedicated processes circuit to carry out view data are handled, though can improve processing speed, but because it increases manufacturing cost, increases the circuit volume, increases power consumption, and treatment of picture mode relative fixed is difficult to the problems such as influence changing flexibly and be subjected to supply channel, and has limited the range of application of dedicated processes circuit.
The utility model content
The utility model provides a kind of device of image processing, can handle flexibly view data, and reduce the volume of system, has reduced the cost of system.
The utility model provides a kind of device of image processing, and described device links to each other with imageing sensor, and described device comprises: the flush bonding processor of at least one processing that is used for carrying out collection, compression and the playback process of view data.
Described embedded processing implement body comprises: be used for from the imageing sensor image data image acquisition units, be used for that the data of gathering are compressed the image compression unit of processing and the data that are used for compression is obtained are carried out at least one unit of the image reproducing unit of playback process, wherein, described image acquisition units is connected with described image compression unit, and described image compression unit is connected with described image reproducing unit.
Described image acquisition units specifically comprises:
Be used for to imageing sensor send acquisition parameter the acquisition parameter output interface, be used for to imageing sensor tranmitting data register frequency the master clock output unit, be used to receive the pixel clock receiving element of the pixel clock that imageing sensor sends and be used for the data acquisition performance element of the acquisition function of carries out image data; Described acquisition parameter output interface links to each other with imageing sensor, and described master clock output unit links to each other with imageing sensor, and described pixel clock receiving element links to each other with imageing sensor, and described data acquisition performance element links to each other with imageing sensor.
Described image reproducing unit specifically comprises:
Be used for according to the file header information obtained set up look-up table and inverse quantization table the table structural unit,
But be used for decision block decompress the data block obtain whether within the indication range of equipment and will be in the cutting unit of the output of the data block within the equipment indication range,
Be used for the data after the conversion are carried out the downsampling unit of the down-sampling processing of luminance component,
One end of described table structural unit links to each other with the data message acquiring unit of the file header information that is used to obtain compressed file, the other end links to each other with the piece decoding unit that is used for compressed file is carried out the piece decompression, also has an end with the particular content that is used for according to the table structural unit converter unit that output block carries out conversion process to be linked to each other;
One end of described cutting unit links to each other with described decoding unit, and the other end links to each other with described converter unit;
Described downsampling unit links to each other with described converter unit.
The technical scheme that is provided by above-mentioned the utility model as can be seen, the utility model adopt flush bonding processor to view data gather, at least one processing in compression and the playback process, reduced the volume of system, reduced the cost of system, and can handle flexibly view data.
Description of drawings
Fig. 1 is the structure chart of the image processing of existing realization embedded system;
Fig. 2 is the structure chart of device of the present utility model;
Fig. 3 is the connection diagram of device of the present utility model and imageing sensor;
Fig. 4 is the schematic diagram of YUV420 sample mode of the present utility model;
Fig. 5 is the flow chart of data processing figure of the utility model in the image reproducing processing procedure;
Fig. 6 is the process schematic diagram that the Y component is carried out down-sampling of the present utility model.
Embodiment
The utility model adopts flush bonding processor to realize at least one processing in collection, compression and the playback process of view data, promptly, flush bonding processor of the present utility model can be gathered, press and compile and playback process, perhaps gather, any two processing in compression and the playback process, perhaps gather, any one processing in compression and the playback process.The concrete structure of flush bonding processor of the present utility model comprises at least one unit in image acquisition units, image compression unit and the image reproducing unit as shown in Figure 2, wherein,
Image acquisition units is used for from the imageing sensor image data;
Image compression unit is used for linking to each other with image acquisition units, and the data of image acquisition units collection are compressed processing;
The image reproducing unit is used for linking to each other with image compression unit, and the data that the image compression unit compression obtains are carried out playback process.
Wherein, image acquisition units comprises:
The acquisition parameter output interface is used for linking to each other with imageing sensor, sends acquisition parameter to imageing sensor; Specifically can send acquisition parameter to imageing sensor by the serial data and the serial clock of flush bonding processor; This acquisition parameter is stored in the internal register of imageing sensor;
The master clock generation unit is used to produce clock frequency;
The master clock output unit is used for linking to each other with the master clock generation unit, and to imageing sensor tranmitting data register frequency, this clock frequency is as the master clock of imageing sensor;
The pixel clock receiving element is used for linking to each other with imageing sensor, receives the pixel clock that imageing sensor sends; The size of this pixel clock is determined according to the concrete parameter in the internal register of imageing sensor, and is produced by master clock;
The data acquisition performance element is used for linking to each other with imageing sensor, under the driving of pixel clock, and the acquisition function of carries out image data;
Synchronization signal unit is used for linking to each other with imageing sensor, initial with the row and column of imageing sensor synchronous transmission view data respectively by row, field sync signal.
This image reproducing unit specifically comprises:
The data message acquiring unit is used for linking to each other with image compression unit, obtains the file header information of compressed file;
The table structural unit is used for linking to each other with piece decoding unit, converter unit and data message acquiring unit, sets up look-up table and inverse quantization table according to the file header information of obtaining; This look-up table and inverse quantization table are used for carrying out under the situation of image operation at needs, directly find out the result from look-up table and inverse quantization table according to the parameter of computing, so that save time;
The piece decoding unit is used for linking to each other with the cutting unit, and compressed file is carried out the processing that piece decompresses, and the transmission of data blocks after piece decompressed is to the cutting unit;
The cutting unit decompresses the data block obtain whether within the indication range of equipment but be used for decision block, and will be in the transmission of data blocks within the equipment indication range to converter unit;
Converter unit is used for linking to each other with the cutting unit, receives the output block of cutting unit, and according to the particular content of table structural unit output block is carried out conversion process;
Downsampling unit is used for linking to each other with converter unit, the data after the conversion is carried out the down-sampling of luminance component and handles;
Color transformed unit is used for view data is transformed to the form that display unit can show;
Display unit is used for the result of converter unit is exported on display device.
Processing method to flush bonding processor of the present utility model is described in detail below.This processing method comprises: the collection of view data, compression and playback three phases are described in detail the processing procedure of this three phases respectively below.
The gatherer process of view data comprises the steps:
Step 1: flush bonding processor sends acquisition parameter and master clock frequency to imageing sensor;
Step 2: imageing sensor receives acquisition parameter and the master clock frequency that flush bonding processor sends, and this acquisition parameter is stored in the internal register, obtains pixel clock by master clock;
Step 3: imageing sensor sends view data and pixel clock to flush bonding processor;
Step 4: flush bonding processor receives view data according under the driving of pixel clock, and by row, field sync signal row and column initial of synchronous images data respectively.
After the entire image data acquisition finished, flush bonding processor compressed processing to the view data that collects.In compressing the process of processing, use standard-compression algorithm to compress, document size is further dwindled.And, in the process that compression is handled, after the part compression of view data is finished, with the compression after file storage to alternative document system (such as storage mediums such as flash memory, storage card, hard disks), afterwards, carry out the compression of other parts of view data again and handle, and the file storage after will compressing finishes up to the whole image data compression to the alternative document system.Adopt this compression method, can reduce the memory consumption of flush bonding processor, so that improve the processing speed of flush bonding processor.
Need carry out under the situation of playback process the view data after the compression, the step of this playback process comprises:
Step 1: flush bonding processor is resolved the form of view data, obtains the file header information of compressed file; This document header can comprise: information such as the picture size in the file header, sample mode, color depth;
Step 2: set up look-up table and inverse quantization table by file header information; Promptly in advance the operation result of image operation is made into look-up table and inverse quantization table, when requiring calculation, direct lookup result from table;
Step 3:, carry out the piece decoding processing of compressed file at different display devices;
Step 4: but whether the data block that the piece decoding processing obtains in the determining step 3 is within the indication range of equipment, but if within the realistic ranges of equipment, then this data block is carried out processing such as conversion, down-sampling, with demands such as the display resolution that adapts to relevant device, color types; But to the data block beyond the realistic ranges of the equipment of being judged as, then return execution in step 3, finish up to the decoding of compressed file piece; Like this, but the data block beyond the realistic ranges of equipment is not done any processing, significantly saved the time of implementation;
Step 5: image is sent to display device through graphic interface.
Use with typical case of the present utility model below: under the situation of ARM (senior compacting instruction set processor), on the ARM platform, realize that the camera function of terminal is an example, embodiment of the present utility model is described in detail as flush bonding processor.
The flush bonding processor in the terminal of the utility model embodiment and the connection diagram of imageing sensor are as shown in Figure 3, comprise in the structure chart shown in Figure 3: the flush bonding processor that is used to realize collection, compression and the playback process of view data, imageing sensor, this imageing sensor directly is connected with flush bonding processor.This flush bonding processor links to each other by serial data, serial clock, master clock, pixel clock, data/address bus and row, field synchronization bus with imageing sensor, wherein,
Serial data, clock bus are used for the register of initial configuration imageing sensor;
The master clock of imageing sensor is produced by flush bonding processor;
Pixel clock, determine according to register by imageing sensor, and obtain, specifically master clock eight frequency divisions can be obtained pixel clock by the master clock frequency division, be that pixel clock is 1/8th of a master clock size, pixel clock links to each other with INT (external interrupt) pin of flush bonding processor;
Data/address bus links to each other with GPIO (general input and output) port of flush bonding processor, is used for transmit image data;
Capable, field sync signal is distinguished the initial of synchronous row and column.
The gatherer process of the image of the utility model embodiment comprises the steps:
Step 1: flush bonding processor is by the register of serial data, clock bus configuration image transducer, and the master clock of generation imageing sensor;
Step 2: imageing sensor is according to the size of in the step 1 configuration result of register being determined pixel clock, and obtains pixel clock by master clock eight frequency divisions; The pixel clock that why is provided with is littler than master clock, be in order to make flush bonding processor that the sufficient processing time be arranged, this is operations such as man-machine interface is operated because flush bonding processor in the process of carrying out images acquired, also may be carried out response simultaneously, the conventional fortune of execution is leaned on;
Step 3: imageing sensor sends view data and pixel clock to flush bonding processor;
Step 4: flush bonding processor receives view data according under the driving of pixel clock, and by row, field sync signal row and column initial of synchronous images data respectively; In the image data transmission process, when image data transmission to flush bonding processor, can cause the interruption of flush bonding processor, and make flush bonding processor enter service routine; Be in the process of service routine GPIO port reads image data in the flush bonding processor at flush bonding processor; After view data reads and finishes, the image data transmission that reads in internal memory, is handled with products for further.
After the entire image collection finishes, the view data that collects is compressed processing.Image compression is used YUV420 (a kind of sample mode) sample mode in JPEG (a kind of compression standard) standard-compression algorithm.In the process that compression is handled, after the part compression of view data is finished, with the compression after file storage to alternative document system (such as storage mediums such as flash memory, storage card, hard disks), afterwards, carrying out the compression of other parts of view data again handles, and the file storage after will compressing finishes up to the whole image data compression to the alternative document system.
The schematic diagram of YUV420 sample mode is as shown in Figure 4:
As can be seen from Figure 4, initial data is Y (brightness), Cb, Cr (Cb, Cr are referred to as color difference components), after YUV420 sample mode down-sampling, the insensitive Cb of human eye, Cr chromatic component are down sampled to 8 * 8 from 16 * 16, and initial data Y remains unchanged, and has significantly reduced the demand to memory space.
After the entire image compression finishes, the file after the compression is carried out playback process, the playback process flow process of compressed file comprises the steps: as shown in Figure 5
Step 1: read the file header of compressed file, and judge whether the form of this document head is correct, if correct, execution in step 2, otherwise finish;
Step 2: rebuild Hafman decoding table, inverse quantization table according to the file header information that reads;
Step 3: compressed file is carried out the piece decode operation;
Step 4: whether the data block that the piece decode operation obtains in the determining step 3 enters the viewing area of terminal LCD (LCD), if then execution in step 5, if not, then judge whether to arrive the compressed file end, if not, then execution in step 3, if arrive the compressed file end, then finish;
Step 5: data block is carried out the operation of piece inverse quantization, inverse discrete cosine transformation, and wherein DC component is carried out the guards escorting prisoners according to original value and is divided coding, and the view data after obtaining afterwards reducing, this view data are the YUV420 forms; These two steps have been used the inverse quantization table of previous reconstruction, have accelerated processing speed equally;
Step 6: the view data of YUV420 form is carried out the operation of luminance component down-sampling, because Cb in the view data and Cr component have carried out down-sampling when compression, so only need carry out down-sampling to the Y component; The algorithm that the Y component is carried out down-sampling is: itself, right, down, four points in bottom right do average, concrete schematic diagram as shown in Figure 6, this down-sampling algorithm computing is simple, has saved the processing time.View data behind down-sampling, size are with the LCD size match;
Step 7: the translation operation of YCbCr to rgb color space carried out in pointwise, converts view data to LCD receptible rgb format;
Step 8: export this data block, and judge whether to arrive the compressed file ending, if, then finish, otherwise, execution in step 3.
Such as: the view data after the compression is of a size of 640 * 480, and terminal LCD is of a size of 176 * 224, and in order to adapt to the demonstration of LCD, (step 4) and down-sampling are handled (step 6) to carry out cutting to the view data after the compression.The method of handling is, reduces 352 * 448 (by finishing dealing with of step 4) from 640 * 480 earlier, it is down sampled to 172 * 224 (by finishing dealing with of step 6) again.These algorithms intersect in the JPEG decode procedure and carry out, and have reduced the number of times of access images data, thereby have improved efficient.
The above; it only is the preferable embodiment of the utility model; but protection range of the present utility model is not limited thereto; anyly be familiar with those skilled in the art in the technical scope that the utility model discloses; the variation that can expect easily or replacement all should be encompassed within the protection range of the present utility model.Therefore, protection range of the present utility model should be as the criterion with the protection range of claims.

Claims (4)

1. the device of an image processing is characterized in that, described device links to each other with imageing sensor, and described device comprises: the flush bonding processor of at least one processing that is used for carrying out collection, compression and the playback process of view data.
2. device as claimed in claim 1, it is characterized in that, described embedded processing implement body comprises: be used for from the imageing sensor image data image acquisition units, be used for that the data of gathering are compressed the image compression unit of processing and the data that are used for compression is obtained are carried out at least one unit of the image reproducing unit of playback process, wherein, described image acquisition units is connected with described image compression unit, and described image compression unit is connected with described image reproducing unit.
3. device as claimed in claim 2 is characterized in that, described image acquisition units specifically comprises:
Be used for to imageing sensor send acquisition parameter the acquisition parameter output interface, be used for to imageing sensor tranmitting data register frequency the master clock output unit, be used to receive the pixel clock receiving element of the pixel clock that imageing sensor sends and be used for the data acquisition performance element of the acquisition function of carries out image data; Described acquisition parameter output interface links to each other with imageing sensor, and described master clock output unit links to each other with imageing sensor, and described pixel clock receiving element links to each other with imageing sensor, and described data acquisition performance element links to each other with imageing sensor.
4. device as claimed in claim 2 is characterized in that, described image reproducing unit specifically comprises:
Be used for according to the file header information obtained set up look-up table and inverse quantization table the table structural unit,
But be used for decision block decompress the data block obtain whether within the indication range of equipment and will be in the cutting unit of the output of the data block within the equipment indication range,
Be used for the data after the conversion are carried out the downsampling unit of the down-sampling processing of luminance component,
One end of described table structural unit links to each other with the data message acquiring unit of the file header information that is used to obtain compressed file, the other end links to each other with the piece decoding unit that is used for compressed file is carried out the piece decompression, also has an end with the particular content that is used for according to the table structural unit converter unit that output block carries out conversion process to be linked to each other;
One end of described cutting unit links to each other with described decoding unit, and the other end links to each other with described converter unit;
Described downsampling unit links to each other with described converter unit.
CN 200720149195 2007-05-18 2007-05-18 Image processing device Expired - Fee Related CN201044472Y (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200720149195 CN201044472Y (en) 2007-05-18 2007-05-18 Image processing device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200720149195 CN201044472Y (en) 2007-05-18 2007-05-18 Image processing device

Publications (1)

Publication Number Publication Date
CN201044472Y true CN201044472Y (en) 2008-04-02

Family

ID=39259364

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200720149195 Expired - Fee Related CN201044472Y (en) 2007-05-18 2007-05-18 Image processing device

Country Status (1)

Country Link
CN (1) CN201044472Y (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101944008A (en) * 2010-10-26 2011-01-12 深圳市云舒网络技术有限公司 VGA (Video Graphics Array) image acquisition system and method
CN102946537A (en) * 2012-11-06 2013-02-27 中国科学院上海微系统与信息技术研究所 System for realizing JPEG (joint photographic experts group) 2000 image coding by combining DSP (digital signal processor) and compression chip

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101944008A (en) * 2010-10-26 2011-01-12 深圳市云舒网络技术有限公司 VGA (Video Graphics Array) image acquisition system and method
CN102946537A (en) * 2012-11-06 2013-02-27 中国科学院上海微系统与信息技术研究所 System for realizing JPEG (joint photographic experts group) 2000 image coding by combining DSP (digital signal processor) and compression chip

Similar Documents

Publication Publication Date Title
CN101990095B (en) Method and apparatus for generating compressed file, camera module associated therewith, and terminal including the same
WO2022252488A1 (en) Image compression method and apparatus, electronic device, and readable storage medium
US20080080778A1 (en) Image data compression method and apparatuses, image display method and apparatuses
CN102523367A (en) Real-time image compression and reduction method based on plurality of palettes
WO2011035658A1 (en) Method, device and system for compressing and decompressing transparent image
CN108900843A (en) Monochrome image compression method, device, medium and electronic equipment
CN115460414B (en) Video compression method and system of baseboard management control chip and related components
CN102833463A (en) Picture processing method and picture processing equipment
CN106713804A (en) Three-channel image transmission interface conversion device and method
CN104952088A (en) Method for compressing and decompressing display data
CN201044472Y (en) Image processing device
US20240104780A1 (en) Image compression method and apparatus, and intelligent terminal and computer-readable storage medium
CN101247474B (en) Image processing device and method
CN104394410A (en) Image data compression method, decompression method, transmission method and device
KR20050113500A (en) Compression and decompression device of graphic data and therefor method
CN108881923B (en) Method for reducing buffer capacity of JPEG coding and decoding line
JP2004514354A (en) On-the-fly transfer of data between RGB and YCrCb color space to DCT interface
CN1317886C (en) Computer pick-up head for implementing specific effect processing of dynamic image and method thereof
KR102642744B1 (en) Cooperative access method and system for external memory, cooperative access architecture
CN114554155A (en) Remote image acquisition device
JP2001145107A (en) Signal processor using dct and image-compressing device
CN100420283C (en) Image sensor and computer system utilizing the same image sensor
CN101753780A (en) Compression method of color image based on primary color extraction, segmentation and compression
CN113038179A (en) Video encoding method, video decoding method, video encoding device, video decoding device and electronic equipment
CN113365016A (en) Real-time map image data acquisition system and method

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant
C56 Change in the name or address of the patentee

Owner name: BEIJING SUPERPIX MICROELECTRONIC TECHNOLOGY CO., L

Free format text: FORMER NAME: SIBIKE MICROELECTRONIC TECH CO., LTD., BEIJING

CP01 Change in the name or title of a patent holder

Address after: 100085 Beijing city Haidian District on the five Street No. 7 building two Room 201 Hao Hai

Patentee after: Beijing SuperPix Micro Technology Limited

Address before: 100085 Beijing city Haidian District on the five Street No. 7 building two Room 201 Hao Hai

Patentee before: Sibike Microelectronic Tech Co., Ltd., Beijing

PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of utility model: Image processing device

Effective date of registration: 20110301

Granted publication date: 20080402

Pledgee: Zhongguancun Beijing science and technology Company limited by guarantee

Pledgor: Beijing SuperPix Micro Technology Limited

Registration number: 2011990000057

PC01 Cancellation of the registration of the contract for pledge of patent right

Date of cancellation: 20121231

Granted publication date: 20080402

Pledgee: Zhongguancun Beijing science and technology Company limited by guarantee

Pledgor: Beijing SuperPix Micro Technology Limited

Registration number: 2011990000057

PLDC Enforcement, change and cancellation of contracts on pledge of patent right or utility model
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of utility model: Image processing device

Effective date of registration: 20130808

Granted publication date: 20080402

Pledgee: Zhongguancun Beijing technology financing Company limited by guarantee

Pledgor: Beijing SuperPix Micro Technology Limited

Registration number: 2013990000555

PLDC Enforcement, change and cancellation of contracts on pledge of patent right or utility model
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20080402

Termination date: 20150518

EXPY Termination of patent right or utility model