Technical background
All camera is housed on current many electronic equipments so that carry out visual communication, for example mobile phone, computer and palmtop PC etc.Nearly all camera is not to adopt CCD (Charge Coupled Device) transducer to adopt CMOS (Complementary Metal Oxide Semiconductor) transducer exactly.Fig. 1 shows and digital signal processor (Digital Signal Processor, be called for short DSP) the 102 existing cmos image sensors 100 that connect, digital signal processor 102 outwards provides view data by an interface 104, described interface 104 can be USB (Universal Serial Bus is called for short a USB) interface.Described cmos image sensor 100 comprises sensor array 106, one or more analog to digital converter (Analog-To-Digital Converter is called for short ADC) 108 and color processing unit 110.Described sensor array 106 is used for producing the analog signal array that characterizes this scene image, just analog signal image when it aims at scene exposure.Described analog to digital converter 108 is used for converting the analog signal image that sensor array 106 produces to DID.Described color processing unit 110 is used for guaranteeing the suitable view data of imageing sensor 100 outputs.Such as, described color processing unit 110 can be used for producing color image data according to the DID from analog to digital converter 108, also can be used for producing component image data, for example rgb image data or YUV view data according to DID from analog to digital converter 108.
In order to adapt to the data transmission bauds restriction of USB interface, described view data must be compressed before by usb 1 04 transmission.Corresponding, dispose JPEG (a kind of compression standard) module 112 in the described digital signal processor 102.In the practical operation, in order to allow the described JPEG module 112 better view data of handling from imageing sensor 100, described digital signal processor 102 also disposes other modules that comprise CPU (not shown), these modules are used for before 112 pairs of view data of described JPEG module (such as YUV component image data) are compressed it being carried out preliminary treatment, and the preliminary treatment of being carried out comprises processing such as contrast, light and shade and colourity.In addition, before compressing, 112 pairs of view data of described JPEG module also want processing such as automatic gain control and Gamma correction.
These modules commonly used and the unified picture signal processing modules (ISP) 114 that are designated of described other modules of leading portion quilt in Fig. 1 such as automatic gain control and Gamma correction, these are to make better the processing from the view data of imageing sensor 100 of described JPEG module 112 in the module that digital signal processor 102 is provided with, make described digital signal processor 102 structurally very complicated.This also is why described imageing sensor 100 and described digital signal processor 102 can not simply be integrated into a crucial reason in the chip.
Many equipment are handheld device especially, is that the free space of its reservation is very limited in order to dispose camera thereon, in some cases, uses can run into very big challenge as the twin-core sheet solution among Fig. 1 like this.Such as, a notebook computer need be provided with camera at its display edge, like this, the operator could be equiped with the notebook computer of camera and other people carry out Video show by this, yet the size of display has been defined, and finds out additional space again and removes to place these two chips and other auxiliary circuit and may seem awkward.
Therefore, demand the computer system that needs imageing sensor that a kind of volume is little, conjugation grade is high, cost is low and easy to manufacture and application have this imageing sensor urgently.
Summary of the invention
In view of this, the computer system that the object of the present invention is to provide that a kind of volume is little, the high and low cost of conjugation grade and the imageing sensor that is easy to make and application has this imageing sensor.
In order to achieve the above object, according to an aspect of the present invention, imageing sensor provided by the invention comprises: a sensor array is used for producing the analog signal that characterizes original image when it aims at scene exposure; Be connected in one or more analog to digital converter of described sensor array, be used for described analog signal is changed to digital signal; An interface is used for reading described digital signal.
Further, described interface sends to described digital signal in the computer system that is connected on the described imageing sensor.
Further, described sensor array lists and is superimposed with color filter lens array.
Further, described interface sends to described digital picture in the computer system that is connected on the described imageing sensor.
Further, described sensor array lists and is superimposed with color filter lens array, and described analog image and digital picture all are meant original image.
Further, described imageing sensor also comprises a compression module, described compression module is used for before described interface is read described digital picture it being compressed, and described computer system includes and is used for that compressing image data is carried out decompress(ion) and contracts and the original image of decompress(ion) is redeveloped into the software module of coloured image.
Further, described color filter lens array is Bel's filter array, and corresponding, described original image is Bel's format-pattern.
Further, each pixel of described Bel's format-pattern is only noted down down a kind of in the three primary colors, has lost 2/3rds color data.
Further, described original image is the image without difference, wherein the only corresponding particular color value of each pixel of image.
Further, described sensor array is a cmos sensor, and described compression module adopts self adaptation difference pulse code technology, and described interface is the USB2.0 interface.
According to an aspect of the present invention, computer system provided by the invention comprises: an internal memory; A processor that is connected in internal memory; A display screen; An edge that is arranged on display screen is used for obtaining the camera of image.Wherein camera comprises: a sensor array is used for producing Bel's format-pattern of the simulation of describing this scene when it aims at scene exposure; Be connected in one or more analog to digital converter of described sensor array, be used for Bel's format-pattern of described simulation is converted to Bel's format-pattern of numeral; A compression module is used for Bel's format-pattern with numeral and compresses and generate packed data in order to Bel's format-pattern of describing described numeral; An interface is used for reading described packed data.Wherein said processor carries out Bel's format-pattern that decompress(ion) contracts numeral with the packed data that described utilizing camera interface is transmitted and is redeveloped into coloured image by carrying out a software module.
Further, the coloured image of described reconstruction is presented on the display screen.
Further, described computer system is connected in a network, and described coloured image is sent in another computer system that is connected in this network by this network.
Further, each pixel of described Bel's format-pattern is only noted down down a kind of in the three primary colors, has lost 2/3rds color data.
Further, described sensor array is a cmos sensor, and described compression module adopts self adaptation difference pulse code modulation technology, and described interface is the USB2.0 interface.
This shows, imageing sensor of the present invention, because at original image (the RWA image that sensor array is not exported, such as Bel's format-pattern) carry out handling such as color processing, Gamma correction, contrast, light and shade and colourity etc. are profound, but directly with original image through USB interface output or with original image after overcompression again through USB interface, make the structure of imageing sensor of the present invention significantly simplify like this.
Embodiment
It provides a kind of imageing sensor according to an aspect of the present invention, and Fig. 2 has shown the structured flowchart of an embodiment of imageing sensor of the present invention.Described imageing sensor 200 comprises sensor array 202, one or more analog to digital converter 204, compression module 206 and USB interface 208.In a specific embodiment, described sensor array 202 can be the cmos sensor array, also can be the ccd sensor array, and its resolution can be 1,300,000 pixels, 3,000,000 pixels or higher.Described analog to digital converter 204 can provide the precision of 6-bits, 8-bits or 10bits according to application need, and according to this precision sensor array 202 to be produced the analog signal conversion that characterizes scene images be DID, and the analog signal of the sign scene image that produces of sensor array 202 also can be called analog signal image here.Utilize the described DID of described USB interface 208 outputs for convenience, described compression module 206 is used to and will compresses from DID, then the DID of compression is exported by USB interface 208.It should be noted that in one embodiment the resolution of obtaining image if desired enough low (such as the VGA format-pattern) is not compressed the support that yet can obtain the USB interface transmission bandwidth to it, this moment, compression module 206 was exactly unnecessary so.
Need to prove, be not called as original image signal (RAWimage) at the analog picture signal of sensor array 202 generations and the DID of analog to digital converter 204 conversions owing to passing through any processed, it has write down the raw information of sensor array 202.And it is corresponding, after the color processing of the DID process color processing unit 110 of analog to digital converter 108 conversions among Fig. 1 and Gamma correction, contrast, light and shade and the colourity etc. of picture signal processing module 114 are handled, not the alleged original image signal of the present invention (RAW image) just.
Visibly different with Fig. 1 is that please referring to shown in Figure 2, for convenience not described compression module 206 of imageing sensor 200 of the present invention is operated and other modules of setting.So in the present invention, but DID that described compression module 206 direct controls obtain from described analog to digital converter 204.In a specific embodiment, on the imaging pixel lattice array of sensor array 202, be superimposed with color filter lens array, on certain meaning, this moment, described sensor array 202 can be regarded as a color sensor array.Specifically be exactly that as shown in Figure 3, the color filter that all superposeed on each imaging pixel point of sensor array 202, described color filter can be red (R), green (G) or blue (B) filter.The arrangement mode of color filter lens array please refer to Bel's filter array usually, and described Bel's filter array is that the RGB three primary colors are arranged on the imaging pixel lattice array with distinctive mode correspondence.This title of Bel's filter array comes from its inventor, the Bryce Bayer of Eastman Kodak company, and 50% is green in described Bel's filter array, 25% is that redness and 25% is blueness, therefore also is known as RGBG or GRGB pattern filter.Described Bel's filter array particular content can be with reference to US3,971, No. 065 United States Patent (USP)s.
Because human eye is extremely sensitive to green light, described Bel's filter employing doubles red or blue green and imitates human eye with this.Bel's sensor array, the said color sensor array in front just, the raw video picture of output (original image RAW image) is called as Bel's format-pattern.Since each imaging pixel point has only write down a kind of in the three primary colors, so other 2/3rds color data has just all been lost.Therefore in order to obtain full color images, just produced the difference algorithm that many kinds are used to rebuild other two kinds of primary colors of each picture element.
Different image reconstruction interpolation algorithms needs different amounts of calculation, and the reconstructed image quality that obtains at last is also just different.Please referring to shown in Figure 1, imageing sensor 100 also is provided with color processing unit 110, after 108 pairs of analog picture signal digitlizations of digital to analog converter, also needs to carry out the color processing and just image data transmission is handled to digital signal processing unit 102.Corresponding is that described compression module 206 of the present invention directly carries out squeeze operation to obtain Bel's format-pattern from described sensor array 202, has saved the pretreated operation in a lot of centres.
In a specific embodiment, described compression module 206 adopts adaptive difference pulse code modulation (Adaptive Differential Pulse Code Modulation is abbreviated as ADPCM) technology.Described adaptive difference pulse code modulation is a kind of novel pulse code modulation (Pulse Code Modulation is abbreviated as PCM) technology, and it is a kind of encoding and decoding technique that utilizes adaptive technique and differential coding technology to combine.The basic principle of ADPCM is to utilize the sample value of several sample values in past being predicted current input, and make prediction circuit have adaptive forecast function and the actual detected value compares, at any time the difference that records is quantized differential processing automatically, make it to remain with signal Synchronization and change.
Described compression module 206 is used for Bel's format-pattern is compressed, and the Bel's format-pattern data volume after the compression significantly reduces, thereby can be applicable to by described USB interface 208 and transmit.As everyone knows, because each pixel of Bel's format-pattern has only write down a kind of in the three primary colors, that is to say that each pixel of Bel's format-pattern is lost 2/3rds color data, therefore, described Bel's format-pattern has only the data volume of rebuilding coloured image 1/3rd.In contrast to this, what the imageing sensor 100 among prior art Fig. 1 was exported is to rebuild coloured image, and JEPG module 112 is compressed on the basis that rebuilds coloured image.After having passed through described compression module 206, described Bel's format-pattern further is compressed, and according to the requirement of picture quality, described Bel's format-pattern can further be compressed 25%-40%.
In a specific embodiment, described USB interface 208 can be based on the interface of USB 2.0, and described USB 2.0 is overall universal serial bus input/output bus agreements, and its USB 1.1 standards with respect to the past allow more high data rate.The maximum transmission rate that USB 1.1 allows is 12Mbits/second, and the maximum transmission rate of USB 2.0 is then up to 480Mbits/second.Just need to transmit per second 60 two field pictures at last, USB 2.0 has the ability to transmit Bel's format-pattern of the compression of various resolution equally.
Bel's format-pattern essence after the compression of obtaining from described USB interface 208 is a kind of image that does not pass through difference, the only corresponding a kind of primary color value of each pixel wherein, and lost other two kinds of primary color value.In order to obtain a width of cloth coloured image, these primary color value of losing will be rebuild based on described Bel's view data.Traditional way is: reconstruction operation realizes in hardware to reach requirement speed.As mentioned above, the Bel's format-pattern that compressed is read from described USB interface 208, therefore needs to distribute enough computational resources to carry out reconstruction operation.
This shows, imageing sensor of the present invention, because at original image (the RWA image that sensor array is not exported, such as Bel's format-pattern) carry out handling such as color processing, Gamma correction, contrast, light and shade and colourity etc. are profound, but directly with original image through USB interface output or with original image after overcompression again through USB interface, make the structure of imageing sensor of the present invention significantly simplify like this.In addition, the present invention utilizes the system resource of the computer system that imageing sensor connects to handle such as color processing, Gamma correction, contrast, light and shade and colourity etc. are profound carrying out through the view data of USB interface output, and then satisfying on the basis of people to the picture quality requirement, simplified the structure of imageing sensor of the present invention.
Present many computing equipments are furnished with powerful processor, for example, be not that the Pentium 4 processor that is equipped with Intel is exactly turion 64 processors that have been equipped with AMD on the up-to-date notebook computer, the two can provide comfortably that computational resource is redeveloped into coloured image with the Bel's format-pattern after will compressing.In addition, also dispose special graph processing chips on many computing equipments, these chips can provide also comfortably that computational resource is redeveloped into coloured image with the Bel's format-pattern after will compressing.Before rebuilding coloured image, need elder generation that Bel's format-pattern of described compression is decompressed to restore the preceding Bel's format-pattern of compression.
It provides a kind of computer system according to a further aspect in the invention, and Fig. 4 shows computer system 418 of the present invention, and in one embodiment, described computer system 418 can be corresponding to a notebook computer that is equipped with imageing sensor shown in Figure 2.Please referring to shown in Figure 4, described computer system 418 comprises data/address bus 420, is connected in central processing unit (CPU) 422 and equipment interface 424 on the data/address bus 420.Described CPU422 is used to carry out specific instruction and comes simultaneous operation all are connected to equipment and interface on the data/address bus 420.Described equipment interface 424 is used to be connected on the PC camera that is equipped with imageing sensor 200 and receives Bel's format-pattern of described compression.
Described computer system 418 also includes display interface device 426, network interface 428, printing interface 440, magnetic disk drive interface 448 and the memory device 446 that is connected on the described data/address bus 420.In general, compiler, executable program or the software module that is used for Bel's format-pattern is redeveloped into coloured image may be loaded into a memory device 446 by described magnetic disk drive interface 438, described network interface 428, described equipment interface 424 or other interfaces that are connected on the described data/address bus 420.Described software module can also be carried out such as other profound processing such as Gamma correction, contrast, light and shade and colourity by the Bel's format-pattern to decompress(ion) under the operation of CPU.
The main memory 442 in addition that connects on the described data/address bus 420, described main memory 442 can be a random-access memory (ram), and described main memory 442 is used to described CPU422 that instruction is provided and is used to visit described memory device 446 to obtain data, other instructions, request or service.In a special embodiment, when the application program instructions in the execution memory device 446, described application program instructions can be meant that leading portion points out is loaded into described software module in the memory device 446, described CPU422 decompresses to Bel's format-pattern of the compression of obtaining from described equipment interface 424, and carry out coloured image according to Bel's format-pattern of described decompress(ion) and rebuild, subsequently, these reconstruction coloured images are shown on the display screen (not shown) by described display interface 426.
A read-only memory (ROM) 444 in addition that connects on the described data/address bus 420, this read-only memory is used for storing those fixing command sequences, for example being used for operation keyboard 450, indicating device 442, described display interface 426 and other is connected the equipment on the data/address bus 420 or the basic output/output function system (Basic Input/Output Operation System abbreviates BIOS as) of interface.Described computing system 418 is connected to and is used to provide one or more resource to share to another computer system on this network or carry out or be used for to accept data and instruction there from the operator as just an interface on the network.In concrete an application, described reconstructed image can send in another computer system by network.
Under in the technical field those of ordinary skill as can be seen, the pin of the imageing sensor 200 among Fig. 2 can be less than the imageing sensor 100 among Fig. 1 far away.Except pin, ground connection that is used to receive various control signals and the pin that connects power supply, the imageing sensor 100 shown in Fig. 1 also needs to dispose a series of pins that are used for view data is read into from imageing sensor 100 digital signal processor 102.Corresponding is, imageing sensor 200 shown in Figure 2 has assembled the USB interface of having only 4 pins, and this USB interface has only two data pins except the pin that connects electricity and ground connection.In addition, according to application need, described imageing sensor 200 also may need 1 or a few to be used for receiving the pin of control signal or other signals, and in certain embodiments, described imageing sensor 200 also may not need to receive the pin of control signal or other signals.This shows, the pin of imageing sensor 200 shown in Figure 2 can be less than the imageing sensor 100 among Fig. 1 really far away, and the volume of imageing sensor 200 chips shown in Figure 2 like this can significantly reduce, engage performance raising greatly, manufacturing cost and manufacture difficulty and all significantly reduce.
The above only is preferred embodiment of the present invention, and is in order to restriction the present invention, within the spirit and principles in the present invention not all, any modification of being done, is equal to replacement etc., all should be included within protection scope of the present invention.Such as, though all be to have used USB interface in the text, the interface of other types also can be used to substitute USB interface obviously.For another example, other types sensor array and compression module also can be used for the present invention.