CN100559334C - Image-processing circuit and image sensor are integrated in the interactive apparatus of a substrate - Google Patents
Image-processing circuit and image sensor are integrated in the interactive apparatus of a substrate Download PDFInfo
- Publication number
- CN100559334C CN100559334C CNB2004100585613A CN200410058561A CN100559334C CN 100559334 C CN100559334 C CN 100559334C CN B2004100585613 A CNB2004100585613 A CN B2004100585613A CN 200410058561 A CN200410058561 A CN 200410058561A CN 100559334 C CN100559334 C CN 100559334C
- Authority
- CN
- China
- Prior art keywords
- image
- interactive apparatus
- substrate
- image sensor
- transmission interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 44
- 238000012545 processing Methods 0.000 title claims abstract description 29
- 239000000758 substrate Substances 0.000 title claims abstract description 28
- 230000005540 biological transmission Effects 0.000 claims abstract description 54
- 238000011156 evaluation Methods 0.000 claims abstract description 22
- 230000003068 static effect Effects 0.000 claims abstract description 17
- 230000003287 optical effect Effects 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000013461 design Methods 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 206010021703 Indifference Diseases 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000010205 computational analysis Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 230000008521 reorganization Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Landscapes
- Image Processing (AREA)
- Image Input (AREA)
Abstract
A kind of image-processing circuit and image sensor are integrated in the interactive apparatus of a substrate, it comprises a processing module and a control circuit.Processing module comprises a substrate; One image sensor is used for and will captures the pairing majority of an image picture element signal; One evaluation unit is used for judging according to most picture element signals the static image parameter of at least one imaged object that constitutes these images; And a transmission interface, be used for exporting the static image parameter of at least one imaged object that evaluation unit produced in the mode of serial transmission.Control circuit system is used for exporting the operation of static image parameter with the control interactive apparatus according to transmission interface.Image sensor, evaluation unit and transmission interface all are formed in this substrate.
Description
Technical field
The present invention relates to a kind of interactive apparatus, refer to a kind of interactive apparatus that image-processing circuit and image sensor is integrated in a substrate especially.
Background technology
Along with prevailing of audio-visual multimedia, image digitization becomes trend gradually.Known image sensor has become digital camera (Digital Video Camcorder) gradually, (Digital Still Camera DSC) waits digital device to absorb the usefulness of dynamic image to digital camera.Yet the higher image sensor of resolution can produce accurate digitized video quality, so be applied in mostly on image identification, the identification of fingerprint.But the image sensor that resolution is low then utilizes mostly on interacting toys, with the usefulness as simple action recognition.For instance, the present robot of releasing on the market is installed on " eyes " that the interior camera of robot can be used as interacting toys, induces user's action, then makes different instructions by the bist control circuit indication.
See also Fig. 1, Fig. 1 is the functional block diagram of known interactive apparatus 10.Interactive apparatus 10 comprises an image sensor 12, a microcontroller 14 and the defeated bus 16 of biographies in the lump.Image sensor 12 is to comprise a CMOS sensing array 22 and an analog-digital converter (analog to digital converter, ADC) 24.The data that 22 sensings of CMOS sensing array come out can be sent to analog-digital converter 24.Because CMOS sensing array 22 can sense most pixel informations.And each image is made up of most pixel informations.So if take a dynamic continuous image, the CMOS sensing array 22 of image sensor 12 just must constantly produce each pixel information.In order to transmit huge pixel information, be to see through the pixel information of the defeated bus 16 transmission institute sensings of biographies in the lump between image sensor 12 and the control circuit 12.Microcontroller 14 then can be according to the pixel information that obtains, the image of the object that reorganization is taken, or be used for judging the state of shot object, with the running of further control interactive apparatus 10.
Yet the data quantity of general 12 sensings of image sensor is very huge, still along with the fast development of serial transmission, uses the also transmission speed of too late serial transmission of the complicated transmitting speed arranged side by side of hardware structure.In addition, after microcontroller 14 utilizes transmission interface arranged side by side to receive the data of these sensings, also computational analysis goes out required data voluntarily, because the range of application of every kind of microcontroller 14 is also inconsistent, for instance, concerning the microcontroller 14 that is applied to mouse, microcontroller 14 does not need to obtain complete image, only needs to follow the trail of the relative position that imaged object moves.If use known image sensor 12 to produce pixel information thus, microcontroller 14 must all be received processing with all pixel informations, causes the burden in the processing.
In addition, image sensor 12 now is single-chips, and its function only is that the simple light with receiving converts corresponding electric signal to.Under the circuit design trend of being particular about system combination, such single-chip image sensor 12 has improved necessity in fact.
Summary of the invention
The technical problem to be solved in the present invention provides a kind of interactive apparatus, its utilization is integrated in image-processing circuit and image sensor the chip of one substrate, be able to calculate earlier the specific image parameters that needs, transmit again and give control circuit and handle, with the complexity of the design of saving control circuit.
The invention provides and a kind of image-processing circuit and image sensor are integrated in the interactive apparatus of a substrate, it comprises a processing module and a control circuit.Processing module comprises a substrate; One image sensor is used for and will captures the pairing majority of an image picture element signal; One evaluation unit is used for judging according to most picture element signals the static image parameter of each imaged object that forms images; And a transmission interface (transmission interface), be used for exporting the static image parameter that evaluation unit is produced in the mode of serial transmission.Control circuit (controller) is to be used for exporting the operation of static image parameter with the control interactive apparatus according to transmission interface.Image sensor, evaluation unit and transmission interface all are formed in this substrate.
According to the present invention, the static image parameter is an imaged object when being in static the demonstration, can be for the parameter that measures.For example the static image parameter of each imaged object is one of following parameter or its combination: the object number of endpoint of the direction parameter of the coordinate of this imaged object, the area parameters of this imaged object, this imaged object, the color parameter of this imaged object, this imaged object, the object length breadth ratio of this imaged object, and the boundary parameter of this imaged object.
Description of drawings
Below in conjunction with accompanying drawing the specific embodiment of the present invention is described in further detail
Fig. 1 is the functional block diagram of known interactive apparatus.
Fig. 2 is the functional block diagram of interactive apparatus of the present invention.
Fig. 3 is the synoptic diagram of most image frames.
The primary clustering symbol description
10 interactive apparatus, 12 image sensors
14 microcontrollers, 16 transfer bus arranged side by side
22 CMOS sensing arrays, 24 analog-digital converters
41 substrates of 30 interactive apparatus
42 image sensors, 44 processing modules
45 evaluation units, 46 computing units
48,52 transmission interfaces, 54 control circuits
100,150 imaged objects, 110,120 pictures
115,125,135 search areas, 130 pictures
Embodiment
See also Fig. 2, Fig. 2 is the functional block diagram of interactive apparatus 30 of the present invention.Interactive apparatus can be a mouse or an interacting toys (interactive toy).Interactive apparatus 30 comprises a processing module 44 and a control circuit 54.Processing module 44 is a chip.Processing module 44 comprises an image sensor 42, its can be a Charged Coupled Device (charge-coupled device, CCD) or a CMOS optical sensor, to be used for most digital pixel (pixel) signals of acquisition.Most pixel signals that produce are sent to processing module 44.Processing module 44 comprises a substrate 41, an evaluation unit 45, a computing unit 46 and transmission interface 48,52.Image sensor 42, evaluation unit 45, computing unit 46 and transmission interface 48,52 all are formed in the substrate 41.
See also Fig. 3, Fig. 3 is the synoptic diagram of most image frames.Each picture (picture) can be combined by most picture element signals.For instance, concerning the picture of a 800*600 size, need 480,000 picture element signals to combine altogether.Image sensor 42 promptly is to be used for producing most picture element signals.And most picture element signals that produce are sent to after the evaluation unit 45, and evaluation unit 45 will be judged the various parameters of each image according to most picture element signals.With target picture 120 is example, the decision show state of destination object 100 on target picture 120 can determine by several image parameterss, such as parameters such as coordinate, area (size), color parameter, directivity (orientation) and border (boundary), the object number of endpoint of destination object 100 on target picture 120, object length breadth ratios.For instance, destination object 100 can be considered the set of the picture element signal with same hue parameter, and evaluation unit 45 can be judged the parameters such as size, directivity border and GTG value of destination object 100 in target picture 120 according to number with same pixel signal and coordinate.Parameters such as evaluation unit 45 all right decision objects number of endpoint and object length breadth ratio.For instance, if destination object 100 is rectangles, then can also to determine the object number of endpoint be 4 to evaluation unit 45, and the length breadth ratio of this rectangular object.In other words, when static image system of parameters destination object 100 is in static the demonstration, can be for the parameter that measures.
In addition, general so-called dynamic image is a succession of continuous image sequence in fact, yet because have a kind of existing picture of persistence of vision on the human vision, so can produce the illusion of the image that links up.And in this kind dynamic image, because the time interval between picture is very little, so several indifferences between the picture that faces mutually are the change in location of picture material mostly.If when showing a dynamic image, most the picture element signals of must constantly recombinating in theory just can present continuous image.Yet, in general, on same image frame, have some common characteristics, perhaps be on the color, perhaps be on how much, or the further feature value obtain.Remove the mode of the redundant information on these spaces, will identify element important in the picture exactly, and remove repetition and do not have the element of demand.Please continue to consult Fig. 3, target picture 120 is to be distinguished into a plurality of objects, and each object can be any size.Each object in the middle of the target picture 120, be according to its with time shaft on difference between a object in the middle of the last picture 110, or and the central object of back one picture 130 between difference encode.With a destination object 100 carry out matching ratio to the time, can compare one by one to the object to be compared of all similar sizes in the search area 115 of last picture 110, or to a search area 135 of back one picture 130 in the object to be compared of all similar sizes compare one by one.In Fig. 3, after comparison, in the middle of all objects to be compared of last picture 110 and back one picture 130, find out is a references object 150 with destination object 100 difference minimums.The displacement difference that references object 150 and destination object are 100 is dynamic vector (motion vector).Computing unit 46 can see through above-mentioned mode and determine dynamic vector between each object.
After evaluation unit 45 and computing unit 46 obtain the correlation parameter of image, will respectively these image parameterss be transmitted and give transmission interface 48,52. Transmission interface 48,52 can be an asynchronism transceiver (universal asynchronous receiver/transmitter, UART) interface.Compared to synchronous concatenation transmission (synchronous parallel transmission), it is little that asynchronous serial (asynchronous serial) transmission has a volume, advantages such as cheap and long transmission distance.For instance, UART Universal Asynchronous Receiver Transmitter is a kind of a kind of asynchronous serial/parallel data converter that includes the data transmission between the serial type device (serial device) that is used for controlling this interactive apparatus 30 (or a processor) and is connected with interactive apparatus 30.More particularly, the function series of interactive apparatus that UART provides 30 is similar in appearance to data termination equipment (the data terminal equipment such as RS-232, DTE) the data function of exchange that is provided, so that interactive apparatus 30 can see through as universal serial bus (universal serial bus, serial type bus USB) and the mutual swap date of serial type device.
Except mentioned before UART (RS232 is a kind of of UART), transmission interface 48,52 also can be I
2C (inter-IC) and USB etc.I
2C is a kind of agreement that sees through two two-way (send and receive) transmission line (serial data line SDA and serial clock pulse line SCL) with data transmission.Because I
2The principle system of conversion such as C and USB serial data and data side by side is similar in appearance to the UART conversion serial data and the principle of data side by side, and is all this field person and knows, so do not repeat them here.
In other words, first transmission interface 48 or second transmission interface 52 can be UART interface, I
2At least a interface in the serial transmission group that C and USB constituted.
At last, control circuit 54 is after receiving static parameters such as the dynamic vector (motion vector) that transmitted by transmission interface 48,52 or the coordinate of object 110, size (size), color parameter, directivity (orientation), border (boundary), object number of endpoint, object length breadth ratio, can utilize the coding of each object in the last picture 110, the dynamic vector and the static parameter that cooperate each object in the target picture 120 are to reduce target picture 120.Or control circuit 54 is done further other processing according to these parameters, with the operation of control interactive apparatus 30.
Among another embodiment, first transmission interface 48 of the data that responsible transmission evaluation unit 45 is produced can be integrated into same interface with second transmission interface 52 of the dynamic vector that responsible transmission computing unit 46 is calculated.
For the interactive apparatus of optical mouse and so on,, pay much attention to for the shift position of cursor (can be considered an object) because optical mouse is a simple cursor (cursor) control device.So the parameter of the size of the imaged object that is determined for evaluation unit 45 and directivity and so on does not need especially, relatively payes attention to the dynamic vector that computing unit 46 is determined on the contrary.Therefore among the 3rd embodiment, processing module 44 can be at the device of optical mouse and so on, only design image sensor 42, computing unit 46 and second transmission interface 52 are formed in the same substrate 41, and do not need the evaluation unit 45 and first transmission interface 48 also together are formed in the same substrate 41.
Among the 4th embodiment, processing module 44 can only be formed at image sensor 42, evaluation unit 45 and first transmission interface 48 in the same substrate 41, and does not need the computing unit 46 and second transmission interface 52 also together are formed in the same substrate 41.
Compared to known technology, the processing module 44 that the present invention includes image sensor 42, evaluation unit 45, computing unit 46, transmission interface 48,52 can be integrated into the single-chip that is positioned at same substrate 41.Evaluation unit 45 can be judged the coordinate of most picture element signals, and determines the image parameterss such as size, border, directivity and color parameter of imaged object according to pixel coordinate.And computing unit 46 can calculate dynamic vector via most the signal of video signal that image sensor 42 is transmitted in advance.Simultaneously transmission interface 48,52 is to utilize the UART interface or other any serial transmission interface transmits the image parameters that these calculate.So use the interactive apparatus 30 of the designed chip of the framework of processing module of the present invention, because this chip can calculate these image parameterss in advance, utilize general serial transmission interface (as UART) that parameter is transmitted simultaneously and give control circuit 54, no longer need additionally to go to calculate these complicated parameter so be positioned at the control circuit 54 of rear end, also therefore reduce the complexity of Circuit Design, make that the use elasticity of control circuit 54 of interactive apparatus 30 is bigger, and shorten the time-histories of interactive apparatus exploitation.
The above only is preferred embodiment of the present invention, and all equalizations of being done according to the present patent application claim change and modify, and all should belong to the covering scope of patent of the present invention.
Claims (13)
1. one kind is integrated in the interactive apparatus of a substrate with image-processing circuit and image sensor, and it is characterized in that: it has a processing module, and this processing module comprises
One substrate;
One image sensor is formed in the substrate, is used for capturing the pairing majority of an image picture element signal;
One evaluation unit is formed in the substrate, is used for according to this majority picture element signal decision structure
Become the static image parameter of at least one imaged object of this image; And
One transmission interface is formed in the substrate, is used for exporting this at least in the mode of serial transmission
The static image parameter of one imaged object; And
One control circuit is used for the static image parameter of the imaged object exported according to this transmission interface to control the operation of this interactive apparatus.
2. by the described interactive apparatus of claim 1, it is characterized in that: the static image parameter of imaged object is one of following parameter or its combination in this device: the object number of endpoint of the direction parameter of the coordinate of this imaged object, the area parameters of this imaged object, this imaged object, the color parameter of this imaged object, this imaged object, the object length breadth ratio of this imaged object, and the boundary parameter of this imaged object.
3. according to the described interactive apparatus of claim 1, it is characterized in that: the transmission interface of this device is an I
2C interface.
4. according to the described interactive apparatus of claim 1, it is characterized in that: the transmission interface of this device is a USB (universal serial bus).
5. according to the described interactive apparatus of claim 1, it is characterized in that: the transmission interface of this device is a UART Universal Asynchronous Receiver Transmitter.
6. according to the described interactive apparatus of claim 1, it is characterized in that: this image sensor is a CMOS optical sensor.
7. according to the described interactive apparatus of claim 1, it is characterized in that: this image sensor is a Charged Coupled Device.
8. one kind is integrated in the interactive device of a substrate with image-processing circuit and image sensor, and it is characterized in that: it has a processing module, and this processing module comprises
One substrate;
One image sensor is formed in the substrate, is used for capturing most signal of video signal;
One computing unit is formed in this substrate, is used for calculating dynamic vector according to this majority signal of video signal; And
One transmission interface is formed in the substrate, is used for exporting this dynamic vector in the mode of serial transmission; And
One control circuit, this dynamic vector that is used for exporting according to this transmission interface is to control the operation of this interactive apparatus.
9. according to the described interactive apparatus of claim 8, it is characterized in that: this transmission interface is a UART Universal Asynchronous Receiver Transmitter.
10. according to the described interactive apparatus of claim 8, it is characterized in that: this transmission interface is an I
2C interface.
11. according to the described interactive apparatus of claim 8, it is characterized in that: this image sensor is a CMOS optical sensor.
12. according to the described interactive apparatus of claim 8, it is characterized in that: this image sensor is a Charged Coupled Device.
13. according to the described interactive apparatus of claim 8, it is characterized in that: this image sensor is used for capturing at least one destination object of one first picture, and capture the object a plurality of to be compared of one second picture, this computing unit is then compared this destination object and a plurality of object to be compared, with find out with this destination object recently like object to be compared, go out dynamic vector by this destination object and the calculation and object of finding out to be compared again.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100585613A CN100559334C (en) | 2004-08-18 | 2004-08-18 | Image-processing circuit and image sensor are integrated in the interactive apparatus of a substrate |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100585613A CN100559334C (en) | 2004-08-18 | 2004-08-18 | Image-processing circuit and image sensor are integrated in the interactive apparatus of a substrate |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1738355A CN1738355A (en) | 2006-02-22 |
| CN100559334C true CN100559334C (en) | 2009-11-11 |
Family
ID=36081000
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2004100585613A Ceased CN100559334C (en) | 2004-08-18 | 2004-08-18 | Image-processing circuit and image sensor are integrated in the interactive apparatus of a substrate |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100559334C (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102238358A (en) * | 2010-05-06 | 2011-11-09 | 原相科技股份有限公司 | Interactive system capable of improving image processing speed and method thereof |
| US8760390B2 (en) | 2004-08-11 | 2014-06-24 | Pixart Imaging Inc. | Interactive device capable of improving image processing |
| US9024880B2 (en) | 2004-08-11 | 2015-05-05 | Pixart Imaging Inc. | Interactive system capable of improving image processing |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8725208B2 (en) | 2008-11-05 | 2014-05-13 | Pixart Imaging Inc. | Serial transmission interface between an image sensor and a baseband circuit |
| CN103177174A (en) * | 2011-12-26 | 2013-06-26 | 原相科技股份有限公司 | Interactive type electronic device |
-
2004
- 2004-08-18 CN CNB2004100585613A patent/CN100559334C/en not_active Ceased
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8760390B2 (en) | 2004-08-11 | 2014-06-24 | Pixart Imaging Inc. | Interactive device capable of improving image processing |
| US9024880B2 (en) | 2004-08-11 | 2015-05-05 | Pixart Imaging Inc. | Interactive system capable of improving image processing |
| CN102238358A (en) * | 2010-05-06 | 2011-11-09 | 原相科技股份有限公司 | Interactive system capable of improving image processing speed and method thereof |
| CN102238358B (en) * | 2010-05-06 | 2013-08-14 | 原相科技股份有限公司 | Interactive system capable of improving image processing speed and method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1738355A (en) | 2006-02-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8760390B2 (en) | Interactive device capable of improving image processing | |
| CN102178510A (en) | Mobile phone infrared imaging system | |
| JP2010136413A (en) | High-speed vision sensor | |
| CN100559334C (en) | Image-processing circuit and image sensor are integrated in the interactive apparatus of a substrate | |
| CN101355644A (en) | Image sensor device and method for embedding image steady data into image data | |
| CN115714855A (en) | Three-dimensional visual perception method and system based on stereoscopic vision and TOF fusion | |
| CN109146927A (en) | A kind of picture charge pattern localization method and system based on machine vision | |
| CN101452349A (en) | Cursor controller on image display apparatus, method and image system | |
| US20040001074A1 (en) | Image display apparatus and method, transmitting apparatus and method, image display system, recording medium, and program | |
| US9024880B2 (en) | Interactive system capable of improving image processing | |
| CN107888288A (en) | A kind of short distance visible light communication method and its hardware system based on mobile terminal | |
| JP4288904B2 (en) | Data communication system, data transmission apparatus and method, and data reception apparatus and method | |
| CN102238358B (en) | Interactive system capable of improving image processing speed and method thereof | |
| CN105430297A (en) | Automatic control system for conversion from multi-video format to IIDC protocol video format | |
| KR100849532B1 (en) | Device having function of non-contact mouse and method thereof | |
| CN103106785A (en) | Remote control with 3D mouse function and control method thereof | |
| CN206133469U (en) | Stage interaction system based on 3D motion -sensing camera | |
| TWI419553B (en) | Detection device | |
| Kim et al. | A cmos image sensor-based stereo matching accelerator with focal-plane sparse rectification and analog census transform | |
| CN207147635U (en) | A kind of infrared thermal imaging device for supporting to connect mobile terminal | |
| CN102313514B (en) | Detection device | |
| CN207022101U (en) | Ultra-wide camera | |
| CN206164681U (en) | CMOS sensor image collection system based on wiFi wireless transmission | |
| CN109547681A (en) | Radio image collecting system suitable for a variety of environment | |
| CN221378606U (en) | Somatosensory man-machine interaction system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C35 | Partial or whole invalidation of patent or utility model | ||
| IP01 | Partial invalidation of patent right |
Commission number: 4W100538 Conclusion of examination: If the patent right is declared invalid, the patent right of invention No. 200410058561.3 shall be valid on the basis of the amendment of the claim submitted by the patent holder in November 19, 2010. Decision date of declaring invalidation: 20110418 Decision number of declaring invalidation: 16363 Denomination of invention: Interactive device for integrating image processing circuit and image sensor in one substrate Granted publication date: 20091111 Patentee: PixArt Imaging Inc. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20210902 Address after: Hsinchu City, Taiwan, China Patentee after: Egis Technology Inc. Address before: Hsinchu City, Taiwan, China Patentee before: PixArt Imaging Inc. |
|
| IW01 | Full invalidation of patent right | ||
| IW01 | Full invalidation of patent right |
Decision date of declaring invalidation: 20220905 Decision number of declaring invalidation: 57993 Granted publication date: 20091111 |