CN202153766U - Image processing device for multiple image sensors - Google Patents
Image processing device for multiple image sensors Download PDFInfo
- Publication number
- CN202153766U CN202153766U CN2011201274053U CN201120127405U CN202153766U CN 202153766 U CN202153766 U CN 202153766U CN 2011201274053 U CN2011201274053 U CN 2011201274053U CN 201120127405 U CN201120127405 U CN 201120127405U CN 202153766 U CN202153766 U CN 202153766U
- Authority
- CN
- China
- Prior art keywords
- image sensor
- chip
- sensor chip
- image
- main control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Studio Devices (AREA)
Abstract
The utility model discloses an image processing device for multiple image sensors and an image processing method, and belongs to the technical field of image processing. The image processing device for the corresponding multiple image sensors comprises a main image sensor chip, which is used for capturing image data, processing the image data and sending the processed image data to a main control chip, or is used for processing image data captured from an image sensor chip and sending the processed image data to the main control chip; one or a plurality of subordinate image sensor chips, which are used for capturing image data, and sending the captured image data to the main image sensor chip; and the main control chip used for receiving the processed image data sent by the main image sensor chip. The image processing device for the multiple image sensors and the image processing method provided in the utility model can prevent the phenomenon of data crosstalk when the multiple image sensors are integrated into the same device, and can optimize the chip area of an image processing part in the device to minimum.
Description
Technical field
The utility model relates to a kind of image processing equipment of multiple image sensor, belongs to technical field of image processing.
Background technology
Equipment capable of taking pictures has in recent years become one of the swiftest and the most violent electronic equipment for consumption of development; The development that image sensor technologies strides has greatly also driven simultaneously burning the wind of video signal technology; Dual camera mobile phone with video call function has goed deep into people's life; Moreover, the multi-cam equipment that 3D (three-dimensional) takes that can carry out that has two or more cameras is also becoming the focus product gradually.And the application of multi-cam is not limited only to the mobile communication series products, uses maximum monitoring cameras as safety-security area and also progressively a plurality of imageing sensors is integrated on the same camera, with the expanding monitoring scope.
Multiple image sensor equipment of the prior art generally uses dual mode that a plurality of imageing sensors and image processing apparatus thereof are become one.First kind of mode becomes one two or more imageing sensors and image processing apparatus thereof, and each imageing sensor all has independently graphics processing unit, and is as shown in Figure 1.First image sensor chip comprises independently first imageing sensor, first graphics processing unit and first parallel interface; Second image sensor chip comprises independently second imageing sensor, second graphics processing unit and second parallel interface.Image sensor chip is handled through graphics processing unit separately respectively after catching view data, and sends data/address bus to through parallel interface separately, and finally arrives the equipment main control chip.The equipment main control chip is controlled the shoot function and the image processing function of first image sensor chip and second image sensor chip through control bus.
The second way is as shown in Figure 2; The picture processing chip that is independent of two or more imageing sensors is installed in equipment; First image sensor chip and the second image sensor chip common image process chip; Imageing sensor is sent to picture processing chip after catching view data, and the view data after the processing sends data/address bus to through parallel interface, and finally arrives the equipment main control chip.The equipment main control chip is controlled the shoot function and the image processing function of first image sensor chip and second image sensor chip through control bus.
Though this dual mode can both be realized a plurality of imageing sensors are integrated in the same equipment; But first kind of mode is that imageing sensor is simply accumulated; Two or more image sensor chip sends view data to the equipment main control chip through same data/address bus through parallel interface separately; Shared same the data/address bus of a plurality of imageing sensors, this connected mode very easily causes data-crosstalk, influences picture signal; And two graphics processing units have in fact been realized identical functions in this integration mode, cause the waste of chip area.The second way makes two shared graphics processing units of image sensor chip, though can solve the problem of two imageing sensor phases mutual interference, independently graphics processing unit and parallel interface still take bigger chip area.
Summary of the invention
The purpose of the utility model provides a kind of data-crosstalk phenomenon that takes place can prevent that multiple image sensor is integrated in the same equipment time, simultaneously the image processing section chip area in the equipment is optimized to the image processing equipment of minimum multiple image sensor.
The purpose of the utility model realizes through following technical scheme:
A kind of image processing equipment of multiple image sensor comprises:
The master image sensor chip is used to catch view data and with sending to main control chip after the said view data processing, perhaps, will after the view data that image sensor chip is caught is handled, sends to main control chip;
One or more from image sensor chip, be used to catch view data, and the view data of catching is sent to the master image sensor chip;
Main control chip is used to receive the view data after the processing that the master image sensor chip sends.
Technical scheme by above-mentioned the utility model provides can be found out; The imageing sensor that does not comprise graphics processing unit in the multiple image sensor equipment of the utility model is connected to the graphics processing unit in the image sensor chip that comprises graphics processing unit through the serial line interface in the chip; Make that a plurality of imageing sensors of device interior can shared same graphics processing unit; The view data of finishing dealing with is sent to data/address bus through the inner parallel interface of image sensor chip that comprises graphics processing unit and parallel interface, and finally is sent to the equipment main control chip; A plurality of imageing sensors are used alternatingly same graphics processing unit and parallel interface, make data/address bus only taken by unique imageing sensor at current time, and the phenomenon of data-crosstalk can not take place; And this graphics processing unit needn't be separately be chip independently; But be integrated in the arbitrary image sensor chip of multiple image sensor equipment inside with parallel interface; Can effectively solve the situation of multiple image sensor device chip area waste of the prior art, reduce the cost of multiple image sensor equipment.
Description of drawings
In order to be illustrated more clearly in the technical scheme of the utility model embodiment; The accompanying drawing of required use is done to introduce simply in will describing embodiment below; Obviously, the accompanying drawing in describing below only is some embodiment of the utility model, for those of ordinary skill in the art; Under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is that first kind of mode module of prior art of the utility model connects sketch map;
Fig. 2 is that the prior art second way module of the utility model connects sketch map;
The structural representation of the image processing equipment of the multiple image sensor that Fig. 3 provides for the embodiment of the utility model;
The schematic flow sheet of the image processing method that Fig. 4 provides for the embodiment of the utility model;
Fig. 5 is the structural representation that is applied to the dual camera mobile phone that the embodiment of the utility model provides;
Fig. 6 is the structural representation that is applied to the 3D capture apparatus that the embodiment of the utility model provides;
Fig. 7 is that the three serial line interface multiplex data channel modules that the embodiment of the utility model provides connect sketch map.
Embodiment
Below in conjunction with the accompanying drawing among the utility model embodiment, the technical scheme among the utility model embodiment is carried out clear, intactly description, obviously, described embodiment only is the utility model part embodiment, rather than whole embodiment.Based on the embodiment of the utility model, those of ordinary skills are not making the every other embodiment that is obtained under the creative work prerequisite, all belong to the protection range of the utility model.
The image processing equipment of the multiple image sensor that this embodiment provides comprises master image sensor chip, one or more from image sensor chip and main control chip; The master image sensor chip be used to catch view data and said view data handled after send to main control chip; Perhaps, will, the view data that image sensor chip is caught send to main control chip after handling; One or morely be used to catch view data, and the view data of catching is sent to the master image sensor chip from image sensor chip; Main control chip is used to receive the view data after the processing that the master image sensor chip sends.The image processing equipment of the multiple image sensor that this embodiment provides is used at the first-class equipment that comprises a plurality of picture processing chips of mobile phone, palmtop PC, panel computer, game machine, shooting the chip area of image processing section being optimized processing; Its basic principle is one or more from picture processing chip and the shared graphics processing unit that is arranged on the picture processing chip of master image process chip, thereby under the prerequisite of the function that does not influence image processing, saves the area of picture processing chip.To combine accompanying drawing that embodiment is done to describe in detail further below, this embodiment provides three embodiment, and is specific as follows:
Embodiment one
In the technical scheme that present embodiment provides, the resolution of the master image transducer of master image sensor chip is 30～1,200 ten thousand pixels, is lower than the resolution of master image transducer from the resolution from imageing sensor of image sensor chip.
As shown in Figure 3; The image processing equipment of the multiple image sensor in the present embodiment is a kind of double image sensor equipment; Comprise master image sensor chip 31, from image sensor chip 32 and main control chip 33; Master image sensor chip 31 wherein comprises the master image transducer, and graphics processing unit and parallel interface comprise second imageing sensor and serial line interface from image sensor chip 32.
Concrete; Main control chip 33 is through control bus control master image sensor chip 31 with from image sensor chip 32, wherein master image sensor chip 31 and the master image transducer that comprises respectively from image sensor chip 32 and from the imageing sensor work that hockets.In main control chip 33, be provided with operating state conversion subelement, be used for getting into non operating state, during from image sensor chip entering operating state, closing and catch the view data function in the master image sensor chip when the master image sensor chip.Image processing method is as shown in Figure 4, and concrete step is following:
Embodiment two
In the technical scheme that present embodiment provides, a plurality of quantity from image sensor chip are two, and synchronization has only one from image sensor chip entering operating state.
Fig. 5 is the structural representation that the utility model is applied to the module of dual camera mobile phone.Two cameras are generally divided into the high-resolution image sensors that places on the mobile phone back panel and are placed the low-resolution image transducer on the mobile phone front panel in the dual camera mobile phone; High-resolution image sensors is used to take scenery or personage's photo of high-resolution, and the low-resolution image transducer is used to take taking a picture certainly of low resolution or carries out video calling.
The high-resolution image sensors chip comprises high-resolution image sensors, graphics processing unit and parallel interface; Because when mobile phone is used for photographed and portrait picture quality is had relatively high expectations, the imageing sensor on the back panel of dual camera mobile phone is generally the high-resolution camera of 30～1,200 ten thousand pixels.The photosensitive area of high-resolution image sensors is bigger; Chip area also increases thereupon; Bigger area makes the high-resolution image sensors chip to increasing the less function of this type of chip area of graphics processing unit and insensitive, can increase extra cost hardly.
When the user prepared to take pictures through function key unlatching high-resolution camera, mobile phone main control chip control high-resolution image sensors chip got into operating state.At this moment, because the user has independently selected camera function, therefore can not require simultaneously to autodyne or video call function, mobile phone main control chip control low-resolution image transducer quits work.High-resolution image sensors is delivered to graphics processing unit with shot image data and is handled, and the view data of finishing dealing with is sent to parallel interface, is sent to the mobile phone main control chip by data/address bus, and is shown by its control.
Repeat above operation and withdraw from screening-mode up to the user; Because the high-resolution image sensors power consumption in the high-resolution image sensors chip is bigger; After finishing shooting; High-resolution image sensors in the mobile phone main control chip control high-resolution image sensors chip quits work, and stops to be its power supply.Graphics processing unit power consumption is little, and it also is required to be low-resolution image sensor chip image data processing, therefore continues its power supply.
The low-resolution image sensor chip comprises low-resolution image transducer and serial line interface; Because it is less demanding when mobile phone is used for auto heterodyne and video calling to picture quality; And excessive view data can make that also the communication load is excessive; Therefore the imageing sensor on the front panel of dual camera mobile phone generally is lower than 300,000 pixels; Current 80,000 pixels more commonly, the resolution of actual low-resolution image sensor chip can select to be lower than the arbitrarily rational resolution of high-resolution image sensors chip resolution.Low-resolution image sensor photosensitive area is less; And when placement-and-routing, need consider logic placement; It is bigger to optimize this type image area sensor difficulty compared to high-resolution image sensors, for example adds Digital Logic such as graphics processing unit above that, and the cost of required increase is higher.
When the user opened auto heterodyne or video call function through function key, mobile phone main control chip control low-resolution image sensor chip got into operating state.At this moment, because the user has independently selected to autodyne or video call function, therefore can not require to open camera function simultaneously, mobile phone main control chip control high-resolution image sensors quits work, and graphics processing unit continues operation.The low-resolution image transducer is delivered to graphics processing unit with shot image data through serial line interface and is handled, and the view data of finishing dealing with is sent to parallel interface, is sent to the equipment main control chip by data/address bus, and is shown by its control.
Repeat above operation and withdraw from the perhaps video calling pattern of autodyning up to the user; After finishing auto heterodyne or video calling pattern; Equipment main control chip control low-resolution image sensor chip quits work, and withdraws from taking the graphics processing unit in the high-resolution image sensors chip.
Embodiment three
In the technical scheme that present embodiment provides; A plurality ofly be connected with the master image sensor chip through the serial line interface that is provided with independent data path from image sensor chip; Perhaps, a plurality ofly be connected with the master image sensor chip through multiplexing same data path from image sensor chip.
Because the development of 3D technology; A lot of mobile phones, computer or IP Camera all possess the 3D technique for taking; Therefore often integrated three or three above image sensor chips in this kind equipment are that example describes with the multiple image sensor equipment with three imageing sensors only below.
As shown in Figure 6, image processing apparatus comprises equipment main control chip, control bus, data/address bus, high-resolution image sensors chip, the first low-resolution image sensor chip and the second low-resolution image sensor chip.High-resolution image sensor comprises high-resolution image sensor, graphics processing unit and parallel interface.The first low-resolution image sensor chip comprises first low-resolution image transducer and the serial line interface.The second low-resolution image sensor chip comprises second low-resolution image transducer and the serial line interface.Graphics processing unit in the high-resolution image sensors chip connects first serial line interface and second serial line interface in the second low-resolution image sensor chip in the first low-resolution image sensor chip respectively.
Owing at current time unique in three an imageing sensors entering operating state is only arranged in the three image sensor apparatus image processing apparatus; Therefore the serial line interface of incoming image processing unit can multiplexing same data path; As shown in Figure 7, an interface of the second serial line interface multiplex data path incoming image processing unit in first serial line interface in the first low-resolution image sensor chip and the second low-resolution image sensor chip.
Three image sensor apparatus working methods are similar with dual camera equipment work mode; Three imageing sensors can not get into operating state simultaneously; Only have one after catching view data, take the graphics processing unit that is included in the high-resolution image sensors chip, the view data that graphics processing unit is finished dealing with is sent to parallel interface; Be sent to the equipment main control chip by data/address bus, and show by its control.In case the image sensor chip in the work quits work, it withdraws from the taking of graphics processing unit at once, so that graphics processing unit receives the view data from other imageing sensors.
The technical scheme that adopts this embodiment to provide; The imageing sensor that does not comprise graphics processing unit in the multiple image sensor equipment is connected to the graphics processing unit in the image sensor chip that comprises graphics processing unit through the serial line interface in the chip; Make that a plurality of imageing sensors of device interior can shared same graphics processing unit; The view data of finishing dealing with is sent to data/address bus through the inner parallel interface of image sensor chip that comprises graphics processing unit and parallel interface, and finally is sent to the equipment main control chip.A plurality of imageing sensors are used alternatingly same graphics processing unit and parallel interface, make data/address bus only taken by unique imageing sensor at current time, and the phenomenon of data-crosstalk can not take place.And this graphics processing unit needn't be separately be chip independently; But be integrated in the arbitrary image sensor chip of multiple image sensor equipment inside with parallel interface; Can effectively solve the situation of multiple image sensor device chip area waste of the prior art, reduce the cost of multiple image sensor equipment.
The above; Be merely the preferable embodiment of the utility model; But the protection range of the utility model is not limited thereto; Any technical staff who is familiar with the present technique field is in the technical scope that the utility model discloses, and the variation that can expect easily or replacement all should be encompassed within the protection range of the utility model.
Claims (5)
1. the image processing equipment of a multiple image sensor is characterized in that, comprising:
The master image sensor chip is used to catch view data and with sending to main control chip after the said view data processing, perhaps, will after the view data that image sensor chip is caught is handled, sends to main control chip;
One or more from image sensor chip, be used to catch view data, and the view data of catching is sent to the master image sensor chip;
Main control chip is used to receive the view data after the processing that the master image sensor chip sends.
2. the image processing equipment of multiple image sensor according to claim 1 is characterized in that, in main control chip, also comprises:
Operating state conversion subelement is used for getting into non operating state, during from image sensor chip entering operating state, closing and catch the view data function in the master image sensor chip when the master image sensor chip.
3. the image processing equipment of multiple image sensor according to claim 1 is characterized in that, said a plurality of quantity from image sensor chip are two, and synchronization has only one from image sensor chip entering operating state.
4. the image processing equipment of multiple image sensor according to claim 1; It is characterized in that; Said a plurality ofly be connected with the master image sensor chip through the serial line interface that is provided with independent data path from image sensor chip; Perhaps, said a plurality ofly be connected with the master image sensor chip through multiplexing same data path from image sensor chip.
5. the image processing equipment of multiple image sensor according to claim 1; It is characterized in that; The resolution of the master image transducer of said master image sensor chip is 30～1,200 ten thousand pixels, the said resolution that is lower than said master image transducer from the resolution from imageing sensor of image sensor chip.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011201274053U CN202153766U (en) | 2011-04-26 | 2011-04-26 | Image processing device for multiple image sensors |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011201274053U CN202153766U (en) | 2011-04-26 | 2011-04-26 | Image processing device for multiple image sensors |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN202153766U true CN202153766U (en) | 2012-02-29 |
Family
ID=45694259
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011201274053U Expired - Fee Related CN202153766U (en) | 2011-04-26 | 2011-04-26 | Image processing device for multiple image sensors |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN202153766U (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105683728A (en) * | 2013-10-04 | 2016-06-15 | ams有限公司 | Colour sensor arrangement and method for colour sensor calibration |
| JP2020504953A (en) * | 2017-05-03 | 2020-02-13 | オッポ広東移動通信有限公司 | Camera assembly and mobile electronic device |
-
2011
- 2011-04-26 CN CN2011201274053U patent/CN202153766U/en not_active Expired - Fee Related
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105683728A (en) * | 2013-10-04 | 2016-06-15 | ams有限公司 | Colour sensor arrangement and method for colour sensor calibration |
| US10072981B2 (en) | 2013-10-04 | 2018-09-11 | Ams Ag | Color sensor arrangement and method for color sensor calibration |
| CN105683728B (en) * | 2013-10-04 | 2018-09-21 | ams有限公司 | Color sensor device and the method calibrated for color sensor |
| JP2020504953A (en) * | 2017-05-03 | 2020-02-13 | オッポ広東移動通信有限公司 | Camera assembly and mobile electronic device |
| JP7023965B2 (en) | 2017-05-03 | 2022-02-22 | オッポ広東移動通信有限公司 | Camera assembly and mobile electronics |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102447847A (en) | Multi-image sensor image processing device with MIPI (Mobile Industry Processor Interface) and method | |
| EP2533520B1 (en) | Image sensor having HDR capture capability | |
| CN103379275B (en) | The image processing apparatus and method of video camera | |
| CN105872393A (en) | High dynamic range image generation method and device | |
| CN104333704B (en) | A kind of method for previewing, device and the terminal of scene of taking pictures | |
| CN104410785A (en) | An information processing method and electronic device | |
| CN103402004A (en) | Method for pre-starting multiple cameras of mobile terminal | |
| EP1622364A3 (en) | Image signal processing apparatus and method thereof in mobile communications terminal | |
| CN1835578A (en) | Method and apparatus for composing images during video communications | |
| CN103888672A (en) | Terminal and terminal shooting method | |
| CN105611171A (en) | Method and device for online shooting video file by utilizing multiple terminals | |
| CN103369246B (en) | Camera resolution conversion device | |
| CN102186015A (en) | Multi-image sensor image processing equipment and image processing method | |
| CN103369217A (en) | Photographic device with multiple lenses and mobile terminal | |
| US20110074965A1 (en) | Video processing system and method | |
| CN202153766U (en) | Image processing device for multiple image sensors | |
| CN107613177A (en) | Camera, imaging method and mobile terminal based on fly's-eye lens | |
| US20170064223A1 (en) | Image sensor device with macropixel processing and related devices and methods | |
| CN201378849Y (en) | Portable camera with WI-FI transmission | |
| CN202309907U (en) | Multi-image-sensor image processing device including MIPI interface | |
| CN201976173U (en) | Hand-held terminal equipment with proximity sensor photographic function | |
| CN103402055A (en) | Camera chip for mobile terminal, mobile terminal with image pick-up function, shooting method for mobile terminal and shooting device for mobile terminal | |
| CN102739930A (en) | Image capturing device and image processing method thereof | |
| CN102244722A (en) | Image capture module and image capture method capable of avoiding shutter delay | |
| CN102572320A (en) | Method for reducing height of CMOS (Complementary Metal-Oxide-Semiconductor Transistor) image sensor module and CMOS image sensor module |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120229 Termination date: 20150426 |
|
| EXPY | Termination of patent right or utility model |