CN103685884A - Intelligent camera based on on-chip visual system - Google Patents

Intelligent camera based on on-chip visual system Download PDF

Info

Publication number
CN103685884A
CN103685884A CN201310498614.2A CN201310498614A CN103685884A CN 103685884 A CN103685884 A CN 103685884A CN 201310498614 A CN201310498614 A CN 201310498614A CN 103685884 A CN103685884 A CN 103685884A
Authority
CN
China
Prior art keywords
vision system
array
sheet
smart camera
camera based
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201310498614.2A
Other languages
Chinese (zh)
Inventor
杨永兴
吴南健
石匆
杨杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute of Semiconductors of CAS
Original Assignee
Institute of Semiconductors of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Semiconductors of CAS filed Critical Institute of Semiconductors of CAS
Priority to CN201310498614.2A priority Critical patent/CN103685884A/en
Publication of CN103685884A publication Critical patent/CN103685884A/en
Pending legal-status Critical Current

Links

Landscapes

  • Studio Devices (AREA)

Abstract

The invention discloses an intelligent camera based on an on-chip visual system. The intelligent camera comprises an optical imaging lens, a housing, the on-chip visual system, a driving module, a power management module and an interface module. An image sensor and a processor are integrated in the same chip, thereby overcoming the transmission bottleneck of an embedded intelligent camera; and images are processed hierarchically, thereby greatly accelerating image processing, and broadening the application range of the intelligent camera. The intelligent camera of the invention is small in size, high in precision, high in speed and low in cost, and can be widely applied to the fields including industrial automation, monitoring security and traffic automation.

Description

A kind of smart camera based on vision system on sheet
Technical field
The present invention relates to machine vision and vision chip technical field, relate in particular to a kind of smart camera based on vision system on sheet
Background technology
Tradition vision system mainly adopts camera and PC or industrial control computer structure, by pure software algorithm, is processed.Along with the development of embedded system, this collection IMAQ of smart camera, the micromachine vision system of processing and be in communication in one are flourish, are widely used in industrial control system and supervisory control system.The structure that traditional smart camera employing COMS or ccd image sensor add flush bonding processor, the structure of main processor adopting DSP array, FPGA, CPU and DSP+FPGA.But because imageing sensor is connected with processor adopting sheet external tapping, its transmittability limited (being generally no more than for 50 frame/seconds), speed is slower, and embedded system is not the special processor for image, handling property is limited, and real-time is poor, is only suitable for being applied to that some are higher to power consumption and volume requirement, deal with data amount is little, the occasion that requirement of real-time is not high.
Summary of the invention
(1) technical problem that will solve
For above problem, the invention provides the smart camera based on vision system on sheet of a kind of high integration, high-performance, low cost, low-power consumption, integrated by imageing sensor and multi-level images processor are carried out on sheet, realize processing speed and application widely that smart camera is higher.
(2) technical scheme
For achieving the above object, the invention provides a kind of smart camera based on vision system on sheet, this camera comprises vision system 3, driver module 4, power management module 5 and interface module 6 on optical imaging lens 1, housing 2, sheet, wherein: optical imaging lens 1, for product or monitoring scene are carried out to imaging; Housing 2, for installing the various assemblies with protection structure camera; On sheet, vision system 3, comprise cmos image sensor and multistep treatment device, for realizing IMAQ and visual analysis; Driver module 4, is used to vision system on sheet that driving is provided; Power management module 5, comprises power supply and administration module, is used to each several part in camera that suitable power source is provided; Interface module 6, comprises the multiple interfaces and the driving thereof that communicate with other system.
In such scheme, this optical imaging lens 1 is adjustable focus camera lens, can and follow the trail of the objective demand and automatically regulates according to environment, to reach best imaging effect.
In such scheme, cmos image sensor on this sheet in vision system 3 comprises the output selection array of the simulation preliminary treatment array of a two-dimentional pel array, an one dimension, an one dimension and the analog-to-digital conversion array of an one dimension, cmos image sensor high speed acquisition image, and utilize correlated-double-sampling mode to carry out noise reduction process to image, then by analog-to-digital conversion generating digital image, and by output select array by image transmitting in multistep treatment device.
In such scheme, multistep treatment device on this sheet in vision system 3 comprises processes pixel battle array column and row processing array and Global treatment device, wherein, processes pixel array is two-dimensional array, one of each unit correspondence image and a plurality of pixels, for to rule but the large rudimentary processing of amount of calculation process; It is one-dimensional array that row is processed array, and each unit is processed a line view data; Global treatment device is comprised of multinuclear reduced instruction processor, processes, for high vision processing and the control to system for realizing Thread-Level Parallelism.
In such scheme, it is, with row parallel mode, view data is carried out to non-linear and wide area processing that this row is processed array, is adapted to the middle rank that complexity is higher and processes.
In such scheme, this cmos image sensor and multistep treatment device are integrated on same chip.
In such scheme, this driver module 4 is according to the service requirement of vision system on sheet 3, for it provides required clock and driving.
In such scheme, this power management module 5, for generating and control the power supply of other each modules, is comprised of power supply, LDO power management chip and protective circuit; The 12V receiving from outside, 5V power supply, obtains the required 3.3V of chip, 1.8V power supply through this power management module 5.
In such scheme, this interface module 6 is for realizing communicating by letter and transfer of data of smart camera and host computer, other cameras, actuating equipment or remote device, and complete control and the indication of camera state, comprise USB, RS-485 serial ports, jtag interface Ethernet interface and driving thereof.
In such scheme, image or result that this smart camera obtains are directly sent to host computer or are realized long-range connection by Ethernet by USB interface, and the program of host computer can download in smart camera RS-485 serial ports for controlling The Cloud Terrace or other actuating equipments by JTAG interface.
(3) beneficial effect
Smart camera based on vision system on sheet provided by the invention, on the sheet of employing vision system integrated IMAQ and processing capacity, image information is transmission process in sheet, has eliminated traditional images transmission bottleneck; Image is processed and is adopted low middle high-grade to process, and takes the hardware processor of different degree of concurrence, has greatly improved treatment effeciency and precision; Adopt many general interface, can communicate transmission with other system easily, be easy to other system compatible.
Accompanying drawing explanation
Fig. 1 is the structural representation of the smart camera based on vision system on sheet provided by the invention;
Wherein, 1 is optical imaging lens, and 2 is housing, and 3 is vision system on sheet, and 4 is driver module, and 5 is power management module, and 6 is interface module.
Embodiment
For making the object, technical solutions and advantages of the present invention clearer, below in conjunction with specific embodiment, and with reference to accompanying drawing, the present invention is described in more detail.
As shown in Figure 1, Fig. 1 is the structural representation of the smart camera based on vision system on sheet provided by the invention, this camera comprises vision system 3, driver module 4, power management module 5 and interface module 6 on optical imaging lens 1, housing 2, sheet, wherein, optical imaging lens is for carrying out imaging to product or monitoring scene; Housing is for installing the various assemblies with protection structure camera; On sheet, vision system comprises cmos image sensor and multistep treatment device, for realizing IMAQ and visual analysis; Driver module is used to vision system on sheet that driving is provided; Power management module comprises power supply and administration module, is used to each several part in camera that suitable power source is provided; Interface module comprises multiple interfaces and the driving thereof communicating with other system.To forming each part of this smart camera based on vision system on sheet, be described in detail respectively below.
1, optical imaging lens
Optical lens is adjustable focus camera lens, can and follow the trail of the objective demand and automatically regulates according to environment, to reach best imaging effect.
2, housing
For the various assemblies with protection structure camera are installed.
3, vision system on sheet
As shown in Figure 1, on sheet, vision system comprises cmos image sensor and multistep treatment device, and this cmos image sensor and multistep treatment device are integrated on same chip.Cmos image sensor comprises the output selection array of the simulation preliminary treatment array of a two-dimentional pel array, an one dimension, an one dimension and the analog-to-digital conversion array of an one dimension, cmos image sensor high speed acquisition image, and by correlated-double-sampling, image is carried out to noise reduction process, then by analog-to-digital conversion generating digital image, and by output select array by image transmitting in multistep treatment device;
Image is processed and generally can be divided into low middle-and-high-ranking processing, and rudimentary processing is all pointwise operation or pointwise neighborhood operation substantially, carries out the operation of identical and rule for every bit, has that operation is relatively simple, rule but a large feature of amount of calculation; Middle rank is processed the information that relates generally to point in certain limit, needs certain nonlinear operation, and computational complexity rises but still has larger degree of parallelism; Advanced processes has independently feature of sequential search and data conventionally, and itself does not have unified form the information of calculating, and operation lacks systematicness, and degree of parallelism is lower.
For the processing complexity of different stage, on sheet vision system integrated multistep treatment device, comprise that processes pixel battle array column and row processes array and Global treatment device; Processes pixel array is two-dimensional array, and one and a plurality of pixels that each unit can correspondence image, to rule but the large rudimentary processing of amount of calculation has great advantage; Going and processing array is one-dimensional array, and each unit can be processed a line view data, and row is processed array can carry out non-linear and wide area processing to view data with row parallel mode, is adapted to the middle rank that complexity is higher and processes; Global treatment device is comprised of multinuclear reduced instruction processor, and operational capability is high, and computational flexibility is strong, can realize Thread-Level Parallelism and process, for high vision processing and the control to system.
4, driver module
Driver module is according to the service requirement of SOC (system on a chip), for it provides required clock and driving.
5, power management module
Power management module is responsible for generating and controlling the power supply of other each modules, mainly power supply, LDO power management chip and protective circuit, consists of; System receives 12V from outside, and 5V power supply obtains the required 3.3V of chip, 1.8V power supply through power management module.
6, interface module
Interface module realizes communicating by letter and transfer of data of smart camera and host computer, other cameras, actuating equipment or remote device, and completes control and the indication of camera state, comprises USB, RS-485 serial ports, jtag interface Ethernet interface and driving thereof etc.; Image or result that smart camera obtains can be directly sent to host computer or be realized long-range connection by Ethernet by USB interface, and the program of host computer also can download in smart camera RS-485 serial ports for controlling The Cloud Terrace or other actuating equipments by interfaces such as JTAG.
Above-described specific embodiment; object of the present invention, technical scheme and beneficial effect are further described; institute is understood that; the foregoing is only specific embodiments of the invention; be not limited to the present invention; within the spirit and principles in the present invention all, any modification of making, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.

Claims (10)

1. the smart camera based on vision system on sheet, it is characterized in that, this camera comprises vision system (3), driver module (4), power management module (5) and interface module (6) on optical imaging lens (1), housing (2), sheet, wherein:
Optical imaging lens (1), for carrying out imaging to product or monitoring scene;
Housing (2), for installing the various assemblies with protection structure camera;
Vision system on sheet (3), comprises cmos image sensor and multistep treatment device, for realizing IMAQ and visual analysis;
Driver module (4), is used to vision system on sheet that driving is provided;
Power management module (5), comprises power supply and administration module, is used to each several part in camera that suitable power source is provided;
Interface module (6), comprises the multiple interfaces and the driving thereof that communicate with other system.
2. the smart camera based on vision system on sheet according to claim 1, is characterized in that, this optical imaging lens (1) is adjustable focus camera lens, can and follow the trail of the objective demand and automatically regulates according to environment, to reach best imaging effect.
3. the smart camera based on vision system on sheet according to claim 1, it is characterized in that, cmos image sensor in vision system on this sheet (3) comprises the output selection array of the simulation preliminary treatment array of a two-dimentional pel array, an one dimension, an one dimension and the analog-to-digital conversion array of an one dimension, cmos image sensor high speed acquisition image, and utilize correlated-double-sampling mode to carry out noise reduction process to image, then by analog-to-digital conversion generating digital image, and by output select array by image transmitting in multistep treatment device.
4. the smart camera based on vision system on sheet according to claim 1, it is characterized in that, multistep treatment device in vision system on this sheet (3) comprises processes pixel battle array column and row processing array and Global treatment device, wherein, processes pixel array is two-dimensional array, one of each unit correspondence image and a plurality of pixels, for to rule but the large rudimentary processing of amount of calculation process; It is one-dimensional array that row is processed array, and each unit is processed a line view data; Global treatment device is comprised of multinuclear reduced instruction processor, processes, for high vision processing and the control to system for realizing Thread-Level Parallelism.
5. the smart camera based on vision system on sheet according to claim 4, is characterized in that, it is, with row parallel mode, view data is carried out to non-linear and wide area processing that this row is processed array, is adapted to the middle rank that complexity is higher and processes.
6. the smart camera based on vision system on sheet according to claim 1, is characterized in that, this cmos image sensor and multistep treatment device are integrated on same chip.
7. the smart camera based on vision system on sheet according to claim 1, is characterized in that, this driver module (4) is according to the service requirement of vision system on sheet (3), for it provides required clock and driving.
8. the smart camera based on vision system on sheet according to claim 1, is characterized in that, this power management module (5), for generating and control the power supply of other each modules, is comprised of power supply, LDO power management chip and protective circuit; The 12V receiving from outside, 5V power supply, obtains the required 3.3V of chip, 1.8V power supply through this power management module (5).
9. the smart camera based on vision system on sheet according to claim 1, it is characterized in that, this interface module (6) is for realizing communicating by letter and transfer of data of smart camera and host computer, other cameras, actuating equipment or remote device, and complete control and the indication of camera state, comprise USB, RS-485 serial ports, jtag interface Ethernet interface and driving thereof.
10. the smart camera based on vision system on sheet according to claim 9, it is characterized in that, image or result that this smart camera obtains are directly sent to host computer or are realized long-range connection by Ethernet by USB interface, and the program of host computer can download in smart camera RS-485 serial ports for controlling The Cloud Terrace or other actuating equipments by jtag interface.
CN201310498614.2A 2013-10-22 2013-10-22 Intelligent camera based on on-chip visual system Pending CN103685884A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310498614.2A CN103685884A (en) 2013-10-22 2013-10-22 Intelligent camera based on on-chip visual system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310498614.2A CN103685884A (en) 2013-10-22 2013-10-22 Intelligent camera based on on-chip visual system

Publications (1)

Publication Number Publication Date
CN103685884A true CN103685884A (en) 2014-03-26

Family

ID=50322061

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310498614.2A Pending CN103685884A (en) 2013-10-22 2013-10-22 Intelligent camera based on on-chip visual system

Country Status (1)

Country Link
CN (1) CN103685884A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110148301A (en) * 2019-06-21 2019-08-20 北京精英系统科技有限公司 A method of detection electric vehicle and bicycle
CN110751107A (en) * 2019-10-23 2020-02-04 北京精英系统科技有限公司 Method for detecting event of discarding articles by personnel
CN112788216A (en) * 2020-12-31 2021-05-11 中冶赛迪重庆信息技术有限公司 Device for image acquisition and recognition
CN113660403A (en) * 2021-08-23 2021-11-16 长春理工大学 Satellite-borne ultra-miniature monitoring camera

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060098114A1 (en) * 2004-11-05 2006-05-11 Fuji Photo Film Co., Ltd. Adaptor device and camera system
US20070024737A1 (en) * 2005-08-01 2007-02-01 Hideo Nakamura Image capturing device having multiple optical systems
CN101035200A (en) * 2006-03-08 2007-09-12 奥林巴斯映像株式会社 Single-lens reflex camera
CN201118765Y (en) * 2007-11-07 2008-09-17 宁波工程学院 An image collection and playback system based on CMOS image sensor
CN101276218A (en) * 2008-04-29 2008-10-01 上海交通大学 Machine vision system aiming at high real time image collecting and processing
CN201608778U (en) * 2010-01-20 2010-10-13 深圳市蓝盾科技有限公司 Intelligent camera

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060098114A1 (en) * 2004-11-05 2006-05-11 Fuji Photo Film Co., Ltd. Adaptor device and camera system
US20070024737A1 (en) * 2005-08-01 2007-02-01 Hideo Nakamura Image capturing device having multiple optical systems
CN101035200A (en) * 2006-03-08 2007-09-12 奥林巴斯映像株式会社 Single-lens reflex camera
CN201118765Y (en) * 2007-11-07 2008-09-17 宁波工程学院 An image collection and playback system based on CMOS image sensor
CN101276218A (en) * 2008-04-29 2008-10-01 上海交通大学 Machine vision system aiming at high real time image collecting and processing
CN201608778U (en) * 2010-01-20 2010-10-13 深圳市蓝盾科技有限公司 Intelligent camera

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
吴南健: "视觉片上系统芯片", 《黑龙江大学工程学报》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110148301A (en) * 2019-06-21 2019-08-20 北京精英系统科技有限公司 A method of detection electric vehicle and bicycle
CN110751107A (en) * 2019-10-23 2020-02-04 北京精英系统科技有限公司 Method for detecting event of discarding articles by personnel
CN112788216A (en) * 2020-12-31 2021-05-11 中冶赛迪重庆信息技术有限公司 Device for image acquisition and recognition
CN113660403A (en) * 2021-08-23 2021-11-16 长春理工大学 Satellite-borne ultra-miniature monitoring camera

Similar Documents

Publication Publication Date Title
CN101055619B (en) Image identification method and device for mechanical instrument window display figure
CN104820418A (en) Embedded vision system for mechanical arm and method of use
CN103685884A (en) Intelligent camera based on on-chip visual system
US10652440B2 (en) Hermetically sealed camera with a graphical processing unit (GPU)
CN207457833U (en) A kind of obstruction-avoiding control system of robot
CN208224794U (en) Robot terminal device
CN202270019U (en) Medical far infrared thermal imaging device adopting wide-angle lens
CN102968086A (en) Remote laboratory controller
CN102055894A (en) Modularized CCD industrial camera
CN104469274A (en) An intelligent video surveillance system
CN104811597A (en) Integrated smart camera
CN104580895B (en) It is a kind of that there is the airborne imaging system taken the photograph according to synchronous working ability
CN104954694A (en) Industrial camera capable of viewing panoramic image in real time through WIFI (wireless fidelity)
CN207968682U (en) IR image processing system based on FPGA
CN202793595U (en) Infrared thermal imaging device based on FPGA
CN203744940U (en) Portable three-dimensional scanner
CN202721739U (en) Monitoring type video recording system
CN214101483U (en) Industrial camera system based on FPGA
CN204795328U (en) Panoramic picture's industry camera is looked over through WIFI in real time
CN203164738U (en) Machine vision control system based on cloud computing
CN204206306U (en) A kind of intelligent electric meter element image capture device
CN208888840U (en) Image object detection device
CN105338234A (en) Endoscopic intelligent camera
CN204180158U (en) Based on the camera system of unmanned plane
CN104320582A (en) Method for designing image collecting system of quadcopter

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20140326