TW498290B - Information collection system, mechanical eyeball, vision device, image sensor, and interlocking device - Google Patents

Abstract

As shown in Fig. 1, the information collection system consists of at least one mechanical eyeballs (1) and at least one user terminals (4) where the mechanical eyeballs and the user terminals are connected through a network. As shown in Fig. 10, the mechanical eyeball (1) consists of a moving camera (10), a vision device (2), and a communication device (7). As shown in Fig 14, by using the vision device (2) to search object and control the panning, the tilting, the rolling, and the zooming of the moving camera (10), the moving camera (10) can film an object in a wide range at a high power so to allow the user to find the target object faster and more accurately. Also, since the vision device (2) is able to identify the type of an object, the communication device (7) can transmit only the filmed moving images of a specific type of object.

Description

498290 'Articles 丨 ·, ·· :: Exaggerated Five A7 B7 Invention Description (ί) [Technical Area] The present invention relates to an information collection system that uses artificial eyeballs to track objects to produce only images of the objects. Specifically, It refers to the normalized image, type, position, size, and number of objects produced by a vision device through a moving camera with a pan, tilt, roll, and zoom mechanism. The vision device will The mobile camera is controlled so that the object is captured in the center of the moving image, and the communication device transmits the image of the object area separated from the background by the visual device to the user terminal via the wired and wireless communication network. [Knowledge technique] There are many research reports on photography devices using mobile cameras (see JP-A-Sho 63-54699, JP-A-Heisei 3-164341, and JP-A Hei 5-297325). Especially in recent years, the imaging device for tracking high-speed moving objects has developed a feedback system for lms vision (refer to Zhongfang Jiahong, Ishiibo, Ishikawa Masatoshi '"Photographic system for lms target tracking using super-parallel and ultra-high-speed vision", Journal of the Japan Robotics Society, Vol.15, No. 3, ρρ · 417-421 '1997). However, since these mobile cameras use a drive system with a conventional motor, the device itself is large, or its movement is restricted, etc. Problem points. Therefore, in the method for solving this problem, a spherical multi-degree-of-freedom motor is useful (for example, refer to JP 6-210585; Nikkan Kogyo Shimbun, December 15, 2011, page 6). Also, In the multi-degree-of-freedom motor, by using an ultrasonic motor instead of a conventional motor, the mechanism and control of the multi-degree-of-freedom motor will become simple (Japanese Patent Application Laid-Open No. 62-228392; Motoki Toyama, "Development of a Spherical Ultrasonic Motor", Tribologist , Vol. 40, No. 8, ρρ · 627-63 Paper size Gu specifications (21G X 297 mm) (Please read the precautions on the back before filling this page)

498290 A7 ____ B7__ 5. Description of the Invention (Y) • 1995; JP-A 7-80793; JP-A 9-54356; JP-A 11-18459: Sazue Keisuke, Otsuki Yasunori, Miki Xiuwu, and Kurosaki Taichon, "Used Development of Friction-Driven Multi-DOF Spherical Motors for Piezoelectric Elements ", [onlme], January 2010, Transcript of Kawasaki Heavy Industries Gazette No. 136, [Retrieved January 20, 2012], Internet < URLhttp // www.khi.coJp / tech / njl36g07.htm >). In addition, mobile cameras using this ultrasonic motor have also been developed (see Japanese Patent Application Laid-Open No. 11-84526). Others have also developed multi-degree-of-freedom piezoelectric actuators that do not require a conventional ultrasonic motor (see Japanese Patent Application No. 2000-243635). When this piezoelectric actuator is used, since the power consumption is low and the control device is simple, it is possible to manufacture a small mobile camera that can be mounted on a mobile phone. On the other hand, the development of vision chips or image sensors for processing images captured by cameras is also underway. For example, CLIP4 (refer to MJBDuff, "CLIP4: A large scale integrated circuit array parallel processor", Proc. IJCPR-3, VoL 4, pp.728-733, 1976), MPP (refer to KEBatcher, "MPP: A high -speed image processor, L.SnyDer, L.HJamieson, DBGannon, HJSiegel, ed., Algorithmically specialized parallel computers, pp.59-68, Academic press, 1985), S3PE (Simple and Smart Sensory Processing Element) vision chip (Refer to Takamori Komura, Nobuyuki Suzuki, Nobuyoshi Ishii, Masatoshi Ishikawa, "Design of Ultra-Parallel and Ultra-High-Speed Vision Chips Using General-Purpose Processing Elements", Papers of the Institute of Electronic Information and Communications, Vol. J81-DI, No. 2, ρρ · 70-76, 1998), artificial reticulation LSI (refer to JP-A-6-139361, JP-A-1M77889), general vision section 5 This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) 'II I ----- III I--It · — —-- I --- (Please read the notes on the back before filling this page) 498290 A7 __B7 _ V. Description of the invention (j) ------ ---- I--I · II (Please read the note on the back first (Please fill in this page again) (GVPP, Generic Visual Perception Processor) (Vision Chip's Circuitry Has Its Eye Out For You. TechWeb News j 1997-09-13 · [online] · CMP Media Inc ·, 1999. [Search time · 1999-12-19] Retrieved from the Internet: < URL: http: //www.techweb.com/ wire / news / 1997/09 / 0913vision.htin1 > ^, vision chip ('Eye, Chip Tracks Movement. Wired News j 1999-04-10, [online]. Wired Ventures Inc. and affiliated companies »1999. [Search time: 1999-12-19] · Retrieved from the Internet: < URL: http: // www.wired.com/news/news/technology/story/19046.html>), etc. Although the above can perform simple processing such as edge detection and optical flow detection, as a result of packaging priority, many problems occur, such as using a 1-bit arithmetic circuit, using an analog circuit, performing only product and calculation, and must be used. A multi-processor of the SIMD (Single Instruction Stream Multi Data Stream) type for synchronizing the entire LSI (Large Integral Circuit). In the case of inconsistent image processing mechanisms and algorithms, multiple vision chips are required to achieve multiple image processing. Difficulties may arise, or it may be limited to situations where objects and the shooting environment are likely to become binary. In addition, although S3PE can be connected to a mobile camera to track high-speed moving objects, in addition to being affected by the shooting environment and the speed of moving objects, S3PE must use other devices for stationary objects and multiple objects. For image processing. In addition, although a wireless image communication device using an artificial retina LSI to transmit an image of an object after removal has been developed, since the wireless image communication device does not have a function of controlling a mobile camera, the use of the wireless image communication device is limited to Surveillance devices using solid-state cameras. 6 This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) 498290, A7 __B7_ V. Description of the invention (L [〇

There are many problems on this vision chip due to the packaging of the LSI, especially the relationship of the degree of integration. That is, if the LSI can incorporate more transistors, the vision chip can perform higher-level image processing on a moving image with more pixels in real time. However, due to the rapid progress of LSI technology in recent years, high-speed and high-integration LSIs have been developed. The integration degree of LSI is not only the miniaturization technology of design rules, but also the three-dimensional LSI technology, especially the wafer bonding technology (for example, refer to JP 5-160340, JP 6-268154, Koyanagi, M., Kurino, H., LEE, KW., Sakuma, K., Miyakawa, N., Itani, H., 'Future System-on-Silicon LSI Chips', [EEE MICRO, 1998, Vol. 18, No.4, PP.17-22) development, LSI will become more highly integrated, so the digital circuits that are conventionally packaged on each LSI are easily packaged on a single LSI. Also, because of the technology used to stack multiple wafers (for example, refer to the Nikkei Micro Devices, June 2000 issue, ρρ · 62-79, Nikkei Micro Devices, June 2000 issue, pp.157-164, Japan Micro-components were developed in June 2000 (PP.176), so it is easier for LSI designers to design electronic circuits than the three-dimensional LSI technology. When three-dimensional LSI technology is used, LSI

The designer can shorten the wiring length, so the LSI designer can easily design the LSI. 〇 In the practical problems of LSI design and manufacturing, as the frequency of the clock signal increases, the clock-skew and signal The extent of the propagation delay time will increase. The reason why the analog chip using analog circuits is actively researched is not so much as the integration of LSI is less than the required amount, but rather to process the digital 7 in real time. This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297). Mm) ------------- install -------- order --------- line (please read the precautions on the back before filling this page) 498290 A7 _ B7 V. Description of the Invention (j), the environment of the circuit is constantly changing, and the frequency of the clock signal must be increased. Therefore, not only is it difficult to obtain the entire LSI's pace, but the heat generation is also increased. Of course, the main reason that it is difficult for the entire LSI to achieve synchronization is that the conventional vision chip has frequently performed a wide range of processing such as boundary calculation, histogram calculation, and region division. Therefore, the present inventors have developed a visual device (refer to, for example, Japanese Patent Application No. 11-253634, International Publication No. WOOO / 16259, Japanese Patent Application No. 2000-269500) to control a mobile camera and perform image processing. The vision device is used for a person who searches for an object and performs an image processing of the object by controlling a pan, tilt, roll and zoom of a mobile camera. Most of the image processing performed by the visual device is local processing, and these local processing are performed in parallel by an array computing device arranged on a two-dimensional grid. If the array computing device is packaged in an LSI, each array computing device will be designed to perform asynchronous communication with an adjacent array computing device. As a result, the wiring pattern becomes very simple and the wiring length becomes shorter. Therefore, the LSI not only increases the package area of the transistor, but also reduces the power consumption. It is not necessary to synchronize all the array computing devices. However, when the scale of the LSI becomes large, in order to execute the pause processing and the like correctly, it is necessary to provide clock signals of the same cycle and reset signals with a small phase difference to all array computing devices. If you consider the above matters, I hope that based on the large-scale integrated circuit technology currently available and the three-dimensional large-scale integrated circuit technology, we will be able to develop a combination of visual devices and photographic elements such as photoelectric diodes. processor. Furthermore, by mounting the processor on a multi-degree-of-freedom motor, a mobile camera controlled by a vision device can be manufactured. 8 This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) --------------------- Order --------- -(Please read the notes on the back before filling this page) 498290, 'A7 ____B7_ V. Description of the invention (! 〇) ---- I -------- I · II (Please read the notes on the back first Please fill in this page again.) Also, a recent study was published, which is based on the image captured by a fixed charge coupled device (CCD) camera mounted on the glasses. The use of electrode array terminals directly transmitted the electrical signals of the edge image to the visual region of the right posterior lobe of the brain to achieve artificial vision (Computer Helps Blind Man 'See' · Wired News, 200-01-17. [Online]. Wired Ventures Inc · , And affiliated companies, 2000. [Search time: 2000-01-20]. Retrieved from the Internet: < URL: http: // www. wired. com / news / technology / 0, 1282, 3369 Bu 00. html >). Because the patient's field of view is very narrow, the patient must move the neck to search for objects, and can only read at a distance of 1. It is about 5 cm in size. However, due to the success of this research, the future will focus on the blind and the visually impaired, and the expectations for embedded artificial eyeballs for achieving wide-field and high-resolution artificial vision will increase. line! If the above considerations are taken into consideration, it is expected that an artificial eyeball can be manufactured, which uses a mobile camera mounted on a multi-degree-of-freedom motor controlled by a vision device to search for objects, and normalized images, types, positions, sizes, and Changes in position can be transmitted directly to the brain. In recent years, with the development of Internet technology and broadband wireless communication technology centered on high-speed wired communication, dynamic images can be transmitted to distant places. In particular, due to the launch of IMT-2000 (DS-CDMA and MC-CDMA) and bluetooth-compatible mobile phones, the environment for anyone to send or receive motion pictures cheaply anytime, anywhere is already available (for example, see JP 6-233020, JP 7-312783, JP 8-163085, JP 8-294030, JP 11-346364). 9 This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 ___B7 — _ V. Description of the invention (1) If the above matters are taken into consideration, then it is expected that the use of the paper is controlled by the visual device A multi-degree-of-freedom mobile camera captures an object 'and the visual device judges the type of the object being captured, so that the communication device can transmit a dynamic image reflecting the object. Finally, in recent years, high-performance sound synthesizers (see JP 5-053595, JP 5-094196, and JP 5-108084) and high-performance voice recognition devices (see JP-A 05-002399 and JP-A 05-002399) have been developed. 011798, JP 5-019787). By incorporating these devices, speakers, and microphones into the navigation system, users can easily use the navigation system through sound (see JP 6-20196, JP 8_35846, and JP 11-276516). If the above matter is considered, the user is expected to use the voice recognition device to control the visual device with voice, and to know the type of object recognized by the visual device using voice. Therefore, the purpose of the present invention, such as the scope of the patent application, is to use a visual device that controls the mobile camera to transmit the dynamic image of the reflected object to the remote even if the mobile camera is not always controlled from the remote end. User terminal. The other purpose is to package the vision device and the imaging element on an LSI, and mount it in a mobile camera. [Disclosure of the invention] The invention of item 1 of the scope of patent application is an information collection system, which is composed of at least one artificial eyeball and at least one user terminal connected to a communication network, and is characterized by the aforementioned artificial eyeball With mobile camera, vision device and communication equipment 10 I ----- III 1-^ 0 I --- I I-* 5 ^ (Please read the precautions on the back before filling this page) This paper size Applicable to China National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 --------B7 _ 5. Description of the invention (&) • Set; the aforementioned mobile camera has At least one of the mechanisms of pitching, rolling, and zooming; the characteristics of the aforementioned visual device are obtaining a digital image from a dynamic image captured by the aforementioned mobile camera, generating the type, position, and number of objects in the aforementioned digital image, and Controls the aforementioned mechanisms for panning, tilting, rolling, and zooming; the communication device is characterized by transmitting one of the aforementioned digital image, the aforementioned type, the aforementioned position, and the aforementioned number to the aforementioned user Terminal, receiving control commands corresponding to the pan, tilt, roll, and zoom from the user terminal and transmitting to the vision device; the user terminal has a central control device, a display, and control buttons; and The central control device receives one of the digital image, the type, the position, and the number from the communication device, and the display displays one of the digital image, the type, the position, and the number, and the user The terminal generates the control command assigned on the control button, and the central control device transmits the control command to the communication device. The artificial eyeball has one of the aforementioned mechanisms for panning (horizontal movement), tilting (vertical movement), tumbling (twisting), and zooming (telephoto). Using the mobile camera, the aforementioned The object is placed in the center of the aforementioned moving image and shot at an appropriate size. The aforementioned visual device generates the aforementioned kind, the aforementioned position, and the aforementioned number of the object from the aforementioned digital image, and controls the aforementioned mobile camera based on the aforementioned position. The aforementioned communication network consists of USB (Universal Serial Bus), Ethernet, ISDN (Integrated Digital Communication Network), xDSL (Digital Subscriber Line), ATM (Asynchronous Transfer Mode), and 11 paper standards in the frame are applicable to China National Standard (CNS) A4 Specification (210 X 297 mm) ---- I--I 11 ---- · 11 (Please read the notes on the back before filling this page) Order: • Line! 498290 A7 __B7_______ V. Description of the invention (1) Wire technology such as frame relay, and wireless technologies such as IMT-2000 (DS-CDMA and MC-CDMA) and Bluetooth. The aforementioned communication device has a digital image , The aforementioned category, the aforementioned location, and the aforementioned number are transmitted to the aforementioned communication network, and the aforementioned control instruction is received from the aforementioned communication network. The user terminal can use a computer, mobile phone, mobile information terminal, and navigation system with the display and the control buttons. The central control device has a communication function for the communication network. The position and the number are output to the display. The control command is also input from the control button. In the present invention, the front & vision device always controls the mobile camera, so that the user does not need to carefully control the mobile camera. In addition, in the present invention, because the visual device recognizes the type of the object taken by the mobile camera, the artificial eyeball only transmits information about the object that the user wants to know to the user terminal. That is, because the user terminal outputs the foregoing information to the display only when shooting the object the user wants to know, the user does not need to pay attention to the display all the time, or the artificial eyeball does not need to occupy the communication network all the time. . Therefore, as the present invention makes the aforementioned user out of the control of the aforementioned mobile camera, various problems related to the photographing and communication of the aforementioned object will be appropriately solved. The invention of item 2 of the scope of patent application is an information collection system, which is composed of at least one artificial eyeball, database and at least one user terminal connected to a communication network, and is characterized in that the aforementioned artificial eyeball has a mobile camera , Visual device and communication device; the aforementioned mobile camera has pan, tilt, roll and 12 paper sizes that are applicable to China National Standard (CNS) A4 (210 X 297 mm) -------- --------- (Please read the notes on the back before filling this page) · Online! 498290 A7 _______ B7__ 5. Description of the invention (I Ο) • At least one of the zooming mechanisms; the characteristics of the aforementioned visual device are to obtain a digital image from a dynamic image captured by the aforementioned mobile camera, and generate a digital image from the aforementioned digital image. Object type, position, and number; The characteristics of the aforementioned communication device are to transmit one of the aforementioned digital image, the aforementioned type, the aforementioned position, and the aforementioned number to the aforementioned database; the characteristic of the aforementioned database is to store the aforementioned digital image, The aforementioned kind, the aforementioned position, and the aforementioned number; generating statistical data from the aforementioned digital image, the aforementioned kind, the aforementioned position, and the aforementioned number; and using a search key to retrieve the aforementioned digital image, the aforementioned kind, the aforementioned position, the aforementioned number, and the aforementioned statistical data The user terminal is provided with a central control device, a display and control buttons; the central control device receives one of the digital image, the type, the position, the number, and the statistical data from the communication device; The display will show the aforementioned digital image, the aforementioned type, the aforementioned One of the location, the aforementioned number, and the aforementioned statistical data, the aforementioned user terminal uses the aforementioned control button to generate the aforementioned retrieval key which has been designated; the aforementioned central control device transmits the aforementioned retrieval key to the aforementioned communication device. The artificial eyeball uses the mobile camera (which has one of the aforementioned structures for panning (horizontal movement), tilting (vertical movement), rolling (twisting), and zooming (telephoto)). The aforementioned object is placed in the center of the aforementioned moving image and photographed at an appropriate size. The aforementioned visual device generates the aforementioned type, the aforementioned position, and the aforementioned number of the aforementioned objects from the aforementioned digital image, and controls the aforementioned mobile camera according to the aforementioned position. The aforementioned communication network is composed of wired technologies such as USB, Ethernet, ISDN, xDSL, ATM, and Frame Relay, and wireless technologies such as IMT-2000 (DS-CDMA and MC-CDMA) and Bluetooth. 13 paper standards Applicable to China National Standard (CNS) A4 specification (210 X 297 mm) ------------------ 1--Order --------- line (please (Please read the notes on the back before filling this page) 498290 B7 V. Description of Invention (M) • The aforementioned communication device has a mechanism for transmitting the aforementioned digital image, the aforementioned type, the aforementioned position, and the aforementioned number to the aforementioned communication network. . The aforementioned database uses mathematical methods such as averaging, dispersion, principal component analysis, finite element method, linear planning method, and basic inference to calculate the aforementioned statistical data from the aforementioned digital image, the aforementioned category, the aforementioned position, and the aforementioned number. As the aforementioned database, a relational database and an object-oriented database having a description language such as SQL (Structure Query Language) can be used. The user terminal is a computer, a mobile phone, a mobile information terminal, a navigation system, or the like using the display and the control buttons. The central control device has a communication function connected to the communication network, and outputs the types, the positions, the number, and the statistical data to the display, and inputs the search key from the control button. In the present invention, the above-mentioned location and the number of the aforementioned digital image and the aforementioned category are stored for a long time by the aforementioned database, so that the aforementioned user can obtain the aforementioned search keys corresponding to the aforementioned category, region, place, season, and date. statistical data. Therefore, the present invention will appropriately solve various problems concerning the calculation and prediction of the aforementioned objects. The invention in the third scope of the patent application is an information collection system such as the first or second scope of the patent scope, in which the aforementioned user terminal has at least a sound synthesis device equipped with a speaker or a sound recognition device equipped with a microphone. For one, the aforementioned sound synthesizing device converts the aforementioned category, the aforementioned position, the aforementioned number, and the aforementioned statistical data into a voice signal; the aforementioned voice recognition device converts the collected voice into the aforementioned control command and the aforementioned search key using the aforementioned microphone. The aforementioned user terminal can use the above-mentioned display 14 This paper size is applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) I --------- · II (Please read the precautions on the back first Fill out this page again) Order: 498290 V. Description of the invention (Ά ---------------- (Please read the precautions on the back before filling out this page) • Device, the aforementioned speaker, the aforementioned Control buttons and computers, mobile phones, mobile information terminals, navigation systems, etc. with the aforementioned microphones. The aforementioned central control device has a communication function connected to the aforementioned communication network, and combines the aforementioned types, the aforementioned positions, the aforementioned numbers, and the aforementioned statistics The data is output to the display and the sound synthesizing device, and the control command and the search key are input from the control button and the sound recognition device. The sound synthesizing device converts the aforementioned type, the aforementioned position, the aforementioned number, and the aforementioned statistics. Is the aforementioned sound signal and is output to the aforementioned speaker. The aforementioned voice recognition device converts the collected voice into the aforementioned control instruction and The search key. The user of the present invention can use the aforementioned user terminal without going through the aforementioned display and the aforementioned control buttons. Therefore, the present invention will appropriately solve various problems related to the user interface. The scope of patent application is 4th The invention of item is an artificial eyeball provided with a mobile camera and a visual device, characterized in that the aforementioned mobile camera has at least one of a pan, tilt, roll and zoom mechanism; the aforementioned visual device is provided with Device for digital images taken from a moving image taken by a video camera, a device for identifying types of objects in the digital image, a device for detecting the position, size, and inclination of the object, a device for calculating the number of the object, and controlling the panning , The aforementioned devices of the aforementioned mechanisms of the pitch, the roll, and the zoom, and the devices that output the aforementioned digital images, the aforementioned types, the aforementioned positions, and the aforementioned numbers. The aforementioned mobile camera is a combination of a plurality of cylinders and a motor, and Using a multi-degree-of-freedom motor to serve the aforementioned panning (horizontal Movement), the aforementioned pitching (vertical movement), the aforementioned rolling (twisting), and the aforementioned zooming (telephoto). Therefore, the aforementioned movement 15 paper size applies to China National Standard (CNS) A4 (210 X 297 mm) 498290 A7 _ _ B7 V. Description of the invention (1)) The camera can place the aforementioned object in the center of the aforementioned moving image and shoot with the size required to identify the aforementioned object. The aforementioned visual device performs local parallel image processing such as an edge information generating device, an edge information forming device, an object / background separation device, a position / size detection device, a position / size / tilt detection device, and a pattern matching device. The object is separated from the digital image, the type is identified, the position, the size, and the inclination are detected, and the number is calculated. In addition, in addition to using the position to control the panning, the tilting, the rolling, and the zooming of the mobile camera, the visual device also uses a control command input from outside to control the panning. Tumble and zoom as described above. According to the present invention, when the position of the object cannot be known in advance and when the object is moving, the mobile camera can also be directed toward the object. Therefore, the present invention is because the user is not controlled by the aforementioned mobile camera, so various problems related to the photography of the aforementioned object will be appropriately solved. The invention of item 5 in the scope of patent application is an artificial eyeball with a communication device such as the item 4 in the scope of patent application, in which the aforementioned communication device is provided with a device for compressing the aforementioned digital image, and transmitting the compressed aforementioned digital image and the aforementioned through a communication network. The type, the aforementioned position, and the aforementioned number of devices. The aforementioned communication device transmits the compressed digital image, the aforementioned type, the aforementioned position, and the aforementioned number to the aforementioned communication network, and receives the aforementioned control command from the aforementioned communication network. In order to compress the aforementioned digital image, the aforementioned communication device uses the aforementioned type recognized by the aforementioned visual device to select the aforementioned digital image reflecting the aforementioned object of the particular aforementioned type. In addition, the aforementioned newsletter 16 paper sizes are applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) -I I ---- 1 !! * ^^.  I I (Please read the notes on the back before filling this page) t ^ J.  -Line 498290 A7 ___ _B7 ___ V. Description of the invention (#) • The device can mask the part outside the area occupied by the aforementioned object in the previously selected digital image and transmit it. In addition, the communication device may also use image compression technologies such as MPEG (Moving Picture Experts Group) and JPEG (Joint Photographic Coding Experts Group) to reduce the data amount of the digital image. The present invention can only transmit the aforementioned digital images captured by the aforementioned objects to the aforementioned communication network. Therefore, in addition to reducing the load of the aforementioned communication network, the present invention can also inform the user of the present invention of the existence of the aforementioned object, so various problems related to the photographing and communication of the aforementioned object will be appropriately solved. The invention in the sixth scope of the patent application is an artificial eyeball with the fourth scope in the patent scope of the patent application, which is provided with a stimulus generator, an electrode array terminal, a connector and a battery. The invention is characterized in that the stimulus generator is generated by the aforementioned visual device. The normalized image of the aforementioned object, the aforementioned kind, the aforementioned position, the aforementioned size, and the aforementioned changes in position are converted into electrical stimulation; the aforementioned electrode array terminal transmits the aforementioned electrical stimulation to the brain through the aforementioned connector. The aforementioned stimulus generator uses the D / A conversion circuit to convert the aforementioned normalized image, the aforementioned type, the aforementioned position, the aforementioned size, and the aforementioned position change of the aforementioned object into the aforementioned electrical stimulation which can appropriately stimulate the nerve cells. The electrodes of the electrode arrangement terminals are made of platinum, and the electrode arrangement terminals are buried in the brain, such as the lobes, lateral lobes, parietal lobes, and anterior lobes. The aforementioned batteries are those that can be repeatedly charged, such as lithium ion batteries, and those that have long discharge times, such as fuel cells. By disengaging the connector, the user of the present invention can easily remove or replace the mobile camera, the visual device, the stimulus generator, and the battery. The present invention is employed by the aforementioned mobile camera and 17 paper sizes that are applicable to the Chinese National Standard (CNS) A4 (21 × 297 mm) ~ '' --------------- ------ Order ----- I --- line (please read the notes on the back before filling this page) 498290 A7 ____ B7 __— V. Description of the invention (1st night) The aforementioned normalized image of the object, the aforementioned type, the aforementioned position, the aforementioned size, and the aforementioned changes are converted into the electrical stimuli and transmitted directly to the aforementioned brain of the user. Therefore, the aforementioned user is not subject to the aforementioned The aforementioned size of the aforementioned object in the digital image and the influence of the surrounding environment are lost, so that the aforementioned object can be easily found and identified. Therefore, the present invention is to allow the aforementioned user to identify the aforementioned object in a short time and with high accuracy. Therefore, various problems related to artificial vision will be properly resolved. t The invention of the 7th scope of the patent application is an artificial eyeball such as the 4th, 5th, or 6th scope of the patent application, wherein the aforementioned mobile camera is provided with an integrated plurality of photographic elements and a plurality of A / D Conversion circuit and image sensor of the aforementioned vision device. The aforementioned imaging element is realized using a photodiode and a CCD or CMOS (Complementary Metal Oxide Film Semiconductor). Using the LSI technology and the three-dimensional LSI technology, the A / D conversion circuit and the vision device are integrated on the imaging element. In the present invention, since the digital image is transmitted in parallel from the A / D conversion circuit to the visual device in pixels, the A / D conversion circuit and the visual device can simplify an electronic circuit for transmitting the digital image. . Therefore, the present invention reduces the number of parts and reduces the size of the aforementioned artificial eyeball, so various problems related to the manufacturing of the aforementioned artificial eyeball will be appropriately solved. The invention in the eighth aspect of the patent application is a visual device, which is characterized in that each array computing device arranged in a grid is provided with a device for initializing the aforementioned array computing device; The device that ends the processing of secondary information; the device for inputting the foregoing secondary information; 18 This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) ----------- -I --- (Please read the precautions on the back 10 before filling out this page)-498290 A7 _ B7______ V. Description of the invention (^) -------------- install --- ( (Please read the notes on the back before filling out this page) -1 line A device for converting the aforementioned secondary information into duplicate information; for calculating the center of gravity from the vicinity of the band pixel 値 of the duplicate data image representing the aforementioned duplicate data, and imaging the movement amount calculated by the aforementioned center of gravity 'and becoming Device for band pixels 値 of a moving image; a device for moving each band pixel 値 of a moving source repeat information image representing moving source repeat information on each moving source to a moving position according to the aforementioned moving amount 丨A device for moving the band pixels 前述 of the repeating information image to the aforementioned moving position according to the amount of said movement; for 'moving each of the band pixels of the repeating information image of the aforementioned mobile source on each of the aforementioned moving sources' 'Update device for updating the total of the aforementioned band pixels 値 of the aforementioned mobile source repeat information image and the total of the aforementioned band pixels 値 of the aforementioned repeat information image moved; a device for updating the aforementioned duplicate information image The band pixels 値 'are updated to all the aforementioned band pixels 値 of all the previously repeated information images that have been moved over. A total device; a device for calculating the inclination angle from all the aforementioned band pixels of the moving information repeating information image; and a device for outputting the above-mentioned band information pixel of the repeating information image and the aforementioned tilt angle. That is, the actual form of this algorithm is used to realize the functions provided by the aforementioned array computing device using digital technology. The aforementioned array computing device is arranged in a lattice shape, and the aforementioned array computing device and a nearby person are combined with each other, and the initial setting of each parameter of the aforementioned array computing device is set. Pixels are appropriately input in units, and calculation is sequentially performed from the center of gravity to outputting the repeated information image and the tilt angle, and iteratively is repeated until the second image is not input. The present invention allows the aforementioned array computing device to operate in parallel, so the relevant position and size 19 paper size applies to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 V. Description of the invention (丨 ^). And the problems of tilt detection will be properly solved. ----— II ------- --- (Please read the notes on the back before filling out this page) The invention in the 9th scope of the patent application is a visual device, which is characterized by a grid Each array computing device in the state configuration includes a processor, a memory, and a plurality of controllers; the controller is a device having the aforementioned array computing device for identifying a transmission source of data transferred between the aforementioned array computing devices, and The 9-line device used to identify the type of the aforementioned data to be transferred 丨 In the aforementioned array computing device, one of the aforementioned controllers connected to the adjacent aforementioned array computing device through a signal line is borrowed from each of the aforementioned controllers So that the foregoing array computing device and the adjacent array computing device may simultaneously transmit a plurality of the foregoing data. In the array operation device, the plurality of controllers are controlled by the processor, so that the array operation device can efficiently transfer the plurality of foregoing data in the memory to the adjacent memory of the array operation device. Since the present invention can transmit a large amount of the aforementioned data in a short time, various problems related to the performance of the aforementioned visual device implementing various local parallel image processing will be appropriately solved. The invention in the scope of patent application No. 10 is a vision device, which is characterized in that in the array computing device in scope of patent application No. 9, the aforementioned controllers are all stacked, so that the aforementioned signal lines between the aforementioned array computing devices are not cross. Because if the designer of LSI uses 3D LSI technology, all the aforementioned controllers will be stacked, so all the aforementioned controllers being stacked will be arranged in a grid. At this time, the aforementioned signal lines are used to connect the aforementioned controllers adjacent to the package at the same level, and the aforementioned signal lines between the aforementioned controllers will not cross. 20 This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) 498290 A7 ______ Β7 ____ 5. Description of the Invention (丨 Image) II --- · II (Please read the precautions on the back before filling this page) 'In the present invention, the aforementioned signal line branch wiring characteristics in all the aforementioned layers can be set to be the same, and the wiring length of the aforementioned signal line can be shortened, so various problems related to the design and manufacture of the three-dimensional LSI will be appropriately solved. -The 11th invention in the scope of patent application is a visual device composed of a plurality of virtual array computing devices arranged in a grid shape, which is characterized by a line ... The aforementioned virtual array computing device has a processor, a memory Billion body, and a plurality of controllers, the aforementioned controller has a front input register group, the front input register group has at least one front input register and at least one counter, so that the foregoing input register is temporarily The register serves as a shift register, so that in each of the foregoing virtual array computing devices, the processor executes a program of a plurality of array computing devices arranged in a grid, the controller, and the adjacent virtual array computing device: The controller communicates, the shift register sequentially inputs and stores a plurality of result data arranged in a grid, the counter calculates the number of the result data, and the processor selects from the shift register Enter one of the foregoing results. In the present invention, the controller has the maximum number of vertical and horizontal numbers of the array computing device arranged in a grid. Adjacent to the aforementioned virtual array computing device in the aforementioned array computing device arranged in a grid form will be classified into communication directions of up, down, left and right, and each category will correspond to one of the controllers which is different. Therefore, from which direction, the aforementioned controller inputs calculation data. If the virtual array computing device can recognize, from which aforementioned array computing device the computing data should be output, the virtual array computing device can recognize. In the present invention, the front input resistor has a storable 21 paper size applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 public love) 498290 A7 B7 ------ 5. Description of the invention (1 I). There is a memory capacity of the aforementioned result data output by the aforementioned array computing device, the aforementioned transfer resistance, and the aforementioned counter, and the aforementioned transfer resistance stores the inputted aforementioned result data in a certain order. Therefore, even if the foregoing result data of a plurality of the foregoing array computing devices arranged in a grid are communicated between the two foregoing virtual array computing devices, the order of the foregoing result data can be maintained. The initial value of the counter is set to the number of the array operation device. Each time the array operation table outputs the result data, the counter is calculated in descending order. Therefore, if all the aforementioned result data are output from the aforementioned array computing device, then 値 of the aforementioned counter is zero. The aforementioned controller will set the front input delivery to 1. Thereafter, if the aforementioned processor reads all of the aforementioned result data in the aforementioned transfer resistor ', the aforementioned processor will set the previous input delivery status to zero. In the present invention, a plurality of the aforementioned array computing devices can be packaged as a program on one of the aforementioned virtual array computing devices. Therefore, the present invention can implement many of the aforementioned array computing devices with very little hardware, so various problems related to the manufacture of the aforementioned visual devices can be appropriately solved. The invention of the 12th scope of the patent application is an image sensor. Its functional blocks are arranged in a two-dimensional grid, and it has at least one camera, at least one A / D conversion circuit, and at least one array operation. The device is characterized in that the aforementioned functional block is a circuit that converts the aforementioned photographic element to the aforementioned A / D, and is connected in a one-to-one manner. At least one 1-input digital signal in the computing device, and all the aforementioned array computing devices input clock signals 22 ----------- 1-- · II (Please read the precautions on the back before filling (This page), a '*-line-This paper size applies to Chinese National Standard (CNS) A4 (210 X 297 mm) 498290 A7 _________B7____ V. Description of the invention (\ 〇) 1— 1I1II1I · II (Please read the back first (Please fill out this page again) • Online! • number; and between adjacent functional blocks, a one-to-one connection is made between the foregoing array computing devices, thereby performing image processing on the moving image captured by the aforementioned imaging element by the foregoing array computing device. The aforementioned photographic element is realized by using a photodiode and CCD or CMOS. The imaging device, the A / D conversion circuit, and the array computing device are integrated in the embedder using LSr technology and three-dimensional LSI technology. If the aforementioned three-dimensional LSI technology is used, the designer of the aforementioned processor can stack the aforementioned array computing device in the aforementioned functional block, so even if the aforementioned designer does not allow the signal line of the aforementioned array computing device to be adjacent to the aforementioned functional block Intersection is also possible. In the present invention, since the digital signal is transmitted from the A / D conversion circuit to the array operation device in the processor, the A / D conversion circuit and the array operation device can transmit electronic signals for transmitting the digital signal. The circuit is simplified and the aforementioned digital signals can be transmitted at high speed. In addition, in the present invention, because the array computing device communicates asynchronously with the array computing device adjacent to the functional block, it has nothing to do with the number of the functional block of the processor, and the clock signal only needs the functional block. The aforementioned array computing device can be synchronized. Therefore, the present invention can reduce the number of parts and wiring, and also enable the aforementioned processor to operate at high speed. Therefore, various problems related to the design and manufacture of the aforementioned processor will be appropriately solved. The invention in the 13th scope of the patent application is an image sensor whose functional blocks are arranged in a two-dimensional grid, and has a plurality of photographic elements, a plurality of A / D conversion circuits, and at least one parallel / serial conversion. Circuit, and at least one virtual array computing device; characterized in that the aforementioned functional block is to convert the aforementioned photographic element and the aforementioned A / D conversion 23 This paper size is applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 male) Love) 498290 A7 ________R7 —__— V. Description of the invention (W) -------------- Install --- (Please read the precautions on the back before filling this page)-line. The circuits are connected on a one-to-one basis, and a plurality of the aforementioned A / D conversion circuits and the aforementioned parallel / serial conversion circuits are wired on the bandwidth of each of the aforementioned photographic elements. At least one input digital signal in all serial circuits and all the aforementioned virtual array computing devices, and all the aforementioned virtual array computing devices input clock signals; and between adjacent functional blocks, each of the aforementioned arrays The computing cranes are connected on a one-to-one basis, so as to perform image processing on the dynamic images captured by the aforementioned imaging elements with the aforementioned virtual array computing device. The aforementioned imaging element is realized by a CCD and a CMOS. The imaging element, the A / D conversion circuit, the parallel / serial conversion circuit, and the virtual array computing device are integrated in the processor using LSI technology and three-dimensional LSI technology. If the aforementioned three-dimensional LSI technology is used, the designer of the aforementioned processor may stack the aforementioned virtual array computing device in the aforementioned functional block, so even if the aforementioned designer does not allow the signal line of the aforementioned virtual array computing device to be adjacent to the aforementioned function Crossing between blocks is also possible. In the present invention, since the digital signal is transmitted from the parallel / serial conversion circuit to the virtual array computing device in the processor, the parallel / serial conversion circuit and the virtual array computing device, g will transmit the digital The electronic circuit of the signal is simplified, and the aforementioned digital signal can be transmitted at high speed. In addition, in the present invention, the virtual array computing device gj communicates with the virtual array computing device adjacent to the functional block, so it has nothing to do with the number of the functional block of the processor. The virtual array computing device in the aforementioned functional block can just stomach. Therefore, the present invention can reduce the number of parts and wiring, and also enable the aforementioned processor to operate at high speed. Therefore, the design and manufacture of the aforementioned processor are rare. The paper size is applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) '* ------ 498290 A7 __________B7___ 5. Description of the invention (w). The problem will be properly resolved. -The invention with the scope of patent application No. 14 is an image sensor such as the scope of patent application No. 12 or 13, where the aforementioned functional block has a synchronous oscillation circuit for generating the aforementioned clock signal and is used for calculation Interlocking counter of the number of pulses of the aforementioned clock signal; the aforementioned synchronous oscillating circuit arranged in a two-dimensional grid form constitutes a first interlocking device by connecting with the adjacent synchronous oscillating circuit; arranged in a two-dimensional grid The aforementioned interlocking counter 'forms a second interlocking device by wiring the adjacent interlocking counter. In the aforementioned synchronous oscillation circuit, an unstable multivibrator, a crystal oscillator, or the like is used. The aforementioned synchronous oscillating circuits are synchronized with the adjacent synchronous oscillating circuits, so the clock signals generated by all of the aforementioned synchronous oscillating circuits are synchronized. Since the aforementioned clock signal is provided only in the aforementioned functional block, the present invention can alleviate the problems of fan-out and clock skew. The aforementioned interlocked counter uses a binary counter. Because the interlocked counters are interconnected with the adjacent interlocked counters, the pulse numbers calculated by all the interlocked counters are consistent. Because the aforementioned interlocked counter can control the input of the reset signal, all the aforementioned functional blocks can be reset together. Therefore, the present invention can reduce power consumption and allow the aforementioned processor to operate at high speed, so various problems related to the design and manufacture of the aforementioned processor will be appropriately solved. The invention in the 15th scope of the patent application is an interlocking device composed of interlocking counters arranged in a square grid and a hexagonal grid. It is characterized by the aforementioned interlocking counters, which are equipped with synchronous counters. 25. The end of the judgment 25 paper size is applicable to China National Standard (CNS) A4 (210 x 297 mm). III I ----- I I ----- (Please read the precautions on the back before filling out this page) ·-line · 498290 A7 ___B7_ V. Description of the invention (τΛ) -------- --------- < Please read the precautions on the back before filling in this page) Lines 丨 · Fixed NOT brake, interlock lock circuit, interlock NOR brake, and counter NOR brake; The outputted interlock signal stops the adjacent interlocked counters from counting, so that the count numbers of all the interlocked counters are consistent. The aforementioned interlocking counter generates the aforementioned interlocking signal because the NOT gate used for judging termination is used to reverse the ripple-carry-ou signal of the synchronous counter. The interlocking NOR gate may generate a possible signal from the interlocking signal. When the interlocking signal is at a high level, the synchronous counter will calculate and restore the interlocking lock circuit. When the interlock signal is at a low level, the synchronous counter is temporarily stopped. After the interlocking NOR gate integrates an external interlock signal, the interlocking lock circuit stores the integration result. The interlocking lock circuit controls the calculation NOR gate based on the integration result, so that the synchronous counter starts to operate. Therefore, the aforementioned synchronous counter will start to count after being linked to the inputted interlock signal from the outside. In the present invention, a plurality of the aforementioned interlocked counters can be connected to each other to make the aforementioned counts 値 of all the aforementioned interlocked counters consistent. In particular, when one clock signal is distributed to the entire LSI, if the frequency of the clock signal is higher, the transmission delay time of the clock signal becomes a problem. However, even if the aforementioned interlocked counters are dispersedly arranged in the aforementioned LSI, the aforementioned counts of all the aforementioned interlocked counters can be made uniform. Therefore, various issues concerning the synchronization of the aforementioned LSIs will be properly resolved. The invention with the scope of patent application No. 16 is an interlocking device such as the scope of the patent application No. 15 where the aforementioned interlocking counter is provided with a standard for judging 26 paper standards that are applicable to China National Standard (CNS) A4 (210 X 297 mm) 498290 A7 __B7 _ 5. Explanation of the invention (> /). The NOR gate for determining the end of the aforementioned count, the end of the count, and the determination; the aforementioned synchronous counter has a synchronous erasing device and a synchronous loading device. When the synchronous counter is an up counter, the output of the up counter is connected to the determination of the count, the maximum is the determination termination, and the nor gate is used. The output of the determination termination, the NOR gate is connected to the determination termination, and the NOT is used. brake. When the synchronous counter is a down-counter, the output of the down-counter will be connected to the determination of the count (minimum), the determination of the termination, using the NOR gate, and the determination of termination, the output using the NOR gate will be connected In the foregoing judgment, the NOT gate is terminated. The output of the NOT brake for judging termination is in addition to the lock circuit for interlocking and the NOR brake for the counter, and it is also connected to the elimination terminal for controlling the erasing device and the load terminal for controlling the load device. And the aforementioned load device will input the starting number of the aforementioned count. Therefore, the aforementioned synchronous counter can set any start value in the aforementioned counting value, so the aforementioned synchronous counter can calculate from the aforementioned value to the aforementioned ending value. Since the present invention can freely design the period of the aforementioned interlocking counter, it is easy to adjust the timing of the electronic circuit. Therefore, various issues related to the synchronization of the aforementioned LSIs will be properly resolved. The invention of the 17th patent scope is an interlock device such as the 15th or 16th patent scope. At least one of the aforementioned interlock counters is provided with a signal distribution decoder, a signal distribution lock circuit, The signal distribution NOR gate and the signal distribution flip-flop (fliD-flop) circuit make the input signal a positive multiple of the clock signal period. In the present invention, because all the aforementioned counts of the aforementioned interlocking counters arranged on the entire LSI are the same, the aforementioned signal distribution decoder can simultaneously output the same timing information. 27 This paper standard applies to China National Standard (CNS) A4 Specifications (210 X 297 mm) • 1--1--IIIIII 1 · II (Please read the precautions on the back before filling out this page) Order ·-Line! 498290 A7 ___ B7___ V. Description of Invention (4) • No. Then, the time between the specified start time and end time of the two different points in the aforementioned timing signal will be a time that is a positive multiple of the period of the aforementioned clock signal. If the input signal is stored in the signal distribution lock circuit, the input signal of the timing start time is determined according to the signal distribution NOR gate, and the end time of the timing is stored in the signal distribution flip-flop circuit. on. If it is the timing end time, the signal distribution flip-flop circuit is restored by the signal distribution decoder. Therefore, in the present invention, as long as the most common transmission delay time of the aforementioned input signal is considered, the aforementioned input signal synchronized on the aforementioned clock signal can be distributed to any place of the aforementioned LSI. Therefore, various issues concerning the design of the aforementioned LSI will be appropriately resolved. The invention of claim 18 in the scope of patent application is an interlocking device composed of synchronous oscillation circuits arranged in a square grid shape and a hexagonal grid shape, and is characterized by:

The synchronous oscillation circuit includes two NOR gates for oscillation, two resistors for oscillation, two capacitors for oscillation, two lock circuits for synchronization, two NOR gates for synchronization, and a NOR gate for initialization, and The phase of the clock signals of the adjacent synchronous oscillating circuits is staggered by the synchronization signal output from the oscillating capacitor, so that the phases of the clock signals of all the synchronous oscillating circuits are consistent. The oscillating part of the aforementioned synchronous oscillating circuit ′ The two aforementioned NOR gates for oscillating and the two aforementioned oscillating capacitors are connected in a ring shape ′ The output and input of the aforementioned NOR gate for oscillating are connected using the aforementioned oscillation resistor. The aforementioned oscillation part is self-excited oscillation, and the aforementioned clock signal is output by the aforementioned NOR gate for oscillation. The aforementioned oscillating part is classified as A end and B 28. This paper size applies Chinese National Standard (CNS) A4 specification (210 X 297 mm) * 1 I ------ IIIII · II (Please read the precautions on the back first Fill out this page again) line! 498290 A7 ___—__ B7_ V. Description of the invention (τΛ) • Two parts. The synchronous part of the synchronous oscillating circuit is classified into the aforementioned A terminal and the aforementioned B terminal corresponding to the aforementioned oscillating section. Regardless of the aforementioned A terminal or the aforementioned B terminal of the aforementioned synchronization section, after the aforementioned synchronous NOR gate system is combined with the aforementioned synchronous signal input from the outside, the aforementioned synchronization lock circuit stores the integration result. The synchronization lock circuit controls the oscillation NOR gate according to the integration result, and matches the phase and period of the synchronization signal of the synchronization oscillation circuit with the phase and period of the synchronization signal input from the outside. When the synchronous signal of the synchronous oscillating circuit and the synchronous signal input from the outside are irregular when the power is turned on, the NOR gate for the initialization will switch the NOR gate for the oscillation at the A terminal. The output is fixed at a low level and determines the aforementioned phase of the aforementioned synchronization signal. According to the present invention, a plurality of the aforementioned synchronous oscillator circuits can be connected to each other to synchronize the aforementioned synchronization signals of all the aforementioned synchronous oscillator circuits. In particular, when one clock is allocated to the entire LSI, the higher the frequency of the clock, the more the transmission delay time becomes a problem. However, by dispersing the synchronous oscillation circuit on the LSI, all the data circuits of the LSI can be synchronized. Therefore, various issues concerning the synchronization of the aforementioned LSIs will be properly resolved. The invention of claim 19 in the scope of patent application, an interlocking device, is characterized in that it is constituted by having two input resistors in the aforementioned synchronous oscillation circuit in the scope of claim 18 of the patent application. When the NOR gate is made of CMOS, if the input of the NOR gate is a current directly stored in the oscillation capacitor, the CMOS will be destroyed. The present invention is used at the A end and 29 paper sizes are applicable to China National Standard (CNS) A4 specifications (210 X 297 mm) -------------- install --- < please first Read the notes on the back and fill in this page again) ¥-Line 498290 A7 ______B7___ V. Description of the Invention (/)) • Add the aforementioned input resistance to each oscillation part of the B terminal to protect the aforementioned CMOS of the NOR gate. If the resistance of the aforementioned input resistor 变 becomes larger, the aforementioned current flowing in the aforementioned NOR gate will decrease, so the time constant will be determined more accurately based on the aforementioned signaling resistor and the aforementioned oscillating capacitor, and all of the aforementioned synchronous oscillations The cycle of the aforementioned clock signal of the circuit will be easier to grasp. Therefore, various problems related to the synchronization of data circuits using the aforementioned CMOS will be appropriately resolved. [Preferred Embodiment of the Invention] Hereinafter, a series of embodiments of the information collection system of the present invention will be described with reference to the drawings. First, as shown in FIG. 1, the invention of the first patent application scope is a system for displaying a digital image 111, the type, position, and number of objects, and outputting the digital image 111, the type, position, and number of objects. At least one of the artificial eyeballs 1 is connected to a communication network 8 with at least one user terminal 4 that transmits control commands. The artificial eyeball 1 has a mobile camera 10 controlled by a vision device 2, and the vision device 2 recognizes the types of objects in the digital image 111, a fixed position, and calculates the number. In addition, the visual device 2 controls the panning (horizontal movement), tilting (vertical movement), rolling (rolling), and zooming (telephoto) of the mobile camera 10 according to a control instruction ′ input from the user terminal 4. Each user terminal 4 can receive a digital image 111, an object type, a position, and a number of the selected artificial eyeballs 1 by selecting one of the plurality of artificial eyeballs 1. The user terminal 4 'is a central control device 221 with a communication function with the communication network 8 30 This paper size applies to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) ---- I ---- -------- (Please read the notes on the back before filling this page) ·-• Line! 498290 A7 _____ Β7 __ V. Description of the invention (I) ------ II I II --- · II (Please read the precautions on the back before filling out this page) • Digital image 111, object type, location, and The number of displays 222 and control buttons 223 such as a cursor key and a search dial Gog dial). Since the artificial eyeball 1 and the user terminal 4 are connected by a communication network 8 using wired technology and wireless technology, the artificial eyeball 1 is not necessarily installed beside the user. Since the visual device 2 can recognize the type of the object ', the artificial eyeball 1 does not need to transmit digital images frequently. Therefore, the user does not have to constantly monitor the user terminal 4. Line 丨-In addition, the simplest combination of the first invention in the scope of patent application is to use a wired communication network 8 to connect a manual eyeball 1 to a user terminal 4 and always transmit digital images 111, Information collection system for object type, position, number and control instructions. Such a system is a mobile phone 211 equipped with an artificial eyeball 1 as shown in FIG. This mobile phone 211 can display a moving image taken by the mobile camera 10 on the display 222. Therefore, the user of the mobile phone 211 can not only display his / her appearance on the display 222 regardless of the orientation or magnification of the mobile camera 10, but can also see the surrounding conditions captured by the mobile camera 10 through the display 222. Therefore, a plurality of such mobile phones 211 are prepared, and each mobile phone 211 transmits a digital image 111, an object type, a position, a number, and a control instruction via each other, thereby constructing an information collection system as shown in FIG. So far we have described mobile phones with artificial eyeball 1 and user terminal 4, but if artificial eyeball 1 and user terminal 4 are connected using communication network 8, artificial eyeball 1 and user terminal 4 Not necessarily need to be together. Therefore, the following is regarded as a user terminal. 31 This paper size is applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 _________B7_ V. Description of the invention (> ° [) The car 321 is taken as an example to describe the setting position of the artificial eyeball 1. • I ------ 111 ------ (Please read the precautions on the back before filling in this page) 丨 Line · As shown in Figure 3, set a manual At eyeball 1, the driver can confirm where there is a dead corner. That is, the vision device 2 'automatically pans, tilts, rolls, and zooms the mobile camera 10' to change the shooting range 326, and the driver can find pedestrians 324, bicycles, motorcycles 325, and other cars 321 passing behind the car 321, and Child playing near the trunk of car 321. Therefore, in parking lots and garages with many dead ends, the driver can safely go backwards. In addition, if the artificial eyeball 1 is provided in the center 323 behind the roof of the car 321, the driver can confirm a wide range of places that are difficult to confirm with the rearview mirror and side mirror (especially in the distance, etc.) and places that must be turned to notice. . That is, the vision device 2 automatically pans, tilts, rolls, and zooms the mobile camera 10, and changes the shooting range 326 ', and the driver can find pedestrians 324, bicycles, motorcycles 325, and other cars 321 approaching from behind the car 321. Therefore, the driver can safely open the door and drive. Although FIG. 3 illustrates the case where the artificial eyeball 1 is installed behind the car 321, the sides and the front of the car 321 are the same. When the artificial eyeball 1 is installed on the door and roof side of the car 321, the driver can confirm the condition of the children playing near the door and the roadside area. If artificial eyeball 1 is installed in the center of the bumper rod in front of the car 321 and in front of the roof, the driver can find pedestrians 324, bicycles, locomotives 325 and other cars 321 passing in front of the car 321, and the hood of the car Children playing nearby. Therefore, drivers can use parking lots, garages, and alleyways with more dead corners. 32 This paper size is applicable to China National Standard (CNS) A4 (210 X 297 mm) 498290 A7 ____B7 ___ V. Description of the invention (now 0) Move forward safely. If the artificial eyeball 1 is installed inside the roof of the car 321, the driver can grasp the condition of all the passengers. In particular, when the mobile phone 211 serving as the user terminal 4 is used, even if the driver gets out of the car 321, the driver can know the condition inside the car. Therefore, even if the car 321 is damaged, the driver can immediately reach the car 321, and even if a child or an infant is in the car, the driver can know the condition of the child or the infant. In addition, as shown in FIG. 4, if the artificial eyeball 1 is installed behind the back of the wheelchair seat 331, and the user terminal 4 is installed on the armrest of the wheelchair seat 331, the user can determine the position of the wheelchair without twisting the body. Objects approaching behind. In particular, users of wheelchairs are mostly unable to move freely, or need to move forward in order to push the wheelchair. It is difficult for users to confirm the rear. However, with the present invention, the user of the wheelchair can move safely. And if the artificial eyeball 1 is set above the seat 331 or is set in the front, the mobile camera 10 can capture a wider range of traffic lights and road signs. In addition, a user terminal 4 is provided above the seat 331, or a wearable computer is used as the user terminal 4 'so that users with poor eyesight can also see the image of the display 222. So far, we have described the information collection system in which the user terminal 4 can continuously manage the artificial eyeball 1. However, with this information collection system, even if the user is sleeping, the artificial eyeball 1 will transmit the digital image 111, the type, position and number of objects. Moreover, the digital image 111, the type, position and number of objects transmitted from the artificial eyeball 1 are not necessarily necessary for the user. Therefore, as shown in Fig. 5, a few of the user terminals 4 are set as the monitoring terminals 5, and a plurality of 33 are replaced by the user. This paper size is applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 mm). (%) ---- I I .--- I--II · II (Please read the notes on the back before filling this page) Meeting · Line-498290 A7 ___B7 _ V. Description of the invention (1) Monitor operation The monitoring terminal 5 'allows the user to use the user terminal 4 only when needed. At this time, the monitoring terminal 5 'will simply transfer the digital image 111, the type, position, and number of the objects received from the appropriate artificial eyeball 1 to the user terminal 4 according to the instructions of the monitor. Both the user terminal 4 and the monitoring terminal 5 are computer systems, so using existing technology, the monitor cooperates with the need to transmit a description of the situation to the user terminal and receive instructions from the user terminal. It's very easy to do. However, if the user of the user terminal 4 does not need to know the digital image 111, the type, position and number of objects transmitted by the artificial eyeball 1 in real time, the user terminal 4 and the monitoring terminal 5 need not be retrieved from the artificial eyeball. 1 Directly receive digital image ill, object type, position and number. For example, when the information collection system is to measure the traffic volume on the road or to calculate the pedestrian flow in the shopping street, the user needs statistical data based on the digital image 111, the type, location and number of objects. Therefore, as shown in Fig. 6, the invention in the second scope of the patent application is an information collection system of database 6 having a relational database and an object-oriented database (having a database description language such as SQL). This database 6 stores the digital images 111, object types, positions, and numbers transmitted by the artificial eyeball 1 as records as shown in FIG. 7, and calculates statistical data. For example, in the situation shown in FIG. 7, the record is composed of a record ID area 501 that stores different record IDs, a time stamp area 502 that stores the current time, a visual device number area 503 that stores the number of the visual device 2 included in the artificial eyeball 1, and a storage indication Area 504 of the number of environmental data of the type of object and location group, area 505 of the type of stored object, storage object 34 This paper size is applicable to China National Standard (CNS) A4 (210 X 297 mm) (Please read the back Note: Please fill in this page again.) 498290 — ______ Β7 5. The location area 506 where the invention is described, the number of objects area 507 that stores the number of objects output by the visual device 2, and the digital image area 508 that stores the digital image 111. Using this record, the database 6 can use the artificial eyeball 1 to calculate the number of specific types of objects captured in a given period of time, or to estimate the movement of the objects. The database 6 will use the search key transmitted by the user terminal 4 to retrieve the records, and transmit the search result to the user terminal 4. Therefore, the user can access the database 6 in accordance with the need. Only the digital image 111 of the object, the type, location, number and statistical data of the object can be obtained, so the burden on the user and the communication network 8 can be reduced. Furthermore, as shown in FIG. 8, if there are a plurality of monitoring terminals 5 between the plurality of user terminals 4 and the database 8, the monitor can provide separate information and knowledge. For example, dealer chains such as convenience stores and fast-food stores, and business consultants can provide the information and knowledge required by a series of stores and customers. Intermediaries who want to predict traffic and crowds can also provide user information. Of course, since the user terminal 4 and the monitoring terminal 5 are computer systems, using the existing technology, the monitor can easily transmit the description of the situation to the user terminal 4 and receive the user terminal from the user terminal. 4 Comments from users. Finally, as shown in FIG. 9, for the invention in the third scope of the patent application, the user terminal 4 is provided with at least one of the voice synthesis device 226 and the voice recognition device 227. The sound synthesizing device 226 converts the type, position, and number of objects received by the central control device 221 into a sound signal, and outputs the signal through RaB-8224. The voice recognition device 227 converts the user's voice collected by the microphone 225 into a temporary original and outputs it to the central control device 35 498290 A7 ___ B7____ 5. Description of the invention ($ 7) • 221. The central control device 221 converts this original version into a control command and a search key, and transmits it to the artificial eyeball 1, the database 6, and the monitoring terminal 5. Because the mobile phone 221 is already equipped with a speaker 224, a microphone 225, a processor 101, and a memory 102, after the sound synthesis program and the voice recognition program are loaded into the memory 102, the mobile phone 211 can be easily equipped with voice synthesis Device 226 and voice recognition device 227. In addition, the navigation system is equipped with a sound synthesizing device 226 and a voice recognition device 227. Therefore, the user of the user terminal 4 does not need to grab the line of sight on the display 222 and does not need to operate the troublesome control button 223, that is, to control the direction, tilt angle and magnification of the mobile camera 10 to hear the types of objects, Location and number. The information collection system composed of the artificial eyeball 1, the user terminal 4 and the database 6 connected by the communication network 8 has been described so far. However, the visual device 2 and the communication device 7 on the artificial eyeball 1 and the central control device 221 on the user terminal 4 are only briefly explained. Therefore, in the following, an embodiment of the artificial eyeball 1 centered on the visual device 2 and the communication device 7 will be described, and then an embodiment of the central control device 221 will be described later. The artificial eyeball 1 first connected to the communication network 8 is represented by a structure as shown in FIG. Most of the mobile cameras 10 have been sold on the market. 'Palm-type mobile cameras 10 have also been sold on the market. The images captured by the mobile camera 10 are transmitted to the visual device 2 as an analog motion image or a data motion image without degrading the image quality of the frame image. In addition, the mobile camera 10 will indicate that 36 of the current mobile camera 10 paper size applies to the Chinese National Standard (CNS) A4 specification (210 X 297 public love) -------------- equipment --- (Please read the precautions on the back before filling this page) Order: Line 498290 A7 ______B7 ___ 5. The invention description status signal is transmitted to the visual device 2, on the other hand the visual device 2 will control the shake of the mobile camera 10. The signals of panning, tilting, rolling and zooming are transmitted to the mobile camera 10. Moreover, the manufacturer of the artificial eyeball 1 can use commercially available products on the communication device 7 or simply use the communication platform. As shown in FIG. 11, the communication device 7 includes an image compression device 701 and an image transmission device 702. The image compression device 701 inputs the generated digital image 111 (solid line in FIG. 11) from the motion image captured by the mobile camera 10 using the vision device 2, and uses a dynamic image compression technology such as MPEG and PEG, etc. The still image compression technology compresses moving images and screen images, and also outputs MPEG images and PEG images to the image transmission device 702. The image transmission device 702 can transmit a MPEG image and a JPEG image to a remote computer system through a communication network 8 such as the Internet by using a communication protocol such as TCP / IP. And because it is a high-area wireless technology such as DS-COMA and MC-CDMA as the image transmission device 7 ', the communication device 7 can make the moving image taken by the mobile camera 10 more convenient. Send a message when it's time. Next, the artificial eyeball 1 can replace the digital image 111, and output a macro image 148 combining the digital image 111 and the object area image 142. The macro image 148 is filled with the background of the digital image Π1, so the image compression device 701 can achieve a high compression rate without adding special functions. As shown so far, the artificial eyeball 1 can use the visual device 2 to control the pan, tilt, roll and zoom of the mobile camera 10 to transmit the motion image of the object to a distance. However, only the aforementioned artificial eyeballs 1 ’37 are used. This paper size is applicable to the Chinese National Standard (CNS) A4 (210 X 297 mm) (Please read the precautions on the back before filling this page)

498290 A7 _____B7__ V. Description of the invention qp ---- I ---- 111-- · II (Please read the precautions on the back before filling out this page), it may not appear in digital images in and macro images 148 On the subject. In particular, even if an object to be captured on the digital image in does not appear on the macro image 148, it is necessary to pay attention when using the macro image 148. Therefore, the recognition result generated by the vision device 2 for the object area 141 will be based on the use method of the image compression device 701 (the dashed line in FIG. 11). The image compression device 701 only compresses the digital image 111 and the macro displayed by the object to be captured. The image 148 is transmitted to the image transmitting device 702. The algorithm of the image compression device 701 for the digital image 111 is shown in FIG. In step 711, it is determined whether there are recognition results input in order. If there is no identification result (step 711: YES), the algorithm ends. If there is a recognition result (step 711: NO), go to step 712. However, if it is not necessary to judge the recognition result, it may be set to an infinite loop antenna ° -line-In step 712, the recognition result is input. In step 713, it is determined whether the recognition result is a specific object type. If the recognition result is not a specific object (step 713: N0) ', the process returns to step 712. If the recognition result is a specific object (step 713: YES), go to step 714. In step 714, a digital image 111 is input. In step 715, compression techniques such as MPEG and JPEG are used to generate a compressed digital image. In step 716, a compressed digital image is output. Then return to step 711. 38 This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 V. Description of the invention (> 4) Therefore, the image compression device 701 can only compress the digital image 111 that shows a specific object. It is also the same when compressing a macro image 148. A mobile camera 10 using an ultrasonic motor is currently being developed by several research institutes and enterprises, and a mobile camera 10 including an outer frame diameter of less than 10 cm has been developed. In particular, since the ultrasonic motor does not require a mechanical structure such as a gear, the mobile camera 10 using the ultrasonic motor can be miniaturized more easily. As shown in FIG. 2, a mobile camera 10 using an ultrasonic motor is installed on the mobile phone 211. The artificial eyeball 1 ′ can reduce the battery in addition to a small and expedient communication device 7 and a battery 212 ′. Power consumption of 212. Therefore, using the mobile camera 10 equipped with a small multi-degree-of-freedom motor such as an ultrasonic motor, the user of the artificial eyeball 1 can carry the artificial eyeball 1 with him. In addition, recently, a technology has been developed to directly input the image of a CCD (charge coupled device) camera into the brain through a stimulus generator 213, a connector 215, and an electrode array terminal 214, so that a completely blind person can also obtain vision. Therefore, as shown in FIG. 13, when the artificial eyeball 1 includes a mobile camera 10, a vision device 2, a stimulus generator 213, an electrode array terminal 214, a connector 215, and a battery 212, a user of the artificial eyeball 1 can use the glasses, etc. Install artificial eyeballs 1 or put it in the eye socket to obtain a wide range of perspectives, identify close objects, and count the number of objects. Finally, although the algorithm for the general-purpose vision device 2 has been developed, if it is to be applied to the artificial eyeball 1, some changes must be made. Therefore, the following mainly describes the visual device 2. First, if you want to find objects, identify the types of objects, and calculate the number of objects 39 This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) (Please read the precautions on the back before filling this page)

498290 A7 ___B7_ V. Description of the invention (υΊ) • Vision device 2 (refer to Japanese Patent Application No. 11-253634, Japanese Patent Application No. 2000-64544), the mobile camera 10 has a mechanism for changing the horizontal and vertical directions, from External input commands for controlling the moving angle can be used for panning and tilting respectively. In addition, the mobile camera 10 is provided with a mechanism for changing the magnification of a captured image, and an external input of a command for controlling the magnification can be quickly enlarged. In addition, when the mobile camera 10 is equipped with a multi-degree-of-freedom motor, the mobile camera 10 can roll because it has a turning mechanism centered on the optical axis of the lens and an external command to control the inclination. Therefore, the mobile camera 10 can cause the camera itself to vibrate slightly according to an external command. Therefore, the screen image of the moving image captured by the mobile camera 10 will be blurred, so that the object in the screen image is shot just when it is vibrating. Whether the stationary object is just captured in the moving image. Next, the mobile camera 10 can use control instructions such as pan, tilt, roll, and zoom to cooperate with the output of the current direction, tilt, and magnification after the movement. The status of the mobile camera 10 while it is moving or stopped will also be matched. Needs output. At this time, if the visual device 2 can control the panning, tilting, rolling, and zooming of the mobile camera, then the mobile camera can be used to shoot moving objects and stationary objects with an appropriate size. Orientation, tilt, and magnification. Therefore, in order for the mobile camera 10 to capture moving objects and stationary objects with appropriate sizes, the visual device 2 will be divided into three coordinate systems according to the function, that is, a camera coordinate system, an image coordinate system, and an environmental coordinate system. First, the camera coordinate system, such as the text mobile camera 10, in order to control the pan, tilt, roll and zoom with the smallest control units, respectively, 40 cameras used in this paper size applies Chinese National Standard (CNS) A4 specifications ( 210 X 297 mm) (Please read the notes on the back before filling this page)

498290 A7 _ B7 ______________ 5. Description of the invention (• The internal three-dimensional spherical coordinate system. The zero point system of the general camera coordinate system is called the static position of the original position of the mobile camera. The camera coordinate system is the only one that can represent moving objects and stationary objects. The coordinate system of the physical location. In any case, the camera coordinate system is different for each mobile camera 10, so the camera coordinate system is not universal. Therefore, the visual device 2 must use other devices to hide the camera coordinate system. 2. The image coordinate system is a two-dimensional coordinate system based on the center of the screen image captured by the mobile camera 10, that is, the optical axis of the lens is zero and the pixel is the unit. This is used to indicate that Which pixel is placed with a moving object and a stationary object. Therefore, although the image coordinate system is suitable to distinguish the detailed positions of a plurality of moving objects and stationary objects in the screen image, only the image coordinate system cannot represent the physical characteristics of these moving objects and stationary objects. Location. Third, the environmental coordinate system, which is the visual device 2 in order to logically One is a three-dimensional spherical coordinate system used to indicate the position of a moving object and a stationary object inside. The environmental coordinate system uses an angle in radians as the unit in the horizontal and vertical directions to indicate the size of the object and the distance area of the object. Real numbers in units of 1.0 are used in the distance direction. Because the size of a general object will not change extremely in a short time, the distance to the object and the magnification of the mobile camera 10 can be regarded as a ratio. The zero point system of the environmental coordinate system It is arbitrary. That is, the environmental coordinate system is used in principle to indicate the relative coordinates of two points on the environmental coordinate system in principle. The visual device 2 uses the mobile camera 10 to project moving objects and stationary objects in the environment that can be photographed. The environmental coordinate system can distinguish between a plurality of moving objects and stationary objects. Therefore, the camera coordinate system and image coordinate system must be related to each environmental coordinate 41. This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) '' " -------------- install --- (Please read the precautions on the back before filling this page) · Thread! 498290 A7 ______B7 _— ____ V. Explanation of the invention (> ° |) i-. It is a coordinate conversion system. The devices that achieve this task include a camera / environmental coordinate conversion device 20, an image / environmental coordinate conversion device 21, and a motion control device 23 (see section Figure 14). These devices calculate the camera coordinate system and image coordinate system units from the specifications of the mobile camera 10 and the image acquisition device 11 (refer to Figure 14), and calculate the ranks to be converted into the environmental coordinate system. By calculating the opposite rank of the conversion sequence from the camera coordinate system to the environmental coordinate system, the conversion rank from the environmental coordinate system to the camera coordinate system can also be obtained. However, the zero point of the camera coordinate system is the stationary position of the mobile camera 10, so The position of the environmental coordinate system converted from the camera coordinate system becomes the relative position of the stationary position of the mobile camera 10 on the environmental coordinate system. On the other hand, the position of the camera coordinate system converted from the environmental coordinate system will become the relative position from the current position of the mobile camera 10 on the camera coordinate system. In addition, since the image coordinate system is a two-dimensional coordinate system, it cannot be converted into the environmental coordinate system only in the image coordinate system. Therefore, the image / environmental coordinate conversion device 21 uses the orientation and magnification of the mobile camera 10 represented by the environmental coordinate system, and the area size of moving objects and stationary objects in the screen image. The image coordinate system is converted to the environmental coordinate system. The position of the environmental coordinate system which is converted from the image coordinate system becomes the relative position from the image center. On the other hand, when the tilt angle of the mobile camera 10 is used, the vision device 2 cannot obtain the environmental coordinate system as described above. For example, as shown in FIG. 15 ', the formation edge information of the object having a tendency angle θ counterclockwise on the position α in the formation edge information image 115 is formed. At this time, the center of the edge information image 115 corresponding to the optical axis of the lens is like the angle 6 when rotating counterclockwise and turning 42 -------------- installation-(Please read the back first Please pay attention to this page before filling in this page} · -line! This paper size applies to China National Standard (CNS) A4 (210 χ 297 male i) 498290

β 工 cos9 a sin0 Οίχ person sin0 cosO A7 V. Description of the Invention (^). If the mobile camera 10 is rotated, the edge information forming device 15 can output the rotated information to form an edge information image 81. That is, the object forming the position α in the edge information image 181 after turning will become upright, making it easier to identify the type of object. However, the coordinates of the image coordinate system obtained from the position α in the edge information image 181 after the rotation are compared with the coordinates of the image coordinate system obtained from the position ck in the edge information image 115, which becomes the angle 0 when the clock rotates. Turning position. Therefore, as the angle 0 becomes larger or the distance σ α becomes longer, the offset between the two coordinates becomes larger. Therefore, in order to obtain the position in the edge information image 181 after the rotation ^ to obtain the image coordinate system coordinates before the rotation, it is only required to let the position in the edge information image 181 formed after the rotation α the angle θ when rotated counterclockwise / 5 is fine. Here, if the image coordinates of the position ^ in the edge information image 181 after the rotation are taken as ay); the image coordinates of the cold position are taken as (zhao X, zhao.), Then it can be obtained from UX, U y) according to Equation 1. Out d, cold y). ⑴ Since position α in edge information image 181 can be obtained from rotation after position / 3, that is, position α in edge information image Η5 is formed, the resulting image / environment coordinate conversion device 21 can be formed from rotation The position α in the edge information image 181 accurately obtains the environmental coordinates. 43 -------------- Loading --- (Please read the precautions on the back before filling out this page). This paper size applies to China National Standard (CNS) A4 (210 χ 297 mm) (%) 498290 A7 ___B7 _ V. Description of the invention (Lf (> ---- I ------------ (Please read the precautions on the back before filling this page) • Line · Use the foregoing The camera coordinate system, image coordinate system, and environmental coordinate system describe the embodiment of the visual device 2. As shown in the second figure, the embodiment of the "visual device 2" uses the following devices: it accepts the photography signal of the mobile camera 10 (picture Image) and then converted into an appropriate format and size digital image 111 image acquisition device 11; an image memory device 12 that stores the digital image 111 at a predetermined time; an image retention device 39 that holds the digital image 111 before output to the output; An edge information generating device 14 for generating edge information image 113 of a moving object from two digital images 111; an edge information image forming device 15 for forming the edge information image 113 more clearly and forming an edge information image H5; used to separate the edge formed by forming the edge Information 114 Objects / Backs in Areas Differentiated Separation device 16; masking device 40 for overlapping the digital image 111 with the area to be separated; image holding device 39 for masking the image 148 before output to the output; normalization of the separation area to the area of the image size Normalization device 27; image holding device 39 that holds a normalized image 145 before outputting to an output place; geometric analysis device 37 that analyzes the approximate shape of a moving object by forming an edge information image 115; performs analysis on the area of a normalized moving object Pattern matching device 38 for pattern matching; image recognition device 29 that recognizes the type of moving object from the matching result image 147 and the geometric analysis result; position / size detection device 17 that detects the position and size of each area distinguished by the rough edge information 112; Camera / environment coordinate conversion device 20 that converts the camera coordinate system representing the direction and magnification of the mobile camera 10 to the environmental coordinate system (the basic coordinate system of the visual device 2); uses the mobile camera 10 represented by the environmental coordinate system Direction and magnification, convert the position of the moving object detected by the position / size detection device Π into 44 books Zhang scale is applicable to China National Standard (CNS) A4 specification (210 x 297 mm). Fly ~ 9〇A7, ------- ^ ____ B7 _---5. Description of the invention --- III .--- II --- · II (Please read the precautions on the back before filling out this page) Image / environmental coordinate conversion device 21 of the soil coordinate system; select one of the multiple moving object positions detected by the position / size detection device 17 Position selection device 22; timing device 32 'which calculates time in units of 1 millisecond (ms) from the orientation and magnification of the mobile camera 10 represented by the environmental coordinate system, the position of a plurality of moving objects represented by the environmental coordinate system, moving objects Type, geometric analysis result, and environment understanding device 31 for making environment maps at all times: environment map holding device 33 that holds environment maps before output, and object position estimation devices that use environmental maps to estimate the positions of moving objects that should be recognized next 34; a control instruction input device 24 for inputting a control instruction to control the direction and magnification of the mobile camera 10 from the outside; a vibration instruction generation device 25 for generating a instruction to vibrate the mobile camera 10; using The direction and magnification of the mobile camera 10 indicated by the environmental coordinate system are determined by referring to the four positions input from the position selection device 22, the control command input device 24, the vibration command generation device 25, and the object position estimation device 34. The coordinate system is a motion control device 23 indicating the position of the mobile camera 10; a camera instruction generating device 26 that generates an instruction to move the mobile camera 10 to the position of the camera coordinate system determined by the motion control device 23. When the image acquisition device 11 inputs a screen image of a moving image from the mobile camera 10, if the moving image is an analog signal, the screen image is converted into a digital signal by A / D conversion. In particular, if the voltage of the photographic element 207, such as a photodiode, can be directly input, it is only necessary to use A / D conversion to convert to a digital signal of an appropriate number of bits. When a moving image is a digital signal, it is decompressed if it is compressed, and directly input if it is not compressed. Because these areas are available, 45 paper sizes are applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 V. Description of the invention (屮)) The motion image is divided into the screen image. Is a digital image m. This inspection image 111 will be in an appropriate format and retain the previous size-image size, so the image acquisition device 11 converts the format according to the image data in pixels, and cuts out the necessary image size part in the visual device 2 and Make digital image 11 丨 output. If the image acquisition device 11 can output all pixels of the digital image ill in parallel, communication from the image acquisition device 11 to the image memory device 12 can be performed in parallel for each pixel. If the image memory device 12 inputs the digital image 111 from the image acquisition device 11, it will store the digital image at a predetermined time in accordance with the time resolution capability of the visual device 2 or the computing power of each device. That is, even if the digital image 111 is input to the image memory device 12 during this predetermined time, the stored image cannot be changed, so various subsequent devices can input the same digital image 111 at different time points. In addition, since the image recording device 12 does not perform image processing on the digital image 111, all pixels of the digital image 1 will be directly stored in a two-dimensional phase relationship. If the image memory device 12 can output all the pixels of the digital image 111 in parallel, the communication from the image recording device 12 to the image holding device 39, the edge information generating device 14, the color information generating device 41, and the masking device 40 can be performed at each The pixels are performed in parallel. If the image holding device 39 inputs the digital image 111 from the image memory device 12, and if the output location of the digital image 1H requires a digital image 111 of an appropriate format, the digital image 111 will be changed in the format requested by the output location of the digital image 111. After that, the image holding device 39 will surely transmit the digital image 111 to the output place of the digital image 111. 'The digital number of a certain period will be stored. 46 I--1111 --- IIC Please read the precautions on the back before (Fill in this page) · --- The paper size of the paper is applicable to China National Standard (CNS) A4 (210 x 297 public love) 498290 A7 B7 _______ V. Description of the invention -------------- I --- (Please read the notes on the back before filling this page). Image 111. If the image holding device 39 limits the conversion format, it can process the convertible digital image 111 only in the neighborhood of each pixel, so it is suitable for parallelization. If the image holding device 39 can output all pixels of the digital image 111 in parallel, communication from the image holding device 39 to the output location of the digital image 111 can be performed in parallel on each pixel. If the edge information generating device 14 inputs a digital image 111 from the image memory device 12, it will be compared with the previously input digital image 111 to generate a coarse edge information image of a moving object. 13 ° The edge information generating device 14 can The pixel neighborhood processing produces a rough edge information image 113 ', so it is suitable for parallelization. If the edge information generating device 14 can output all the pixels of the coarse edge information image 113 in parallel, then the communication from the edge information generating device 14 to the edge information forming device 15 and the position / size detection device 17 can be performed in parallel on each pixel . -Line and edge information forming device 15 When inputting the rough edge information image 113 from the edge information generating device 14, the image memory device 12 refers to the stored digital image 111 to generate a clear moving object that is more specific than the rough edge information image 113. It forms an edge information image 115. The edge information forming device 15 is suitable for parallelization because it can generate a rough edge information image 115 by processing only in the neighborhood of each pixel. If the edge information forming device 15 can output all pixels forming the edge information image 115 in parallel, the communication from the edge information forming device 15 to the object / background separation device 16, the geometric analysis device 37, and the inclination detection device 42 can be performed in each Pixels proceed in parallel. If the object / background separation device 16 inputs the edge information image 115 from the edge information forming device 15, it will include the object area included in the moving object 47. This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 ___B7____ V. Description of the invention (L ^ ---- II --- I--IIII (please read the notes on the back before filling this page). The pixels in domain 141 and the pixels included in the background are separated into different The group 'sequentially outputs the separation results in groups. In addition, the object / background separation device 16 can separate these object regions 141 into different groups when the object regions 141 are clearly distinguished by forming the edge information 114 regardless of whether they are adjacent or not. The number of groups will also be more than 3. The object / background separation device 16 is suitable for parallelization because it can process the separated object area 141 and the background 'in each pixel neighborhood. If the object / background separation device 16 can output the object area in parallel For all pixels of the image 142, communication from the object / background separation device 16 to the mask device 40 and the area normalization device 27 can be performed in parallel on each pixel. 40 If the object area image 142 is input from the object / background separation device 16, the digital image 111 stored by the image memory device 12 is referred to, and the pixels that are not overlapped with the object area 141 are covered to generate a mask image 148. Mask device 40 Since the mask image 148 can be generated only in the neighborhood of each pixel, it is suitable for parallelization. If the mask device 40 can output all pixels of the mask image 148 in parallel, the communication of the image holding device 39 from the mask device 40 is performed. Can be performed in parallel on each pixel. If the image holding device 39 inputs a mask image H8 from the mask device 40, if the output location of the mask image 148 requires a mask image 148 in an appropriate format, the mask image 148 The output destination will convert the mask image 148 in the required format. After that, the image holding device 39 will store the mask image 148 for a certain period in order to reliably transmit the mask image 148 to the output destination of the mask image 148. Image retention If the format of the conversion is limited by the device 39, since the conversion mask image 148 can be processed only in each pixel neighborhood, it is suitable for parallelization. If the image holding device 39 can output in parallel All pixels of the mask image 148 '48 is in accordance with the Chinese National Standard (CNS) A4 specification (210 x 2 criminal millimeters) " 498290 A7 ___B7____ V. Description of the invention (id) From the image holding device 39 to the mask image 148 The communication of the output place can be performed in parallel on each pixel. If the area normalization device 27 inputs the object area image 142 and the digital image 111 from the object / background separation device 16 and the image acquisition device 11, respectively, the digital image 111 Cut out the separated object region 143 ′ of the moving object while deforming the separated object region 143 while complementing and expanding the image size of the digital image 111 as much as possible to produce a normalized image 145. The area normalization device 27 is suitable for parallelization because it can normalize the separated object area 143 only in the neighborhood of each pixel. If the area normalization device 27 can output all pixels of the normalized image 145 in parallel, communication from the area normalization device 27 to the pattern matching device 38 and the image holding device 39 'can be performed in parallel on each pixel. If the image holding device 39 inputs the normalized image 145 from the area normalization device 27, and if the output location of the normalized image 145 requires a normalized image 145 in an appropriate format, the output location of the normalized image H5 will be converted in the required format. Normalized image 145. Thereafter, the image holding device 39 stores the normalized image H5 for a certain period of time so that the normalized image 145 can be surely transmitted to the output location of the normalized image 145. If the image holding device 39 limits the format of the conversion, the normalized image 145 can be processed only in the neighborhood of each pixel, so it is suitable for parallelization. If the image holding device 39 can output all pixels of the normalized image 145 in parallel, communication from the image holding device 39 to the output location of the normalized image 145 can be performed in parallel on each pixel. If the geometry analysis device 37 inputs the edge information image 115 from the edge information forming device 15, it will perform collision sampling method and inbreeding conversion. 49 This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 public love). Equipment --- (Please read the precautions on the back before filling this page) Order: -1 line '498290 A7 ______ — _B7 V. Geometric analysis of the invention description (L ^ j), far-crossing conversion and half conversion, etc. The shape of the moving object in the screen image, and produce the geometric analysis result. In conventional image recognition, it is to identify objects in the image by extracting direct lines from the image itself, etc., and using various transformations that do not allow the position and size of moving objects to be controlled. Therefore, even if the processing is simple, the number of combinations becomes huge, and the result requires a huge amount of calculation, and it takes a long time to obtain the desired result, or only a low-quality identification result. However, the visual device 2 recognizes and processes the moving objects in the screen image by the object / background separation device 16, the area normalization device 27, the pattern matching device 38, and the image recognition device 29. However, the recognition processing performed by the object / background separation device 16, the area normalization device 27, the pattern matching device 38, and the image recognition device 29 is not good at recognizing geometric figures such as the outline of a moving object. Therefore, the geometric analysis device 37 can easily analyze the geometric figure by analyzing and forming the edge information image 115 'with a simple device, and can also reduce the burden of the geometric analysis device 37 itself. In addition, since the geometric analysis device 37 is used, the pattern matching device 38 does not need to recognize geometric figures, and the pattern matching device 38 is simplified. Furthermore, using the results of geometric analysis, the environment understanding device 31 can reliably create an environment map at a high speed. The geometric analysis result is output from the geometric analysis device 37 to the image recognition device 29 and the environment understanding device 31. When the pattern matching device 38 inputs a normalized image 145 from the area normalization device 27, it compares the normalized image 145 with a plurality of template images 146 in pixels, and generates a matching result image 147. In addition, the pattern matching device 38 can also cooperate with the purpose of the visual device 2 by using the template image 146 prepared in advance, and using the input normalized image 145 as the template image 50. This paper size applies the Chinese National Standard (CNS) A4 specification ( 210 X 297 mm) ------------- i -------- ^ --------- ^ (Please read the notes on the back before filling this page ) 498290 A7 ___B7____ 5. Description of the invention (tfl1) '146. Each pixel of the normalized normal image H5 is similar to the pixels corresponding to different template images 146, so the matching result image 147 will become a speckle composed of several pieces. If the pattern matching device 38 can output all the pixels of the matching result image 147 in parallel, the communication from the pattern matching device 38 to the image recognition device 29 can be performed in parallel on each pixel. If the image recognition device 29 inputs a matching result image 147 from the pattern matching device 38, it uses a suitable pattern recognition device to recognize the matching result image 147 and outputs the recognition result, that is, the type of the moving object. In the pattern recognition method of the image recognition device 29, in addition to simply selecting the most matching result in the matching result image 147 as in the majority decision, it is also possible to use nerves such as sensors learned by the back-propagation method Network (neural network). In addition, when using a neural network, a dedicated accelerator for neural network can be used to achieve parallelization and high speed. The recognition result of the matching result image 147, that is, the type of the moving object is output from the image recognition device 29 to the recognition result holding device 30 and the environment understanding device 31. However, if the image recognition device 29 inputs a geometric analysis result from the geometric analysis device 37, the image recognition device 29 first determines whether it is a figure to be recognized. If the geometry analysis result is a figure out of the object, the image recognition device 29 will not operate. If the geometric analysis result is an object figure, the image recognition device 29 recognizes the matching result image 147. For example, according to the situation of the back-propagation learning sensor of Pan method, each object graphic will use the matching result image 147 to make learning data, and then the image recognition device 29 will select the learning data according to the geometric analysis result. The sensor can also efficiently perform the object graphics. Pattern recognition. That is, if the geometric analysis result is a circle, only the human face or spherical circle will be used. 51 This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm). (Please read the precautions on the back first to save Fill out this I) Assembly 丨 line 498290 A7 _ B7____ V. Description of the invention (f |) • -------- I I ---. II (Please read the precautions on the back before filling out this page), form Object learning data; if the geometric analysis result is a triangle, only the learning data of triangular objects such as road signs or mountains will be used. In this way, not only small-scale sensors can be used to recognize most objects, but the sensor itself can also learn efficiently. If the recognition result holding device 30 inputs the recognition result of the matching result image 147 from the image recognition device 29, if the output location of the recognition result requires a signal of an appropriate format, the output location of the recognition result will convert the recognition result in the requested format. Thereafter, the identification result holding device 30 stores the identification result for a certain period in order to reliably transmit the identification result to the output location of the identification result. -line! When the position / size detection device 17 inputs the rough edge information image 113 from the edge information generating device 14, it detects the position and size of the indicated moving object based on the rough edge information 112. The position / size detection device 17 is suitable for parallelization because it can process only each pixel neighborhood 'to generate a repeated information image 132 indicating the detection result of the position and size of the area of the moving object. If the position / size detection device 17 can output all pixels of the repeated information image 132 in parallel, the communication of the image / environment coordinate conversion device 21 from the position / size detection device 17 can be performed in parallel on each pixel. The camera / environmental coordinate conversion device 20 and the image / environmental coordinate conversion device 21 convert the position of the moving object area indicated by the repeated information image 132 generated by the position / size detection device 17 into the position of the environmental coordinate system. At this time, if the total number of positions of the moving object area in the screen image is 2 or more, there will also be more than 2 positions on the environmental coordinate system. Therefore, controlling the panning, tilting, and rapid zooming of the mobile camera 10 is applicable to any one 52-sheet paper in accordance with the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 B7 V. Description of the invention (p)- -(Please read the cautions on the back and save this page to fill in this page first)-To adjust the direction and magnification of the mobile camera 10 by moving a line, you need to select one of the multiple positions on the environmental coordinate system. The position selecting device 22 selects one position on the environmental coordinate system based on a certain judgment criterion. The judgment criteria used here are mainly as follows. First, the position selecting device 22 selects the mobile camera 10 (or the largest one) at the position closest to the moving object on the environmental coordinate system. When the moving object is far (or smaller), because the edge information generating device 14 may generate noise, the position selection device 22 will select the accuracy of the existence of the moving object from a plurality of positions on the environmental coordinate system. The higher. Secondly, when there are a plurality of position clusters within a certain range on the environmental coordinate system, the position selecting device 22 selects one of them. In addition, two possibilities can be considered here. One is that the edge information generating device 14 may generate scattered coarse edge information 112 for one moving object, and the other is that a plurality of moving objects may actually exist. Therefore, the position selection device 22 only needs to select an appropriate position. Third, when most of the positions on the environmental coordinate system are almost the same distance (or almost the same size), the position selection device 22 selects the closest position, that is, the position closest to the direction of the mobile camera 10. By using an appropriate combination of these coordinated uses or conditions, the position selecting device 22 can select one of a plurality of positions on the environmental coordinate system. The timer device 32 outputs the current time in units of 1 millisecond using a timer circuit. Now the time will be continuously output from the timing device 32 to the environment understanding device 31 0 environment understanding device. 31 If the recognition result of the object area 141 of the moving object is input from the image recognition device 29, the recognition result will be produced and the mobile camera will be 53 paper sizes Applicable to China National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 _B7__ V. Description of the invention (Xi I) Location of the environmental coordinate system of the camera 10 'and environmental information formed from the current time. When the environment understanding device 31 inputs the positions of the environmental coordinate system of all the object areas 141 in the screen image from the image / environment coordinate conversion device 21, only the number of the object areas 141 is generated and the identification result formed by invalid data is generated. The position on the environmental coordinate system of the camera 10 and the position on the environmental coordinate system of an object area 141 in the screen image, and the environmental data formed by the current time. The environment map at this time will become a collection of environmental data made from the present time to a predetermined time, and the position in the environmental data will be represented by the environmental position of the zero position of the moving camera 10 as the zero point. The environment understanding device 31 adds and deletes environmental data to and from the environment map and the passage of time. The environment understanding device 31 replaces the environmental data of the duplicated content with a change in position, etc. and deletes the position in the environmental data whose identification result is invalid data. When the identification result is near the position in other environmental data which is not invalid data, , The identification result will delete the environmental data of invalid data. In addition, when the recognition result is the location in the environmental data without valid data, and the location in other environmental data where the recognition result is not invalid data, if the recognition result in these environmental data is consistent, the former will be deleted. Environmental information. Determine the accuracy of the environmental map based on the recording time of the environmental data and the vicinity of the location in the environmental data. After the position of the current mobile camera 10 on the environmental coordinate system is added to the environmental map, the environmental map is output from the environmental understanding device 31 to the environmental map holding devices 33 and 35, and the object position estimating device 34. However, if the environmental understanding device 31 inputs the geometric analysis result from the geometric analysis device 37, the image recognition device 29 first determines whether it is a figure to be recognized. If the 54 ^ paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 public love) " (Please read the precautions on the back before filling this page) Binding: 498290 A7 _____ B7 _ ^ _ V. Geometric Analysis of the Invention The result is a figure outside the object, which will be near the position on the environmental coordinate system of the mobile camera 10, and the environment understanding device 31 will immediately delete the environmental data whose identification result is invalid data from the environmental map. Thereby, unnecessary environmental data is deleted from the environmental map, and the object position estimation device 34 and the like do not need to output unnecessary object estimated positions. When the geometric analysis result is an object figure, the environment understanding device 31 waits for the recognition result from the image recognition device 29 at a predetermined time. If the environment map holding device 33 inputs an environment map from the environment understanding device 31, and if the output location of the environment map requires a signal of an appropriate format, the output location of the environment map will convert the environment map in the requested format. Thereafter, the environmental map holding device 33 stores the environmental map for a certain period of time in order to reliably transmit the environmental map to the output location of the environmental map. If the object counting device 35 inputs an environment map from the environment understanding device 31, it will calculate the number of environmental data in the environment map that has the recognition result indicating the specific object, and generate an arbitrary number of objects. The identification results in the environmental data can be selected from the identified object types using the image recognition device 29. Any number of objects is output from the object counting device 35 to the object number holding device 36. In addition, if necessary for the application, the object counting device 35 can be changed to easily specify the type of the object to be calculated from the outside. If the object number holding device 36 inputs an arbitrary number of objects from the object counting device 35, it will surely transfer the arbitrary number of objects to the output destination of the arbitrary number of objects, and it will memorize the arbitrary number of objects for a certain period. If the object position estimation device 34 inputs an environment map from the environment understanding device 31, it will select 1 environmental data whose identification result is invalid data, and draw 55 ^ [张 级 剌 巾 剌 家 standard (CNS) A4 specification (21G X '( Please read the notes on the back before filling this page) Binding · ·-Thread · 498290 A7 ^ ______ B7_____ 5. The invention explains the position in the environmental data. From this position, use the camera / environmental coordinate conversion device 20 to bring out the calculated The current position on the environmental coordinate system of the mobile camera 10 and the object position estimation device 34 ′ Regardless of whether the rough edge information 112 has been generated in the past, the current position on the environmental coordinate system of the mobile camera is used as the zero point. The relative position on the environmental coordinates of the moving object in the recognition result is only the moving object that does not necessarily exist at the current position. Therefore, this position becomes the speculative position of the moving object that the moving object may exist. On the other hand, There is no environmental data in the map whose identification result is invalid data, so it is within the range that the mobile camera 10 can move. The position on the appropriate environmental coordinate system is generated. The criterion for generating the appropriate position is as follows. First, any position is generated from the suspected random number. Second, the position with low density in the environmental data in the environmental map is calculated. Third , In the proper order, sequentially generate the positions in the possible range of the mobile camera 10. For example, in the range that the mobile camera 10 may move, the positions are sequentially generated from the upper left position to the right, and when it reaches the right, it will descend one level Positions are generated sequentially from the back left, to the left and then one level down, and positions are generated sequentially from the right. Repeatedly. These combinations can be used to efficiently estimate the estimated position of the moving object that was not captured by the mobile camera 10 尙The object's estimated position will be output from the object position estimation device 34 to the motion control device 23. If the color information generating device 41 inputs a digital image 111 from the image memory device 12, the color in each pixel of the digital image 111 will be selected and at least specified in advance. If the color and color area of one are consistent, a color information image 172 is generated. The color information generating device 41 Can produce color in units of pixels 56% Zhang scale Applicable to China National Standard (CNS) A4 specification (210 X 297 public love). 1 -11 (Please read the precautions on the back before filling this page) Order-. • Line 498290 A7 ____B7______ 5. Description of the invention (pf) • Information 171, so it is suitable for parallelization. If the color information generating device 41 can output all pixels of the color information image Π2 in parallel, then the communication from the color information generating device 41 to the position / size detection device 17 , Can be performed in parallel on each pixel. If the position / size detection device 17 inputs a color information image 172 from the color information generating device 41, it will use the color information 171 to detect the position and size of the indicated moving object area. The position / size detection device 17 is suitable for parallelization because it can process only in the neighborhood of each pixel and generate a repeated information image 132 indicating the detection result of the position and size of the area of the moving object. If the position / size detection device 17 can output all pixels of the repeated information image 132 in parallel, the communication of the image / environment coordinate conversion device 21 from the position / size detection device 17 can be performed in parallel on each pixel. After that, the position of the moving object in the repeated information image 132 is selected based on the image / environment coordinate conversion device 21 and the position selection device. 22 and output to the motion control device 23. If the position / size / inclination detection device 44 inputs the edge information image 115 from the edge information forming device 15, it will use the edge information 1U to detect the position, size, and inclination of the indicated moving object. The position / size / tilt detection device 44 can be processed only in the neighborhood of each pixel to generate an angle image representing the tilt angle of the area of a moving object, and is therefore suitable for parallelization. If the position / size / tilt detection device 44 can output all pixels of the repeated information image 132 and all pixels of the tilt angle image in parallel, the communication from the position / size / tilt detection device 44 to the tilt detection device 42 can be performed in Each pixel is performed in parallel. 57 This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) '' -------------- ^ -------- ^ ---- ----- Line (Please read the precautions on the back before filling this page) 498290 V. Description of the invention (0) If the tilt detection device 42 inputs the tilt angle image from the position / size / tilt detection device 44, it will The tilt angle at the most central position is detected. In this way, the mobile camera 10 can rotate with the object shot in the center. The inclination angle is output from the inclination detection device 42 to the motion control device 23 〇 In addition, the vision device 2 does not need to use all the devices shown in FIG. 14. The mobile camera 10 can also be controlled, the type of the identified object, and the specific object can be controlled. position. Therefore, the makers and programmers of the visual device 2 actually use the LSI technology to choose the required device when cooperating with the object to be photographed, the required functions, and the provided computer resources. can. In addition to the position selected by the position selection device 22, the vision device 2 may also require the mobile camera 10 to perform panning, tilting, rolling, and zooming at the following positions. The first is that when the moving camera 10 is to capture the movement of a stationary object, the visual device 2 must make the moving camera 10 vibrate. The vibration command generating device 25 specifies the position where the mobile camera 10 should move as the position on the environmental coordinate system. The position designated by the vibration command generating device 25 is extremely determined by a suspected random number or the like within the range where the mobile camera 10 does not vibrate. In addition, this vision device 2 can input control instructions from the outside to request the mobile camera 10 to pan, tilt, roll and zoom. In general applications, the pan, tilt, roll, and zoom are based on the current direction, tilt, and magnification of the mobile camera 10. Therefore, the control instruction input device 24 is used to store the temporary control instruction to calculate and move. The current position of the camera '10 is taken as the position on the environmental coordinate system of zero. In addition, with 58 paper sizes, the Chinese National Standard (CNS) A4 specification (210 X 297 mm) is applicable — II ------ I ------- (Please read the precautions on the back before filling in this Page) Ίδτ '*.-Line · 498290 A7 B7___ V. Description of the invention ( < L), the control command input device 24 is improved, and the mobile camera 10 can be easily moved to a specific position. ---------------- (Please read the precautions on the back before filling out this page) So in order to control the pan, tilt, roll and zoom of the mobile camera 10, the motion control device 23 One of the five positions on the aforementioned environmental coordinate system will be selected. At this time, the motion control device 23 ′ will generate a position selection device 22 on the control instruction input device 24, an object position estimation device 34, and an edge information generation device 14; a position selection device 22 will be generated on the color information generation device 41, and will be generated according to the vibration instruction. The sequence of the device 25 'selects an input position from the available devices. The selected position is converted from the environmental coordinate system to the camera coordinate system using the motion control device 23. Thereafter, the camera command generating device 26 is used to replace the command recognizable by the mobile camera 10 and transmitted to the mobile camera 10. Therefore, the vision device 2 can control the pan, tilt, roll and zoom of the mobile camera 10. -丨 Line- In addition, depending on the model of the mobile camera 10, some models cannot obtain the status of the mobile camera 10 without transmitting specific instructions to the mobile camera 10, that is, the direction, tilt, and direction of the mobile camera 10. Magnification or information on whether the mobile camera 10 is moving or stopped. Therefore, the motion control device 23 selects one of the above five positions and outputs it to the camera command generating device 26, so that the command for querying whether the mobile camera 10 is moving or not can be transmitted to the mobile camera 10, and the motion The control device 23 instructs the camera instruction generating device 26 to wait for receiving this information from the mobile camera 10 through the camera / environment coordinate conversion device 20. If the received information indicates that it is in motion, a command asking whether the mobile camera 10 is in motion will be transmitted to the mobile camera. 59 This paper size applies to the Chinese National Standard (CNS) A4 (210 X 297 mm) 498290 A7. 5. Description of the invention (fj) • 10, the motion control device 23 will instruct the camera instruction generating device 26 again. If the received information indicates that it is stopped, a command inquiring the current direction, tilt and magnification of the mobile camera 10 will be transmitted to the mobile camera 10, and the motion control device 23 will instruct the camera instruction generating device 26. The motion control device 23 does not select 5 positions during this period. The camera command generating device 26 transmits the corresponding command to the mobile camera 10 according to the instruction from the motion control device 23. The camera / environment coordinate conversion device 20 will completely transmit the information of whether the mobile camera 10 is moving to the motion control device 23, and convert the current direction, tilt and magnification of the mobile camera 10 from the camera coordinate system to the environmental coordinate system. position. With this, the visual device 2 can control the panning, tilting, rolling, and zooming of the mobile camera 10 while sequentially inspecting the state of the mobile camera 10. Finally, the vision device 2 includes an edge information generation device 14 and a position / size detection device 17, an edge information formation device 15, a position / size / tilt detection device 44, an object / background separation device 16, an area normalization device 27, Between the image holding device 39 and the pattern matching device 38, each device does not necessarily make the input image resolution or image size the same. For example, in this visual device 2, the edge information generating device 14 inputs a low-resolution digital image 116 that reduces the resolution of the digital image 111; on the other hand, in the edge information forming device 15, the input generates edge information with a suitable device. The image size of the low-resolution coarse-edge information image 117 generated by the device 14 is enlarged to the coarse-edge information image 113 of the image size of the digital image 111; the digital image 111 is input on the object / background separation device 16 and the area normalization device 27. Reduce the load on the edge information generating device 14 (see FIG. 25). 60 This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) ---- 1 ---- ---- II (Please read the precautions on the back before filling this page) · ·- -Line · 498290 V. Description of the invention (---- 1 11 ------ I 1 --- (Please read the notes on the back before filling out this page}. Line! That is, 'the information on the edge is hardly changed The quality of the normalized image 145 generated after the formation device 15 can control the panning, tilting, rolling and zooming of the mobile camera 10 after the position / size detection device 17 at a higher speed. And this device goes further 'In the edge information forming device 15' Input the low resolution coarse edge information generated by the edge information generating device 14 to divide the coarse edge information image 119 of the area where the coarse edge information in the image 117 exists; in the object / background separation device 16 and area normalization device 27, input a cut-out digital image 120 in the same position as the rough edge information image U9 cut out from the digital image 111, which can reduce the number of normalized images 145 after the edge information forming device 15 Generate a load (refer to Figure 26). With this visual device 2, if the mobile camera 10 can capture a moving object in the center of the screen image with an appropriate size, it can decide in advance the digital image 111 to cut out the rough edge information image 119 and the digital image 120. Using this device, the vision device 2 can use a mobile camera 10, which has the same function as the object search device using a wide-angle camera and a high-resolution camera. The image memory device 12 used in the vision device 2, color Information generation device 41, edge information generation device 14, edge information formation device 15, position / size detection device 17, position / size / tilt detection device 44, object / background separation device 16, area normalization device 27, masking device 40. The image holding device 39 and the pattern matching device 38 can be actually installed using a data processing device 110 composed of an array computing device 100 (ARRAY OPERATION UNIT). Hereinafter, the array computing device 100 is used. The embodiment of the data processing device 110 is taken as an example to describe the visual device 2 61 with reference to the drawing. National Standard (CNS) A4 specification (21 × X 297 mm) 498290 A7 ___B7__ F. Explanation (Firstly, the array computing device 100 uses 1 pixel of the input image and its nearby pixels to generate 1 pixel of the output image As shown in FIG. 16, the array computing device 100 is matched with the size of the input image, and then the data processing device 110 arranged in a grid is used, and the array computing device 100 can generate an output image from the input image. In the figure, the array computing device 100 is referred to as an AOU. Then, the array computing device · 100 can be installed with dedicated hardware, or it can be installed with software on a general computer. That is, if an output image can be generated from an input image, the installation device is not limited. Therefore, by representing the algorithm of the array computing device 100, the image processing of the data processing device 110 can be represented. In order to show the algorithm of the array computing device 100, the image memory device shown in FIG. 14, the color information generating device 41, the edge information generating device 14, the edge information forming device 15, and position / size detection will be described here. Formulas used by the device 17, the position / size / tilt detection device 44, the area normalization device 27, the mask device 40, the image holding device 39, and the pattern matching device 38. If it is assumed that the 2η tone image of any of width w, height h, and number of bands b is 2L ν, I, and, then 2L, i, w use band pixels at each position P (i, j, k)値, yuk, wUk are as shown in Equations 2, 3, and 4. In addition, the underlined characters represent vectors. Η is a non-negative integer, and w, h, b, i, j, and k are natural numbers. x = (xijk \ xijk is value at k), l < i < Wil < j < h, l < k < b} (2) 62 This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) ---------- I --- · 11 (Please read the note on the back first Please fill in this page again) Order. · 498290 A7 B7 V. Description of the invention (/ b) V = {Vijklyijk is value at p (ij, k), l < i < w, l w = (wijk \ wijk is value at k), l < i < w, l M < k < b} (3) lKl < k < b} (4) First, the following describes the functions related to the processing of the points of each band pixel of the aforementioned image. To convert the image to a two-dimensional image, the band pixels are binarized according to Equation 5. = < 1 if xijk > 0, 〇 otherwise. (5) ----------------- (Please read the precautions on the back before filling this page) To copy the image 2LJ When specifically changing to the maximum band image, the maximum band is selected from the band bands of pixels in row j and column j according to Formula 6. In addition, since the largest band image in the band becomes a single band image, it is expedient to process the image with the band number 1. Therefore, the third subscript of the function ByOO is 1 〇 Βίη (χ) = max {xijk} 线 line! Assume that the image is a two-frame image. If you want to reverse image 1, calculate it according to Equation 7.对 The logarithmic transformation at the position P (ι, ", k) of the image L is performed according to Equation 8. Here, the e-series deviation is used to make the 値 output by the natural logarithmic function within the effective range, so generally e = l is sufficient. Based on this, the 63 paper sizes apply the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 ⑻

Pijk {〇) = < A7 B7 V. Description of the invention (u). Digitization can change the division between band pixels 値 into subtraction. In addition, if the image t is a digital image 111 of 2 ° tone, if the checklist containing elements is brought to the memory 102 regardless of the number of bands, it is not necessary to calculate the natural logarithmic function every time A standard logarithmic table is required.

Lijk (x) = ln (xijk + e) The set of positions Pijk (q) near q on the image position p (i, j, k) is represented by Equation 9. However, Q is a continuous sequence of 4, 8, 24, 48, 80, 120, (2r + 1) 2-1, and r is a natural number. In addition, if the position exceeding the image size is included in the set Pijk (q) ', the position P (i, j'k) will be used instead unless otherwise specified. In other cases, pixels are equivalent to 0 as specified, and imaginary positions not included in the image are used instead. With this, edge processing will be performed automatically. Therefore, the number of elements Nuk in the set Pijk (Q) is Q. {p (i + p (ij + 1, A;), p (i-p (ij-1? A :)} if? = 4, {p (l, m, k) \ i — r < l < i + r, j — r < m < j + r, p [l, m, k) 妾 p (i, j, k)} if $ = (2r + l) 2 — 1. (9) The following describes the functions and operators for the neighborhood processing of 182 around the maximum 8 pixels in each band of the image. The smoothing at the position p (i, j, k) of the image L is based on formula 10 64 (Please (Read the notes on the back before filling out this page)

This paper size applies to China National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 ______ Β7 ____ V. Description of the invention ------------ II ------ (Please read the notes on the back first Fill out this page again) • and proceed. However, int (v) means the real number v is rounded down to the decimal point. If the band pixels 影像 of the image 2 ^ are integers, then during hardware installation, change to execute the right Shift instruction twice for the sum of xlmk when Njik = 4, and perform the right Shift 3 times for the sum of xlmk at 8 The circuit of instructions, and the circuit of performing division can be omitted.

Sijk (x) = int (—— X) ^ imk) ljk p (^ k) ^ pijk (q) (10) The calculation system of Laplacian is shown in Equation 11, except that it is a second-order difference operator. . The vicinity of 182 is suitable for the present invention because it captures subtle changes in the sound, so the zero point and the zero crossing are increased. However, because Nijk is 4 or 8, if the hardware installation is changed to Nik = 4, the left shift instruction is executed twice on xljk, and Njik = 8 is the circuit on which the left shift instruction is executed 3 times on xijk. Eliminates the need for circuits that perform real multiplication. Line 丨 Jade = >: Imk ^ ijk ^ ijk p (l, m, k) ePijk {< l) (11) As far as the method of finding the zero point from the 値 obtained by Laplace Although it is known to find pixels that change from positive to negative, the present invention is based on Equation 12, in addition to finding pixels that cross from negative to positive zero, and find zeros that pass from negative to zero and from zero to positive, etc. Zero continues pixels. In the present invention, the zero point found in Equation 12 is not a place where there are edges' but a place where there is noise, that is, a place where there is no edge. In addition, the conversion of two of the real numbers 値 by Equation 12 is performed simultaneously. 65 This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 B7 V. Description of the invention (b = < 1 if Xijk < 〇and xirnk > 0 for 3p (l, m, k) 6 Pijk (q), 0 otherwise. (12) Assume that the image is an arbitrary two-dimensional image. If a pixel with holes is to be incorporated into the image L, it is calculated according to formula 13. Here f is the expression that should be entered. The parameter of the size of the hole is generally enough that f = l. In addition, it is better to set it to 182 near 8 because it cannot be detected diagonally in the vicinity of 4.

Fijk (x) = < 1 if ^ p (l, m, k) € Pijk (Q) ^ / Xijk otherwise. (13) When the image is any binary image, there are no separate points in image L or separate holes are deleted Will be calculated according to Equation 14. In addition, since it is impossible to detect a diagonal line when it is near 4, it is better to set it to 182 near 8.

Aijk (x) = < 0 if ^ ijk — 1 3, nd Ylp (l, m, k) ^ Pijk (q) ^ Imk ^ 〇? 1 if Xijk — 〇3, nd Σρ (/, τ? Ι, Α;) € ΡϋΑ: (^) == ^ ijk Xijk otherwise. (14) Image L is any binary image. In order to detect pixels with a line width of 1 in image L, 4 nearby pixels will be used to calculate according to formula 15. 66 (Please read the notes on the back before filling this page)

This paper size applies to Chinese National Standard (CNS) A4 (210 X 297 mm) 498290 A7 B7 V. Description of the invention (bp

Xijk if + = 0 or xij-lk + = 0, = < n otherwise. (15) 2 pixels 2L, for any two-frame image The pixel image 'is used to expand the pixel [pixel line width with a center line width of 1' will use 4 nearby pixels to calculate according to formula 16.

Ktjkis-'i y) = <

Xijk if team one + 2 / i + ljA: + 2 / ij —1 left + ϊ / ij. + LA: > 0, otherwise. ---- I --------- install --- (Please read the precautions on the back before filling in this page) (16) Therefore, if you use the line width detection of formula 15 and the line width expansion of formula 16, you can simply describe the line width supplement of the second image according to formula 17. ^ ijk (s): = Kijk (x, lU)) (17) Regarding the neighborhood processing of each band pixel 値 of the following image, the following description will be made on the number and operator. Eight When there are 2 images 2L and 1, the maximum pixel size of these images can be calculated according to > y) ^ ijk if jk ^ Vijki yijk otherwise. (18) When there are two images 1, l, the difference between these images can be calculated according to the formula. (210 x 297 mm) 19 498290

V. Description of the Invention (L ^) (19)

Dijk y) ^ xijk y ^ k If the difference between Laplace in Formula 11 and Formula 19 is used, the sharpness of the image can be simply described according to Formula 20.

Eijkiy) ^ Dijk {sj V ^ · ^) (2〇) When there are 2 images 2L, I, and the image ^ is a single-region two-frame image 1 According to Equation 21, the band pixels of the image iL are used to mask the image. 2L image of each area. 〇ijk (ST V) = ^ ijkVijl _ (21) When there are two images 1i, and the images 2L and iL are two-dimensional images, you can reshape the image based on the image X based on Equation 22 I ° ijk if Uijk + Yjp (l, m, k) ePijk {< l) > 0 otherwise. (22) When there are two images 2L, I, and the image L is a two-dimensional image, the unspecified image L will be specified according to formula 23. The band pixel 値 'of the image 2L · is supplemented by the average value of the image x band pixels 定 defined by the image near the image band pixel 値. However, int (v) means that the number below the decimal point of v must be rounded off. In addition, since the denominator of the image y is a positive number, the inverse number from 1 to q is stored on the memory 102, so that the division of the integer can be replaced by the multiplication of the real number. 68 This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) (Please read the precautions on the back before filling out this page) Pack aj. 498290 A7 B7 V. Description of the invention (Lt vijk {x ^ y) l ^ P (^ ma) € Pi-1 (,) yimi) lf = 0 and ZP (i ^ i) ePijl (q) yiml > 0, ijk otherwise. (23) The present invention is to convert pixels The position or movement amount is treated as simple as the image data. This is called the imaging of position p. Several functions and operators related to imaging of position are explained below. The first is to treat each 1, m, 〇 値 at position p (l, m, 〇) as image data and convert it into band pixels 値, whose operator is #, and the converted band pixels 値 are #p ( l, m, 0). Next, consider a case where the band pixel 値 moves from a position p (i, j, k) to a position p (i = 1, j + m, k + 0). At this time, the movement amount of the band pixel 値 is expressed by p (l, m, 0). That is, the amount of movement can be regarded as a vector from a certain position. Finally, the operator used to obtain the position from the band pixel 令 is expanded by one. Therefore # _1 # p (l, m, o) = p (l, m, ο) ο Therefore, according to formula 24, the plane can be moved to 180 in a plane representing the movement amount P (i, j, k) in the width and height directions. Degrees turn in opposite directions. (24) There is image 1. When image ^ is a single-area two-frame image, the amount of movement of the center of gravity position on image \ position p (i,: i, 1) will be calculated according to formula 25. In addition, although the division of the original center of gravity is required for calculation, the division is used to calculate the amount of movement in the vicinity of 8 to 182, so the division is omitted in Equation 25. 69 ----------------- (Please read the precautions on the back before filling this page) * tr ° J · line. This paper size is applicable to China National Standard (CNS) A4 (210 X 297 mm) 498290 A7 B7 V. Description of the invention 25) From the amount of movement P (i, j'k) ', using equations 26 and 27 δ ten pairs of movements within 182 near 8 can be imaged on the amount of movement image. There is also formula 27, only Use 眇 (1,0, A〇ifz > 0, \ j \ < | z | / 2, bismuth (1, -1, 々) ifi >0,; < 0, \ i \ / 2 < \ j \ < 2 \ il ttp (0, one: U) ifi < 0,2 | z | < | j |, ίίρ (-1? -1, k) if z < 0, j < 0 „\ i \ / 2 < \ j \ < 2 | i |, ㈣ 一 1,0, A〇if z < 0, \ j \ < \ i \ f2,眇 (-1,1, A) if z <0,; > 0, | i | / 2 < | j | < 2 | z |, bismuth (0,1, magic ifi > 0, 2 | z | < | i |, ftp (l, l, fc) ifi > 0, j > 0, | z | / 2 < | j | < 2 | i |, jjp (0,0, k) otherwise.

Jtp (l, 0, A;) if i > 0, \ j \ < \ i \ / 2, ttp (l? 0 ^) iii > 〇J < 〇 ^ \ i \ / 2 < \ j \ < 2 \ il itp (071, k) if z < 0, j > 0, \ i \ / 2 < lil < 2 | z |, fcp (0, l, fc) ifj > 0,2 | i | < | j |, if z >0,; > 0, | i | / 2 < | j | < 2 | i |, Up (0,0, k) otherwise. Applicable to China National Standard (CNS) A4 (210 X 297 mm) (26) (27) (Please read the notes on the back before filling this page)

498290 A7 ___B7____ V. Description of the Invention (0) 'Therefore, if formulas 25, 26, and 27 are used, according to formulas 28 and 29, the band pixels 域 of the moving image in the direction of the center of gravity of the single-region secondary image can be simply described. The number of bands of the moving image is 1. = QiGi ^ ix)) (28) Δ ·; 1 (χ) = & (Giji (x)) (29) On the other hand, since the opposite position of the center of gravity can be obtained by using formula 24, using formula 30, we can Briefly describe the band pixels of the image center of gravity of a single area and the image of the moving amount in the opposite direction. The number of bands in the moving image is one.

Riji (x) = Q (T (Giji (x))) (30) There are two images 1, I, and image l is a moving image. You can use formula 31 to move the image [band pixel 値 to the image After the intended moving position is set, the band pixels moved to the pixels in the same area are collectively determined as the shaded image. y) = Σ ^ imk for p (l, m, 1) 6 Piji (q) and tlyimi = p (i-IJ-m, 0). (31) Therefore use formulas 5, 28, 29, and 31, according to the formula 31 or Formula 33, after moving the single-area shading image 2 ^ to the direction of the center of gravity nearby, simply describe the total number of band pixels that move to the pixels in the same area. (32) Λ ^ · ι (χ) = Γ ^ · ι (χ, Δ (Φ (χ))) 71 The paper size is applicable to China National Standard (CNS) A4 (210 χ 297 mm) ---- ------------- (Please read the precautions on the back before filling this page) Enter the-· line! 498290 A7 ___B7___ V. Description of the invention (t / |) Λ〇) = riyi (2, ^! (Record))) (33) However, if the number Q in the vicinity of Formula 31 is limited to 8, the amount of pixels is moved 3L. A specific movement source can be selected from 182 near 8 on each pixel. Therefore, image 2L · is a repeated information image 132, and as shown in FIG. 17, for 2L pixels 182 in the vicinity of the counterclockwise direction 182 plus 1 to the number, then the eight formulas of formula 34 to formula 41, respectively It is determined whether there is movable duplicate information 131 on each of the 8 moving sources.

Hjife y) = 1 if r'yz-fij ,! = p (-l, 0, 0), (34) 1 ° otherwise. If it = p (-l, l, 0), (35) ί 0 otherwise Γ ^ · 3 ν) two if Γ ^ Μ-ι, ι =: P (0,1,0), (36) 1 ° otherwise. F -lj—u (£) if it-i—lj-ia = p (U, 〇), (37) 0 otherwise. f (τ ι, \-) W 1 ij5 \ ^ 2 / J — s ^ it 1yi ~ ij, i = p (i, 〇, 〇), ( 38) otherwise. 72 This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) (Please read the precautions on the back before filling this page)

498290 A7 B7 V. Description of the invention (Γ ^ · 6 (χ, y) = < Φ ^ υ + 1ι1 (χ) · if Γ ^ ζ-υ + ι, ι = p (l, -l, 〇), 0 otherwise. (^) If ft = p (0, a 1,0), (39) (40) 0 otherwise. ^ I + l, j + l, l ㈤ if it = p (—1, a 1, 0), 0 otherwise. (41) ------------- Install --- (Please read the precautions on the back before filling this page) Therefore, use formulas 42 and 43 instead of formulas 32 and 33 , From the 8-area shading image & consisting of 8 moving source repeat information 183 and the single-area shading image i consisting of repeating information 131, 8 moving source repeat information 183 for each moving source are generated. ~ Γΐ7Α; (χ, Δ (Φ (^))) + Δ (Φ (^))) Eight ^ dagger, 2) = Jin ⑼)) + Γ ;; times, "(企 ㈤)) (42) (43) line ·· There are two images l, y_, and image 2L is a two-frame image; when image iL is a moving image, the position of the source of the movement of each band pixel 値 of the image L can be obtained, so the moving source can find duplicate bands Domain pixels 因此. Therefore, the moving sources of each band pixel 値 of image 2 ^ will not be duplicated, and the band pixels 表示 of the movable image that represent the moving band pixels 値 will be rooted. Generated according to formula 44. The number of bands of the movable image is 1. 73 This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 B7 = < (44) 5. Description of the invention 1 if xi: / 1 = 0 and r ^ mi = one D — m, 〇) for only one of p (Z, m, 1) S corpse 〇1 ⑷, 0 otherwise. There are 3 images 2L, I, meaning When the image 2L is a movable image and the image I is a moving image, the image can be moved according to Formula 45, and the band pixels of 2L are 値

Ximk if Viji = 1 and ^ ^ ^ 〇) for 3p (l, m, l) e Piji (q),

Tijk (x, y, w) == \ 〇if team mi = 1 and j {一 = pG one claw one:? ·, 0) for 3p (Z, m, 1) G Piji (q), χφ otherwise (45) Therefore, if formula 30, formula 44 and formula 45 are used, according to formula 46, the position of the center of gravity calculated from the second image y and the image bands obtained by moving the area pixels of the image X in opposite directions can be simply described Pixels. (46) Therefore, by using Equation 2 to Equation 46, it can be described that the image memory device 12, the color information generating device 41, the edge information generating device 14, the edge information forming device 15, and the position / size detection shown in FIG. 14 are installed. Algorithms of device 17, position / magnitude / tilt detection device 44, area normalization device 27, mask device 40, and image processing device Uo of all data processing devices Uo 100 algorithm. The following is the use of data processing 74 This paper size applies to China National Standard (CNS) A4 specifications (210 X 297 public love) ---------------- (Please read the precautions on the back first (Fill in this page again) · 498290 A7 -_____ B7_____ V. Description of the invention (p) -------------- Installation --- (Please read the precautions on the back before filling in this page) • An algorithm of any of the array computing devices 100 in the device 110, explaining the image memory device 12, the color information generating device 41, the edge information generating device 14, the edge information forming device 15, the position / size detection device 17, the position / size / tilt The detection device 44, the area normalization device 27, the mask device 40, and the image holding device 39. In order to store the digital image 111, the image memory device 12 implemented by the data processing device 110, the array computing device 100 arranged in a grid shape will move in parallel and synchronously. If the array computing device 100 arranged in i rows and j columns on the grid is regarded as AO%, the algorithm of AO% is shown in FIG. In step 1201, AO% is arranged on the rows i and j of the grid. Whether it is logical or practical, it is used to determine the vicinity of AO%. In step 1202, the vicinity of A0% or the start of the variable is set. •line! In step 1203, it is determined whether there are digital images 1U that are sequentially input. If there is no digital image 111 (step 1203 · YES) ', the algorithm ends. If there is a digital image 111 (step 1203: NO), the process proceeds to step 1204. However, when the array computing device 100 is installed only for a specific image size, it may be set to an infinite loop. In step 1204, wait until the digital image 111 is ready for input. In step 1205, as many pixels as the number of bands of the digital image 111 are input. Therefore, AO% needs a memory for storing at least as much image data as the number of bands. 102 ° In step 1206, in order to be output while waiting for input, the pixels of rows i and j of the digital image 111 are stored. 75 This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 ___ B7 __ V. Description of the invention ("] $) In step 1207, the band pixels of the digital image 111 are output. After that, go back to step 1203. Therefore, using the data processing device 110 composed of the array computing device 100, the image memory device 12 can store the digital image 111. As shown in FIG. 19, in order to generate the color information 171 from each pixel of the digital image 111, the color information generating device 41 reached by the data processing device 110, the array computing device 100 arranged in a grid form moves in parallel and synchronously. If the array computing device 100 arranged in i rows and j columns on the grid is regarded as AO%, the algorithm of AOUij is shown in FIG. 20. In step 4101, AO% is arranged on the row i and column j of the grid. Whether this is theoretical or practical, it must be decided around the AO%. In step 4102, the vicinity of AO% or the starting point of the variable is set. In step 4103, it is determined whether there are digital images 111 that are sequentially input. If there is no digital image 111 (step 4103: YES), the algorithm will end. If there is a digital image 111 (step 4103: NO), the process proceeds to step 4104. However, when the array computing device 100 is installed only for a specific image size, it can also be set to infinite loop. In step 4104, the i-th row and j-th column of the digital image 111 are input into the number of band fields. Therefore, the AO% needs to store at least the memory 102 of the image data of the number of bands. In step 4105, color information 171 is generated after extracting a specific color from the i-th row and j-th column of the digital image 111. The generated color information 171 is processed as band pixels of the color information image 172. In step 4106, the band information pixels of the color information image Π2 are output. 76 This paper size is applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) -------------- --- (Please read the notes on the back before filling this page) 498290 A7 ___B7 _____- 5. Description of the invention. It will then return to step 4103. Therefore, using the data processing device 110 composed of the array computing device 100, the color information generating device 41 can generate a color information image 172 from the digital image 111. As shown in FIG. 21, in order to generate a rough edge information image 113 from the digital image 111, the edge information generating device 14 implemented by the data processing device 11 will operate in parallel and in parallel. . If the array computing device 100 arranged in i rows and j columns on the grid is regarded as AO%, the algorithm for the AO% of the edge information generating device 14 will be as shown in FIG. 22. In step 1401, AO% is arranged on i rows and j columns on the grid. Whether this is logical or practical, it is used to determine the vicinity of AO%. In step 1402, the vicinity of AOUij and the starting point of the variables are set. In the setting of the neighborhood, the nearby size Q used by each of the aforementioned functions may be determined to be 4 or 8, respectively, or all may be unified to 4 or 8. In order to improve the accuracy of the rough edge information 112 generated by the edge information generating device Η of the present invention, it is desirable to set all nearby sizes q to 8. However, the limitation of the calculation time for generating the rough edge information 112 and the number of bands of the digital image 111 allow the edge information generating device 14 to respond to the need to change the appropriate nearby size. In step 1403, it is determined whether the digital image 111 is finished. If there is no digital image 11U (step 1403: YES), the algorithm ends. If there is a digital image 111 (step 1403: NO), the process proceeds to step 1404. However, when the array computing device 100 is installed for a specific number of bands and image size, 77 paper sizes can also apply the Chinese National Standard (CNS) A4 specification (210 X 297 mm) ------- ----------- (Please read the notes on the back before filling this page) Order-line! 498290 A7 _____B7 ____

5. Description of the invention (" / A • Set to infinite loopback. In step 1404, enter as many pixels as the number of bands in the 111th row of the digital image 111. This is for AO% to process the batches of digits. Pixels in rows i and j of image 111. Therefore, AO% needs to store at least as much image data as memory 102. In step 1405, A0% communicates with the nearby array computing device 100 to make Each band pixel 値 of the input digital image 111 is smoothed according to a function SUkoL). The smoothed band pixels 値 are treated as band pixels 平 of the smoothed image. In this function Sljk (20 can also be repeated several times as needed. Generally speaking, for multi-band images, this number of times is sufficient. In step 1406, for each band pixel of the smoothed image, the function will be based on the function LUk. (20 Perform logarithmic conversion. Each band pixel that has undergone logarithmic conversion will be treated as a band pixel that undergoes logarithmic conversion. In step 1407, AO% will communicate with the nearby array computing device 100 to perform logarithmic conversion. The band pixels of the image are sharpened according to the function EijkQ0. The band pixels that are sharpened are treated as band pixels of the sharpened image. Also, when there is a lot of noise in the digital image 111, This step can be omitted. In step 1408, for each band pixel of the sharpened image, each band pixel of the sharpened image before input 1 will be derived according to the function DUk (2L, I). The band pixel for which the difference is calculated Will be treated as the band pixels of the time difference image. In step 1409, the corresponding band pixels of the sharpened image will be set to 78 ^ -------- ^ ------- -(Please read the notes on the back before filling (Page) This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 B7____ 5. Description of the invention ("] A), each pixel in the band of the sharpened image before input 1 is changed. In 1410, AOUij will use the communication with the nearby array computing device 100 to perform Laplace calculations on the band pixels of the time-difference image according to the operator. The band pixels of Laplace are calculated as time Band pixel processing of the differential Laplacian image. In step 1411, AO% will use the communication with the nearby array computing device 100, and for each band pixel of the time differential Laplacian image, it will be extracted according to the function Zljk〇〇. Zero point. The band pixels from which the zero point is extracted will be treated as the band pixels of the time difference zero point image. In step 1412, each band pixel of the time difference Laplacian image is detected according to the function BUk〇〇. The largest one of the band pixels. The detected maximum band pixels will be treated as the band pixels of the maximum time-difference zero-point image. It is also expedient that the number of bands is 1. In step 1413, A0% will use the communication with the nearby array computing device to calculate the Laplacian for each band pixel of the sharpened image according to the operator Vu. The Laplacian band pixel is calculated. Will be treated as band pixels in the Laplacian image. In step 1414, AOUij will communicate with the nearby array computing device 10 (). For each band pixel in the Laplacian image, it will be based on the function Zljk 〇L) Extract the zero point. The band pixels of the extracted zero point will be treated as the band pixels of the zero point image. In step 1415, for each band pixel of the Laplacian image, each band will be detected according to the function BUkQ0. The largest pixel in a domain pixel. The detected maximum band pixel will be regarded as the maximum band pixel of the zero point image. 79 __-_____ ___ ^ --- This paper size applies to China National Standard (CNS) A4 (210 X 297) Li) ---------- I --- i I (Please read the precautions on the back before filling in this page) Order ·-Line 丨 498290 A7 ___B7 ___ 5. Description of the invention 〇 "]) • Management. There are also expedient upper-band domains of 1. In step 1416, for each band pixel of the Laplacian image, and each band pixel of the time-differential Laplacian image, a band pixel located at the same position in each image is detected according to the function MUk (2L). The largest pixel in the range. The detected maximum band pixel will be treated as the band pixel of the mixed zero point image. Also, the expedient band number is 1. In step 1417, AOUij will use the calculation with the nearby array. Device 100 communication, for the band pixels of the mixed zero point image, will remove the hole according to the function Fijk (20. The band pixels of the removed hole will be treated as the band pixel of the mixed zero point image of the hole. The right number of bands is 1. The function Fijk〇〇 can also be repeated several times according to the needs. In general, the number of bands in the band is 1 time. In step 1418, Α ％ will be used. Communication with the nearby array computing device ι〇〇 'For the band pixels of the mixed zero point image of removing holes, the outliers and isolated holes will be removed according to the function AljkQ0. The band pixels of the isolated points and isolated holes will be treated as The noise is processed by removing the band pixels of the mixed zero point image. It is also expedient to set the number of band regions to 1. In step 1419, the band pixels of the mixed noise zero point image are not inverted according to the function IUkOL). 0 and 1. The inverted band pixels 被 will be treated as band pixels 粗 of the rough edge information image 113. In step 1420, the band pixels 粗 of the rough edge information image 113 will be output. Then return to step 1403. Therefore, using a data processing device 110 composed of an array computing device 100, the edge information generating device 14 can generate a rough edge from a digital image 111. This paper has been scaled to the Chinese National Standard (CNS) A4 specification (210 x 297). Public (Please read the notes on the back before filling out this page)

498290 A7 _____B7___ V. Description of the invention • Information image 113. As shown in FIG. 23, the edge information forming device 15 reached by the data processing device 110 generates a formation edge composed of the formation edge information 114 from the rough edge information image 113 composed of the rough edge information 112 and the digital image 111. The information image 115 and the array computing device 100 arranged in a grid form move in parallel and synchronously. If the array computing device 100 arranged in i rows and j columns on the grid is taken as AOUij, the AO% algorithm will be as shown in FIG. In step 1501, AO1 ^ is arranged on the rows i and j of the grid. Whether this is theoretical or practical, it must be decided around the AO%. In step 1502, the vicinity of AOUij or the starting point of the variable is set. In the setting of the neighborhood, the nearby size Q used by the foregoing functions can be individually determined to be 4 or 8, or all of them can be unified to 4 or 8. In order to improve the accuracy of forming the edge information 114 formed by the edge information forming device 15 of the present invention, it is better to set all the nearby sizes q to 8. However, using the calculation time or limitation of forming the rough edge information 112, or the number of bands of the input digital image 111, etc., the edge information forming device 15 can change the appropriate nearby size for processing as needed. In step 1503, it is determined whether there is a digital image 111 or a rough edge information image 113 input in order. If there is no digital image 111 or rough edge information image 113 (step 1503: YES), the algorithm is ended. If there is one of the digital image 111 or the rough edge information image 113 (step 1503 · · NO), the process proceeds to step 1504. However, when the array computing device 100 is installed for a specific number of bands and image size, it can also be set to infinite. 81 This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) ------ ----------- (Please read the notes on the back before filling this page)

498290 A7 __B7__ 5. Description of the invention (T1). Loop. In step 1504, the pixels in the "i-row" row of the digital image 111 and the rough edge information image 113 are input in the number of bands. This is to process the i-th row of the digital image 111 and the coarse-edge information image 113 in a batch: pixels in the j-th column. Therefore, AO% needs at least a memory 102 for storing image data with a number of fields. In step 1505, pixels in rows i and j of the digital image 111 and pixels in rows i and j of the rough edge information image 113 are separated. This is because A0U, · The pixels in the i rows and j columns of the digital image 111 and the pixels in the ^ rows and columns of the rough edge information image 113 are treated as pixels of individual independent images. If the i-th row of the digital image 111, the pixels of the j-th column and the pixels of the i-th row and the j-th column of the coarse-edge information image 113 are separated and input from the beginning, no special processing is required. In step 1506, AO% passes through and nearby The array computing device 100 communicates and smoothes each band pixel 値 of the input digital image 111 according to a function SUk00. The band pixels that are smoothed are treated as band pixels of the smoothed image. In this function SUk (20 can also be repeated several times as needed. Generally speaking, for multi-band images, this number of times is sufficient. In step 1507, for each band pixel of the smoothed image, the function will be based on the function LUk. 〇〇 Perform logarithmic conversion. The band-converted pixels of the logarithmic conversion will be treated as the band-pixels of the log-converted image. In step 1508, AO% will communicate with the nearby array computing device 100 to process the log-converted image. Pixels in each band: According to function 82, this paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) (Please read the precautions on the back before filling this page)

498290 A7 __B7 ___ V. Description of the Invention (? Fly) .EukQO sharpens. The sharpened band pixels will be treated as sharp band images. In step 1509, the AO% will communicate with the nearby array computing device 100 for each band pixel of the sharpened image. Laplace calculation is performed according to the operator ▽ ijkl. The calculated band pixels of Laplace will not be treated as band pixels of Laplace images. In step 1510, AOUij will communicate with the nearby array computing device 100. For each band pixel of the Laplacian image, the zero point will be extracted according to the function Zljk (20. The band pixel with the extracted zero point will be regarded as Processing of the band pixels of the zero point image. In step 1511, for each band pixel of the zero point image, the maximum value of each band pixel value is detected according to the function Bijk0. The detected maximum band pixel value will be regarded as The band pixels of the maximum 値 zero point image are processed. It is also expedient that the number of bands is 1. In step 1512, the band pixels of the maximum 値 zero point image will be inverted according to the function Iijk (2〇0 and 1). The inverted band pixels 値 will be treated as band pixels of the basic edge information image. In step 1513, the band pixels 粗 of the coarse edge information image 113 that has been input will be used as a starting point for shaping the coarse edge information image. Band pixels Straight __, because AO% will communicate with the nearby array computing device 100. Band pixels of the basic edge information image will be used. For band pixels of the shaped coarse edge information image, it will be based on the function QUk. L, reshaping. The reshaped band pixels 値 will be treated again as band pixels of the reshaping rough edge information image. Here the function QUk0L, ϊ) will be repeated until the original reshaping rough edge information 83 (Please read the precautions on the back before filling in this page> The size of this paper is applicable to China National Standard (CNS) A4 (210 X 297 mm) 498290 A7 __S ---- One or five. Description of the invention (穸 丨) ;. • The band pixels of the information image have not changed. However, in the calculation time saving, the quality of the input coarse edge information image 113, the quality pursued in the formed edge information image 115, etc., the shaping processing is performed appropriately. The number of repetitions is better. In step 1514, ΑΙΙ ^ will communicate with the nearby array computing device 100, and perform band width repair on the band pixels of the shaped rough edge information image according to the function CijkQ0. The band to be repaired The pixels 値 will be treated as band pixels 形成 forming the edge information image 115. In step 1515, the band pixels 形成 forming the edge information image 115 will be output. Then return to step 15 03. Therefore, using the data processing device 110 composed of the array computing device 100, the edge information forming device 15 can form the rough edge information image 113 to form the edge information image 115. Here, the so-called rough edge information image 113 is used to form the edge information. The formation of the image 115 is to estimate the edge information to be created from the high-resolution digital image 111 of the same situation from the edge information created by shooting a low-resolution digital image 111 of a certain situation. Therefore, for natural numbers As shown in FIG. 25, when the resolution of the digital image 111 is set to a low-resolution digital image 116 lower than 1 / n, and the edge information generating device 14 is used to create a low-resolution coarse edge information image 117, η can be used. The low-resolution coarse-edge information image 117 is enlarged to create a coarse-edge information image 113. However, since the resolution of the digital image 111 is set to 1 / n, it is only necessary to simply extract one of the n consecutive digital images 111 for the horizontal and vertical directions. Because of the η-fold expansion of the low-resolution coarse-edge information image 117, the horizontal and vertical directions 84 (Please read the precautions on the back before filling this page)

This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 __MI _ ^ ---- ^ V. Description of the invention (... As long as the continuous pixels t of the low-resolution coarse-edge information image 117 is simply It is sufficient to put η— 1 pixel with a band pixel 値 0. If n is not too large at this time, the data processing device of the edge information forming device 15 is realized, and an enlarged low-resolution coarse edge information image 117 is formed. Thickness * 1, the edge information image 115 of the edge image 113 will be almost the same; and the data processing device 11 of the edge information forming device 15 will form the edge of the thick edge information image 113 made of the digital image 111. The information image 115 is also almost the same. The reason is that in order to refer to the edge information forming device 15, a digital image 111 is used, which one of the edge information created inside is used. Since the edge information forming device 15 uses only thick edges, 7 information image 113. Therefore, when the coarse edge information image 113 of the enlarged low-resolution coarse edge information image 117 is input to the edge information forming device 15, it is realized from the low-resolution digital image 116 The low-resolution coarse-edge information image 117 edge f data processing device 110 of the data generating device 14 can reduce the amount of calculation or hardware. If this method is further developed, it will be reduced from the digital image as shown in Figure 26. Of the low-resolution coarse-edge information image 117 created by the 111-resolution low-resolution digital image 116, the rough-edge information 112 can be cut out. The surrounding low-resolution rough-edge information image 118 can be cut. If this low-resolution is expanded, Cut out the rough edge information image 118, cut out the rough edge information image 119, cut out the digital image 120 of the same area as the cut out digital image 111, and input the data processing device 11 ′ that realizes the edge information forming device 15 to make the cut. Produce the edge information image 121. In this case, the data processing device 110 that realizes the edge information forming device 15 can reduce the amount of hardware. There is also a visual device 85 (please read the precautions on the back before filling this page)

This paper size applies to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 _ B7 __ V. Description of the invention (0) Set to 2, can also be used to cut out the digital image 120 must always be in the digital image 111 The center, and the orientation and magnification of the mobile camera 10 are changed. As shown in FIG. 27, the position / size detection device 17 reached by the data processing device 110 is to create a repeating information image 132 from the rough edge information image 113 having the rough edge information 112 as a pixel and repeating information 131 as a pixel. The array computing devices 100 arranged in a grid form move in parallel and synchronously. If the array computing device 100 arranged in one row and j columns on the grid is regarded as AO%, the AOIV algorithm will be as shown in FIG. 28. In step 1701, AO% is arranged on the rows i and j of the grid. Whether this is theoretical or practical, it must be decided around A0%. In step 1702, the vicinity of AO% or the starting point of the variable is set. In the neighborhood setting, the neighborhood size q used by the aforementioned functions can be individually determined, or all of them can be unified. In order to improve the accuracy of the repeated information image 132 created by the data processing device 110 of the present invention, it is better to set all the nearby sizes Q to large. However, the position / size detection device 17 can adjust the size of the rough edge information 112 for calculation of the center of gravity of the object, the size of the input rough edge information image 113, and the like. In step 1703, it is determined whether or not the coarse edge information image 113 is sequentially input. If there is no rough edge information image 113 (step 1703 ··· YES), the algorithm is ended. If there is a rough edge information image 113 (step Π03: No), the process proceeds to step 1704. However, when the array computing device 100 is installed only for a specific image size, it may be set to an infinite loop. In step 1704, 1 area will be input into the rough edge information image 113 of 86. This paper size is applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) (Please read the precautions on the back before filling this page)

498290 A7 _B7___ 5. Description of the invention (0) Pixels in row i and column j. Therefore, the AO% needs to store at least 1 area of image data in the memory 102. In step 1705, the rough edge information 112 of the rough edge information image 113 is converted into the repeated information 131 of the repeated information image 132. The repeated information 131 becomes a band pixel 値 equivalent to 1 or 0. In step 1706, AOUu communicates with the nearby array computing device 100, and calculates the movement amount for each band pixel of the repeated information image 132 according to the function Δv00. Band pixels that are imaged by the amount of motion will be treated as band pixels of the amount of motion image. In step 1707, the AO% communicates with the nearby array computing device 100, and each band pixel of the repeated information image 132 will be moved to the moving amount indication place according to the function AukQ0. The band pixels after the movement will be treated as band pixels of the new repeated information image 132. In step 1708, it is judged whether the number of movements indicating the number of repetitions from step 1706 to step 1707 has reached the specified number. If the number of movements has not reached the specified number (step 1708: NO), it returns to step Π06. If the number of moves reaches the specified number (step 1708: YES), it moves to step 1709. The specified number of times is determined according to the size of the formed edge information image 115 or the size of the object indicated by the formed edge information 114 and the nearby size q. If you set appropriate parameters in conjunction with the purpose of use, it is not a problem even if you specify a large number of times, but if you specify too many times, the time required to detect the position and size will become longer. In step 1709, the AO% will communicate with the nearby array computing device 100. For each band pixel of the repeated information image 13 2, it will be in accordance with the function 87. This paper size applies the Chinese National Standard (CNS) A4 specification (210 x 297) ) (Please read the notes on the back before filling this page)

498290 A7 _B7_ V. Explanation of the invention (4) • △ # 00 calculates the movement amount. Band pixels that are imaged by the amount of motion will be treated as band pixels of the amount of motion image. In step 1710, AOU. · Using communication with the nearby array computing device 100, for each band pixel of the repeated information image 132, it will be moved to the position indicated by the movement amount according to the function AUk (20). The band pixel after the movement will be regarded as new The band pixels 値 of the repeated information image 132 are processed. In step 1711, the band pixels 重复 of the repeated information image 132 are output. After that, the process returns to step 1703. In addition, each of the repeated information 131 of the repeated information image 132 is expressed as The position is the total number of rough edge information 112 around the center, and the result becomes the size of the object centered at the position. Therefore, using the data processing device 110 composed of the array computing device 100, the position / size detection device 17 The edge information image 113 is made into a repeated information image 132. In this algorithm of FIG. 28, if the object area image 142 representing the object area 141 is used instead of the coarse edge information image 113 composed of the coarse edge information 112, it will be as shown in FIG. As shown, the position / size detection device 17 implemented by the data processing device 110 can also be created from an object area image 142 representing the object area 141 The repeated information image 132 of the repeated information 131 is displayed. However, when the object area image 142 is used, each repeated information 131 of the repeated information image 132 indicates the total number of pixels of the object area 141 centered on the position, so the result will be expressed as The area of the object at the center. Therefore, to obtain the size of the object from the repeated information image 132, pay attention to the square root of the repeated information 131. Also, use the edge information shadow to form the paper. 88 This paper scale is applicable to the Chinese National Standard (CNS) A4 size (210 X 297 mm) (Please read the notes on the back before filling this page)

498290 A7 _ _B7_ V. Description of the invention (F " i) • The same is true for 115 and color information image 172. As shown in FIG. 30, the position / size / tilt detection device 44 implemented by the data processing device 110 is used to create a rough edge information image 113 with coarse edge information 112 as pixels and repeat information 131 as pixels. The information image 132 is repeated, and the array computing device 100 arranged in a grid form moves in parallel and synchronously. If the array computing device 100 arranged in i rows and j columns on the grid is regarded as AO1 ^, the AO% algorithm will be as shown in FIG. 31. In step 4401, A0% is arranged on the i row: j column of the grid. Whether this is theoretical or practical, it must be decided around the AO%. In step 4402, the vicinity of AOUij or the starting point of the variable is set. In the neighborhood setting, the neighborhood size q used by the aforementioned functions can be individually determined, or all of them can be unified. In order to improve the accuracy of the repeated information image 132 produced by the data processing device 110 of the present invention, it is better to set all the nearby sizes q to large. However, the position / size / inclination detection device 44 can be changed according to the need to change the appropriate nearby size for processing due to the calculation time of the center of gravity of the rough edge information 112 of the object and the size of the rough edge information image 113 to be input. In step 4403, it is judged whether the coarse edge information image 113 is input in order. If there is no rough edge information image 113 (step 4403: YES), the algorithm ends. If there is a rough edge information image 113 (step 4403: No), the process proceeds to step 4404. However, when the array computing device 100 is installed only for a specific image size, it can also be set to infinite loop. In step 4404, pixels of one row and column j of the rough edge information image 113 are divided into one area. Therefore, ΑΟΙ ^ needs to store at least 1 area of the image. 89 This paper size applies to the Chinese National Standard (CNS) A4 (210 X 297 mm) (Please read the precautions on the back before filling this page)

498290 A7 _B7_ V. Memory 102 for the description of the invention (f /). In step 4405, the rough edge information 112 of the rough edge information image 113 is converted into the repeated information 131 of the repeated information image 132. The repeated information 131 becomes a band pixel 値 equivalent to 1 or 0. Repeated information for 8 other mobile sources is 183, which will be confusing with band pixels equivalent to 0. In step 4406, AO% communicates with the nearby array computing device 100, and for each band pixel of the repeated information image 132, the movement amount is calculated according to the function △. Band pixels that are imaged by the amount of motion will be treated as band pixels of the amount of motion image. In step 4407, the AO% communicates with the nearby array computing device 100, and each band pixel of the repeating information image 184 of the moving source will be moved to the moving amount indication place according to the function AijkQ0. The band pixels 値 after the movement will be treated as band pixels 重复 of the new moving source repeat information image 184. In step 4408, the AO% communicates with the nearby array computing device 100, and for each band pixel of the source repeated information image 132, it will be moved to the moving amount indication place according to the function AUkOO. The band pixels 値 after the movement are treated as band pixels 新 of the new repeated information image 132. In step 4409, it is judged whether the number of movements indicating the number of repetitions from step 4406 to step 4408 has reached the specified number. If the number of movements has not reached the specified number (step 4409: NO), it returns to step 4406. If the number of moves reaches the specified number (step 4409: YES), it moves to step 4410. The specified number of times is determined based on the size of the rough edge information image 113 or the size of the object indicated by the rough edge information 112 and the nearby size q. (Please read the notes on the back before filling out this page)

498290 A7 _ B7___ 5. Description of the invention (β). If you set the appropriate parameters in conjunction with the purpose of use, it is not a problem even if the number of specified times is determined, but if the number of specified times is too much, the time required to detect the position, size, and inclination will become longer. In step 4410, AO% will use 100 to communicate with the nearby array computing device 100, and for each band pixel of the repeated information image 132, the movement amount will be calculated according to the function △ ukQO. Band pixels that are imaged by the moving amount will be treated as band pixels of the moving amount image. In step 4411, AO% will use 100 to communicate with the nearby array computing device 100 to repeat the information image 184 for the moving source. Each band pixel 値 will be moved to the position indicated by the movement amount according to the function AUk (20). The band pixel 移动 after the movement will be treated as a band pixel 新 of the new repeated information image 132. In step 4412, AO % Will use 100 to communicate with the nearby array computing device, and for each band pixel of the repeated information image 132, it will be moved to the amount of movement according to the function AUk (20. The band pixel after the movement will be Processed as band pixels of the new repeated information image 132. In step 4413, it is judged whether the number of retractions indicating the number of repetitions from step 4406 to step 4412 has reached the specified number. If the number of retractions has not reached the specified number (step 4413) : NO), it will return to step 4406. If the number of withdrawals reaches the specified number of times (step 4413: YES), it will move to step 4414. The specified number of times is based on the size of the rough edge information image 113 Or the size of the object indicated by the rough edge information 112 and the nearby size q are determined. If the appropriate parameters are used in conjunction with the purpose, even if the number of designated times is determined, it is not a problem. The time required for the inclination will become longer. 91 ^ The paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 male i '(Please read the precautions on the back before filling this page)

^ 8290 A7 ~ B7 One or five, the description of the invention (0) --------------- I (Please read the precautions on the back before filling this page) Step 4414, duplicate information will be output The band pixels 値 of the image 132 and the band pixels 移动 of the moving source repeat information image 184. Then it returns to step 4403. In addition, since each of the repeated information 131 of the repeated information image 132 indicates the total number of coarse edge information 112 on the periphery with its position as the center, the result becomes the size of an object centered on the position. Also, because there is moving source repeat information 183 'only when the repeat information 131 has pixels, the result becomes the inclination of the object centered on the position. Therefore, using the data processing device 110 constituted by the array computing device 100, the position / size / tilt detection device 44 can create a repeating information image 132 from a rough edge information image 113 and a moving source repeating information image 184 °. In the algorithm, the formed edge information image 115 composed of the formed edge information 114 may be used instead of the rough edge information image 113 composed of the rough edge information 112. If an object area image 142 representing the object area 141 is used instead of the coarse edge information image 113 composed of the coarse edge information 112, then as shown in FIG. 32, the 'position / size / tilt detection device 44 may The object area image 142 is a duplicate information image 132 and a moving source duplicate information image 184. However, when the object area image 142 is used, each repeated information 131 of the repeated information image 132 indicates the total number of pixels of the object area 141 centered on the position, so the result will be the area of the object centered on the position. Therefore, to obtain the size of the object from the repeated information image 132, it is necessary to take the square root of the repeated information 131, etc. The same applies when a color information image 172 composed of color information 171 indicating the presence or absence of a specific color of the object is used instead of the object area image 142. 92 This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 ___B7__ V. Description of the invention So far, it has explained the information from the coarse edge information image 113, the formation of the edge information image 115, and the object area image 142 and color information image 172 create a method of moving source repeat information image 184. The following describes how to obtain the tilt angle of an object from the moving source repeat information 183. First of all, as shown in Figure 17, the mobile source repeating information 183 using nearby 1 to nearby 8 as the moving source is regarded as N1 S {N8 respectively, and the inclination angle 0 expressed by counterclockwise will be based on the formula Find it out. The tilt angle Θ is expressed in radians. If the object is horizontal and vertical, the tilt angle θ will be 0 radians. arctan (^ ± g |)-f if iVl + ΑΓ5 > iV3 + ΝΊ,) (47) arctan (^ | ^ ~ |)-| otherwise. For example, the mobile source repeat information 183 from N1 to N8 becomes the 33rd In the figure, the inclination angle 0 is approximately 0.4 radians. Although the formula 47 is a simple formula for obtaining the inclination angle β, it is a matter of course that the user of the present invention can obtain the inclination angle 0 more accurately if conditions more detailed than the formula 47 are used. For example, if the array computing device 100 in the eighth item of the patent application calculates the formula 47, the array computing device 100 can output a smaller amount of data if it is compared with the output of repeated information 183 from eight mobile sources. Moreover, if the inclination angle 0 can also be expressed by a certain number, the memory 102 only needs to store a file of the inclination angle upwards relative to the logarithmic table. In Figures 30 and 32, although for a single object, the rough edge information image 113 and package containing the rough edge information 112 will be created, the paper size of this paper applies the Chinese National Standard (CNS) A4 specification (21 〇X 297 mm) (Please read the notes on the back before filling in this page)

498290 A7 _____B7 _ V. Description of the invention Λ) Object area image 142 including object area 141 Input position / size / tilt detection device 44, but even if there are multiple objects, position / size / tilt detection device 44 can detect Individual object position, size and inclination. When the color information image 172 has a structure as shown in FIG. 34, the position / size / inclination detection device 44 can also detect the position, size, and inclination from the blocks of the individual color information 171. Therefore, the position / size / tilt detection device 44 can also be used for structural analysis. As shown in FIG. 35, the area normalization device 27 implemented by the data processing device 110 is used to create an image including an object area image 142 including an object area 141 and a digital image 111 including a separate object area 143 overlapping the object area 141. In the normalized image 145 of the normalized area 144, the array computing device 100 arranged in a grid shape moves in parallel and synchronously. If the array computing device 100 arranged in i rows and Γ columns on the grid is regarded as AOUij, the AOl ^ algorithm will be as shown in FIG. 36. In step 2701, AO% is arranged on the rows i and j of the grid. Regardless of whether this is theoretical or practical, it must be decided around 0101 ^. In step 2702, the vicinity of AO% or the starting point of the variable is set. In the neighborhood setting, the neighborhood size q used by the aforementioned functions can be individually determined, or all of them can be unified. In order to improve the accuracy of the normalized image 145 prepared by the area normalization device 27 of the present invention, it is better to set all the nearby sizes q to be large. However, because of the calculation time for normalizing the separated object area 143, the size of the digital image 111 to be input, etc., the area normalization device 27 can change the appropriate nearby size to handle the need. In step 2703, it will be judged whether the image of the object area has been input in order. 94 This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) (Please read the precautions on the back before filling this page)

498290 A7 _B7_ V. Description of the invention (fl) .142 or digital image 111. If there is no object area image 142 or digital image 111 (step 2703: YES), the algorithm ends. If there is an object area image 142 or a digital image 111 (step 2703: NO), the process proceeds to step 2704. However, when the array computing device 100 is installed only for a specific number of bands and image size, it may be set to an infinite loop. In step 2704, one area is input into the object area | domain image 142 pixels in row i and column J, and the digital image 111 in row j column. This is because AO% processes the pixels in row i and column j of the object area image 142 and the pixels in row ^] of the digital image 111 in a batch. Therefore, at least 01 ^ needs to store at least a memory 102 of the total band of image data. In step 2705, pixels in the i-th column of the object area image 142 and pixels in the i-th and j-th column of the digital image 111 are separated. This is because AO% treats the pixels in the “i-row” column of the object area image 142 and the pixels in the “i-row j” column of the digital image 111 as separate pixels. If the pixels in row i and row j of the object area image 142 and pixels in row i and row i of the digital image 111 are separated and input from the beginning, no processing is necessary. The object area image 142 and the digital image 111 are copied to the updated object area image and the updated digital image, respectively. In step 2706, the AO% communicates with the nearby array computing device 100, and calculates the movement amount of each band pixel of the object area image according to the function RmOO. Band pixels that have been imaged with motion are treated as band pixels that are imaged with motion. In step 2707, the AO% communicates with the nearby array computing device 100. For each band pixel of the object area image update, the function can be applied to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) in accordance with the function 95 paper size. (Please read the notes on the back before filling this page)

498290 A7 _____ B7_____ — V. Description of the invention (? 少 • Huk (2L, I) finds a pixel in a moving zone that can be moved. It indicates whether a pixel in a moving zone is considered a zone pixel in a movable image. Processing. In step 2708, AOUij communicates with the nearby array computing device 100, and will update each band pixel of the object area image according to the function Uijk (2L, Ϊ) to move it. The domain pixels will not be treated as new band pixels of the new object area image. In step 2709, A0% penetration will communicate with the nearby array computing device 100, and the band pixels of the digital image will not be updated. According to the function Uljk (2L, move it to a movable place. The moving band pixels will be treated as the band pixels of the new digital image. In step 2710, it will be judged that from step 2706 to step 2709. Has the number of repetitions reached the specified number of times. If the number of repetitions has not reached the specified number of times (step 2710 · · NO), it returns to step 2706. If the number of repetitions has reached the specified number of times (step 2710) : YES), it will move to step 2711. In addition, the specified number of times is determined based on the size of the digital image 111 or the size of the separated object area 143 of the digital image 111, and the nearby size Q. If the setting for the use purpose is appropriate As for the parameter, even if the number of designated times is determined, it is not a problem, but if too many designated times, the time required for normalization will become longer. In step 2711, AO% will use 100 to communicate with the nearby array computing device. Each band pixel of the updated object area image will be completed according to the function Vuk0L and the average value of the vicinity. And ^ is the updated object area image. The band pixels placed by the average value will be treated as The band pixels of normalized updated object area images are processed. 96 This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) (Please read the precautions on the back before filling this page)

498290 A7 _____ _B7_____ 5. Description of the invention ---- I ------------ (Please read the precautions on the back before filling this page) In step 2712, AO% will be used to calculate with nearby arrays. The device 100 communicates, and for each band pixel of the updated digital image that has completed the movement, it will be entered according to the function VUkoL, with a nearby average. And 2L · is for updating the digital image; it is for updating the image of the object area. Band pixels 値 塡 that are averaged in are treated as band pixels 更新 that are normalized to update the digital image. In step 2713, it is judged whether or not the number of complements representing the number of repetitions from step 2711. to step 2712 has reached the specified number. If the number of replenishments has not reached the specified number (step 2713: NO), it returns to step 2711. If the number of corrections reaches the specified number (step 2713: YES), the process moves to step 2714. Generally, the number of replenishment is about one and a half times of the nearby size q. Line · In step 2714, it is judged whether or not the number of continuations indicating the number of repetitions from step 2706 to step 2713 has reached the specified number. If the number of continuations has not reached the specified number (step 2714: NO), it returns to step 2706. If the number of continuations reaches the specified number (step 2714: YES), the process moves to step 2715. In addition, the specified number of times is determined based on the size of the digital image 111 or the size of the separated object region 143 of the digital image 111 and the size Q of the vicinity. If appropriate parameters are used in conjunction with the purpose of the project, it is not a problem even if the number of specified times is determined, but if the number of specified times is too large, the time required for normalization will become longer. In step 1715, the band pixels 更新 of the updated digital image are output as band pixels 正 of the normalized image 145. After that, it returns to step 2703. Therefore, using the data processing device 110 composed of the array computing device 100, the area normalization device 27 can obtain the image 142 and the digital image 97 of the object area. This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290. A7 _________B7_____ 5. Description of the Invention (ft) The image 111 is used to create a normalized image 145. As shown in FIG. 37, in order to create a mask image 148 from the digital image 111 and the object area image 142, the mask computing device 40 implemented by the data processing device 110 is synchronized in parallel with the array computing device 100 action. If the array computing device 100 arranged in i rows and j columns on the grid is regarded as AO%, the [] AOIV algorithm will be as shown in FIG. 38. / In step 4001, AO% is arranged on row i and column j of the grid. Whether this is theoretical or practical, it must be decided around the AO%. In step 4002, the vicinity of AO% or the starting point of the variable is set. In step 4003, it is determined whether there is a digital image 111 or an object area image 142 input in order. If there is no digital image 111 or object area image 142 (step 4003: YES), the algorithm will end. If there is one of the digital image 111 or the object area image 142 (step 4403: NO), the process proceeds to step 4004. However, when the array computing device 100 is installed only for a specific number of bands and image size, it can also be set to an infinite loop. In step 4004, the digital image 111 and the object region image 142 are entered in line i of the band. Column of pixels. This is because AO% processes the pixels in rows i and j of the digital image 111 and the object area image 142 in a batch. Therefore, 80% needs to store at least 100% of the image data of the band. 102 ° In step 4005, for each band pixel of the digital image 111, mask processing is performed according to the function 0Uk0L. Masked band pixels are treated as band pixels of the mask image 148. In step 4006, the band pixels 値 of the mask image 148 are output. 98 of this paper size is in accordance with Chinese National Standard (CNS) A4 specification (21〇X 297 mm) (Please read the precautions on the back before filling this page). -Line- 498290 A7 _____B7 ___ V. Description of the invention (% ) • Then go back to step 4003. ---- 1 ---- II ------ (Please read the precautions on the back before filling this page) Therefore, using the data processing device 110 composed of the array computing device 100, the masking device 40 can cover It covers outside the separated object area 143 in the digital image 111. In order to store the normalized image 145, the image holding device 39 implemented by the data processing device 110, the array computing device 100 arranged in a grid shape moves in parallel and in parallel. If the array computing device 100 arranged in i rows and j columns on the grid is regarded as AO%, the AOIV algorithm will be as shown in FIG. 39. In step 3801, AO% is arranged on rows i and j of the grid. Whether this is theoretical or practical, it must be decided around the AO%. In step 3802, the vicinity of AO% or the starting point of the variable is set. -Line · In step 3803, it is judged whether or not the normalized image 145 is sequentially input. If there is no normalized image 145 (step 3803: YES), the algorithm ends. If there is a normalized image 145 (step 3803: NO), it proceeds to step 3804. When the array computing device 100 is installed only for a specific image size, it can also be set to infinite loop. In step 3804, the pixels in the i-th row and the j-th column of the normalized image 145 are input with the number of domains. Therefore, at least AO% needs to store the image data with the number of domains of the memory 102. In step 3805, if the output device is necessary, the format of the normalized image 145 will be converted. In particular, the number of bands of the normalized image 145 is set to 1: If the number of bands of the digital image 111 is 4 or more, the number of bands of the normalized image 145 is set to 3, which is easy to create an analog signal. Otherwise, do nothing. 99 This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 public love) 498290 A7 V. Description of the invention (U) In step 3806, in order to reliably transfer the image data to the device with different processing speed, Pixels in rows i and j of the normalized image 145 are stored. In step 3807, the band pixels 値 of the normalized image 145 are output. After that, it returns to step 3803. Therefore, using the data processing device 110 'composed of the array computing device 100, the image holding device 39 can output the normalized image 145. The image holding device 39 that maintains the digital image 111 and the mask image 148 also operates in the same manner. Here it is explained that the data processing device 11 inputs 1 or 2 images for neighborhood processing to image processing image storage device 12, color information generating device 41, edge information generating device 14, edge information forming device 15, The size detection device Π, the position / size / inclination detection device 44, the area normalization device 27, the mask device 40, and the image holding device 39. However, the pattern matching device 38 must use a very large number of images. Therefore, the following is a description of the neighborhood processing used by the pattern matching device 38, and a description of a method of implementing the pattern matching device 38 using the data processing device 110. First, the normalized image 145 is taken as 2L; the n template images 146 are taken as ff, ,, / ,, and y. If a natural number g is used, the matching result σ⑴ of the i row and j column of the matching result image 147 will be compared with the pixel of the i row and j column of the normalized image 145 and the template image 146 according to Formula 48. The number of pixels of the template image 146 of the pixel. : In addition, because the matching result image 147 is a single-band domain image, it will be processed with the right number of upper-band domains. Therefore, the third plus word of the matching result ° · ⑴ is 1. 100 _____ 一 ---- This paper size is applicable to China National Standard (CNS) A4 (210 x 297 mm) --------------------- Order- -------- Line (Please read the notes on the back before filling this page)

498290 A7 B7 Five (48), Invention Description (IF) 9 if Zhi ^ ijk-Vijk) 2 = minx ^^ n Ek (xijk-y ^ jkY for 1 < ^ < n and only one of 0 otherwise. In The matching result created according to formula 48 does not have to be unified in the matching result image 147. When there are many sample images I46, the possibility of the matching result image 147 becoming mosaic-like is very high. Therefore, the data processing device 110 has a high probability of The method of calculating a rectangular map of the matching results in the vicinity of q and converging the matching result σ⑴ is shown below. When any single-band image ^ is the matching result image 147, if the natural number g, real numbers u and V are used, the matching result image 147 will be updated according to formulas 49 and 50. In addition, because the matching result image 147 is a single-band domain image, it will be treated as an expedient upper-band domain number 1. Therefore, the third subscript of the function --------- ----- 装 —— (Please read the precautions on the back before filling this page) r = < 9 if ^ ijl) Σρ (ί, 77ΐτ1) € Pι; ι (^) ^ Iml) ^ maxx < / l < n {eq (/ i, Xiji) + and 2 [eq (g, Xiji) + Σρ ^ τη ^ βΡιΜς) e < l (9iximi)} > Niji fov 1 < g < n and o nly one of g1 0 otherwise. (49)-line · eq (乜, i;) 1 if u = r, 0 otherwise. (50) The data processing device lio repeatedly calculates the formula 49 after the matching result image 147 does not change. And formula 50, the matching result of the matching result image 147 as a whole can be converged. At this time, the 101 L ^ g scale of the normalized image 145 and the template image 146 is applied to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 ____B7_____ V. Description of the invention (θ) • Combination, the matching result will be as follows convergence. If about half of the pixels of the normalized image 145 are most similar to the pixels of the specific template image 146, almost the matching result of the matching result image 147 will converge to this specific template image 146 number. However, if the pixel blocks of the normalized image 145 are similar to the pixel blocks of several different template images 146, the number of blocks of the template image 146 surrounded by 0 will be generated in the matching result image 147. Furthermore, if the normalized image 145 has no correlation with the set of template images .146, the matching result of the matching result image 147 is almost zero. Therefore, the pattern matching realized by the data processing device I10 is difficult to specify the template images 146 that are most like the normalized images 145. Low is to select several similar template images 146 from the template images 146. Therefore, in the process of preparing the recognition result from the result of pattern matching, the matching result image 147 created by using pattern matching only needs to select the most powerful candidate from the similar candidates of the template image 146. As shown in FIG. 40, the pattern matching realized by the data processing device 110 is used to create a matching result image 147 composed of a matching result representing the image number of the normalized image 145 in the template image 146, arranged in a grid pattern. The array computing device 100 operates synchronously and in parallel. If the array computing device 100 arranged in i rows and j columns on the grid is regarded as AOUij, the Bayou J AOUu algorithm will be as shown in FIG. 41. In step 2901, A0% is arranged on i rows and j columns on the grid. Whether this is theoretical or practical, it must be decided around A0%. In step 2902, the vicinity of A0% or the starting point of the variable is set. In the neighborhood setting, the neighborhood size q used by the aforementioned functions can be individually determined, or all of them can be unified. In order to improve the data processing device 110 to 102 of the present invention, the paper size is applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) ----------------- (please first Read the notes on the back and fill in this page again.) Order-· Line 498290 A7 ____B7______ 5. The correctness of the matching result image 147 described in the invention, so it is better to set all nearby size Q to large. However, due to the update of the calculation time of the matching result, the size of the normalized image 145 that is input, etc., the pattern matching can be processed according to the need to change the appropriate nearby size. In step 2903, it is determined whether or not the template images 146 are sequentially input. If there is no template image 146 (step 2903: YES), the process proceeds to step 2905. If there is a template image 146 (step 2903 ··· NO), the process proceeds to step 2904. In step 2904, the pixels of the i-th row and the J-th column of the template image 146 are input with the number of domains. Therefore, at least AO% needs to store a memory 102 having pixel data of the number of bands and the number of template images 146. After that, it returns to step 2903. In step 2905, it is determined whether there is a normalized image 145 that has been sequentially input. If there is no normalized image 145 (step 2905 ··· YES), the algorithm ends. If there is a normalized image 145 (step 2905: NO), it proceeds to step 2906. When the array computing device 100 is installed only for a specific image size, it can also be set to infinite loop. In step 2906, the pixels in the i-th row and the j-th column of the normalized image 145 are input with the number of domains. Therefore, the AO% needs to store at least the memory 102 with pixel data in the number of domains. In step 2907, the matching result σ⑴ of the matching result image 147 is calculated from the normalized image H5 and the template image 146. The matching result will be the band pixel 値 〇103 II n I nn I n ί ii ii I 0 emmmm I which is closest to the normalized image 145 of the template image 145 (Please read the precautions on the back before filling this page) Order ·· --- line · This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) 498290 A7 _____ B7 ____ 'V. Description of the invention (P /) ---------- ---- Install --- (Please read the precautions on the back before filling this page} In step 2908, AO% communicates with the nearby array computing device 100, and for each band pixel of the matching result image 147 値The matching result will be updated according to the function. The updated band pixel will be treated as the band pixel of the matching result-fruit image 147. The function here will be repeated until the band pixel of the original matching result image 147. No change. However, according to the calculation time requirements, the quality of the input edited image 145, the quality sought on the updated matching result image 147, etc., it is better to finish the calculation with an appropriate number of iterations. Steps In 2909, a matching result is output Band pixels 値 like 147. After that, it returns to step 2905. Therefore, using the data processing device 110 composed of the array computing device 100 and the pattern matching in the image recognition device 29, a matching result image can be made from the normalized image 145 147.-Line · So far, the use of the data processing device 110 composed of the array computing device 100 has been described to perform image processing with only neighborhood processing. The following is the description of the use of the array computing device 100 The data processing device 110 is composed of an object / background separation device that uses only neighborhood processing. 16 First, a nonlinear vibrator will generally cause a pull-in phenomenon. The so-called pull-in phenomenon is a limit-cycle or suction In the case of periodic actions such as an attractor, non-linear vibrators with different periods are constrained to interact with each other and vibrate at a simple constant ratio. At this time, if the vibration of a non-linear vibrator is changed , Because other non-linear vibrators also change, these non-linear vibrators are synchronized with each other. And it is applicable to China with 104 paper scales Home Standard (CNS) A4 Specification (210 X 297 mm) 498290 A7 B7 V. Description of Invention (PI) Adjusting the interaction of the non-linear vibrator can make the vibration difference between each other as small or large as possible. Therefore, if By operating this interaction, a group of nonlinear oscillators can be divided into a plurality of groups with different phases. The object / background separation device 16 uses the pull-in phenomenon of such a nonlinear oscillator to make the edges in the edge information image The information becomes a boundary to separate the object from the background, and an object region image 142 representing the object region 141 is generated. In addition, here, the case where Van-der-Pole is used as a nonlinear oscillator is taken as an example. First, in a non-linear vibrator network composed of non-linear vibrators arranged in a grid, if the non-linear vibrators in the i-th row and j-columns are taken as ω, then they are near the q of the non-linear vibrator. The set of non-linear oscillators (Ω) will be expressed according to Formula 51. However, q is a continuous sequence of 4, 8, 24, 48, 80, 120, (2r + l) 2-l, and r is a natural number. In addition, when the nonlinear vibrator beyond the network size range is included in the nearby set QJq), the nonlinear vibrator 6 ^ will be used instead. Therefore, edge processing occurs automatically. Therefore, the number of elements in the nearby set is usually q. It is judged from this that the nonlinear oscillator network will be treated the same as a single area pixel. For simplicity, the subscripts in the nonlinear oscillator network only use two types of width and height: if q {ωι ^ τη ^ < l < i + r, j-r < m < j + r, ωιιΤη φ uid} if g = (2r + l) 2 — 1 · 105 This paper size applies to China National Standard (CNS) A4 (21〇X 297 mm) (51) (Please read the notes on the back first (Fill in this page again)

498290 B7 V. Description of the Invention (f ^) Next, the nonlinear vibrator gathers Ω near Qa

The non-linear oscillators on Jq) are combined using the combination 値 calculated according to the formula. In addition, without using a logarithmic table, it can be very close to using formula 53. And #, ^ are appropriate normal numbers. r π (52) 1 — 2 \ x \ 2 + \ x [c if 0 < | x | < 1, sinc (x) ^ 4 — 8 |: r | + 5 | 工 | 2 — | z | 3 if 1 < \ x \ < 2, 〇otherwise. (53) When all the non-linear oscillators of the non-linear oscillator network are synchronized in exactly the same phase, as long as the processor 101 is used to calculate, the non-linear oscillator is Doing 6 ^ "will continue the same phase action permanently. Therefore, in the event of external disturbances, such a situation can be avoided. Suspected random numbers can also be used as external disturbances, but they can be obtained using a simple formula such as Equation 54. In addition (ij indicates whether there is edge information in the i row and j columns of the edge information image. If there is edge information, it is regarded as 1; if it is not, it is regarded as 0. And / c is an appropriate normal number.

Pij = (54) The non-linear oscillator ω ij is synchronized with the non-linear oscillator kl of the nearby set Ω yq), so the total nearby input ση is calculated according to Formula 55. (55) 106 (Please read the notes on the back before filling this page)

This paper size applies to Chinese National Standard (CNS) A4 (210 X 297 mm) 498290 A7 V. Description of the invention (/ 〇V) (Please read the precautions on the back before filling this page) constitutes Van-der-Pole non The two parameters of the linear vibrator ... and Ψϋ will be calculated according to Equation 56 and Equation 57. R and ε are appropriate positive constants. = φ .. dt (56) ^^ 一 7 知 —— 4) know + σ ”. + ~ (57) Although to separate the non-linear oscillator into the object region 141 and the background region, all the non-linear vibrations must be calculated The phase shift of the sub-element is simply separated into two areas: the object area 141 and the background area, so the parameter will calculate the phase offset based on whether the limit is 以上 0 or more or less. The output separates the object area 141 from the background area. The output of the result can be obtained by formula 58. Θ is an appropriate normal number. (1 if ipij > θ, λυ = S (remove 0 otherwise. ^; \ Although the edge information is not sufficient to separate the object from the background, The edge information must be supplemented. Therefore, the number of nonlinear oscillators ω ij (qB) must be found in the set of nonlinear oscillators ω ^ near qB of the nonlinear oscillator ωϋ. Therefore, Equation 59 is used. Calculate contour parameter 7? ”.

Vij = Σ λ ^ 'λ ^ + (χυ) 2 (59) ^ ki ^ ij (Qb) Represents the limiting parameter of the marginal information supplement ratio based on this result Γϋ will be calculated using Equation 60. Α, none, 77_, and 77max are appropriate. 107 The paper size is applicable to the Chinese National Standard (CNS) A4 (21 × 297 mm) ^ ij dt (60) 498290 A7 B7 V. Explanation of the invention Positive constant

Vmin ^ Vij ^ Ήτηαχι / 3 (1 — (fi; ·) otherwise. Although the state of Van-der-Pole, which is a nonlinear oscillator, has been described here, other Brussels machines and intQgrate-and- A nonlinear vibrator with a finite period of stability such as a fire-shaped vibrator, and a chaos vibrator that generates Lorentz-attractor and Roessler's equations, etc., any of the nonlinearities of the pull-in phenomenon The vibrator may also operate. At this time, it is only necessary to replace the parameters and Ψυ with the parameters of individual non-linear vibrators. At this time, only the appropriate parameters are added to the nearby input total σ υ and the external disturbance ρ ^. But chaos In the case of a vibrator, in particular, the external disturbance Pυ is not necessary. Using the formulas 51 to 60, the algorithms of all the array computing devices 100 capable of installing the data processing device 110 of the object / background separation device 16 can be described. The following The algorithm using any array computing device 100 in the data processing device 110 is used to describe the related object / background separation device 16. As shown in FIG. 42, the data processing device 110 is used to implement The object / background separation device 16 needs to use the edge information 151 of the triangle to separate the inner area 152 and the outer area 153 of the triangle. The array computing device 100 arranged in a grid will move in parallel and synchronously. Row i on the grid: The array computing device 100 in column i is regarded as AOUij, and the AO% algorithm will be as shown in Figure 43. In step 1601, A0UH is arranged in row i on the grid: 108 papers on column i Dimensions are applicable to China National Standard (CNS) A4 (210 X 297 mm) (Please read the precautions on the back before filling this page)

498290 A7 -------- B7 V. Description of the invention (〖〇L) 〇 In step 1602, it is connected with 公式 τ Ukl according to formulas 52 and 53 to connect nearby peers and wkl. In step 1603, an appropriate initial value 设定 is set on the parameters Φ ·· and ^^ of the nonlinear oscillator. In step 1604, it is determined whether or not the edge information image 115 is sequentially input. If no edge information image 115 is formed (step 1604: YES), the algorithm will end. If an edge information image Π5 is formed (step 1604: NO), the process proceeds to step 1605. However, when the array computing device 100 is installed only for a specific number of bands and image size, it can also be set to infinite loop. In step 1605, Γ ij forming the edge information 114 is input. In step 1606, the chaos p ij is calculated from the Γ u of the edge information 114 that was just input according to formula 54. In step 1607, AoUkl of the array computing device 100, which has the nonlinear vibrator okl in the nearby set Qij (Qa), is input, and the total 値 σ ij is calculated according to formula 55. In step 1608, the parameters Φ ^ and Ψ ij of the nonlinear oscillator are calculated according to Equations 56 and 57. That is, the solutions of the differential equations represented by these formulas are obtained by the Runge-Kutta method. In step 1609, the output time u of the nonlinear oscillator is calculated according to Formula 58. Here, if Ψϋ-0, it will be treated as λ 1, if it is other, it will be treated as U; In step 1610, there will be a non-linear vibration in the nearby set. 109 The paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) ---------------- -----Order --------- (Please read the precautions on the back before filling out this page) 498290 A7 ______B7____ V. Description of the invention C]) A 0ki array computing device A〇〇 of A〇 ukl input; lij, then calculate the contour parameters ^ according to formula 59. In step 1611, the boundary parameters are calculated according to formula 60. That is, use the difference method or the Rugen Gotthard method to find the solutions of the differential equations represented in these formulas. In step 1612, it is judged whether the number of separations indicating the number of repetitions from step 1606 to step 1611 has reached the specified number. If the number of separations has not reached the specified number (step 1612: NO), the process returns to step 1606. If the number of separations reaches the specified number (step 1612: YES), the process moves to step 1613. In step 1613, the output λ ij of the non-linear vibrator of the band pixel 値 which becomes the object region image 142 is output. After that, it returns to step 1604. In addition, to obtain the number of separations in step 1612, the following method can be used. On the object / background separation device 16, if the image size is constant, regardless of the initial state of the non-linear vibrator, almost all of the formation edge information 114 will be separated at a predetermined time. The story first calculates the time, and then Calculate the number of iterations from step 1606 to step 1611. This is because if the initial state of the nonlinear oscillator is within a certain range, there will not be a great difference in time between the pull-in phenomenon and the synchronization of the nonlinear oscillator. In this way, only the nonlinear vibrator is calculated, the edge information 151 of the triangle can be used to separate the inner region 152 and the outer region 153 of the triangle due to the pull-in phenomenon that uses the properties of the nonlinear oscillator. That is, when two non-linear vibrators are combined with a positive combination 値, they are in the same phase, or when they are combined with a negative combination 値, the phase difference becomes large. Take advantage of this property 110 This paper size applies to Chinese National Standard (CNS) A4 (210 X 297 mm) (Please read the precautions on the back before filling this page)

498290 A7 ____B7 _

V. Explanation of the invention (/ A, the non-linear vibrators arranged on the grid are combined with the positive combination of similar companions, and the non-linearly coupled non-linear vibrator companions will become the same phase. If they are combined with negative, Combined with the non-linear vibrator companion on the pixel place enclosing the edge information 114, the two sides of the edge information will be offset from each other as much as possible. In this way, the triangle information can be used without combining all the non-linear oscillators. The inner and outer sides of 151 gather different phases. Therefore, the object / background separation device 16 is separated into the inner region 152 of the triangle and the outer region 153 of the triangle as shown in FIG. 42. At this time, the inner region 152 of the triangle and the outer side of the triangle are separated. The phase difference of the region 153 is as much as possible beyond 90 degrees and close to 180 degrees, and the triangle and the background region can be separated. In this embodiment, it is important that in this embodiment, the method shown each time the edge information 114 is formed will be combined. Change to a pseudo-like form. First, formulae 52 and 53 will combine the nonlinear oscillator okl into a nonlinear oscillator 6 ^ The combination is treated as r Ukl (refer to step 1602). It is the same in forming the edge information 114, it is 1 when there is an edge, and 0 if it is not. If you input one of the forming edge information 114 (see step 1605), The AOUij of the array computing device 100 forwards the edge information 114 Γ k 丨 to AO%, and calculates the combination 値 r _ (1— Γ ki) as an alternative to the combination 値 rUkl (refer to step 1607). In conjunction with 値 r _ (ι_rkl), the boundary parameter will be treated as a magnification from 0 to 1 (refer to step 1607). As shown in Figure 44, when the edge information 114 is formed as triangle edge information 154 with a dotted state, Need to complete the dashed line. First use 111 (please read the precautions on the back before filling this page)

This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 ______B7_ V. Description of the invention (丨 〇 ° |). The triangle edge information 154 in the dotted state enables the system to operate (refer to step 1605), then The phase difference between the inside and outside of the triangle edge information 154 in the dashed state is about 90 degrees, but the boundary between the inside and outside of the triangle is not clear. Therefore, each AO% will calculate the output Ay of the non-linear vibrator (see step 1609). When this output λ u is 1, if the non-linear vibrator with Akl of 1 in the nearby non-linear vibrators is regarded as 0 kl, then the parameter Ψ. And Wkl are both above Θ. That is, 'λ ij and λ kl are approximately In the same phase, if Θ is positive, the worst case phase difference will not exceed 90 degrees. The maximum value of this phase difference depends on the value of 0, and will increase if the range of I and λ kl are 1. 6>, this phase difference will be close to 0 degrees. Therefore, using λ u and λ kl, the contour parameter ij representing the number of approximately the same phase in the nearby nonlinear oscillator will be calculated according to formula 59 (refer to step 1610). This contour parameter 7 / ^ is all around If it is about half, it will be reduced to the bounding parameter of the ratio of 値 according to formula 60. If it is not the case, it will be increased according to formula 60 (refer to step 1611). For example, if the number is around 8 and 182 is between 3 and 5 In the meantime, it is good to reduce the boundary parameter according to formula 60. If the process is repeated, when the triangle edge information 154 of the broken line state is set as shown in FIG. 44, it will be separated into the inner area 155 of the broken line triangle and the broken line triangle. Outside area 156. As shown in Figure 45, when two triangles overlap, edge information 157 of the front triangle and edge information 158 of the rear triangle can be obtained. At this time, the inside area 159 of the front triangle and the inside area 160 of the rear triangle can be obtained. The phase of the non-linear vibrator in the three areas of the background area 161 of the double triangle will be offset from each other, so they will be separated into three areas. As shown in Figure 46, 112 This paper scale applies Chinese National Standards (CNS) A4 size (210 X 297 mm) --------------------- ^ --------- ^ (Please read the precautions on the back first (Fill in this page) 498290 A7 ____________B7 __ 、 Explanation of the invention (| (0) •, even if the two overlapping circular edge information 162 are dotted lines, they will be separated into a square-shaped inner area 163 and a rear-shaped inner area 164 and a double-circular background area 3 of 165. Therefore, using the data processing device 110 composed of the array computing device 100, the object / background separation device 16 can use the formation edge information 114 forming the edge information image 115 as a boundary line to separate the object area 141 and the background area. In addition, although the separated regions are read with the passage of time together with the output λ ^, the array computing device 1 () 0 will calculate the phase of the non-linear vibrator. The separated regions can be regarded as The phase group is output on the list. The visual device 2 has been described so far. These vision devices 2 can be installed using a general computer, but when the searched object is a moving object, each of the aforementioned devices must be executed at a high speed according to the moving speed of the moving object. Especially after increasing the image size or resolution of the screen image, the image storage device 12, the color information generating device 41, the edge information generating device 14, the edge information forming device 15, and the position / size detecting device 17 taking the image itself as a processing object The object / background separation device 16, the area normalization device 27, the mask device 40, the image holding device 39, and the pattern matching device 38 are calculated in the width direction and the height direction, and will be equal to the image size or resolution. Increase proportionally. Therefore, the vision device 2 may not achieve the desired performance depending on the application. In order to use digital technology to install image storage device 12, color information generation device 41, edge information generation device M, edge information generation device 15, position / size detection device 17, object / background separation device 16, area regular 113 This paper size is applicable to China National Standard (CNS) A4 specification (210 X 297 public love) (Please read the precautions on the back before filling out this page) Installation-丨 _ 498290 A7 _____ Β7 ___ V. Description of the invention (/ 〖/). 化 装置 27 、 The cover device 40, the image holding device 39, and the pattern matching device 38 arrange the array computing device 100 in the data processing device 110 into a grid shape as shown in FIG. 16, and the array computing device 100 can only process data. The adjacent array computing devices 100 in the device 110 are wired in a communication manner with each other. That is, direct wiring is performed to similar persons in the vicinity of 4. Therefore, compared with the case of wiring 182 similar persons near 8, the same high-speed operation can be performed with fewer electronic parts and wiring amount, and it can be simply expanded when the size of the vicinity is increased in the future. The array computing device 100 is shown in FIG. 47. A processor (PROCESSOR) l (n, which stores all parameters, constants, functions, and operators used in the formula in image processing) (MENORY) ) 102 and a controller 103 (CONTROLLER) 103 for communication with the nearby array computing device 100. The processor 101 can use the address (ADDRESS) specified by the address bus 51 to select the memory 102 and control Any memory component and register of the memory 103. In addition, the processor 101 will be connected to the memory 102 and the controller 103 through the data bus 52 to enable bidirectional communication and access to the addresses specified by the address bus 51 Data (DATA) of any memory element and register. If the array computing device 100 inputs a previous input data group (FRONT INPUR DATA SET) composed of at least one input screen, the controller 103 stores the aforementioned input data group In the memory 102. The controller 103, in addition to transmitting the calculation data in the memory 102 created by the function to the adjacent array computing device 100, also stores the calculation data received from the adjacent array computing device 100 in The memory 102, if necessary, is transferred to the array computing device 100 other than the input. Finally, the controller 103 sets 114 --- I ---------- III 1 1 II order ---- ----- (Please read the precautions on the back before filling this page) This paper size is applicable to China National Standard (CNS) A4 (210 X 297 mm) 498290 A7 ^ _ B7____ 5. Description of the invention (// 1 ) The image data of the output image is output as the result data (RESULT DATA). The reason for installing the controller 103 on each of the array computing devices 100 is that the processor 101 can operate during the communication between the array computing devices 100. Therefore, the processor 101 can use communication to perform high-speed processing after calculation in the waiting time; even if the number of hardware of the array computing device 100 in the vicinity changes, there is no need to change; because the controller 103 processes the edge of the image, that is, The edge pixels in the image will be automatically processed with exceptions, so the program of the processor 101 does not need to do edge processing and becomes very simple. The processor 101 and the memory 102 can use general digital circuits. The details of the controller 103 The circuit diagram of sex is shown in Figure 48 As shown, the address buffer (ADDRESS BUFFER) 53 will receive the address (ADDRESS) from the processor 101 through the address bus (ADDRESS BUS) 51, and use the address decoder (ADDRESS DECODE) 54 to select each bit Address and other functional blocks. The data buffer (DATA BUFFER) 55 will receive the data (DATA) from the processor 101 through the data bus (DATA BUS) 52, and the internal data bus 56 and the address decoder 54 choose The resistors communicate exclusively. The communication direction is specified by READ. When the FLAG REGISTER 57 is specified by the resistor, the data will be stored in the FLAG REGISTER 57 and compiled with the FLAG DECODER 58 and transmitted as a plurality of signals (SIGNALS) to the connected array. Computing device 100. The plurality of signals will be received using the flag encoder (FLAG ENCODER) 59. After being parsed, the signals will be stored in the STATUS REGISTER 60 and regarded as the receiving (RECEIVE) returned to the array computing device of the transmission source 10 (). Receiving is based on the 115 paper size applicable to the Chinese National Standard (CNS) A4 (210 X 297 mm) -------------- install --- (Please read the precautions on the back first (Fill in this page again) t5J · -line- 498290 A7 ___B7_____ V. Description of the Invention (/ ^) • The flag encoder 59 of the transmission source of several signals received the signal and confirmed as a result that the transmission of the plurality of signals was completed. If the status register 60 is selected using an address, the content of the status register 60 will be transmitted to the processor 101 as data through the data bus 52. If the flag encoder 59 receives at least one front input response (FRONT INPUT SEND) corresponding to at least one input image (INPUT IM'AGE), it will read in the input data group (FRONding INPUT) formed by at least one input image DATA SE) The required storage capacity is prepared before the input data register (FRONT INPUT DATA REGISTER). 6 If you use the address to select the input data register 61, the content of the input resistor will be transmitted as data. To the processor 101. After the processor 101 finishes the calculation, it uses the address to select the result data register (RESULT DATA REGISTER) 62. The result data register 62 reads the image data of the output image as the result data (RESULT DATA). At the same time, the flag encoder 59 will transmit the result and send (RESULT SEND). Obtain the data required for calculation from the nearby array computing device 100 as the address selection output data register (OUTPUT DATA REGISTER) 63, and use the data to be sent to the nearby array computing device 100 as the calculation data ( CALCURATION DATA) read the output data address 63. It is then transmitted as computational data on all adjacent array computing devices 100. If a plurality of signals (SIGNALS) are received from the array computing device 100 above, the calculation data will be read into the UPPER INPUT DATA REGISTER 64. After that, if the data address 64 is input from the address selection, the content of the data input register 64 will be transmitted as calculation data. Array computing device 116 from below, left and right This paper size is applicable to China National Standard (CNS) A4 specification (210 X 297 mm) -------------- installed --- (Please read the notes on the back before filling this page)

498290 A7 ____ Β7 _____ 5. Description of the invention (// ^) 100 is the same when receiving multiple signals, the lower input data register 65, the left input data register 66, and the right input data register 67 will do the same. Various buffers, various resistors, and each block of the address decoder 54 are general-purpose electronic circuits. Specifically, the flag decoder 58 and the flag encoder 59 have output and input signals as shown in Figs. 49 and 50. Type (TYPE) indicates the type of content read into the OUTPUT DATA REGISTER 63 with 6 bits. Although this number of bits is all the calculation data that the array computing device 100 should send and receive, it is sufficient. Count — X (COUNT-X) and Count One Y (COUNT-Y) represent integers without 4-bit symbols, respectively, and display the number of transfers between the array computing device 100. When the array computing device 100 transmits the calculation data, each calculation is 0. When the calculation data that has been transmitted is transmitted from the left and right array computing devices 100 again, the count -X of the flag encoder 59 is a sufficient number of 1, and again from the top to the bottom. When the array computing device 100 transmits the calculation data that has already been transmitted, the count -Y of the flag encoder 59 is a sufficient number of one. After the processor 101 specifies on the delivery flag (SENT FLAG) of the flag register 57 to transmit the content of the output data register 63 to one of the up, down, left, and right directions, the flag encoder 58 receives the designation. The central decoder (CENTRAL DECODING) of the address decoder 54 of the output data register 63, and the flag encoder 58 will cooperate with the specified direction of the sent flag to output the delivery (SEND). The delivery flag is represented by 4 bits, and when the calculation data of the array computing device 100 is transmitted to the surrounding array computing device 100, the processor 101 will be set to 1111; if the array computing device 100 from the right is transmitted, The calculation data is transferred to the upper and lower 117 paper sizes applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) -------------------Order- ------- line (Please read the notes on the back before filling this page) 498290 A7 ____B7_

V. Description of the invention (/ 〖P When the left side, the processor 101 will be set to 1110; when transferring from the left to the top and bottom right, it will be set to 1101; when transferring from the bottom to the top, it will be set to 1000; from the top to the bottom The time is set to 0100. Therefore, it is not only unnecessary to repeat the efficient transfer when transferring, but also the rules for determining the transfer direction are clear. Therefore, using the combination type, count-X and count-Y, the flag encoder 59 can determine whether to start from Which array computing device 100 transmits which kind of calculation data. While the calculation data on the result data register 62 is read as the result data, the flag decoder 58 receives the result decoding (RESULT DECODING) and transmits the result Delivery (RESULT SEND) If the flag encoder 59 receives delivery in any of the four directions, it will receive the type and count -X, count -Y of the receiving direction, and update the status register 60 of that part. At the same time as the update, it will be set to 1 in the receiving direction and sent after receiving. The receiving from the flag encoder 59 of the array computing device 100 of the transmission source will become 1 again, and it will be updated. RECEIVE STATUS of the state register 60. Therefore, in each array computing device 100, as long as the processor 101 detects the reception state of the state register 60, it can determine which input data address will store valid data Calculation data. For example, the calculation data is read in the input data register 64. Although the processor 101 can read the data from the input data register 64 using the specified address, it will be transmitted from the address decoder 54 at the same time. UPPER DECODING to the flag encoder 59, and the upper part of the reception status will return to 0, and the upward reception will be transmitted as 0. The same is true for the lower left and right cases. The flag encoder 59 If one is also required to receive the input image, it will be delivered before the corresponding input, then the corresponding state register 60 will receive 118. This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) ----- -------- ^ -------- t --------- ^ (Please read the notes on the back before filling this page) 498290 A7 B7_ .... I — * · _ ·· | 丨 _ 丨 丨 丨 | 1 丨 __ ΙΙΙΜΜ 卿 '" V. Invention Description (丨 4) ------------ --Install --- (Please read the precautions on the back before filling this page) If you input the input image before receiving it, the input status (FRONT INPUT SEND STATUS) will be set to 1 °. When the input image is read by the previous input data register 61, the address decoder 54 sends a FRONT DECODING to the flag encoder 59, and the input status is set to 0 corresponding to the input before the input is received. The processor 101 can judge the content of the read-in status register 60 to determine whether the latest input image is stored in the previous input data register 61 or not.

The algorithm when the processor 101 transmits the calculation data on the surrounding array computing device 100 through the controller 103 is shown in FIG. 51. Fig. 51 shows the use of the processor 101 and program control; the mixed processing of the flag decoder 58 and the flag encoder 59 and hardware logic. For FIG. 51, in step 71, the processor 101 reads the contents of the state register 60. In step 72, it is determined whether the reception status in the read content is all 0. If it is No, the processing ends. If YES, go to step 73. In step 73, the processor 101 determines the type, calculation and transmission direction of the data transmitted to the adjacent array computing device 100, and writes the content into the flag register 57. In step 74, the processor 101 writes the data transmitted to the adjacent array computing device 100 into the output data register 63. In step 75, the content of the output data register 63 is regarded as calculation data and transmitted to the adjacent array computing device 100. In step 76, only the direction designated by the delivery flag delivered to the flag register 57 is set to 1 and then transmitted. Therefore, the one-time transmission algorithm of the processor 101 ends. The processor 101 starts the transmission algorithm each time the data to be transmitted is updated in the memory 102. The controller 103 receives the calculation data from the array computing device 100 above. 119 The paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) '"' 498290 A7 ___B7 _ V. Description of the invention (/ ^) The algorithm is shown in Figure 52. Fig. 52 shows a flag decoder 58 and a flag encoder 59 and hardware logic representation processing. For FIG. 52, in step 81, the flag encoder 59 will input the delivery. In step 82, the flag encoder 59 determines whether the delivery is 1. If NO, the process ends. If YES, go to step 83. In step 83, the input data register 64 will read in the transmitted calculation data from above. In step 84, the flag encoder 59 sets the reception status at the top of the state register 60. At the same time, the reception will be set to 1 and then transmitted to the array computing device 100 above. The same applies to the left and right sides. Therefore, the controller 103 receives the algorithm once. The controller 103 monitors the usual delivery from the array computing device 100 on the top, bottom, left, and right, and starts the receiving algorithm each time the delivery is received. Figure 53 shows. Figure 53 shows the use of processor 101 and program control; the use of flag decoder 58 and flag encoder 59 and mixed processing of hardware logic. Referring to Fig. 53, in step 91, the processor 101 reads the contents of the state register 60. In step 92, it is determined whether the reception status used in the upper part of the read content is 1. If NO, the process ends. If YES, go to step 93. In step 93, the processor 101 reads data from the input data register 64. In step 94, the flag encoder 59 sets the reception status used in the upper part of the status register 60 to 0, and sends the reception to the array computing device 100 after receiving the set status. The same applies to the lower left and right. Therefore, the processor 101 receives the algorithm once. The processor 101 monitors the contents of the status register 60 at regular intervals. Each time the paper size is 120, the Chinese national standard (CNS) A4 specification (210 X 297 mm) is applied. (Please read the precautions on the back before filling this page. )

498290 A7 ___E7____ 5. Description of the Invention (/ #) When the receiving status of one of the up, down, left, and right sides is 1, the receiving algorithm will start. In addition, even if the processor 101 does not monitor the contents of the state register 60 at regular intervals, it may be installed by an insert processing. This array computing device 100 is mainly described on the premise that one output image is created from at least one input image, but it is necessary to change the circuit to output the calculation data during the calculation according to the application. In this case, only the result of the flag decoder 58 that has the number of calculated data to be output is delivered, as long as the procedure is changed so that the result delivery of only the calculated data corresponding to the read result data register 62 is set to 1. The array computing device 100 has been described so far. However, when the image with a large number of bands is to be transferred like the moving source repeat information image 184, the array computing device 100 may have only one controller 103, and the transfer efficiency may decrease. Therefore, finally, the array computing device 100 having a plurality of controllers 103 will be described. As shown in FIG. 54, the array computing device 100 in the ninth scope of the patent application may be provided with a plurality of controllers 103. In the case of FIG. 54, the array computing device 100 includes five controllers 103 arranged on a diagonal line, and each controller 103 is connected to an address bus 51 and a data bus 52. In order to identify the five controllers 103, the processor 101 assigns different addresses to the address decoder 54 of each controller 103. Each controller 103 is provided with a front input data register 61 and a result data register 62, so all the controllers 103 can independently input the front input data group and output the result data. In addition, each controller 103 ′ is connected to one of the five controllers 103 of the adjacent array computing device 100, and the array computing device 100 can expand the communication area 121. The paper size is applicable to Chinese national standards ( CNS) A4 specification (210 X 297 mm) ----------------- (Please read the precautions on the back before filling this page) Order ·-i-line-498290 A7 ________ Β7__ 5. Description of the invention (/ ^) • It is 5 times as large. Therefore, even when a large number of images are to be transferred in the transfer area like the moving source repeat information image 184, increasing the number of controllers 103 will not reduce the transfer efficiency. In addition, when the array computing device 100 includes a plurality of controllers 103, the processor 101 must monitor the conditions in the state registers 60 of all the controllers 103 according to the algorithms shown in Figs. 51 and 53. Monitoring and dispatching are mainly carried out in circular patrols. In the circular patrol mode, the controller 103 is theoretically ring-shaped and parallel, and the processor 101 will access the controller 103 in order along the ring. The processor 101 executes an algorithm shown in FIG. 53 for one controller 103. If there is any data to be transmitted, the processor 101 executes the algorithm shown in Fig. 51 on the controller .103. The processor 101 then moves to the controller 103 in the next sequence. Therefore all controllers 103 are processed peer-to-peer. Compared with the amount of data transferred by the array computing device 100 in a short time, this method is effective when the communication area of the controller 103 is narrow. In addition, different numbers of priorities are attached to the controller 103, and the priority of the controller 103 can be sequentially accessed from the highest priority of the processor 101 each time. Compared with the amount of data transferred by the array computing device 100 in a short time, this method is effective when the communication area of the controller 103 is wide. Generally, since the array computing device 100 has only a few controllers 103, when the visual device 2 performs local parallel image processing, it is more advantageous to use a circular patrol method in a priority manner. However, for high-speed execution of Vision Device 2 for locally parallel images containing functions that must transfer a large amount of data, 122 This paper size applies to the Chinese National Standard (CNS) A4 specification (210 X 297 public love) (Please read the precautions on the back before filling in this page)

498290 A7 _____B7_ V. Description of the invention • When the array computing device 100 has a sufficient number of controllers 103, the remaining functions refer only to 182 band pixels near 4 or 8 near the circle patrol mode. Communication efficiency will decrease. In this case, the priority method is more advantageous. Of course, if all the controllers 103 and processors 101 are equipped with a plug-in function, the processor 101 does not need to regularly monitor the status of the state register 60 of each controller 103. In addition, in the 9th In the item, when the controller 103 is arranged on the mounting plane of the LSI, the main problems are that the mounting area of the LSI will become larger, the wiring between the controllers 103 will become complicated and long, and it is not easy to increase the controller 103. There are three problems such as the number. However, if three-dimensional LSI technology is used, LSI designers can easily solve these problems. The following is an explanation of the array computing device 100 using three-dimensional LSI technology. As shown in FIG. 55, the scope of patent application is tenth. The controller 103 of the item is stacked in the array computing device 100 using three-dimensional LSI technology. In the case of FIG. 55, five controllers 103 are stacked on the processor 101 and the memory 102, and each controller 103 uses The address bus 51 and the data bus 52 that are vertically wired are connected to the processor 101 and the memory module 102. As can be determined from Figure 55, even if the number of controllers 103 is increased, the installation area of each layer does not have to be Expand Large, and the controller 103 only needs to be connected to the adjacent controller 103 on the same layer. Furthermore, LSI designers, if the controller 103 is added, it only needs to increase the number of controllers to install the 103 layer, and as long as it is appropriate Designing the address bus 51 on the ground, the LSI designer does not need to process the lower layers at all. The controller 103 of each layer is composed of circuits other than the address decoder 54, so the design of the controller 103 of the newly stacked layer becomes very Simple. 123 This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) --- (Please read the precautions on the back before filling out this page) Order:-line · 498290 A7 _____B7______ 5. Description of the invention << 4) As shown in Figs. 54 and 55, since the array computing device ιOO has a plurality of controllers 103, the array computing device 100 can not only expand the communication area with the array computing device 100. It is also possible to identify which controller 103 receives which calculation data. Therefore, the following description is about the use of a plurality of controllers 103 to group a plurality of consecutive array computing devices 100 into one group. And the array computing device 100 in the group shares the processor 101 and the data processing device 110 of the memory 102. First, as shown in FIG. 56, the array computing device 100 arranged on a two-dimensional grid will be organized as appropriate The size of the rectangular group. This group is called the virtual array computing device 105. In the case of Figure 56, the virtual array computing device 105 is a 3x3 array computing device 100 organized into a group. Then as shown in Figure 47, As shown in FIG. 54 and FIG. 55, the virtual array computing device 105 includes a processor 101, a memory module 102, and a controller 103 having the largest number of vertical and horizontal array processing devices 100 or more. In the case of FIG. 56, the virtual array computing device 105 requires more than three controllers 103. Also, these controllers 103 are assigned different numbers for expediency. As shown in FIG. 57, the communication path of the array computing device 100 also has a number different from that of the controller 103. However, the relative numbers must be the same. Finally, a program that allows the processor 101 to execute the nine array computing devices 100 is stored in the memory 102. However, if the array computing device 100 communicates with the array computing device 100 of the adjacent virtual array computing device 105, it is necessary to install the program through the controller 103 which is consistent with the number programmed on the communication channel. Therefore, the virtual array computing device 105 can identify from which array computing device 100 the computing data is transferred to which array computing device 100. 124 This paper size is applicable to China National Standard (CNS) A4 (210 X 297 mm). -------- Order --------- line (please read the precautions on the back before filling (This page) 498290 A7 _______B7___ 5. Description of the invention (1) I I ------ I ----. — I (Please read the precautions on the back before filling this page) and 105 virtual array computing devices Increasing the number of controllers 103 cannot completely install a plurality of array computing devices 100. This is because the virtual array computing device 105 must input data groups before inputting from other virtual array computing devices 105, or must output the result data to other virtual array computing devices 105. When the controller 103 is installed on a two-dimensional plane as shown in FIG. 54, if the number of the controllers 103 is sufficient, the controller 103 is numbered in the same manner as the calculation data, and the problem is solved by a program. However, in the case of FIG. 57, the controller 103 needs nine. Therefore, when the number of array computing devices 100 included in the virtual array computing device 105 increases, this method becomes very inefficient. Moreover, when the controller 103 is accumulated as shown in FIG. 55, it is very difficult to ensure the communication channel for the previously input data group and the result data. Therefore, the following is a description of a method for solving this problem by using only the input data register 61 before changing the controller 103. —Line · First, consider the case where the controller 103 treats one previous input data group as the previous input data group from another controller 103, and then sends the result data as the previous input. At this time, as shown in FIG. 58, the front input data register 61 includes a front input shift register 68 composed of a number of resistors equal to the number of the array computing device 100 in the virtual array computing device 105, and a front input shift register 68. Counter 69. The front input counter 69 is calculated by taking the number of resistors as the drop of the initial value. When the count of the front input counter 69 is 0, the front input counter 69 will output the front input. Then, if the result data is input, the front input counter 69 is initialized to the initial value. In Fig. 58 ', the front input shift register 68 is composed of 9 resistors. If 9 result data is input in the front input shift register 68, the front input delivery will be output. 125 paper sizes are applicable to China National Standard (CNS) A4 (210 x 297 mm) 498290 A7... B7 ______ —- _ 5. Description of the invention (/ &gt; 1). Each resistor of 68 and the front input counter 69 will be sent as the trigger signal input result. In addition, the address decoder 54 decodes the address, and selects one of the resistors of the input shift register 68 before the selection. Therefore, if the processor 101 specifies an appropriate resistor address in the front input shift register 68, each resistor can output the result data on the data bus 52. In addition, other signal lines of the address decoder 54 are omitted in FIG. 58. And if the virtual array computing device 105 outputs the result data of the nine array computing devices 100 in a certain order, these result data will be stored in the register of the input shift register 68 before the output order. Therefore, when the front input counter 69 outputs the previous input and reaches the point stored in the data resistor 60, the right processor 101 accesses each resistor, and the processor 101 can obtain the result data of the specific array operation device 100. The vision device 2 has been described so far. Although the image size of digital image 111 is limited, and a certain degree of calculation time is tolerated, even a single-chip computer on the market can implement visual devices2, but to increase the image size or achieve actual timeliness, a dedicated large-scale product must be installed. Body circuit. In particular, several devices of the visual device 2 are installed on a large integrated circuit. The visual device 2 can achieve space saving, low power consumption, and practical timelines. The following describes the processor using the visual device 2. The processor used in the invention claimed in item 7 of the scope of the patent application is to arrange the functional pillars 201 as shown in FIG. 59 and arrange them in a two-dimensional grid as shown in FIG. 60. In addition, in Fig. 59, the array computing device 100 is abbreviated as AOU; in Fig. 60, the functional column 201 is abbreviated as FC. In order to easily output the repeated information 131 and the matching result from the processor, the paper size of Figure 14 is the same as the Chinese National Standard (CNS) A4 (210 X 297 mm). (Please read the precautions on the back before filling this page. )

498290 A7 V. Description of the invention (/ &f; f) Added three image holding devices 39. Although the plurality of array computing devices 100 in Fig. 59 reach each device, as shown in Fig. 61, even one array computing device 100 can realize a plurality of devices using a program. Of course, as shown in Fig. 62, even a single virtual array computing device can use a program to realize a plurality of array computing devices 100. In FIGS. 59, 61, and 62, in addition to the array computing device 100 and the virtual array computing device 105, a photographic element 207 such as a photodiode and a CCD is placed on the functional pillar 201, and A / D conversion circuit 204. However, in the function column 201, an individual oscillation circuit can also be used instead of the clock signal input from the outside of the function column 201. In addition, since the photodiode can be mounted on an LSI in the same way as CMOS, the design and installation of the processor is very simple. As shown in FIG. 60, each array computing device 100 in FIG. 59 is located near 4 and communicates with the array computing device 100 executing the same device through a signal line. Therefore, each array computing device 100 can cooperate to form a data processing device 110. When the processor is installed using a three-dimensional large-scale integrated circuit (three-dimensional VLSI) technology, as shown in FIG. 63, all the array computing devices 100 in the function column 201 are installed in a vertical arrangement using the three-dimensional VLSI, and the signals between the function columns 201 The wires will not cross between the array computing device 100. Therefore, the design and installation of the processor will become very easy. The processor has been described so far. However, if you want to use a LSI to make a practical scale and processing speed of the processor, you cannot avoid synchronization issues such as clock signals and recovery signals. Therefore, the embodiment of the interlocking device of the present invention will be described below with reference to the screen. 127 (Please read the notes on the back before filling this page)

I-— — III — — — — — — — — ——---H I

This paper size applies to China National Standard (CNS) A4 specification (210 X 297 mm) —J 498290 A7 ____ B7__ 5. Description of the invention First, as shown in Figure 64, the interlocking counter 416 is composed of a counter part and a linkage part. Make up. In Fig. 64, the interlocking counters 416 are inputted with the interlocking signals BLK1 ', BLK2', BLK3, and BLK4 by the four interlocking counters 416. In the counter section, the synchronous counter 411, the NOT gate 412 for determining the end and the NOT gate 415 for calculation are connected in a loop. Figure 64 shows a binary and three-digit synchronous counter 411 composed of three flip-flop circuits synchronized with the clock signal (CLK). However, since N flip-flop circuits are used, it must be changed to A binary N-bit synchronous counter 411 is easy. In the synchronous counter 411, since the input of the NOR gate is changed from the Q 'terminal of the flip-flop circuit to the Q terminal, the synchronous counter 411 can also be changed to a down counter. The synchronous counter 411 outputs counts while synchronizing with the clock signal. If the count reaches the end, that is, if the synchronous counter 411 outputs a pulsating carry signal (RCO), it will end. The judgment NOT gate 412 outputs an interlock signal BLK0 '. The calculation NOR gate 415 outputs an enable signal (G ') before the interlock signal BLK0' is input. Therefore, the synchronous counter 411 counts until the count reaches the end, and stops counting when the count reaches the end. According to the interlocking signals BLK1 ', BLK2', BLK3 ', and BLK4' which are input from the outside, the interlocking NOR gate 414 and the interlocking lock circuit 413 control the calculation NOR gate 415. Therefore, the interlocking part can match the phase and period of the interlock signal BLK0 'with the phase and period of the interlock signals BLK1', BLK2 ', BLK3', and BLK4 '. Interlocking counting 128 This paper size is applicable to China National Standard (CNS) A4 (21〇 X 297 public love) (Please read the precautions on the back before filling this page)

498290 A7 ___B7 _ V. Description of the invention (/ 4) (Please read the notes on the back before filling this page) The device 416 will synchronize with the clock signal, but the clock signal itself may not provide all the interlocking counters at the same time. 416. Therefore, before the interlocking counter 416 receives the clock signal, any of the interlocking signals BLK1 ', BLK2', BLK3 ', and BLK4' will become the High level (H level). As a result, the valid signal may become the Η level . Therefore, using the interlock circuit 413, the interlocking part can keep the effective signal at the Low level (L level) before the calculation part starts the calculation. In FIG. 64, although the state of the interlocking counter 416 is that the interlocking signals are input from the four interlocking counters 416, as long as the number of the interlocking counters 416 to be connected changes the number of inputs of the interlocking NOR gate 414, Or pull-down the input which is not needed when inputting the NOR gate 414 for linkage. In the synchronous counter 411 shown in Fig. 64, the start 値 of the count 値 is fixed at 0 and the end 値 is fixed at 7. However, there are cases where the count (starting and ending) may be changed according to the specifications of the LSI. Therefore, the interlocking counter 416 can use a synchronous erasing device such as a commercially available synchronous calculating device 411 and a synchronous counter 411 having a step loading device, and can set any starting and ending points. At this time, the judgment of the end point is implemented by adding the NOT gate before the end of the judgment gate 412. Of course, the combination of the NOT gate 412 and the NOT gate for judgment is replaced according to the NAND gate. The circuit structure of the interlocking counter 416 alone has been described so far. In the following, a timing chart is used to explain how the interlocked counters 416 are linked to each other when a plurality of interlocked counters 416 are connected. First, as shown in Figure 65, consider that three interlocking counters 416 are connected to 129. This paper size is applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 ---------- B7___ V. Description of Invention (/ &gt; 7) In Fig. 65, the interlocked counter 416 is abbreviated as ICU. The interlocking signal BLK0 of each interlocking counter 416 is input to the NOR gate 414 for interlocking of the remaining interlocking counters 416. Therefore, the NOR gate 414 for interlocking can be a 2-input gate gate. When these three interlocked counters 416 operate after stabilization, the timing diagram of any one of the interlocked counters 416 will be shown in FIG. 66. And because all the interlocked counters 416 are symmetrical, the timing diagrams of the remaining interlocked counters 416 are also the same. From Figure 66, it is clear that when the counts of all the interlocked counters 416 are When they are consistent, the output of the NOR gate 415 for calculation will instantly become the high level, but since it will return to the L level immediately, the NOR gate 415 for calculation can be continuously calculated. Therefore, all the interlocked counters 416 can continuously output the same count. As shown in Fig. 67, when the waveform of the interlock signal BLK1 'becomes shorter for some reason, the interlock counter 416 operates regardless of the interlock signal BLK1'. Therefore, the interlocking signal BLK1 'has no effect on the counting chirp. In addition, an interlocking counter 416 that creates an interlocking signal BLK1 'will operate the interlocking signal BLK1' in accordance with the phases of the interlocking signals BLK0 'and BLK2'. As shown in Figure 68, when the waveform of the interlock signal BLK2 'becomes longer for some reason, the interlock counter 416 will cooperate with the phase of the interlock signal BLK2' to act on the phase of the interlock signal BLK0 '. Therefore, until the interlock signal BLK2 'becomes the L level, the interlock counter 416 will count as "continuous output end". As shown in Figure 69, the waveform of the interlocking signal BLK1 'is for some reason 130 This paper size applies to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) (Please read the precautions on the back before filling this page )

498290 κι __Β7_ V. Description of the invention (/ 1) becomes shorter; when the waveform of the interlock signal BLK2 'becomes longer for some reason, the interlock counter 416 will cooperate with the phase of the interlock signal BLK2' to interlock the signal BLK0 ' Of phase. Therefore, before the interlock signal BLK2 'becomes the L level, the interlock counter 416 will count as "continuous output ends". Using the above-mentioned timing diagram, the three interlocked counters 416 count the slowest judgment cooperation. This also holds true for the case where different interlocked counters 416 are connected. Therefore, even when the counts of the three interlocked counters 416 are different when the power is turned on, the counts of all the interlocked counters 416 will be consistent within the time after the period of the clock signal is multiplied by the maximum number of end clocks. The interlocked counter 416 does not have to be connected to all other interlocked counters 416 as shown in FIG. 65. Therefore, the following description deals with the case where the interlocked counter 416 is regularly arrayed. As shown in FIG. 70, the interlocking device composed of the interlocking counter 416 is a network of interlocking counters 416 adjacent to the same type and arranged in a square grid. In this case, the number of inputs of the NOR gate 414 for interlocking is four. In addition, on the edge interlock counter 416, the input of the interlocking NOR gate 414 without a ground is lowered by the left area. Instead of arranging the interlocking counters 416 in a square grid shape, they can also be arranged in a hexagonal grid like adjacent ones as shown in FIG. 71. If the interlocked counter 416 is configured in this way, all the interlocked signal lines have almost the same length, so the interlocked counter 416 can be easily interconnected. Therefore, for paper processing equipment, such as pipeline processing equipment, DSP (Digital Signal Processor), systolic array, data flow machine, and parallel image processing equipment, this paper standard applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) --------------------- Order --------- line (please read the precautions on the back first) (Fill in this page) 498290 A7 ___ B7_ V. Description of the invention (/ ^) The same large-scale and regular digital circuits are set up. These two-dimensional counter networks can easily provide the interlocking counter 416 count. Clock signal is divided into week signal. Furthermore, the three-dimensional counter network is a network in which most of the aforementioned interlocking counters 416 arranged in a square grid shape and a hexagonal grid shape are stacked using three-dimensional LSI technology. Therefore, when arranged in a square grid, the number of inputs of the NOR gate 414 for continuous number is 6; when arranged in a hexagonal grid, the number of inputs of the NOR gate 414 for linkage is 8. And by adjusting the positions of the interlocking counters 416 of each layer, the length of the signal line can be set to the shortest, so the transmission delay time of the interlocking signals of each interlocking counter 416 is almost equal, and the interlocking counters 416 are easy to each other. Gearing. These three-dimensional counter networks are arranged in a square grid and a hexagonal grid, and the data processed by the processor 101 is oriented vertically. It can provide interlocking efficiently for pulsating arrays and parallel image processing devices that want to do pipeline processing. The counting counter of the digital counter 416 is the weekly signal of the clock signal. In addition, when the count of the interlocking counter 416 is distributed, the digital circuits such as the network of the interlocking counter 416 arranged in the square grid and the hexagonal grid, and the processor 101 and the arithmetic circuit can be installed in a three-dimensional LSI. On different layers. Therefore, for the configuration of the digital circuit, the configuration of the interlocking counter 416 will not shift, and the signal line of the interlocking signal BLK0 'will not be detoured. Since the interlocked counter 416 is not subject to the noise image of the digital circuit, the interlocked counter 416 operates stably. In addition, since the digital circuit can input the count 値 from any interlocked counter 416 of the network of the interlocked counter 416, it is easy to design the digital circuit. 132 This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) -------------- Loading --- (Please read the precautions on the back before filling this page ) Lamp ·-丨 Wire- 498290 A7 ____B7__ 5. Explanation of the invention (/ &gt;) However, if a two-dimensional counter network and a three-dimensional counter network are used, all interlocking counters 416 can be given to the entire LSI and provided Counting puppet. That is, using this counter, an interlocking signal distribution circuit is designed so that appropriate signals are distributed to the entire LSI at the same time. As shown in Figure 72, an interlock device that forms an input signal at a positive multiple of the clock signal period will use the signal distribution decoder 421 to symbolize the count 値 of the interlock counter 416 to create a clock signal (CLK ) Timing signal for synchronization. Therefore, it indicates the timing start time and the timing end time. Using two different timing signals, the signal distribution decoder 421 can calculate the time of the clock signal being a multiple of a positive period. In addition, in Figure 72, the timing signals 3 and 5 are used to indicate the timing start time and the timing end time, but of course other timing signals can also be used. If an appropriate signal (SIGIN) is input from the outside, the signal distribution lock circuit 422-once this signal is stored, it will be input to the signal distribution flip-flop circuit 424 at the timing start time using the signal distribution NOR gate 423. The signal distribution flip-flop circuit 424 synchronizes to a clock signal, stores the input signal, and resets it to the timing end time. Therefore, regardless of the transmission delay time of the input signal, the interlocking signal distribution circuit can output the input signal before the timing start time from the timing start time to the timing end time. In addition, when the theory of the input signal is reversed, by adding a NOT gate before the signal distribution lock circuit 422, the interlocking signal distribution circuit can operate normally. The timing diagram of the interlocking signal distribution circuit shown in Fig. 72 is shown in Fig. 73. As shown in Figure 73, once the input signal (SIGIN) is input, the time from the time when the clock signal (CLK) at the output timing signal 3 falls to 133 (please read the precautions on the back before filling in this page)

This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 ___ B7____ V. Description of the invention (ρι) • The time after the clock signal (CLK) drops when the timing signal 5 is output, The output signal (SIGOUT) is output. Therefore, no matter where the digital circuit is arranged in the LSI, the SIGOUT signal can be reliably input and output at the beginning of the timing signal No. 5. This function is necessary and indispensable when a digital circuit with a completed design such as a reset signal, a trip signal, and an input / output signal is installed in a system LSI without change. So far, the interlocked counter 416, counter network and interlocked signal distribution circuit have been described. The following description is related to the synchronous oscillation circuit 410 required for synchronizing the interlocked counter 416 with the entire LSI when the clock signal becomes a high frequency. First, as shown in Fig. 74, the synchronous oscillating circuit 410 is composed of an oscillating part, a synchronizing part, and a NOR gate 402 for initialization. The oscillating part and the synchronizing part are respectively classified into A side and B side. In Fig. 74, the synchronous oscillating circuit 410 is regarded as inputting synchronous signals SyncAl ', SyncA2', SyncA3 ', SyncA4', SyncBl ', SyncB2', SyncB3, and SyncB4 'from the four synchronous oscillating circuits 410. In the oscillating part, the A-side oscillation NOR gate 401a, the A-side oscillation capacitor 404a, the B-side oscillation NOR gate 401B, and the B-side oscillation capacitor 404B are connected in a ring shape, and the A-side oscillation NOR gate 401a and The output and input of the B-side oscillation NOR gate 401B are connected with the A-side oscillation resistor 403a and the B-side oscillation resistor 403B, respectively. Here, the resistance 値 of the A-side oscillating resistor 403a and the B-side oscillating resistor 403B are regarded as R ohms, and the 値 of the A-side oscillating capacitor 404a and the B-side oscillating capacitor 404B are regarded as C Farads. The oscillating part will cooperate Time constant RC uses self-excited vibration 134 This paper size applies Chinese National Standard (CNS) A4 specification (210 X 297 mm) (Please read the precautions on the back before filling this page)

498290 A7 --- _B7__ V. Description of the Invention (〇Χ) Swing ′ can generate 2 clock signals _ciockA and ClockB, and 2 synchronization signals SyncAO ’and SyncBO. In the synchronization part, according to the synchronization signals SyncAl SyncA2, SyncA3 ', SyncA4', SyncBl ', SyncB2', SyncB3 ', and SyncB4', the A-side synchronization lock circuit 405a and the A-side synchronization gate 406A, and B The side synchronization lock circuit 405B and the B side synchronization NOR gate 406B control the A-side oscillation NOR gate 401a and the B-side oscillation NOR gate 401B, respectively. Therefore, the phase and period of the synchronization signals SyncAO 'and SyncBO' can be matched with the phase and period of the synchronization signals SyncAl ', SyncA2 ,, SyncA3, SyncA4, SyncBl', SyncB2 ', SyncB3', and SyncB4 '. The initialization NOR gate 402 determines the phase of the synchronization signal SyncBO 'by using the NOR gate 401a for controlling A-side oscillation when the power is turned on. In addition, FIG. 74 shows the case where the synchronous oscillator circuit 410 receives synchronization signals from four synchronous oscillator circuits 410, but as long as the number of connected synchronous oscillator circuits 410 is changed, the A-side synchronization NOR gate 406a and the B-side synchronization are changed. Use the input number of the NOR gate 406B, or pull down the unnecessary input of the NOR gate 406a for the A-side synchronization and the NOR gate 406B for the B-side synchronization.

The synchronous oscillating circuit 410 in FIG. 74 can be installed using many semiconductor technologies such as TTL (Transistor-Transistor Logic) and ECL (Emitter-Coupled Logic Circuit). However, when using a FET (field-effect transistor) such as CMOS, if the charges stored in the A-side oscillation capacitor 404a and the B-side oscillation capacitor 404B flow out at the input of the NOR gate, the NOR gate may be damaged. As shown in Figure 75, the synchronous oscillation circuit 410 uses A-side input resistors 407a and B 135 in order to avoid this problem. This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) (Please read first (Notes on the back then fill out this page)

498290 A7 ___ B7_ —_-_ 5. Description of the invention (fj \) side input resistance 407B. Therefore, the charges stored in the A-side oscillating capacitor 404a and the B-side oscillating capacitor 404B do not flow together at the input of all NOR gates. By using the A-side input resistor 407a and the B-side input resistor 407B, the current flowing out of the A-side oscillation NOR gate 401a and the B-side oscillation NOR gate 401B is reduced, so the A-side input resistors 407a and A are increased. The accuracy of the time constants obtained by the side-oscillation capacitor 404a, the B-side input resistor 407B, and the B-side oscillation capacitor 404B. In addition, the resistance of the A-side input resistor 407a and the B-side input resistor 407B are regarded as R0 ohms. The resistance 値 R0 is determined after referring to the power supply voltage, the input characteristics of the NOR gate, and the capacitance 値 C. Even if NOR gates, resistors, and capacitors are implemented using LSI technology, differences in performance of each part in Figs. 74 and 75 may occur. Moreover, it is difficult to generate a clock frequency as expected by the synchronous oscillation circuit 410. Therefore, as shown in FIG. 76, the synchronous oscillation circuit 41o 'can use the crystal oscillator 408 instead of the A-side oscillation capacitor 404a' to cooperate with the self-excited oscillation of the crystal oscillator 408. However, the capacitance 値 C of the capacitor 404B for the B-side oscillation needs to be set to the synchronous oscillation circuit 41. The oscillation frequency of the crystal oscillator 408 is roughly derived from the oscillation. The circuit configuration of the synchronous oscillation circuit 410 alone has been described before. In the following, when a plurality of synchronous oscillation circuits 410 are connected, it is explained how the synchronous oscillation circuits 410 are synchronized with each other and the timing diagram is used. In addition, in the case of CMOS, because the input impedance is high 'and the limit 値 of the input voltage can be set at the center of the power supply voltage and the ground voltage', the following timing charts are written with CMOS as the center. However, even at TTL and 136 paper sizes, the Chinese National Standard (CNS) A4 specification (210 X 297 mm) is applicable --- I ------------ I --- 1 Order --- --- I-- line (please read the precautions on the back before filling this page) 498290 A7 __B7____ V. Description of the invention (| ^ f) ECL, etc., the timing diagram also shows the same waveform. First, as shown in FIG. 77, a case where three synchronous oscillation circuits 410 are connected is considered. In Fig. 77, the synchronous oscillation circuit 410 is abbreviated as SOU. The synchronization signals SyncAO 'and SyncBO' of each synchronous oscillation circuit 410 are input to the remaining side synchronous oscillating circuit 410 for the A side synchronous NOR gate 406a and the B side synchronous NOR gate 4p6B. Therefore, if the A-side synchronization NOR 406a and the B-side synchronization NOR gate 406B are two-input NOR gates. When these three synchronous oscillation circuits 410 stabilize and self-oscillate, the timing diagram of any one synchronous oscillation circuit 410 is shown in FIG. 78. Since all the synchronous oscillating circuits 410 are symmetrical, the timing diagrams of the remaining synchronous oscillating circuits 410 are also the same. As shown in Fig. 78, when the synchronous oscillation circuit 410 oscillates independently, the clock signals ClockA and ClockB do not become the High level (H level) at the same time. Therefore, the output of the NOR gate 402 for initialization is usually a low level (L level). According to the asymmetry of the true value of the NOR gate 401a for the A-side oscillation and the 401B for the B-side oscillation, the voltages of the A-side oscillation capacitor 404a and the B-side oscillation capacitor 404B will be discharged and will reach the A-side oscillation. Using the time point of the input voltage limit 値 of the NOR gate 401a and the NOR gate 401B as the starting point, the synchronous oscillation circuit 410 oscillates by itself. As shown in Fig. 79, when the waveforms of the synchronization signals SyncAl 'and SyncBl' become shorter for some reason, the synchronous oscillation circuit 410 operates independently of the synchronization signals SyncAl 'and SyncBl'. Therefore, it has no effect on the clock signals ClockA and ClockB. In addition, the synchronous signal SyncAl 'and SyncBl' are used to create the synchronous oscillation circuit 410. The synchronous signal SyncAl '137 is compatible with the Chinese National Standard (CNS) A4 (210 X 297 mm) paper size. ^ -------- ^ ---------- ^ (Please read the notes on the back before filling out this page) 498290 A7 ____B7__ 5. Description of the invention (| Seven 5). And SyncBl 'with the synchronization signals SyncAO', SyncA2 ', Phase action of SyncBO 'and SyncB2'. As shown in Figure 80, when the waveforms of the synchronization signals SyncAl 'and SyncB2' become longer for some reason, the synchronous oscillation circuit 410 will match the phase of the synchronization signal SyncBO '(or SyncAO') with the synchronization signal SyncB2 '(or SyncA2 ') phase action. Therefore, the period of the clock signal Clock and ClockB will be longer than the period of the synchronization signal SyncB2 '. (Or SyncA2'). As shown in Fig. 81, the waveforms of the synchronization signals SyncAl 'and SyncBl' become shorter for some reason; when the waveforms of the synchronization signals SyncA2 'and SyncB2' become longer for some reason, the synchronous oscillation circuit 410 causes the synchronous signal SyncBO The phase of '(or SyncAO') matches the phase of the synchronization signal SyncB2 '(or SyncA2'). Therefore, the period of the clock signals ClockA and ClockB will be longer in accordance with the period of the synchronization signal SyncB2 '(or SyncA2'). Using the above timing diagram, the three synchronous oscillation circuits 410 will determine to synchronize the longest period. This also holds true when the synchronous oscillator circuit 410 having a slightly different time constant is connected. As shown in Figure 82, when the power is turned on, all the signals are 0 volts, so the outputs of the NOR gate 401a for oscillating A side and the 401B for oscillating B side are regarded as L level. Therefore, the output of the initialization NOR gate 402, that is, the signal Osc 'will immediately change to a Η level. At the same time, the outputs of the NOR gate 401a for oscillating on the A side and the NOR gate 401B for oscillating on the B side will also immediately change to the Η level. However, if the signal Osc 'is at a high level, the output of the A-side oscillating NOR gate 401a will be forced to be changed to the L level. As a result, only the output of the B-side oscillating NOR gate 401B will be a high-level. At this time, the signal 〇sc 138 paper size is applicable to China National Standard (CNS) A4 specification (210 X 297 mm) ------------------- II ^ ---- ------ ^ (Please read the notes on the back before filling out this page) 498290 A7 __B7___ V. Description of Invention (Mt) • 'L will become the L level, and then maintain the L level. Therefore, after the power is turned on, the phases of the sync signals SyncAO 'and SyncBO' are determined to be the same. Although the timing chart of connecting three synchronous oscillation circuits 410 has been described so far, the same operation will be performed when the synchronous oscillation circuit 410 including the crystal oscillator 408 is used in at least one of the three synchronous oscillation circuits 410. However, since the period of the crystal oscillator 408 is considered constant, the phase of the synchronous oscillator circuit 410 without the crystal oscillator 408 is included. In order to comply with the phase of the synchronous oscillator circuit 410 including the crystal oscillator 408, the crystal oscillator is not included. The waveform length of the synchronous oscillating circuit 410 of the amplifier 408 will change preferentially. Therefore, on the network of the synchronous oscillation circuit 410, if there is a synchronous oscillation circuit 410 including a crystal oscillator 408, the clock frequency of the entire network can be kept constant. The synchronous oscillation circuit 410 does not have to be connected to all other synchronous oscillation circuits 410 as shown in FIG. 77. Therefore, the following description explains the regular arrangement of the synchronous oscillation circuits 410. As shown in Fig. 83, the two-dimensional oscillating circuit network is a network of adjacent synchronous oscillating circuits 410 connected in a square grid pattern. In this case, the number of inputs of the A-side oscillating NOR gate 401a and the B-side oscillating NOR gate 401B is four. In addition, on the edge synchronous oscillation circuit 410, the inputs of the NOR gate 401a for oscillating on the A side and the NOR gate 401B for oscillating on the B side without being connected to the ground are lowered in the left region. Instead of arranging the synchronous oscillating circuits 410 in a square grid, they may be arranged in a hexagonal grid adjacent to the same type as shown in FIG. 84. If the synchronous oscillator circuit 410 is configured like this, the length of all the signal lines for the synchronous signal is almost the same, so the synchronous oscillator circuit 139 This paper is applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 mm)- --------------- (Please read the notes on the back before filling this page)

498290 A7 ___ Β7 _____ 5. Description of the Invention (Β)) • 410 is easy to synchronize with each other. Therefore, for large-scale and regular digital circuits such as pipeline processing devices, DSPs (Digital Signal Processors), pulsating arrays, data flow machines, and parallel image processing devices, these two-dimensional networks are used to distribute clock signals from external sources. Compared with the situation, it is easy to provide a clock signal with a complete set of oranges. The three-dimensional oscillating circuit network is a network in which most of the synchronous oscillating circuits 410 arranged in a square grid and a hexagonal grid are stacked using three-dimensional LSI technology as described above. Therefore, when it is arranged in a square grid, the number of inputs of the NOR gate 406a for A side synchronization and the NOR gate 406B for B side synchronization is 6. When it is arranged in an angular grid, the NOR side 406a and B side synchronization are used for A side stepping. The number of inputs with NOR gate 406B is eight. By adjusting the position of the synchronous oscillation circuit 410 of each layer, the length of the signal line can be set to the shortest. Therefore, the transmission delay time of the synchronous signal of each synchronous oscillation circuit 410 is almost equal, and the synchronous oscillation circuits 410 are easy to synchronize with each other. . These three-dimensional oscillating circuit networks are arranged in a square grid and a hexagonal grid. The data processed by the processor 101 is oriented vertically, and it can provide a phase efficiently for pulsating arrays and parallel image processing devices that want to do pipeline processing. Complete clock signal. Furthermore, when the clock signal is distributed, if the network of the synchronous oscillation circuit 410 arranged in a square grid shape and a hexagonal grid shape and digital circuits such as the processor 101 and the arithmetic circuit are installed on different layers of the three-dimensional LSI, Above, for the configuration of the digital circuit, the configuration of the synchronous oscillation circuit 410 will not shift, and the signal lines of the sync signals SyncAO 'and SyncBO' will not be detoured. Because the synchronous oscillating circuit 410 is not affected by the noise image of the digital circuit, 140 paper sizes are applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) -------------- I -------- ^ --------- ^ (Please read the notes on the back before filling out this page) 498290 A7 ^ ______ B7_ V. Description of the invention • Therefore, the synchronous oscillation circuit 410 will be stable action. In addition, since the digital circuit can input clock signals ClockA and ClockB from any of the synchronous oscillation circuits 410 of the network of the synchronous oscillation circuit 410, it is easy to design the digital circuit. The artificial eyeball 1, visual device 2, communication device 7 and image detector have been described before. Therefore, the central control device 22 will be explained at the end. First, the central control device 221 shown in FIG. 85 is divided into three groups. The environment map and any number of objects output by the visual device 2 are also converted into sound. Groups of map text and number of objects that can be input by the synthesis device 226; groups that convert the text output of the voice recognition device 227 into control instructions that can be input by the visual device 2; and digital images 111 output by the visual device 2 Insert map text, object count text, and instruction text groups on the text. The first group includes an environment map input device 301, a map / text conversion device 302, an object number input device 303, an object number / text conversion device 304, and a map / object number text holding device 305. First, an environmental map composed of environmental data indicating the type and location of the object area 141 is output from the visual device 2 each time, and the environmental map input device 301 inputs the environmental map and stores them in the buffer in turn. If the map / text conversion device 302 can be input, the environment map input device 301 will input each environmental data according to the input order. The map / text conversion device 302 converts the type and position of the object area 141 into a character string (map text) when inputting environmental data. At this time, the map / text conversion device 302 'regards the position of the user as the zero point, and converts the position and change of the object to 141. The paper size is applicable to the Chinese National Standard (CNS) A4 ^ grid (210 X 297 mm) ( Please read the precautions on the back before filling in this page) Load 16 · _line-498290 A7 ____ B7 ___———— V. Description of the invention. The direction that users often look at, that is, the coordinates based on the front, and change to use Easy-to-understand words: such as front, back, right, left, up, down, near, far, close, away, crossing, staggering, crossing, etc. Using escape-sequence and special symbols, the map / text conversion device 302 converts the position based on the orientation and magnification of the mobile camera 10 included in the environment map into a coordinate that is used as the zero point, and changes it to The aforementioned terms will be added to the map text. Therefore, the map may use different coordinates to indicate the position of the same object area 141. The map / object number text holding device 305 sequentially stores the converted map texts in the buffer area according to the map / text conversion device 302, and outputs them to the sound synthesis device 226. Similarly, on the environment map, any number of objects indicating the number of objects recorded in a certain period of time. Each time it is output from the visual device 2, the object number input device 303 will input the number of any one of the objects and sequentially store them in the buffer. Area. If the number of objects / text conversion device 304 can be input, the number of objects input device 303 will output any number of objects according to the input order. Number of objects / text conversion device 304 If any number of objects is input, the number of object regions 141 is converted into a character string (number of objects). The map / object number text holding device 305 sequentially stores the converted object numbers in the buffer according to the object number / text conversion device 304, and outputs them to the sound synthesis device 226. The second group includes a command text input device 306, a text / command conversion device 307, and a control command holding device 308. The first is the recognition result of the instructions instructed by the user. Each time the front, back, right, left, up, down, near, far, more, a little more, etc. (command text) is output from the voice recognition device, The instruction text input device 306 will input the instruction text, and 142 paper sizes are applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) --- I ------------ (Please (Please read the notes on the back before filling this page)-ί 线-498290 A7 ____B7______ 5. Description of the invention • Stored in the buffer in order. If the text / instruction conversion device 307 is inputtable, the instruction text input device 306 outputs each instruction text according to the input order. In addition, the text input device 306 is instructed to sequentially store the control codes assigned to the control buttons 223 to the buffer. If the text / instruction conversion device 307 enters the instruction text, the instruction text is converted into a control instruction that can be input to the visual device 2. At this time, the text / instruction conversion device 307 will convert the text of the instruction to the direction of the mobile camera 10, that is, the position based on the center of the display 222 and the magnification of the mobile camera 10 will be converted to the coordinates used as the zero point and calculated. The relative amount of movement from the current position of the mobile camera 10. This allows the user to easily control the mobile camera 10 while looking at the display 222. The control instruction holding device 308 will use the text / instruction conversion device 307 to sequentially store the converted control instructions in the buffer area and output them to the vision device 2. The third group includes a digital image receiving device 309, a text insertion device 310, and an image signal output device 311. First, the digital image receiving device 309 inputs the digital image 111 transmitted by the communication device 7 and outputs the digital image 111 to the text insertion device 310. The text insertion device 310 is to input a map text from the map / text conversion device 302, or to input the text number of objects from the number of objects / text conversion device 304, or to input the instruction text from the instruction text input device 306. Regardless, it will be implemented using The software covering the (superimpose) function inserts the map text, the object count text, and the command text into the digital image 111. The text insertion device 310 outputs the digital image 111 to the image signal output device 311 regardless of whether there is a map text, an object number text, or an instruction text. If the image signal output device 311 is to input digital images from the insertion device 310 of this article, 143 This paper size is applicable to China National Standard (CNS) A4 (210 X 297 public love) (Please read the precautions on the back before filling this page)

498290 A7 _B7_ V. Explanation of the invention (/ &gt; (Image like 111, shell!) Will be converted to NTSC, PAL, HDTV, VGA, MPEG specifications and other video signals and output to the display 222. Although the above describes the embodiment However, the present invention is not limited to the above-mentioned embodiments. Anyone who is familiar with the technology can implement various forms. Of course, without departing from the technical idea of the present invention, the structure of the present invention can be changed as appropriate. The change also belongs to the technical scope of the present invention. [Industrial Applicability] According to the inventions in the scope of patent application No. 1 and the scope of patent application No. 3, the artificial eyeball 1 can change the type of objects captured by the mobile camera 10. It is transmitted to the user terminal 4 so that the user can know through the user terminal 4 that there are certain types of objects around the artificial eyeball 1. Therefore, a plurality of artificial eyeballs 1 can be arranged in vehicles, boats, homes, buildings and Around or inside the space station, etc., one or more user terminals 4 are installed in a specific house, or by wearing on the user, the user Find objects that are close to artificial eyeball 1, or monitor people hovering around artificial eyeball 1. Especially by using mobile phone 211 and mobile information terminal as user terminal 4, users can use it even when they are out and in the bedroom. Can grasp the status of vehicles, ships, houses, buildings, space stations, etc. For example, by installing artificial eyeballs 1 around the vehicle, the driver can know that there are objects in the dead corner, and can also grasp the positions of multiple objects. With the artificial eyeball 1 installed to photograph the interior of the vehicle, the user can prevent accidents caused by putting the baby on the car. In addition, even if a suspicious person approaches a vehicle parked in a night parking lot, the artificial eyeball 1 You can also use the 144 paper size of the suspicious person for the Chinese National Standard (CNS) A4 specification (210 X 297 mm) (Please read the precautions on the back before filling this page)

498290 A7 __B7 _______ 5. The description of the invention • The image is transmitted to the user terminal 4, so the user can respond quickly no matter where they are, and the recorded image can be used as a vehicle damage in the future. evidence. In addition, if a part of the user terminal 4 is used as the monitoring terminal 5, the monitoring personnel operating the monitoring terminal 5 constantly monitors the surroundings of the artificial eyeball 1, so that the user of the user terminal 4 can Eliminate the trouble of monitoring around the artificial eyeball 1. On the other hand, since the artificial eyeball 1 notifies the monitoring terminal 5 that an object is approaching the surroundings, one monitor can manage multiple artificial eyeballs 1. Therefore, the security company and enterprise security deployment can use a small number of monitors to monitor multiple sites. According to the inventions in the scope of patent application No. 2 and the scope of patent application No. 3, because the artificial eyeball 1 can transmit the types of objects captured by the mobile camera 10 to the database 6, the user can know the specific through the user terminal 4 When and where kinds of objects exist. Therefore, by arranging a plurality of personal eyeballs 1 around and inside roads, shopping streets, shops, and stations, the user can investigate the traffic of people and vehicles, and can also predict the traffic of people and vehicles from statistical data. In other words, the store operator can adjust the production and inventory of the product by the traffic volume in front of the store and the number of customers who visit the store from the database 6. This effect can be significant especially by combining statistics with weather forecasts. In addition, the car driver investigates the traffic jam situation on the road from the database 6 and formulates a driving plan to avoid the traffic jam. In addition, if a part of the user terminal 4 is used as the monitoring terminal 5, the monitoring personnel who operate the monitoring terminal 5 constantly monitors the surroundings of the artificial eyeball 1 to make the user of the user terminal 4 Avoid the trouble of monitoring around the artificial eyeball 1. The monitor has accumulated statistics for analysis database 145 ----------------- (Please read the notes on the back before filling this page) Magic: -1 line · This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 _B7_____ V. Description of the invention. The expertise of the material 'so it is not necessary for users to use it for analysis, special knowledge of statistical data . Therefore, 'specialized chain stores and other organizations' can quickly and efficiently launch stores. According to invention No. 4 of the scope of the patent application, the mobile camera ο is controlled by the visual device 2 so that the mobile camera captures an object at a local resolution, and the visual device 2 recognizes the type of the object and records the position of the object in detail. Therefore, the pet-type robot according to the present invention can be moved toward the person being searched. In addition, if the pet-type robot is equipped with a device and a program for judging the appearance of a person, the pet-type robot can easily determine whether the person is the owner. According to invention No. 5 of the scope of the patent application, 'Because the visual device 2 will control the mobile camera 10 by automatically controlling the mobile camera 10', users and computers at a distance do not need to constantly control the mobile camera. 10. And if the object is a person, that person does n’t need to check whether he is on the lens all the time. Therefore, 'the user and the computer in the distance can free up time to do other work', so the user and the computer can work very efficiently, and the communication device 7 does not need to continuously transmit control instructions. For example, a 'television reporter sets up the invention at the scene of an incident or accident' so that a single person can take a report and interview, and then can directly transmit it to a radio station. That is, the present invention becomes a useful photographic device when individuals transmit moving images on the Internet. In addition, the visual device 2 determines whether an object is reflected in the moving image captured by the mobile camera 10, and the communication device 7 transmits only the digital image 111 and the mask image 148 showing the object, so even the communication The slow communication device 7 can also efficiently transmit a moving image reflecting an object. 146 This paper size applies to China National Standard (CNS) A4 specification (21 × 297 mm) ---- I ---- 1 ------- (Please read the precautions on the back before filling this page ) »·

498290 A7 ___B7__ 5. Description of the invention (/ (^ p Therefore, the present invention can effectively use media with limited communication circuit capacity, such as the mobile phone 211. Especially since the visual device 2 easily extracts the face as the object area 141, the action is taken by The telephone 211 is connected to a remote computer system, so that the user can use the present invention as a personal authentication device. Of course, the present invention protects the privacy of the user by setting appropriate images in the background, and the user can also be happy The present invention is applied to the photographing of posters. Furthermore, since the communication device 7 transmits the digital image 111 and the mask image H8 only when the visual device 2 recognizes the object, it is borrowed in the office, house, factory, road The invention of a device such as a vehicle or a vehicle enables users and security companies to use the invention as a cheap surveillance device. According to the invention in the scope of patent application No. 6, compared to the case of using a CCD camera fixed on the glasses, The mobile camera 10 performs panning, tilting, rolling and zooming, and the artificial eyeball 1 can achieve a wide field of view and a high degree of vision even if the CCD with the same integration degree is used. And because the visual device 2 automatically searches for objects, pedestrians 324, bicycles, cars 321, etc. can be found in advance, and objects that are close to the user can walk safely. Although the user recognizes the object, it is useful information The visual device 2 is provided to the user, so the present invention can reduce the burden on the user compared with the case of simply using a CCD camera, and the present invention can also provide a comfortable life for the user. In addition, if the electrode array terminal 214 is used, The electrical stimulation of the nerve that controls the direct movement of the eyeball is taken out of the user's brain, and the visual device 2 can use the electrical stimulation to control the mobile camera 10. Furthermore, the mobile camera 10 is a mechanism for controlling panning, tilting, rolling and zooming. When using a multi-degree-of-freedom motor, the multi-degree-of-freedom motor is very close to the actual eyeball shape of 147. This paper size applies to the Chinese National Standard (CNS) A4 specification (210 X 297 mm). (Please read the precautions on the back before filling (This page)

498290 A7 _ B7__ 5. Description of the invention (/ (^ Γ) • Spherical, so it is easy to bury artificial eyeball 1 into the eye socket. Especially when the multi-degree-of-freedom motor is an ultrasonic motor using a piezoelectric chip and a piezoelectric register 'Multi-degree-of-freedom motor can save space, low weight and low power consumption' The user can reduce the anxiety from chaos, accidents or weight. When the user implants the artificial eyeball 1 into the eye socket, the user can wear it Wearing sunglasses makes it difficult for the person facing artificial eyeball 1 to see, and it will reduce the psychological burden on both sides. Furthermore, the electrode array terminal 214 is buried into the optic nerve, lateral lacquer body, posterior lobes, and sides through the eye sockets. In the scalp and parietal lobes, the doctor does not need to make holes in the cranium of the user, and the user does not need to worry about a pipeline running out of the cranium. Therefore, the present invention can reduce the burden on the user. According to the invention of the present invention, almost part of the image processing performed by the visual device 2 is installed in the shooting portion of the mobile camera 10. That is, although the present invention is space saving and low power consumption, it is also The image processing can be performed at high speed. The present invention can reduce the burden on the user 'and facilitate the maintenance of the artificial eyeball 1. According to the invention of the eighth aspect of the patent application, the position / size / tilt detection device 44 is parallel in pixel units. After processing, the position, size, and inclination of the object can be detected from the formation of the edge information image 115, the object area image 142, and the color information image 172. Moreover, even if the shape of the object is unknown, the position / size / inclination detection device 44 can Obtain the inclination of the object. The position / size / inclination detection device 44 is also used to identify multiple images from a still image of a moving image captured by a video camera or a digital phase machine and read by a scanner. Objects can be processed beforehand, and can achieve the pattern recognition algorithms of moving images and still images at high speed and cheaply. Position / Large 148 This paper size is applicable to China National Standard (CNS) A4 (210 X 297 mm) (Please read the back first (Notes for filling in this page)

498290 A7 ____B7_ __ V. Description of the Invention (Your Hand) • The small / inclination detection device 44 can also be used as a pre-recognition structure. Since the array computing device 100 does not output repeating information 183 of eight moving sources, a system for inputting a repeating information image 132 and an inclination angle from the position / size / tilt detection device 44 can make the communication mechanism simple. According to the invention in the ninth scope of the patent application, the array computing device 100 can transfer a large amount of data to the nearby array computing device 100 in a short time. Therefore, when it is necessary to transfer most of the data to the vicinity like the moving source repetitive information image 184, the present invention does not reduce performance due to the bottleneck of communication. The invention of the eighth aspect of the patent application can be achieved. In addition, when several local parallel image processes are to be performed together, the present invention can also efficiently perform these local parallel image processes. Furthermore, since each controller 103 includes a front input data register 61 and a result data register 62, the array computing device 100 can output and input a plurality of wide materials together. In particular, the present invention is effective for an edge information forming device and an area normalization device such as a local parallel image process using a plurality of images. For the communication between the cross-layer array computing devices 100, the data register 61 and the result data register 62 are input before several controllers. LSI designers can effectively utilize the impact of three-dimensional LSIs. With the invention of the tenth item, the array computing device 100 can transfer a large amount of data to the nearby array computing device 100 in a short time. Therefore, when it is necessary to transfer a large amount of data to a nearby place like a moving source repeat information image 184, the present invention does not reduce performance due to the bottleneck of communication, and can achieve the eighth invention of the patent application scope. In addition, when several local parallel image processing is to be performed together, the present invention can also efficiently perform these local flat 149 paper sizes to the Chinese National Standard (CNS) A4 specification (210 x 297 mm) ------- -------------- ^ --------- ^ (Please read the notes on the back before filling this page) 498290 A7 _- — B7

-------------- Install --- (Please read the precautions on the back before filling this page) Image processing. In the present invention, the controller 103 is installed on an independent layer, and because the controller 103 communicates with the processor and the memory 102 through the address bus 51 and the data bus 52, the LSI designer needs to add a controller to the installation as needed. The number of layers of 103 can improve the communication performance between the array computing devices 100. In addition, the inventions of the eighth and ninth patent applications are combined, and the LSI can integrate the controller 103 at a high density. Line · According to the 11th invention of the scope of patent application, when the visual device 2 processes a fixed number of pixels of dynamic images, the visual device 2 requires only a few virtual array computing devices 105 compared with the array computing device 100. . That is, when the number of array computing devices 100 that can be installed with the conventional LSI technology is less than the number of pixels of a moving image, the LSI designer can use the virtual array computing device 105 to mount the visual device 2 on the LSI. In addition, when the array computing device 100 such as the position / size / tilt detection device 44 must communicate with most of the computing data of the adjacent array computing device 100, the virtual array computing device 105 only needs to refer to these computing data in the recorder 102. That is, the designer of the LSI can appropriately determine the number of 100 array computing devices allocated to the virtual array computing device 105, and can also operate the visual device 2 at high speed. Furthermore, since the array computing device 100 can share programs and look-up tables in the virtual array computing device 105, the data processing device 110 can reduce the consumption of the entire memory 102. According to the inventions in the scope of patent applications Nos. 12, 13, and 14, manufacturers of CCD and CMOS processors can directly use their own LSI, CCD, and CMOS manufacturing technologies to manufacture high-performance processors. Therefore, the manufacturer can manufacture high-function parts in a short time and at a low price. 150 This paper size is applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 Γ ----— _Β7__ V. Description of the invention (/ ¾ ^) • Controller 'So users of the present invention can use it in housing, convenience stores, supermarkets, offices, factories, general roads, parking lots, stations, public welfare agencies, cars, ships, and space stations. High-performance processors for various applications such as surveillance devices, security devices, search devices, alert devices, tracking devices, computing devices, pet-type robots' counter robots, work robots, and welfare robots. In the present invention, the designer of the CCD and CMOS processors arranges only one functional column 201 on a two-dimensional grid, which can capture an image of an appropriate size, and it is easy to design a high-function processor. Therefore, these designers can design high-performance processors in a short period of time and at a low price. According to the inventions in the 15th and 16th of the patent application scope, even if the frequency of the clock signal becomes high, the clock signal is transmitted by the delay time. The interlocking counters 416 are dispersedly arranged on the LSI as a whole within the period, so that the counts of all the interlocking counters 416 are consistent. In particular, a synchronous oscillation circuit 410 to be used as a clock signal is used. Since the clock signal is synchronized with the entire LSI even if the frequency of the clock signal becomes high, all the interlocked counters 416 can be synchronized. Therefore, the interlocked counter 416 and the synchronous oscillating circuit 410 can be easily separated from other digital circuits. Therefore, LSI designers can synchronize the interlocked counter 416 and the synchronous oscillating circuit 410 with other than the interlocked counter 416 and synchronous Digital circuits other than the oscillation circuit 410 are independent and localized. Therefore, the LSI designer 'can easily set the LSI with a clock signal of δ ten corresponding to the office frequency. According to the present invention, a parallel system having a large-scale performance, such as a pipeline processing device, a DSP (Digital Signal Processor), a pulsating array, a data stream machine, and a parallel image processing device, as a whole, has an improved performance. Standard (CNS) A4 specification (210 x 297 mm) I ----- II ----- i I (Please read the precautions on the back before filling this page) Order:-line · 498290 A7 _B7_ 5 Explanation of the invention (/ q) Provides a weekly signal and a timer interrupt signal that are synchronized with the clock signal. Guru LSI designers can avoid the problem of transmission delay time and can also design large-scale parallel systems. According to the invention of claim 17 in the scope of patent application, a digital circuit arranged on the entire LSI can simultaneously receive transmitted signals from any place of the LSI. Especially in the case of multiple function blocks on one LSI like a system LSI, the higher the frequency of the clock signal, the more difficult it is to change each of the methods of responding to the signal, the interrupt signal and the time point of the input and output Design of functional blocks. However, using the present invention, regardless of the configuration of each functional block, as long as the maximum transmission delay time is considered, the time point of the reply signal, the break signal and the input / output signal can be controlled, so the LSI designer hardly needs to change the functional blocks. Design, these functional blocks can be installed in one LSI. Furthermore, when multiple processors 101, such as a SIMD (Single Instruction Stream Multi Data Stream) type multiprocessor, input the same command, whether the transmission delay time of the signal from the memory 102 storing the instruction to each processor 101 is different All processors 101 must operate at the same time. However, since the present invention can provide instructions to all processors 101 at the same time regardless of the clock frequency, the LSI designer can easily design the processors 101. According to the inventions in claims 18 and 19 of the scope of patent application, it has nothing to do with semiconductor manufacturing technologies such as TTL and ECL, such as bipolar semiconductors, and CMOS, etc. As long as simple circuits are added, the digital circuits of the entire LSI can be synchronized. In particular, in recent years, by increasing the speed of digital circuits, the clock frequency has been increased ', and it has become increasingly difficult to maintain the synchronization of the entire LSI. Therefore, the use of this 152 paper size applies to the Chinese National Standard (CNS) A4 specification (210 X 297 public love) -------------- install --- (Please read the note on the back first Please fill in this page for more details) Order--line · 498290 __B7 _____ V. Description of Invention (/ ^ 1) Inventions allow semiconductor manufacturers to easily design processors 101 and measuring machines required for high-speed operation. In addition, a part of the synchronous oscillation circuit 410 in the interlock device may input a synchronization signal from a stable oscillation circuit like the crystal oscillator 408, and the entire clock frequency of the interlock device may be matched with the vibration number of the crystal oscillator 408. According to the present invention, in the parallel system as a whole, which has a larger scale function, such as a pipeline processing device, a DSP (Digital Signal Processor), a pulsating array, a data stream machine, and a parallel image processing device, the clock signal synchronization can be provided for each cycle. The signal and the timer interrupt the signal, so the LSI designer can avoid the problem of transmission delay time, and can also design a large-scale parallel system. [Brief description of the diagram] Figure 1 is an illustration of an information collection system that transmits information generated by an artificial eyeball to a user terminal. Figure 2 is an explanatory diagram of a mobile phone equipped with an artificial eyeball. Fig. 3 is an explanatory diagram when a mobile camera and a vision device are installed behind a car. Fig. 4 is an explanatory diagram when a mobile camera and a vision device are installed behind the wheelchair. Fig. 5 is an explanatory diagram of an information collection system that is continuously monitored by the monitoring terminal to generate information from the artificial eyeball and cooperates with the information that needs to be transmitted to the user terminal. FIG. 6 is an explanatory diagram of an information collection system in which information generated by an artificial eyeball is stored in a database and a user terminal appropriately retrieves the database. Figure 7 is an explanatory diagram of a database record that records environmental data, number of objects, and digital images formed by the types and locations of objects collected from the vision device controlling the mobile camera. Figure 8 is the information generated by the artificial eyeballs is stored in the database, and the appropriate database is retrieved by the monitoring terminal, and 153 paper sizes are applicable to the Chinese National Standard (CNS) A4 specification (210 X 297 mm) ) ----- II --- · II (Please read the notes on the back before filling this page) ιδ. Line-498290 A7 ____ B7 ___— ____ V. Description of the invention (丨 义 |) Transmitted to the user terminal An illustration of an information collection system. Fig. 9 'is a block diagram of an information collection system composed of a manual eyeball and a user terminal. Fig. 10 is an explanatory diagram of an artificial eyeball having a mobile camera, a vision device, and a communication function. Fig. 11 is a block diagram of a communication device installed on an artificial eyeball. Fig. 12 is a flowchart showing an algorithm of the image compression device of this embodiment. Fig. 13 is an explanatory diagram of an artificial eyeball having a mobile camera, a vision device, a stimulus generator's electrode array terminals, a connector, and a battery. Fig. 14 is a block diagram of a visual device that controls a mobile camera to find an object and counts the number of objects. Fig. 15 is an explanatory diagram of image coordinates when the mobile camera is operated with the optical axis of the lens as a center. Fig. 16 is a block diagram of an array computing device arranged in a grid pattern. Fig. 17 is an explanatory diagram sequentially attached to numbers around 8 which are turned counterclockwise. Fig. 18 is a flowchart showing an algorithm of the image memory device of this embodiment. Figure 19 is an explanatory diagram when color information is generated for a specific color in a digital image. Fig. 20 is a flowchart showing an algorithm of the color information generating device of this embodiment. Fig. 21 is an explanatory diagram when rough edge information is generated using a digital image. Fig. 22 is a flowchart showing an algorithm of the edge information generating device in this embodiment. FIG. 23 is an explanatory diagram when rough edge information is formed into edge information using a digital image. Fig. 24 is a flowchart showing an algorithm of the edge information forming apparatus of this embodiment. Figure 25 is an explanatory diagram when forming low-resolution coarse-edge information generated from low-resolution digital images into edge information. Fig. 26 is an explanatory diagram when cutting out a low-resolution coarse edge information region generated from a low-resolution digital image to form edge information. Figure 27 'Detection of edge information shadow 154 This paper size applies Chinese National Standard (CNS) A4 specification (210 X 297 mm) • I II —-— — — — —--(Please read the Please fill in this page again for the matters needing attention) = 0 · Refer to 498290 A7 ___B7_ V. Description of the invention (/ ^ 丄) • An illustration of the position and size of the objects in the image. Fig. 28 is a flowchart showing the algorithm of the position / size detection device of this embodiment. Fig. 29 is an explanatory diagram when the position and size of an object in pixels in the object area are detected. Figure 30 is an explanatory diagram when the position, size, and inclination of an object in the edge information image are detected. FIG. 31 is a flowchart showing an algorithm of the position / size / tilt detection device of this embodiment. Fig. 32 is an explanatory diagram when detecting the position, size and inclination of an object in the image of the object area. Figure 33 is an explanatory diagram of an example of duplicate information of a mobile source. Figure 34 is an explanatory diagram when detecting the position, size, and inclination of the texture in the color information image. Fig. 35 is an explanatory diagram when the separated object area of a digital image is normalized. Fig. 36 is a flowchart showing an algorithm of the area normalization device of this embodiment. Fig. 37 is an explanatory diagram when a virtual image is generated from a digital image using an image of a separated object area. Fig. 38 is a flowchart showing an algorithm of the virtual device of this embodiment. Fig. 39 is a flowchart showing an algorithm of the image holding device of this embodiment. Fig. 40 is an explanatory diagram when pattern matching is performed on the normalized image from the template image. Fig. 41 is a flowchart showing an algorithm of a pattern matching device in this embodiment. Fig. 42 is an explanatory diagram showing a state in which edge information of a triangle is separated into an inner region and an outer region of the triangle. Fig. 43 is a flowchart showing an algorithm of the object / background separation device of this embodiment. Fig. 44 is an explanatory diagram showing a state in which edge information of a triangle in a broken state is separated into an inner region and an outer region of the dotted triangle. Fig. 45 is an explanatory diagram showing a state in which edge information of two overlapping triangles is separated into two triangle regions and a background region. Figure 46 shows the edge of the dotted line when two circular object areas are overlapped. 155 This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) (Please read the precautions on the back before filling in this page)

498290 A7 ___B7 —_ 5. Description of the invention (tfi). An illustration of the separation of edge information into two circular areas and a background area. Figure 47 is a block diagram of the internal structure of an array computing device. Figure 48 is a block diagram of the controller. Figure 49 is an explanatory diagram showing the input and output signals of a flag encoder. Figure 50 is an explanatory diagram showing the input and output signals of a flag encoder. Figure 51 is a flowchart showing the algorithm of the processor transmitting data to the adjacent array computing device through the controller. Fig. 52 'is a flowchart showing an algorithm in which a controller receives data from an adjacent array computing device. Fig. 53 is a flowchart showing an algorithm for the processor to receive data from the input resistor. Fig. 54 is an explanatory diagram of an array computing device when five controllers are arranged on a plane. Fig. 55 is an explanatory diagram of an array computing device when five controllers are stacked. Fig. 56 is an explanatory diagram when nine array operation devices are regarded as one hypothetical array operation device. Fig. 57 'is an explanatory diagram when the assigned number for the controller is attached to 9 array computing devices included in one hypothetical array computing device. Fig. 58 is an explanatory diagram of a shift register which sequentially stores 9 result data output from 9 array computing devices. Fig. 59 is a functional column block diagram of an artificial eyeball processor that executes each process using an individual array computing device. Figure 60 is a block diagram of the processor when the functional columns are arranged on a two-dimensional grid. Fig. 61 is a functional block diagram of an artificial eyeball processor that performs all processing using one array computing device. Fig. 62 'is a functional block diagram of an artificial eyeball processor that performs all processing using a hypothetical array computing device. Figure 63 is a block diagram of a processor when a functional pillar is vertically packaged on a packaging surface of a large integrated circuit. Fig. 64 'is a circuit diagram of a basic interlocking counter. Figure 65 is a network block consisting of 3 interlocking counters. 156 This paper size is applicable to China National Standard (CNS) A4 (210 x 297 mm) (Please read the precautions on the back before filling out this page. )

498290 A7 __B7___ V. Description of the Invention (M) --------- I ---- · I I (Please read the notes on the back before filling this page) Line-drawing. Fig. 66 is a timing chart when three interlocked counters are synchronized. Figure 67 is a timing diagram when one of the three interlocked counters has a faster phase. Figure 68 is a timing diagram when one of the three interlocked counters has a slower phase. Figure 69 is a timing diagram when the phases of the three interlocked counters are different. Figure 70 is a block diagram of a network composed of interlocking counters arranged in a square grid. Figure 71 is a block diagram of a network composed of interlocking counters arranged in a hexagonal grid. Figure 72 is a circuit diagram of an interlocking signal distribution circuit that uses output signals 3 and 5 in the decoder output to generate an output signal. Figure 73 is a timing diagram of an interlocking signal distribution circuit that uses output signals No. 3 and No. 5 to generate an output signal. Fig. 74 is a circuit diagram of a basic synchronous oscillation circuit. Figure 75 is a circuit diagram of a synchronous oscillation circuit using an input resistor. Figure 76 is a circuit diagram of a synchronous oscillation circuit when a crystal oscillator is used. Figure 77 is a block diagram of a network composed of three synchronous oscillator circuits. Fig. 78 is a timing chart when three synchronous oscillation circuits are synchronized. Figure 79 is a timing diagram when one of the three synchronous oscillation circuits has a faster phase. Figure 80 is a timing diagram when one of the three synchronous oscillation circuits has a slower phase. Fig. 81 is a timing chart when the phases of the three synchronous oscillation circuits are different. Fig. 82 is a timing chart when power is supplied to three synchronous oscillation circuits. Figure 83 is a block diagram of a network composed of synchronous oscillator circuits arranged in a square grid. Figure 84 is a block diagram of a network composed of synchronous oscillator circuits arranged in a hexagonal lattice. Fig. 85 is a block diagram of a central control device that communicates with a mobile camera, a visual device, a display, a sound synthesizing device, and a voice recognition device. 157 [This paper size applies the Chinese National Standard (CNS) A4 specification (21〇x 297 public love 1 ^ 498 290 A7 _B7 V. Description of the invention (• [Symbol] 1 Artificial eyeball 2 Vision device 4 User terminal 5 Monitoring Terminal 6 Database 7 Video device 8 Communication network 10 Mobile camera 11 Image acquisition device 12 Image memory device 14 Edge information generation device 15 Edge information formation device 16 Object / background separation device 17 Position / size detection device 20 Camera / environmental coordinates Conversion device 21 Image / environment coordinate conversion device 22 Position selection device 23 Motion control device 24 Control instruction input device 25 Vibration instruction generation device 26 Camera instruction generation device 27 Area normalization device 29 Image recognition device 158 (Please read the precautions on the back first (Fill in this page again.) Installation-line · This paper size applies to Chinese National Standard (CNS) A4 (210 X 297 mm) 498290 A7 B7 Description of the invention (ai) 30 Identification result holding device 31 Environmental understanding device 32 Timing device 33 Environment map holding device 34 Object position Estimation device 35 Object counting device 36 Object number holding device. 37 Geometric analysis device 38 Pattern matching device 39 Image holding device 40 Mask device 41 Color information generating device 42 Tilt detection device 44 Position / size / tilt detection device 51 Address Bus 52 Data bus 53 Address buffer 54 Address decoder 55 Data buffer 56 Internal data bus 57 Flag register 58 Flag decoder 59 Flag encoder 60 Status register 159 --- ----------- Loading --- (Please read the precautions on the back before filling this page) · '-丨 Line · This paper size applies to China National Standard (CNS) A4 (210 X 297) Mm) 498290 A7 B7 Description of the invention (61 before input data register 62 result data register 63 output data register 64 upper input data register 65 lower input data register 66 left input data register 67 Right input data register 68 Front input shift register 69 Front input counter 100 Array operator 101 Processor 102 Memory 103 Controller 105 Virtual array computing device 110 Data processing device 111 Digital image 112 Rough edge information 113 Rough edge information image 114 Edge information 115 Form edge information image 116 Low-resolution digital image 117 Low-resolution coarse edge information image 118 Low-resolution coarse edge information image 119 Cut out Rough-edged information image 160 ----------------- (Please read the notes on the back before filling this page) Order: -1 line-This paper size applies to Chinese National Standards (CNS ) A4 specification (210 X 297 mm) 498290 A7 _B7 V. Description of the invention 120 Cut out digital image 121 Cut out to create edge information image 131 Repeat information 132 Repeat information image 141 Object area 142 Object area image 143 Separate object area 144 Normalization Region 145 Normalized image 146 Template image 147 Matching result image 148 Mask image 151 Triangle edge information 152 Triangle inner area 153 Triangle outer area 154 Triangle edge information of the dotted state 155 Inside area of the dotted triangle 156 Outside area of the dotted triangle 157 Edge information of front triangle 158 Rear triangle Shape edge information 159 Inside area of front triangle 160 Inside area of rear triangle 161 Background area of double triangle 162 Two overlapping round edge information 161 (Please read the precautions on the back before filling this page)

This paper size applies the Chinese National Standard (CNS) A4 specification (210 X 297 mm) 498290 A7 _ B7 V. Description of the invention (// f) 163 The inner area of the front circle 164 The inner area of the rear circle 165 Double circle Background area 171 color information 172 color information image 181 edge information image 182 8 nearby 183 8 moving source repeat information 184 moving source repeat information image 201 function column 204 A / D conversion circuit 207 photographic element 208 parallel / serial conversion circuit 211 Mobile phone 212 Battery 213 Stimulus generator 214 Electrode array terminal 215 Connector 221 Central control device 222 Display 223 Control button 224 Speaker 225 Microphone 226 Sound synthesis device 162 --- (Please read the precautions on the back before filling this page) Cable -This paper size is in accordance with Chinese National Standard (CNS) A4 (210 X 297 mm) 498290 A7 _B7 V. Description of the invention (/ ζ.) 227 Voice recognition device 301 Environmental map input device 302 Map / text conversion device 303 Any object Number input device 304 Number of objects / Text conversion device 305 Map / Number of objects Holding device 306 Command text input device 307 Text / command conversion device 308 Control command holding device 309 Digital image receiving device 310 Text insertion device 311 Video recorder signal output device 321 Car 322 Rear bumper center 323 Rear roof center 324 Pedestrian 325 Locomotive 326 Shooting range 331 Seat 401a NOR gate for oscillating 401b NOR gate for oscillating 402 402 Synchronization part and NOR gate for initialization 403a A resistor for oscillating 403b A resistor for oscillating B 163. I ---- I ----— I (Please read the precautions on the back before filling this page) • Thread-This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) 498290 A7 B7, Invention Description (| Gl 404a A side oscillation capacitor 404b B side oscillation capacitor 405 a A side synchronization lock circuit 405b B side synchronization lock circuit 406a A side synchronization NOR gate 406b B side synchronization NOR gate 407a A side input resistance 407b B side Input resistance 408 Crystal oscillator 410 Synchronous oscillation circuit 411 Synchronous counter 412 End of judgment NOT gate 413 Interlock lock circuit 414 Interlocking NOR gate 415 Calculation NOR gate 416 Interlocked counter 421 Signal distribution decoder 422 Signal distribution lock circuit 423 Signal distribution NOR gate 424 Signal distribution flip-flop circuit 501 Record 502 Time stamp 503 Visual device number 504 Environmental information Number 164 This paper size is applicable to China National Standard (CNS) A4 (210 X 297 mm) (Please read the precautions on the back before filling this page)

498290 A7 _B7 V. Description of the invention ([ί, 505 types 506 positions 507 objects 508 digital images 701 image compression devices 702 image transmission devices --- (Please read first Note on the back, please fill in this page again) Line · 165 This paper size applies to China National Standard (CNS) A4 (210 X 297 mm)

Claims (1)

498290 Printed clothing A8 B8 C8 D8 by the Consumer Cooperative of the Intellectual Property Bureau of the Ministry of Economic Affairs 6. Application for patents 1. An information collection system consisting of at least one artificial eyeball and at least one user terminal connected to a communication network , Characterized in that the artificial eyeball is provided with a mobile camera, a vision device, and a communication device; the mobile camera is provided with at least one of a mechanism for panning, tilting, rolling, and zooming; the visual device Is to obtain a digital image from the dynamic image captured by the mobile camera, to generate the type, position, and number of objects in the digital image, and to control the pan, tilt, roll, and zoom The aforementioned mechanism; the aforementioned communication device transmits at least one of the aforementioned digital image, the aforementioned type, the aforementioned position, and the aforementioned number to the user terminal, and corresponds to the aforementioned panning, the aforementioned pitching, the aforementioned rolling, and The aforementioned zoom control instruction is received from the aforementioned user terminal and transmitted to The visual device; the user terminal is provided with a central control device, a display, and a control button to generate the control command specified by the control button; the central control device is a device that converts the digital image, the type, and the foregoing At least one of the position and the number is received from the communication device, and the control command is transmitted to the communication device; the display is used to display at least one of the digital image, the type, the position, and the number One. (Please read the notes on the back before filling this page) This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) 498290 A8 B8 C8 D8 VI. Patent Application Scope 2. An information collection system, at least 1 manual eyeball connected by a communication network , A database, and at least one user terminal, characterized in that: the artificial eyeball is provided with a mobile camera, a visual device, and a communication device; the mobile camera is provided with a pan, tilt, roll , And at least one of the zoom mechanism; the aforementioned visual device is used to obtain a digital image from the moving image captured by the mobile camera, and to generate the type, position, and number of objects in the digital image The aforementioned communication device transmits at least one of the aforementioned digital image, the aforementioned category, the aforementioned location, and the aforementioned number to the aforementioned database; the aforementioned database is used to store the aforementioned digital image, the aforementioned type, the aforementioned location, and The aforementioned number, and statistical data are generated from the aforementioned digital image, the aforementioned type, the aforementioned position, and the aforementioned number. , Which uses a search key to retrieve the aforementioned digital image, the aforementioned category, the aforementioned location, the aforementioned number, and the aforementioned statistical data; the aforementioned user terminal is provided with a central control device, a display, and a control button to generate the aforementioned control button The designated search key f and the central control device are used to receive at least one of the digital image, the type, the position, the number, and the statistical data from the communication device, and control the search key. Send to the aforementioned communication device. 2 This paper size is in accordance with Chinese National Standard (CNS) A4 (210 X 297 mm) --- (Please read the precautions on the back before filling this page) Printed by the cooperative— ^ 1 ^ ----- II niii ^^ i • Printed by the Consumers ’Cooperative of the Intellectual Property Bureau of the Ministry of Economy Printed 498290 A8 B8 C8 D8 _ VI. The scope of the patent application The aforementioned display displays the aforementioned digital images, At least one of the aforementioned type, the aforementioned position, the aforementioned number, and the aforementioned statistical data. 3 · If the scope of patent application The information collection system according to item 1 or item 2, wherein the user terminal has at least one of a sound synthesis device with a speaker and a sound recognition device with a microphone; the sound synthesis device is used for combining The position, the number, and the statistical data are converted into sound signals; the sound recognition device converts the sound collected by the microphone into the control command and the search key. 4. An artificial eyeball, which has a mobile camera and The visual device is characterized in that: the mobile camera includes at least one of a mechanism for panning, tilting, rolling, and zooming; the visual device includes the following 6 devices: from the mobile camera A device for obtaining a digital image from the captured dynamic image, a device for identifying the type of the object in the digital image, a device for detecting the position, size, and inclination of the object, a device for calculating the number of the object, Used to control the aforementioned pan, tilt, roll, and change The mechanism of the apparatus, and the position of the digital image, and means for outputting the number of the aforementioned type. 5. If the artificial eyeball in item 4 of the patent application scope is further equipped with a communication device, the aforementioned communication device is provided with a device for compressing the aforementioned digital image and transmitting the compressed aforementioned digital image via a communication network. 3 paper sizes Applicable to China National Standard (CNS) A4 specification (210 X 297 public love) (Please read the precautions on the back before filling this page) 498290 A8 B8 C8 D8 Printed by the Consumer Cooperatives of the Intellectual Property Bureau of the Ministry of Economic Affairs ^, the scope of patent application •, the aforementioned categories, the aforementioned locations, and the aforementioned number of devices. 6. If the artificial eyeball in item 4 of the patent application scope, further includes a stimulus generator, electrode array terminals, connectors, and batteries; the stimulus generator is used to normalize the image of the object generated by the visual device The aforementioned kind, the aforementioned position, the aforementioned size, and the changes in the aforementioned position are converted into electrical stimulation; and the electrode array terminal transmits the aforementioned electrical stimulation to the brain via the connector. 7. For the artificial eyeballs in the scope of the patent application for item 4, item 5, or item 6, wherein the aforementioned mobile camera is equipped with an integrated plurality of photographic elements, a plurality of A / D conversion circuits, and the aforementioned visual device processor. 8. A visual device, characterized in that: each array computing device arranged in a grid is provided with a device for initializing the aforementioned array computing device; and for ending processing if there is no information to be inputted Device; a device for inputting the above-mentioned secondary information; a device for converting the foregoing secondary information into duplicate information; a device for calculating the center of gravity from the vicinity of the band pixel 値 of the repeated data image representing the duplicate data, so that The movement amount calculated by the center of gravity is imaged and becomes a device of band pixels of the movement amount image; for each moving source, according to the foregoing movement amount, each moving source repeating information image representing the moving source repeating information is Band pixel 値 A device that moves to a moving position; used to move the band pixel 4 of the aforementioned repeated information image according to the aforementioned movement amount (please read the precautions on the back before filling this page) • Line. This paper size applies to China National Standard (CNS) A4 (210 X 297 mm) 498290 Printed by A8 B8 C8 D8 of the Consumer Cooperatives of the Intellectual Property Bureau of the Ministry of Economic Affairs 6. Scope of patent application, 値 Move to the aforementioned mobile position The above device; for each of the aforementioned mobile sources, repeating each of the aforementioned band pixels of the aforementioned mobile source repeating information image, update 1 to be the total of all the aforementioned band pixels of the aforementioned mobile source repeating information image And a device corresponding to the sum of the aforementioned band pixels 値 of the aforementioned duplicate information image that has been moved;, for updating the band pixels 値 ′ of the aforementioned duplicate information image to the aforementioned bands of all the aforementioned duplicate information image that has been moved A device for summing all the pixels 値; a device for calculating the tilt angle of all the aforementioned band pixels 重复 of the information image from the moving source; and a device for outputting the band pixels 値 and the aforementioned tilt angle of the repeated information image . 9. A visual device, characterized in that: each array computing device 'arranged in a grid shape is provided with a processor, a memory, and a plurality of controllers, and the controller is provided with a means for identifying between the array computing devices. A device of the aforementioned array computing device which is a transmission source of the transmitted data and a device for identifying the kind of the aforementioned data to be transferred> In the aforementioned array computing device, a plurality of the aforementioned controllers are respectively connected to the adjacent aforementioned through signal lines. One of the plurality of aforementioned controllers of the array computing device, so that the aforementioned array computing device and the adjacent array computing device which are adjacent to each other simultaneously transmit the plurality of aforementioned data. 10 · —A kind of visual device, which is characterized in the scope of patent application 9 5 This paper size applies to Chinese National Standard (CNS) A4 (210 X 297 mm) (Please read the precautions on the back before filling this page ) 498290 A8 B8 C8 D8 6. Scope of Patent Application • In the array computing device of the item, 'the aforementioned controllers are all stacked', so that the aforementioned signal lines between the aforementioned array computing devices do not cross. 11. A visual device is composed of a plurality of virtual array computing devices arranged in a grid, characterized in that: the virtual array computing device has a processor, a memory, and a plurality of controllers; It has a front input register group, a front input register group, which has at least one front input register and at least one counter, so that the foregoing input register is used as a shift register, so that In an array computing device, the processor executes a program of a plurality of array computing devices arranged in a grid, the controller communicates with the controller of an adjacent virtual array computing device, and the shift register is arranged in a grid. The plurality of result data is sequentially input and memorized, the counter calculates the number of the result data, and the processor selects one of the plurality of result data from the shift register and inputs it. 12. An image sensor with functional blocks arranged in a two-dimensional grid, and provided with at least one photographic element, at least one A / D conversion circuit, and at least one array computing device; its characteristics are: The aforementioned functional block is a one-to-one connection between the aforementioned imaging element and the aforementioned A / D conversion circuit, and all of the aforementioned array computing devices are selected from at least one of all the aforementioned A / D conversion circuits and all the aforementioned array computing devices. A digital signal is input, and a clock signal is input to all of the aforementioned array computing devices; and between the adjacent functional blocks, a one-to-one connection is made between the aforementioned array computing devices, so that the aforementioned array computing devices are used for the aforementioned The motion image captured by the photographic element is image processed. 6 This paper size is in accordance with Chinese National Standard (CNS) A4 (210 X 297 mm) (Please read the notes on the back before filling out this page) t · • Line · Printed by the Intellectual Property Bureau of the Ministry of Economic Affairs and Consumer Cooperatives 498290 A8 B8 C8 D8 VI. Scope of patent application (please read the precautions on the back before filling this page) 13. —An image sensor whose functional blocks are arranged in a two-dimensional grid, and has a plurality of photographic elements, a plurality of An A / D conversion circuit, at least one parallel / serial conversion circuit, and at least one virtual array computing device; characterized in that the aforementioned functional block is a pair of the photographic element and the aforementioned A / D conversion circuit; 1 wiring, wiring a plurality of the aforementioned A / D conversion circuits and the aforementioned parallel / serial conversion circuits over the bandwidth of each of the aforementioned imaging elements' all the aforementioned virtual array computing devices from all the aforementioned parallel / serial circuits and all At least one of the aforementioned virtual array computing devices inputs a digital signal 'all of the aforementioned virtual array computing devices have input clock signals; and in adjacent adjacent functional blocks Between the array among the one-to-one arithmetic unit wiring, thereby to virtual array operation to the image processing apparatus for the motion pictures captured by the photographic element. _ Printed by the Consumer Cooperatives of the Intellectual Property Bureau of the Ministry of Economic Affairs. 14. If the image sensing benefits of the 12th or 13th in the scope of the patent application are applied, the aforementioned functional block is a synchronous oscillator circuit for generating the aforementioned clock signal. And an interlocking counter for counting the number of pulses of the aforementioned clock signal; the aforementioned synchronous edge-shaping circuits arranged in a two-dimensional grid form a first interlocking device by wiring with an adjacent synchronous oscillation circuit; The aforementioned interlocking counters arranged in a two-dimensional grid form a second interlocking device by wiring the adjacent interlocking counters. 15. —An interlocking device is composed of interlocking counters arranged in a square grid shape and a hexagonal grid shape, characterized in that the aforementioned interlocking counters are provided with a synchronous counter and a NOT gate for determining the end of the frame , Interlocking Lock Circuit, Interlocking NOR Gate, and Counting 7 This paper size applies to China National Standard (CNS) A4 (210 X 297 public love) 498290 A8 B8 C8 D8 * Printed by the Consumer Cooperatives of the Intellectual Property Bureau of the Ministry of Economic Affairs System VI. Apply for NOR gate for patent range device; use the interlock signal output by NOT gate to stop the adjacent interlocked counters to stop counting according to the aforementioned termination / determination so that the counts of all the aforementioned interlocked counters are consistent . 16. For example, the interlock device of the scope of application for patent No. 15, wherein the aforementioned interlocked counter is provided with a NOR gate for determining the end of the aforementioned count, the end of the count, and the determination; the aforementioned synchronous counter is provided with synchronous elimination Device and sync loading device. 17. If the interlocking device in the scope of patent application No. 15 or No. 16, at least one of the aforementioned interlocking counters is provided with a signal distribution decoder, a signal distribution lock circuit, a signal distribution NOR gate, and a signal The flip-flop circuit for distribution, and the input signal becomes a positive multiple of the clock signal period. 18. An interlocking device is composed of synchronous oscillation circuits arranged in a square grid and a hexagonal grid. It is characterized by : The aforementioned synchronous oscillating circuit includes two NOR gates for oscillation, two resistors for oscillation, two capacitors for oscillation, two lock circuits for synchronization, two NOR gates for synchronization, and a NOR gate for initialization, The phase of the clock signals of the adjacent synchronous oscillation circuits is shifted from each other by the synchronization signal output from the oscillation capacitor, so that the phases of the clock signals of all the synchronous oscillation circuits are consistent. 19. An interlocking device, characterized in that it is constituted by having two input resistors in the aforementioned synchronous oscillation circuit of the 18th scope of the patent application. 8 This standard is applicable to China National Standard (CNS) A4 specifications (210 X 297 Public Love 3 (Please read the precautions on the back before filling this page) Order-· -Thread_