TW567446B - Screen image reading system of PDA/mobile phone - Google Patents

Abstract

A screen image reading system of PDA/mobile phone targets at the screen image reading system of PDA/mobile phone capable of being adopted for the mechanism and application of personnel identification, purchase voucher or deduction for payment. The system comprises the sensing unit of PDA/mobile phone, CCD camera, frame grabber, image processing unit and image recognition unit. The sensing unit of PDA/mobile phone is responsible for detecting the PDA/mobile phone entering sensing area and forwards the sensing message to the frame grabber to trigger CCD camera for taking picture of screen image of PDA/mobile phone. After the taken screen image is processed by the image processing unit, the complete 2D screen image is forwarded to the image recognition unit for image recognition execution. The CCD camera can be coupled with lens to obtain excellent view and focus. Based on the screen image of PDA/mobile phone taken by CCD camera, using the feature of higher horizontal/vertical gradient variation, screen image positioning is proceeded and 2D image processing is conducted in terms of the located image position. Furthermore impurity is removed and image main body is kept, and then image processing technique is used to recognize the screen image.

Description

567446 A7 B7 V. Description of the invention (PA020074 TWP-3/11 10 15 Printed by the Consumer Cooperatives of the Intellectual Property Bureau of the Ministry of Economic Affairs 20 [Technical Field] The present invention relates to a pDA / mobile phone screen image reading system, especially referring to an application The reading system on the PDA / mobile phone screen or other liquid crystal display screen images is used as a mechanism for personnel identification, purchase vouchers or payment deductions. [Previous technology] Generally, laser diodes are used to emit lasers. When shooting on an object, the method of reading the reflected wave is used to distinguish the image. This technology cannot be applied to the image displayed on the screen of PDA / mobile phone. This shows that there are still many shortcomings in the above-mentioned conventional methods. It is not a good designer, and it needs to be improved. In view of the various shortcomings derived from the above-mentioned conventional methods, the inventor of this case is eager to improve and innovate. After years of painstaking and meticulous research, he finally successfully developed this PDA / mobile phone screen Image reading system [Objective of the invention] The object of the present invention is to provide a pDA / mobile phone screen image reading system, which Scenery > image processing technology and image recognition technology to provide a reading system for daylight images on PDA / mobile phone screens, to make up for the lack of reading / recognition using laser diodes, and can be applied to personnel Mechanisms for identification, purchase of goods, or payment deduction. [Technical content] A PDA / mobile daytime image reading system that can achieve the above-mentioned invention goals includes: PDA / mobile phone sensor unit, CCD camera, image capture card (Frame Grabber), image processing unit, image recognition unit (please read the precautions on the back before filling this page)

、 1T line '567446 A7 --- ~ B7 5 ~ f This system is based on image processing / recognition technology, and uses ccd photo- " several 1_PDA / daytime image images on the screen of the mobile phone, from the image processing sheet: The position of the daytime image is located and cut out in the Yau shirt image, and the image is binarized 'and the miscellaneous domain is removed. The county image recognition unit 5 completely recognizes the image. _The mobile phone sensing unit is responsible for detecting the PDA / mobile phone entering the sensing area, and sending the sensing information to the image manipulation card to trigger the CCD camera to capture the image of the screen on the screen of the chest mobile phone #; the image data obtained according to ^ ^ The horizontal image of Hunan image is straight and straight: ^ The characteristic of large gradient change 'locates and cuts the position of the image in the image, binarizes the image cut by 10 and removes impurities to keep the image body, and then Use horizontal / vertical scan lines to identify images line by line / column. [Brief description of the drawings] Please refer to the following detailed description of a preferred embodiment of the present invention and the accompanying drawings' for further understanding of the technical content of the present invention and its effects: 15 The drawings related to this embodiment are: · Figure 1 is a flow chart of a PDA / mobile phone screen image reading system according to the present invention; 'Figure 2 is an example of a PDA / mobile phone daytime image image captured by a CCD camera of the PDA / mobile phone daytime image reading system; Figure 2 is an embodiment of the image processing unit flow of the PDA / mobile phone screen image reading system; Figure 4 is an embodiment of the image recognition unit flow of the PDA / mobile phone screen image reading system; (Please read the precautions on the back before filling This page} Printed line for employees' cooperatives of the Intellectual Property Bureau of the Ministry of Economic Affairs ο --------- Figure 5 is the PDA / mobile phone screen image reading system 2PDA /, machine written

567446 A7 B7 V. Description of the invention (Example of image positioning; Figure 6 is a PDA / mobile phone screen image reading example of the PDA / mobile phone screen image cutting system; Figure 7 is a PDA / mobile phone screen image reading system PDA / mobile phone screen 5 image dualization embodiment; Figure 8 is a PDA / mobile phone day-time image reading system of the PDA / mobile phone screen image fetching example; and Figure 9 is the PDA / PDA / mobile phone screen image removal system for mobile phone day and night image reading system. 10 [Main part representative symbols] 11 PDA / mobile phone sensing unit 12 CCD camera 13 image capture card 14 image processing unit 15 image Identification unit 16 Printed by Consumer Consumption Cooperative of Intellectual Property Bureau, Ministry of Economic Affairs, Ministry of Economic Affairs, PA020074 TWP-5/11 (Please read the precautions on the back before filling this page)

17 PDA / mobile phone [preferred embodiment] Please refer to Figure 1, which is the structure and process of the PDA / mobile phone screen image reading system provided by the present invention. It mainly includes: · PDA / mobile phone early sensing unit 11, CCD It consists of a camera 12, an image capture card (Frame Grabber) 13, an image 15 processing unit 14, and an image recognition unit 15. Among them, the PDA / mobile phone sensing unit 11 is responsible for detecting the PDA / mobile phone 17 entering the sensing area 16 and transmitting the sensing information to the image capture card 13 to trigger the CCD camera 12 to capture the PDA / manual paper. CNS) A4 specification (210X29? Mm) 567446 A7 B7 V. Description of the invention (today) PA020074 TWP-6/11 Employees of the Intellectual Property Bureau of the Ministry of Economic Affairs, Consumer Cooperatives, screen images on the screen of the printer; PDA / mobile phone sensor 11 can be a hardware sensor (Sensor) or a software image detection method to sense whether a PDA / mobile phone 17 exists within its sensing range. When the PDA / mobile phone 17 enters, the sensor detects The state change will trigger the image capture card Π, and the image capture card 13 instructs the CCD camera 12 to capture the image of the daytime image on the PDA / mobile phone screen; the captured image image is processed by the image processing unit 14 Then, the generated binary image is transmitted to the image recognition unit 15 for identification. Figure 2 shows an example of a daytime image of a PDA / mobile phone captured by a CCD camera. When the PDA / mobile phone enters the sensor, the sensed state change is transmitted to the image capture card, and the image capture card triggers the CCD camera to capture a BarCode image on the screen of the PDA / mobile phone. Figure 3 shows an embodiment of the flow of the image processing unit. Enter the PDA / mobile phone image image captured by the CCD camera. Because BarCode has the characteristics of sharp vertical changes, vertical gradient processing is performed on the daytime image image and the critical value of the effective line is determined. When all effective lines are determined and After recording, group these effective rows (meaning the closest ones are grouped together), and then identify these groups in the same way and perform grouping actions, because of the characteristics of BarCode The gradient characteristics of the column groups in each row group are the same, so grouping the row groups with similar characteristics, the resulting area is the BarCode image area; the next step is to find the BarCode image by image processing. The straight edge of the image is used for horizontal / vertical correction of the image. After BarCode image positioning and horizontal / vertical correction, then apply this paper size to Chinese National Standard (CNS) A4 (2l0X2) fcf centimeters (Please read the precautions on the back before filling this page) 10 15 20 Order line 567446 Μ Β7 Printed by the Consumer Cooperatives of the Intellectual Property Bureau of the Ministry of Economic Affairs < " η ,, // ΡΑ020074 TWP-< V. Description of the invention (i) BarCode image is cut out, using a dynamic binary method Binarize the BarCode image and remove the impurities to retain the image body, and finally output the binary image of BarCode. FIG. 4 shows an embodiment of a process of an image recognition unit. First enter a binary image of 5 BarCode, and take one half of the width of BarCode as the number of points for the scanning line (meaning that one scanning line is taken every two pixels wide). Scan from the first Bar vertically. Scan and record the number, width and position of Bar, the number, width and position of blanks after scanning; remove the scanning seedling lines with a small number and large number of Bars The missing part of the binarization and elimination of the duality is to remove the scan line), leaving most of the scan lines with the same number of Bars, and the width of the Bar and the width of each bar respectively Do the averaging and then decode; match the decoded result with the BarCode's Check Code, and if it is correct, output the BarCode decoded recognition result. If it is incorrect, reject the daytime image. 15 Figure 5 shows an example of PDA / mobile daytime image positioning. The input color PDA / mobile phone screen image is converted into a grayscale image, and the vertical position of the BarCode is used to change the position of the image using the gradient method and the grouping method; the BarCode legend here is placed vertically If it is placed horizontally, the program can also use the characteristics of the sharp change of the BarCode level to locate the image position. Figure 6 shows an example of PDA / mobile phone screen image cutting. After the BarCode image location is complete, the BarCode image is cut out. Figure 7 shows an example of a dual image of a PDA / mobile phone screen image. For (Please read the notes on the back before filling this page)

This paper size applies Chinese National Standard (CNS) A4 specification (nOxiWi) A7 Printed by the Consumer Cooperatives of the Intellectual Property Bureau of the Ministry of Economic Affairs 567446 B7 ^ ^, r, / / x PA020074 TWP-V. Description of the Invention (6) BarCode images are dynamically binary, and the removal of impurities also fills in the gaps of each Bar. Figure 8 shows an example of scanning scanning of daytime images of PDA / mobile phones. After the binarization of the BarCode image, one-half of the BarCode width and 5 degrees are used as the number of scanning line points (the BarCode length and width of the legend are 250 and 123 pixels, respectively, so 62 scanning lines are taken as Take points) Average BarCode from the first Bar to the last Bar. Figure 9 shows an example of a PDA / mobile phone screen image removal scan line. Starting from the first Bar, record the results of each scan line, record the number, width and position of 10 Bars, the number, width and position of blanks respectively; remove the scan lines with fewer and more Bars (meaning The scanning line scans for impurities or scans for the disappearance of the binary, that is, the scanning line is removed), leaving most scanning lines with the same number of Bars. The red scanning lines in the figure That is, scan the blank part of the BarCode edge and scan the 15 Bar that disappeared due to the binarization and the part that combined the two Bars due to the binarization. [Features and effects] The PDA / mobile phone screen image reading system provided by the present invention has the following advantages when compared with the aforementioned citations and other conventional technologies: (1) Can be widely read for other conventional technologies that cannot be read PDA / mobile phone screen 20 or other LCD display image. (2) Combined with image processing and identification technology, a wide range of images can be read, not limited to reading bar codes. (3) Use the CCD camera to read the recognition image to reduce the chance of laser waves harming the human body. This paper size applies to China National Standard (CNS) A4 specification (210X2V? F%) (Please read the precautions on the back before filling this page)

567446 A7

The above list is printed by the Consumers' Cooperative of the Intellectual Property Bureau of the Ministry of Economic Affairs. It is a detailed description of one of the feasible embodiments of the present invention, but this embodiment is not intended to limit the scope of patents of the present invention. All equivalent implementations or changes shall be included in the patent scope of this case. To sum up, this case is not only technically innovative, but also can use items to enhance the above-mentioned multiple effects. It should have fully complied with the statutory invention patent requirements of _ nature. According to the law, ^ this application for an invention patent should be approved. Encourage invention, to the sense of Γ. nuclear

Claims (1)

Printed by the Consumer Cooperatives of the Intellectual Property Bureau of the Ministry of Economic Affairs 567446 A8 B8 C8 D8 --- ^ ?. Called Ding Liuli, patent application scope 1 'A PDA / mobile phone screen image reading system, the PDA / mobile phone sensing unit is responsible for detecting the PDA / mobile phone entering the sensing area, and sending the sensing information to the image capture card to trigger The CCD camera captures the image image of the screen on the PDA / hand screen, and the captured daytime image shadow image is used by the image processing unit to generate a binary image, and then the binary image is transmitted to the image Identification unit to identify. 2. The PDA / mobile phone screen image reading system described in item 1 of the patent application scope can convert the screen image displayed by the PDA / mobile phone screen or other liquid crystal display into an image format, and then use image processing technology. Recognize the day and night images. 3 The PDA / mobile daytime image reading music system described in item 1 of the patent scope of the application, where the H3A / mobile phone sensing unit can be sensed using a hardware sensor or software image detection Is there a PDA / mobile phone within its sensing range? 15 4_The PDA / mobile phone screen image reading system described in item 1 of the scope of patent application, wherein the PDA / mobile phone sensing unit detects the PDA / mobile phone entering the sensing area 'and sends the sensing information to the image capture card Trigger the CCD camera to capture the daytime image on the pda / mobile phone screen. 5 · The PDA / mobile phone screen image reading 2 system described in item 4 of the scope of patent application, the system can use the screen image image of the PDA / mobile phone screen captured by a CCD camera for image recognition. 6. The PDA / mobile phone screen image reading system as described in item 1 of Shenjing's patent scope, where the image processing unit can use the characteristics of Barco's horizontal / vertical sharp changes, using gradient methods and grouping methods. Come to apply the Chinese National Standard (€ Na) 8 4 specifications (21〇 \ 297 mm) to this standard. (Please read the precautions on the back before filling this page) 567446 Patent application scope PA020074 TWP 8. 9. 15 Intellectual Property Bureau of the Ministry of Economic Affairs printed 20 BarCode for positioning. The PDA / mobile daytime image reading system described in item 1 of the scope of the patent application, wherein the image processing unit uses the image processing method to find the straight edges of the BarCode image and perform horizontal / vertical correction on the BarCode image. . Such as the scope of patent application! The PDA / mobile phone screen image reading system described in the above item, wherein the image recognition unit uses a half of the length of the BarCode as the number of points for the scanning line, and scans the screen vertically from the first one. Record the number, width and position of the ugly anus of each scanning line after the seedling, and the number, width and position of the blanks; remove the scanning lines with a small number and a large number of Bars, leaving most of the same number of scanning lines Sight the lines, and average the width of the ^ shape and the width of the blank space for each scan line separately and then decode. According to the PDA / mobile daytime image reading system described in item 8 of the scope of patent application, the image recognition unit uses the decoded result to match the BarCode's Check Code, and if it is correct, it outputs the BarCode decoded recognition result. If it is not correct, the screen image image will be rejected. In response to a message, the user is requested to reposition the pDA / mobile phone in the sensing area, and then the CCD camera will manipulate the screen image image.