TW201839608A - Automatic Image Monitoring Method - Google Patents

Abstract

An automatic image monitoring method includes acquiring a display image, generating a monitoring result message when the display image is static during a predetermined period of time, receiving the display image and the monitoring result message by a system host, and executing a debug process by the system host according to the display image and the monitoring result message.

Description

Automated image monitoring method

The invention discloses an automatic image monitoring method, in particular to an automatic image monitoring method capable of saving a large amount of manpower.

With the rapid development of technology, various production lines, automated production processes, or a variety of sophisticated processing processes, and even some games or audio and video processing, rely on the computer for auxiliary operations. Therefore, the stability of the computer, the smoothness of program execution, and the probability of computer failure will become a very important performance indicator. In order to reduce the risk of errors when the computer is running, the general computer will first perform system stability test and system performance test before the actual line. The computer will be used officially after passing the standards for line system stability testing and system performance testing.

When the computer is testing, the tester must observe the computer for a long time. When the computer runs halfway through the abnormal state, you must manually record the error message and find a way to debug. For example, a computer may first pass a Burn-in Test to test system stability as the processor approaches full load. The tester must continuously observe whether the computer screen is unstable or the wrong message appears. If the computer fails to overheat in half, the system may fail with a blue-and-white error message. The tester can record the time of the error and the status of the error, and stop the computer to execute the subsequent procedures, and then find a way to debug. However, when the computer is being tested, it takes a lot of manpower because the tester has to observe it in front of the computer for a long time. Moreover, if the tester does not observe the computer continuously (for example, once every half hour), when the computer is abnormal and the screen is paused, the tester will not be able to solve the problem immediately, and thus the test efficiency is low and the time is lost.

An embodiment of the present invention provides an automated image monitoring method, including inputting a character string, and starting a photography module to capture a screen image. If the screen image remains unchanged for a predetermined time, an image detection program is performed to detect whether the screen image is included. Bar code image, if the screen image contains barcode image, analyze and decode the barcode image to determine whether the barcode image conforms to the block, and generate corresponding monitoring result information according to whether the barcode image conforms to the block.

Another embodiment of the present invention provides an automated image monitoring method, including inputting a character string, and starting a photography module to capture a screen image. If the screen image remains unchanged for a predetermined time, an image detection program is performed to detect whether the screen image is detected. Contains text images. If the screen image contains text images, analyze and decode the text images to determine whether the text images conform to the word group, and generate corresponding monitoring result information according to whether the text images conform to the word group.

Another embodiment of the present invention provides an automated image monitoring method, comprising: initiating a photography module to capture a screen image, and generating a monitoring result information if the screen image remains unchanged for a predetermined time.

1 is an architectural diagram of an embodiment of an automated image monitoring system 100 of the present invention. The automated image monitoring system 100 includes a computer PC1, a screen device 11, a camera module 12, a system host PC2, and a user device UE. The computer PC1 can be regarded as the computer to be tested. The "computer" of the present invention can be a personal computer, a notebook computer, a workstation, or a server control machine. The computer PC1 has a motherboard MB to drive all the hardware/software in the computer PC1. The motherboard MB includes an output unit 10 and a general-purpose input/output interface (General-Purpose Input/Output) GPIO1. The output unit 10 can be an output port of any video signal, such as a Universal Serial Bus, a Video Graphics Array Connector, a High Definition Multimedia Interface Connector, and the like. The pin type (Pin) of the general-purpose I/O interface GPIO1 port can be freely used by the user in a program-controlled manner. The screen device 11 is coupled to the output unit 10 on the motherboard MB for displaying the status of the current execution program of the computer PC. The camera module 12 can be disposed in front of the screen device 11 for capturing the screen image displayed by the screen device 11. The photography module 12 can be any image capture device such as a digital camera or a digital camera. The system host PC2 can also be a computer, including a processing unit 13, an access unit 14, a general-purpose input/output interface GPIO2, a communication software 15, and a transceiver 16. Processing unit 13 can be a central processing unit or any computing unit having programmable logic processing capabilities. The processing unit 13 is coupled to the camera module 12 for processing and analyzing the screen image captured by the camera module 12. The access unit 14 is coupled to the processing unit 13 for storing the screen image and the data analyzed by the processing unit 13. The access unit 14 can be any form of memory, such as random processing memory, non-volatile memory, or a hard disk, and the like. The general-purpose input/output interface GPIO2 is coupled to the processing unit 13 and a general-purpose input/output interface GPIO1 in the computer PC1. Therefore, the processing unit 13 can control the motherboard MB in the computer PC1 through the general-purpose input/output interface GPIO2 and the general-purpose input/output interface GPIO1 to eliminate the error of the computer PC1. The communication software 15 can be disposed in the hard disk of the system host PC2 and communicate with the access unit 14 and the processing unit 13. The communication software 15 can be any application that has the ability to send data, such as an email program (Outlook Express). However, any reasonable hardware or software change of the automated image monitoring system 100 is within the scope of the present invention. For example, the communication software 15 can also be installed in the access unit 15. Therefore, the processing unit 13 can control the transceiver 16 by using the communication software 15, so that the data in the access unit 14 is transmitted to the outside through the transceiver 16. In this embodiment, the transceiver 16 can transmit the data in the access unit 14 to the user equipment UE through a wired network or a wireless network. The user equipment UE can be a portable electronic device, such as a smart phone, a notebook computer, or a tablet computer. In the automated image monitoring system 100, when an error occurs in the motherboard MB of the computer PC1, the screen image displayed on the screen device 11 is stopped. Since the camera module 12 can continuously monitor the screen image, when the screen image is abnormal, the system host PC2 performs error analysis in real time, and controls the computer through the general-purpose input/output interface GPIO2 and the general-purpose input/output interface GPIO1. The motherboard MB in PC1 to eliminate the error of PC1. The process of performing automated image monitoring of the automated image monitoring system 100 is described below.

The automated image monitoring method of the present invention can be divided into a barcode image recognition mode, a text image recognition mode, and a preset image recognition mode. The user can select one of the three modes to monitor the image recognition mode. The three image recognition modes will be described below.

Figure 2 is a flow chart of the automated image monitoring system 100, which operates on an automated image monitoring method in a barcode image recognition mode. The automated image monitoring method in the barcode image recognition mode includes steps S201 to S217 as described below.

The steps are described below. In step S201, if the user wants to monitor the computer PC1 by using the system host PC2, the image monitoring program can be started first, and the monitored image recognition mode is selected in the barcode image recognition mode. In this embodiment, the definition of "barcode image" can be any barcode image, such as a QR code of a QR code, a Bar Code image, etc., any The encoded images are within the scope of the present invention. In step S202, the user can input a block corresponding to the barcode image, such as inputting a decoded block or identifying a block (for example, inputting a block composed of English and numbers). Thereafter, in step S203, the system host PC2 activates the camera module 12 to capture the screen image of the screen device 11. In step S204, the camera module 12 continuously monitors the screen image and determines whether the screen image remains unchanged for a predetermined time. For example, if the screen image monitored by the camera module 12 has been stopped for more than one minute, It means that the motherboard PC of the computer PC1 may have an error, causing the system to pause at a certain point in time and cannot continue execution. At this time, the system host PC2 proceeds to step S205 for further analysis. On the other hand, if the screen image monitored by the camera module 12 does not stop, it indicates that the motherboard MB of the computer PC1 is still operating normally. Therefore, the process returns to step S204 to continuously capture the screen image of the screen device 11. In step S205 (in the case where the screen image has been stopped), the system host PC2 performs an image detection process to detect whether the screen image contains a barcode image. This mode is to determine the state of the computer PC1 error by using the barcode image. Therefore, the system host PC2 will attempt to find a specific key barcode image from the screen image monitored by the camera module 12. If the barcode image cannot be detected (for example, the location where the computer PC1 is in error is on the display card, causing the barcode image to be completely distorted), the system host PC2 generates an unexpected error message according to step S207. If the barcode image can be detected, the system host PC2 analyzes and decodes the barcode image according to step S206 to determine whether the barcode image conforms to the block. Since the block corresponding to the error state has been set in step S202, when an error occurs in the PC1, if the barcode image is decoded and conforms to the previously set block, the error indicating that the PC1 is in the user's expectation. Therefore, according to step S213, the monitoring result information is generated. Conversely, if the barcode image is decoded and does not match the previously set block, it indicates whether the PC1 error is in the user's expectation. Therefore, according to step S207, unexpected error information is generated. Moreover, the monitoring result information or the unexpected error information may include the time when the error occurred, the screen stop time, the system execution time, or any information about the screen image. The monitoring result information or the unexpected error information may be generated by the photography module 12 or may be generated by the system host PC2. The present invention does not limit what kind of hardware device is generated by monitoring result information or unexpected error information.

As mentioned above, there are two conditions for generating unexpected error information. The first type of bar code image cannot be detected by the screen image, and the second type of bar code image can be detected by the screen image, but the bar code image is decoded and does not match the previously set block. The monitoring result information corresponding to the expected error is generated by the barcode image being detected by the screen image, and the barcode image is decoded and matched with the previously set block. Subsequent steps S214 to S212 for generating unexpected error information and subsequent steps S214 to S217 for generating monitoring result information corresponding to expected errors will be described below. In step S208, the system host PC2 receives the screen image and unexpected error information. Then, according to step S209, the system host PC2 stores the screen image, for example, into the access unit 14. Since the unintended error debugging method and data are not in the database of the system host PC2, if the computer PC1 is to be debugged, it must be debugged by the administrator (user). Therefore, according to step S210, the system host PC2 can use the communication software 15 to send unintended error information and a screen image to the user equipment UE. Therefore, for the remote user, the location and cause of the error can be immediately understood. Next, according to step S211, the user controls the system host PC2 to execute the debug program by using the user equipment UE. Finally, according to step S212, the system host PC2 can control the computer PC1 displaying the screen image through the universal input/output interfaces GPIO2 and GPIO1 to eliminate the error of the computer PC1, and return to step S203 to continuously capture the screen of the screen device 11. image. Therefore, for the unintended error, since the system host PC2 transmits the data to the remote user, the user can immediately debug the computer PC1 through the system host PC2. However, the user can directly debug the operating system host PC2 or even directly operate the computer PC1, and any reasonable step changes are within the scope of the present invention.

In the case where the erroneous monitoring result is expected, the system host PC2 receives the screen image and the monitoring result information in step S214. Then, according to step S215, the system host PC2 stores the image of the screen, for example, into the access unit 14. Since the error debugging method and the data are expected to be in the database of the system host PC2, the system host PC2 can directly debug the computer PC1 in an automated manner. In step S216, the system host PC2 executes the debug program according to the screen image and the monitoring result information. Finally, according to step S217, the system host PC2 can control the computer PC1 displaying the screen image through the universal input/output interfaces GPIO2 and GPIO1 to eliminate the error of the computer PC1, and return to step S203 to continuously capture the screen of the screen device 11. image. Therefore, for the expected error, since the system host PC2 can directly debug the computer PC1 in an automated manner, the labor consumption can be greatly reduced. However, as mentioned above, any reasonable changes to the steps are within the scope of the invention. Therefore, the system host PC2 can also transmit the expected monitoring result information and the screen image to the user equipment UE by using the communication software 15. Therefore, although the system host PC2 can debug the computer PC1 directly in an automated manner in the case of an erroneous monitoring result. However, the present invention also preserves the flexibility of the user to fine-tune or control the debug program, and the system host PC2 can also use the communication software 15 to transmit the data that is immediately debugged to the user equipment UE, so that the user can grasp at any time. Wrong progress and results.

Figure 3 is a flow chart of the automated image monitoring system 100, which operates on an automated image monitoring method in a text image recognition mode. The automated image monitoring method in the text image recognition mode includes steps S301 to S317 as described below.

In the flow of the automated image monitoring method in the text image recognition mode, the operations of steps S301 to S317 are similar to the operations of steps S201 to S207 described above. The difference is that in step S305, the system host PC2 performs an image detection process to detect whether the screen image contains a text image. And in step S306, the system host PC2 analyzes the text image to determine whether the text image conforms to the word group. Step S317 is a step in the character image recognition mode. Therefore, the system host PC2 attempts to find a specific key text image from the screen image monitored by the camera module 12. For example, the user can set the keyword "Error404" that will appear when an error occurs on the computer PC1 in step S302. Therefore, when the computer PC1 is stopped, the system host PC2 attempts to determine whether there is a text image in the screen image monitored by the camera module 12 according to step S305, and then recognizes the text image according to step S306 to determine the key of the error. Whether the word is "Error404". In other words, in the bar code image recognition mode mentioned above, when the computer PC1 is stopped, the system host PC2 attempts to recognize the key bar code image from the screen image monitored by the camera module 12. In the text image recognition mode, when the computer PC1 is stopped, the system host PC2 attempts to recognize the key text image from the screen image monitored by the camera module 12. The remaining steps of the text image recognition mode are the same as the bar code image recognition mode described above, and will not be described herein.

Figure 4 is a flow chart of the automated image monitoring system 100, which operates on an automated image monitoring method in a preset image recognition mode. The preset image recognition mode can be regarded as a simplified image monitoring method, and includes steps S401 to S408 as described below.

The steps are described below. In step S401, if the user wants to monitor the computer PC1 by using the system host PC2, the image monitoring program can be started first, and the monitored image recognition mode is selected in the preset image recognition mode. Thereafter, in step S402, the system host PC2 activates the camera module 12 to capture the screen image of the screen device 11. In step S403, the camera module 12 continuously monitors the screen image and determines whether the screen image remains unchanged for a predetermined time. For example, if the screen image monitored by the camera module 12 has been stopped for more than one minute, It means that the motherboard PC of the computer PC1 may have an error, causing the system to pause at a certain point in time and cannot continue execution. At this time, according to step S404, the monitoring result information will be generated. As mentioned above, the monitoring result information may include the time when the error occurred, the time the screen was stopped, the system execution time, or any information about the screen image. The monitoring result information may be generated by the photography module 12 or may be generated by the system host PC2. The present invention does not limit what kind of hardware device the monitoring result information is generated. On the other hand, if the screen image monitored by the camera module 12 does not stop, it indicates that the motherboard MB of the computer PC1 is still operating normally. Therefore, the process returns to step S403 to continuously capture the screen image of the screen device 11. After the screen image is stopped and the monitoring result information is also generated, the system host PC2 stores the screen image, for example, in the access unit 14 according to step S405. Then, according to step S406, the system host PC2 can use the communication software 15 to send the monitoring result information and the screen image to the user equipment UE. Therefore, for the user, the location and cause of the error can be immediately understood. Then, according to step S407, the user can use the user equipment UE to control the system host PC2 to execute the debugging program according to the monitoring result information and the screen image. Finally, according to step S408, the system host PC2 can control the computer PC1 displaying the screen image through the general-purpose input/output interfaces GPIO2 and GPIO1 to eliminate the error of the computer PC1, and return to step S402 to continuously capture the screen of the screen device 11. image. However, as mentioned above, after the user receives the monitoring result information and the screen image, the operating system host PC2 can directly operate the computer PC1 to perform debugging, and any reasonable step change belongs to the scope disclosed by the present invention. .

In summary, the present invention describes an automated image monitoring method that can save manpower and increase detection efficiency when testing a computer. The automated image monitoring method utilizes a photographic module to monitor the screen image at any time, and can be combined with image recognition (including bar code or text recognition functions) for more accurate debug analysis. When the computer's error is in the expected state, the error can be eliminated directly through the host system. When the computer's error is in an unexpected state, the screen image and the error data report at the time of the error can be immediately notified to the inspector (user) to smoothly eliminate the error. Therefore, the automated image monitoring method of the present invention has the following advantages. First, the tester does not need to be on standby before the computer, and the time plan of the tester will be more flexible. Second, when there is a problem with the detected computer, the system host can instantly transmit the image information to the inspector through the communication software, so even the remote detection personnel can immediately solve the problem. Third, since the system host can synchronize with the device of the tester by the communication software, the tester can grasp the progress and result of the debug at any time. Fourth, the automated image monitoring method of the present invention can greatly reduce the labor consumption and the loss of detection time. The above are only the preferred embodiments of the present invention, and all changes and modifications made to the scope of the present invention should be within the scope of the present invention.

100‧‧‧Automated image monitoring system

PC1‧‧‧ computer

MB‧‧‧ motherboard

GPIO1 and GPIO2‧‧‧ general-purpose input and output interfaces

PC2‧‧‧ system host

UE‧‧‧User equipment

10‧‧‧Output unit

11‧‧‧Screen device

12‧‧‧Photography module

13‧‧‧Processing unit

14‧‧‧Access unit

15‧‧‧Communication software

16‧‧‧ transceiver

S201 to S217‧‧ steps

Steps S301 to S317‧‧

Steps S401 to S408‧‧

1 is an architectural diagram of an embodiment of an automated image monitoring system of the present invention. Figure 2 is a flow chart of the automated image monitoring system of Figure 1, which operates on an automated image monitoring method in a barcode image recognition mode. Figure 3 is a flow chart of the automated image monitoring method of Figure 1 for automated image monitoring in a text image recognition mode. Figure 4 is a flow chart of the automated image monitoring system of Figure 1, which operates on an automated image monitoring method in a preset image recognition mode.

Claims (10)

An automated image monitoring method includes: inputting a character group; starting a photography module to capture a screen image; if the screen image remains unchanged for a predetermined time, performing an image detection process to detect the screen image Whether the image includes a barcode image; if the screen image includes the barcode image, analyzing and decoding the barcode image to determine whether the barcode image conforms to the font group; and generating a corresponding monitoring result information according to whether the barcode image conforms to the font group . The method of claim 1, wherein the corresponding monitoring result information is generated according to whether the barcode image conforms to the character group, and if the barcode image does not conform to the character group, an unexpected error message is generated. An automated image monitoring method includes: inputting a character group; starting a photography module to capture a screen image; if the screen image remains unchanged for a predetermined time, performing an image detection process to detect the screen image Whether the image includes a text image; if the screen image includes the text image, analyzing the text image to determine whether the text image conforms to the character group; and generating a corresponding monitoring result information according to whether the text image conforms to the character group. The method of claim 1, wherein the corresponding monitoring result information is generated according to whether the text image conforms to the character group, and if the character image does not conform to the character group, an unexpected error message is generated. The method of any of claims 1 to 4, wherein the block is a decoded block or a recognized block. An automated image monitoring method includes: starting a photographic module to capture a screen image; and generating a monitoring result information if the screen image remains unchanged for a predetermined time. The method of any one of claims 1 to 4, wherein the system host receives the screen image and the monitoring result information; and according to the screen image and the monitoring result information, the system host performs a division Wrong procedure. The method of claim 7, further comprising: the system host transmitting the monitoring result information and the screen image to a user equipment by using a communication software; wherein the system host executing the debugging program is used by a user The user equipment controls the system host to execute the debug program. The method of claim 7, further comprising: after the system host executes the debug program, the system host controls a display of the screen image through a general-purpose input/output interface (General-Purpose Input/Output) interface. Computer to troubleshoot the computer. The method of claim 7, further comprising storing the screen image on the system host.