TW201729095A - Smart testing robotic system capable of controlling multiple smart robotic bodies by means of internet for a synchronized automatic testing process - Google Patents

Abstract

Disclosed is a smart testing robotic system, wherein the main body of the smart robot has a computation platform connected with a storage module capable of storing testing scripts, and the computation platform is connected respectively with a signal output unit and an image input unit. Additionally, the computation platform is connected with a wireless communication module connecting to a remote master computer, therefore, when the computation platform automatically executes a test according to a testing script, such as power switching on or off, keying in strings by means of a keyboard, moving cursers, clicking, and etc., a command of the testing script is sent through the signal output unit to an object under test for controlling movement, and the image input unit receives an output image from the object under test and sends back to the computation platform, thereby enabling a captured image to be graphical and identified automatically according to an image identification command of the testing script. Furthermore, the remote master computer can also control multiple smart robotic bodies by means of internet for a synchronized automatic testing process, thereby speeding up the testing and cutting down cost. Hence, the disclosed increases overall production efficacy.

Description

Smart test robot system

The invention provides a smart test robot system, in particular, the computing platform can automatically perform the test according to the test script, and controls the action of the object to be tested through the signal output unit, and the image input unit receives the image of the output of the object to be tested and returns the image to the operation. After the platform, the captured images can be automated in accordance with the test script.

According to the current rapid growth of electronic technology, computers, notebook computers, tablet computers, smart phones, car information systems, smart TVs and other electronic devices have become commonplace in all corners of society, and they are powerful in computing. Fast, small size, fine image and more power-saving. However, with the standardization of electronic hardware and software, and the continuous expansion and upgrade of functions, manufacturers have developed various applications for industrial control, network and communication. Electronic equipment in the fields of equipment, machine vision, intelligent transportation systems, or industrial applications requiring high reliability and stability, such as transportation and aerospace, to meet customer specific specifications and perform high efficiency in harsh environments. A requirement that can work.

Furthermore, in the automation of production lines, electronic equipment is applied to different stations for various processing, assembly, inspection and testing, warehousing and transportation processes. The inspection and testing process is to add manual inspection to the electronic equipment process. Work to filter out defective products and improve manufacturing quality and yield, but for the speed of electronic devices, if you want to count A large number of electronic devices are installed and executed manually in a manual manner. The labor cost and test time considerations are difficult to meet the requirements of rapid development time and cost of electronic equipment, so the requirements for automated inspection and production testing are also met. Health, not only can further strengthen the quality control measures in the development of electronic equipment, but also can launch better quality products at a faster rate.

Furthermore, due to the continuous advancement of the information industry and the enhancement of network communication technology, the new generation of industrial automation equipment based on the instant messaging interface has developed rapidly and vigorously, and the digital signal and control parameters are transmitted through the network. Various communication transmission protocols have developed higher speed and high precision motion control technology. In order to construct a highly efficient test system, some operators use near-end computers to convert images and keyboards, mouse signals, etc. into IP-KVM communication technology. The network signal allows the user to remotely control the near-end computer for testing the object to be tested. However, because the near-end computer lacks computing power, the main purpose is only remote control and cannot be automated. In addition, there are also operators. The main control computer uses the VNC protocol to synchronize the test of the test object. Although the test can be automated through the graphic identification method, the main control computer cannot automatically perform the test without installing the operating system. The system's personal computer is the main control computer, it will be difficult to miniaturize and not conducive to centralized control, and the graphics Known as a pure software test method, it is impossible to carry out automatic test of hardware specifications or other signal processing (such as power on or off) for the object to be tested, and there are still certain restrictions on the overall function, so it is for those engaged in this industry. I want to study the key to improvement.

Therefore, in view of the above-mentioned problems and shortcomings, the inventors have collected and collected relevant data through various evaluations and considerations, and have used the trial and modification of many years of R&D experience in this industry to design such a smart test robot system. The invention patent was born.

The main purpose of the invention is that the computing platform of the intelligent robot body is connected with a storage module capable of storing test scripts, and the signal output unit and the image input unit are respectively connected by the computing platform, and the computing platform is connected with the far side. The wireless communication module connected to the main control computer can pass the test script command through the signal when the computing platform automatically performs the test according to the test script, such as the power switch control, the keyboard input string, the mouse cursor movement, the click, and the like. The output unit sends the image to the object to be tested for control, and the image received by the image input unit is sent back to the computing platform, and the captured image can be automatically identified by the image recognition instruction of the test script, and the image is captured. The end master computer can also control multiple intelligent robot bodies through the Internet to synchronize the automated test process to speed up testing time and save costs, thereby improving overall production efficiency.

The secondary purpose of the present invention is that the intelligent robot body can automatically perform the test procedure of the test object in addition to the near-end control, and can also communicate with the remote host computer through the wireless communication module through the wireless communication module using the IP-KVM communication technology. The remote host computer can operate and control the one-to-many intelligent robot body through the Internet, and remotely control multiple intelligent robot bodies to synchronize the test process of the object to be tested, such as starting test, suspending, stopping The test script sends, returns the test results, test progress, etc., and the intelligent robot body can be used to achieve the software and hardware automated test with the combination of automatic graphics recognition and IP-KVM technology.

Another object of the present invention is that the computing platform, the storage module, the signal output unit, the image input unit and the wireless communication module of the intelligent robot body can be integrated into a single system chip, and the circuit design can be reduced and the module can be reduced. To reduce the size of the footprint, it can also be VNC-compliant through the Internet through a single system chip using IP-KVM communication technology. The remote host computer communicates, so that the remote host computer can realize the remote operation and control of the keyboard, display image and mouse of the intelligent robot body through the Internet. The intelligent robot body is not installed. Under the condition of the system, all tests can be automatically completed regardless of any operating system and hardware specifications of the object to be tested.

1‧‧‧Smart robot body

11‧‧‧ Computing Platform

12‧‧‧ Storage Module

121‧‧‧Test script

13‧‧‧Signal output unit

14‧‧‧Image input unit

15‧‧‧Wireless communication module

16‧‧‧Non-image signal transmission unit

2‧‧‧Test object

3‧‧‧ Remote master computer

The first figure is a block diagram of the present invention.

The second diagram is a flow chart of the steps of the present invention.

In order to achieve the above objects and effects, the technical means and constructions of the present invention will be described in detail with reference to the preferred embodiments of the present invention.

Please refer to the first and second figures, which are respectively a block diagram and a step flow chart of the present invention. As can be clearly seen from the figure, the smart test robot system of the present invention includes a smart robot body 1, which is intelligent. The robot body 1 has a computing platform 11, and the computing platform 11 is connected with a storage module 12 that can store the test script 121, and the computing platform 11 is connected to the object to be tested 2 to send the test script 121 to the standby. The signal output unit 13 that performs the corresponding control action of the object 2, and the image that can receive the output of the object to be tested 2 are sent back to the image input unit 14 for the automatic graphic recognition by the operation platform 11 according to the test script 121, and then by the operation platform 11 The wireless communication module 15 is connected to the remote main control computer 3 and can synchronously operate the smart robot body 1 , and the computing platform 11 is further connected with the non-image signal transmission unit 16; For a tablet only For a preferred embodiment, it can also be an electronic device for a smart phone, a notebook computer, a smart TV or other image output function with a screen image.

However, the above computing platform 11 is a CPU including a central processing unit (CPU) and a graphics processing unit (GPU), or an X86-based CPU, an advanced reduced instruction set machine (ARM) or a field editable logic gate array (FPGA). With a graphics processing unit (GPU), and the storage module 12 can be a random access memory (such as DDR3), flash memory (Flash RAM), hard disk (HDD), solid state drive (SSD) , electronic erasable rewritable read-only memory (EEPROM) or other storage device for storing data and test script 121, and the signal output unit 13 can be a keyboard mouse with universal serial bus (USB) (USB KB /Mouse), PS/2 interface keyboard mouse (PS/2 KB/Mouse), Universal Asynchronous Receiver Transmitter (UART) including RS232, RS485 serial 埠 standard, general purpose input/output interface (GPIO), power supply A switch or other transmission interface for transmitting power and transmitting a control signal to the object 2 to be controlled, and the image input unit 14 can be a video graphics array (VGA), a digital video interface (DVI), a display port (DP) ), high resolution multimedia interface (HDMI) or other output image for receiving the object under test 2 The video interface and the wireless communication module 15 can be a regional network transmission control protocol and Internet Protocol (TCP/IP), Wireless Fidelity (Wifi), Bluetooth (Bluetooth), Wireless Sensing Network (ZigBee) Or other wireless transmission interface with wireless (WLAN) transmission function; in addition, the non-video signal transmission unit 16 can be a regional network transmission control protocol and Internet Protocol (TCP/IP), serial port (such as RS232, RS485, etc. ), Universal Input/Output Interface (GPIO) or other A non-video signal transmission interface that can be connected to the object to be tested, the peripheral device and the device (not shown) in a wireless (WLAN) or wired (LAN) manner.

Furthermore, the computing platform 11 of the smart robot body 1 of the present invention (such as CPU, ARM or FPGA with GPU, etc.), storage module 12 (such as DDR3, Flash RAM, EEPROM, etc.), signal output unit 13, and image input unit 14 And the wireless communication module 15 is an integrated circuit that can be integrated into a single system on a chip (SoC), and the overall circuit design can be reduced and modularized to reduce the occupied volume, but in practical applications, The non-image signal transmission unit 16 can also be integrated into the integrated circuit of the single system chip described above, and the smart robot body 1 is preferably implemented as a single system chip using IP-KVM (KB, Video, Mouse) communication technology. On the motherboard, the IP-KVM SoC communicates with the remote host computer 3 via the Internet (NCC) Virtual Network Computing RFB (Remote Frame Buffer) protocol, so that the remote host computer 3 can pass through the Internet. The road realizes the keyboard, display image, mouse remote operation and control of the intelligent robot body 1, and the VNC protocol is written in Java language, allowing the user to execute and access the Internet through any operating system. Intelligent robot body 1 then run the program, and the picture screen (FB) 2 analyte during the testing process automatically generated transmission to a remote host computer 3 simultaneously displayed.

When the smart robot body 1 of the present invention performs the test of the object 2, the following steps are implemented:

(a1) The computing platform 11 reads the test script 121 stored in the storage module 12.

(a2) The control signal is sent to the object to be tested 2 through the signal output unit 13 in accordance with the test script 121 to perform a corresponding control action.

(a3) The image input unit 14 receives the image of the control action outputted by the object 2 to be returned to the computing platform 11, and performs automatic graphic recognition according to the test script 121 command to meet the expectations of the test script 121. If yes, step (a04) is performed, and if no, step (a06) is performed.

(a4) Judging whether or not the next test is performed in accordance with the test script 121? If yes, repeat step (a02), and if no, proceed to step (a05).

(a5) The test result is Pass.

(a6) The test result is Fail.

It can be clearly seen from the above implementation steps that the smart robot body 1 of the present invention can receive or download the test script 121 by connecting to the remote host computer 3 through the wireless communication module 15, and store the test script 121 to the storage. The module 12 can also receive or download different test scripts 121 according to the actual test procedure, or can be directly created (recorded), automatically generated by a test automation program or programmed in a programming language 121, and read and stored by the computing platform 11 When the test script 121 is stored in the module 12, the test flow can be automatically executed according to the instruction of the test script 121, such as power switch control, keyboard input string, mouse cursor movement, click and other control actions, and control output of the command. After the signal is sent to the object to be tested 2 through the signal output unit 13, the corresponding control actions such as the power switch, the analog keyboard input, the mouse cursor movement, and the screen click are performed, and the object to be tested 2 is received by the image input unit 14. The output screen image is transmitted back to the computing platform 11, and the captured image can be automated according to the instructions of the test script 121. Shape recognition.

When the computing platform 11 performs automatic graphic recognition of the captured image according to the image recognition instruction of the test script 121, the flow control such as If-Else, the test loop control, and the like can be used to determine whether the test script 121 meets the expectations, such as determining whether there is a specific The graphic appears on the screen, the characters appearing on the screen (OCR), and wait until the specific image appears on the screen. In fact, the test flow of the object 2 is completely in accordance with the content of the test script 121, if it matches the test script. The expectation of 121 can be judged that the test result of the test object 2 is Pass; otherwise, if the test script 121 is not expected, the test result of the test object 2 can be judged as fail (Fail). The computing platform 11 of the intelligent robot body 1 can perform the automatic test of the object to be tested 2 according to the test script 121 without installing the operating system, and can automatically complete all the operating systems and hardware specifications regardless of the object to be tested 2 Test, in addition to the power switch, keyboard, mouse and other controls and image capture of the screen, you can also expand the input / output 任意, or even Step peripheral instruments and equipment for data acquisition and control, and accelerate test time and can shorten the product development process in line with the time-saving and cost of claims, thereby improving overall production efficiency.

The smart robot body 1 of the present invention can automatically perform the test procedure of the object to be tested 2 in the near-end control, and can also communicate with the remote host computer 3 via the wireless communication module 15 via the wireless communication module 15 using the IP-KVM communication technology. The remote host computer 3 can operate and control the one-to-many intelligent robot body 1 through the Internet, and remotely control multiple intelligent robot bodies 1 to simultaneously perform the automatic test process of the object to be tested 2, such as starting the test, Suspension, stop, test script 121 transmission, return test results, test progress, etc., can be achieved by the intelligent robot body 1 with integrated graphics recognition and IP-KVM technology to achieve the software and hardware automated test function.

Therefore, the present invention is mainly directed to the computing platform 11 of the smart robot body 1 for automatically performing the test according to the test script 121 stored in the storage module 12, and transmitting the command of the test script 121 to the object to be tested through the signal output unit 13 After the control action is performed, and the image outputted by the image input unit 14 is sent back to the computing platform 11, the captured image can be automatically identified by the image recognition instruction of the test script 121 by the computing platform 11. The test result of the object to be tested 2 is judged, and the remote host computer 3 can also be connected to the wireless communication module 15 through the internet to remotely control multiple intelligent robot bodies 1 to perform automatic test of the object to be tested 2 simultaneously. Process to speed up testing and save costs, thereby improving overall production efficiency.

The above detailed description is intended to be illustrative of a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention, and other equivalents and modifications may be made without departing from the spirit of the invention. Changes are intended to be included in the scope of the patents covered by the present invention.

In summary, the intelligent test robot system of the present invention can achieve its efficacy and purpose when used, so the invention is an invention with excellent practicability, and is in fact conforming to the application requirements of the invention patent, and submitting an application according to law. I hope that the trial committee will grant this case as soon as possible to protect the inventor's hard work. If there is any doubt in the bureau, please do not hesitate to give instructions, the inventor will try his best to cooperate with him.

1‧‧‧Smart robot body

11‧‧‧ Computing Platform

12‧‧‧ Storage Module

121‧‧‧Test script

13‧‧‧Signal output unit

14‧‧‧Image input unit

15‧‧‧Wireless communication module

16‧‧‧Non-image signal transmission unit

2‧‧‧Test object

3‧‧‧ Remote master computer

Claims (10)

A smart test robot system includes a smart robot body, the smart robot body has a computing platform, and a storage module capable of storing test scripts is connected by the computing platform, and the computing platform is respectively connected with the object to be tested a signal output unit connected to send a test script command to the object to be tested for corresponding control action, and an image input unit capable of receiving the image of the object to be tested and transmitted back to the computing platform for automatic graphic recognition according to the test script instruction, and then The computing platform is connected with a wireless communication module that is connected to the remote host computer and can synchronously operate the intelligent robot body. For example, the smart test robot system described in claim 1 wherein the computing platform communicates with the remote host computer via the Internet using the IP-KVM communication technology and the RFB protocol of the VNC. The control computer realizes the keyboard, display image and mouse remote operation and control of the intelligent robot body. The smart test robot system according to claim 1, wherein the computing platform is a CPU including a central processing unit (CPU) and a graphics processing unit (GPU), or an X86 CPU, an advanced reduced instruction set machine ( ARM) or field editable logic gate array (FPGA) with a graphics processing unit (GPU). The smart test robot system of claim 1, wherein the storage module is a random access memory, a flash memory, a hard disk (HDD), a solid state drive (SSD), or Electronic erasable rewritable read-only memory (EEPROM). The smart test robot system according to claim 1, wherein the signal output unit is a keyboard mouse with a universal serial bus (USB) (USB KB/ Mouse), PS/2 interface keyboard mouse (PS/2 KB/Mouse), Universal Asynchronous Receiver Transmitter (UART), General Purpose Input/Output Interface (GPIO) or power switch. The smart test robot system according to claim 1, wherein the image input unit is a video graphics array (VGA), a digital video interface (DVI), a display (DP) or a high resolution multimedia interface (HDMI). The smart test robot system according to claim 1, wherein the wireless communication module is a regional network transmission control protocol and Internet Protocol (TCP/IP), Wireless Fidelity (Wifi), Bluetooth ( Bluetooth) or wireless sensing network (ZigBee). The smart test robot system according to claim 1, wherein the computing platform is a non-image signal transmission unit that is further connected to the object to be tested, peripheral instruments and devices for data acquisition and control. The smart test robot system of claim 8, wherein the non-video signal transmission unit is a regional network transmission control protocol and an internet protocol (TCP/IP), a serial port, or a general-purpose input/output interface ( GPIO). The smart test robot system of claim 1, wherein the computing platform performs the following steps: (a1) the computing platform reads the test script stored in the storage module; (a2) according to the test script command, the control signal is sent to the object to be tested through the signal output unit for corresponding control action; (a3) the image input unit receives the image of the control action outputted by the object to be tested and returns to the transport Calculate the platform and follow the test script instructions to determine whether the automatic graphics recognition meets the expectations of the test script. If yes, proceed to step (a04), if no, proceed to step (a06); (a4) determine whether to follow the test script Next test, if yes, repeat step (a02), if not, proceed to step (a05); (a5) test results are acceptable; (a6) test results are unqualified.