KR20060120978A - A tele-control . monitoring system on the basis of ubiquitous - Google Patents

Abstract

An open type remote control/monitoring system based on ubiquitous is provided to perform remote control, reservation control, and remote monitor irrespective of time/location by controlling an open type machine such as a CNC(Computerized Numerical Control) machine in PSTN(Public Switched Telephone Network) and WLAN(Wireless Local Area Network) with a wireless terminal like a PDA(Personal Digital Assistant). The wireless terminal(100) displays data received from a server(300) to a screen, and transmits a remote control signal, such as start/stop and reserved start/stop of the open type machine(400), to the server by including a client mobile content program(110) for controlling the open type machine. The server obtains monitoring data, such as a machine state, an alarm, an NC(Numeric Control) program command, and an operation position of each shaft, and transceives an image obtained from a USB(Universal Serial Bus) camera installed to the machine by including a server content program(310) for displaying the machine state and transceiving a machine control command with the wireless terminal through communication.

Description

Ubiquitous based open machine remote control and monitoring system {A tele-control · monitoring system on the basis of ubiquitous}

1 is a block diagram of a mobile remote control and monitoring system of an open machine using a CDMA20000 (IMT 20000) network and a wireless LAN network as an example of a control system according to the present invention.

2 shows the structure of a server-side content OPC program using OLE,

3 illustrates the structure of a client-side content program;

4 shows a control structure of an open machine that interfaces with server-side content,

5 illustrates an interface structure between server-side contents and an actual open machine (eg, a CNC machine tool).

6 shows a mainframe of server-side content,

7 illustrates a mainframe of client-side content.

* Description of symbols on the main parts of the drawings *

100: wireless terminal 110: client mobile content module

200: device station 300: server

310: server content module 400: open machine

The present invention relates to a remote control and monitoring system, and more particularly, it is possible to perform real-time remote control, reservation control and remote monitoring of an open type machine such as a CNC machine tool on a telephone network and a wireless LAN using a PDA regardless of time and place. Ubiquitous based open machine remote control and monitoring system.

With the rapid development of the telecommunications and software industry, there is a rapid growth in the control method of each machine tool.

With the development of these technologies, a communication method called ubiquitous has recently emerged. Such a communication method is to satisfy the desire to create an industrial / living environment that can achieve a user's purpose quickly and accurately anytime, anywhere, and the desire is strong in the machine field which is most used in the industry.

As an example, remote meter reading and control have been conducted through many studies. As the wirelessization such as remote control and meter reading is accelerated, the need for remote control and monitoring under a wireless environment is emerging for the control of mechanical devices. .

However, the control and monitoring in the field of open machines, such as the conventional CNC machine tools, are limited to the machine itself, communication between the machine and peripheral devices, and the remote control is not performed.

Recently, with the development of computers and networks, many researches on remote control and monitoring have been conducted in the field of machine tools, but most of them are wired due to problems such as the field environment where IT technology is difficult to apply in the field of machine tools and production systems. In the LAN environment, the classical client / server method of local domain is mainly dominant, and only recently, web-based control and monitoring using the Internet has become possible.

In addition, the conventional remote control and monitoring is performed only over the wire, and is not well performed in the wireless or mobile environment in the ubiquitous environment, which has become an issue in recent years.

The present invention has been made to solve the above-mentioned problems, and by using a wireless communication means such as PDA to control the open machine such as CNC machine tools on the telephone network and wireless LAN, regardless of time and place in real time It aims to provide a ubiquitous-based open machine remote control and monitoring system capable of remote control, reservation control and remote monitoring.

An object of the present invention is an open-type machine control system using a communication network, the base station responsible for wired and wireless communication with each server and terminal; A terminal program including a mobile content module for a client for controlling the open machine is provided, receives data from a server, displays the data on a screen, and remotely controls signals such as start and stop of a machine, reservation operation, and reservation stop. A wireless terminal for transmitting to a server; A server program including a server content module which communicates with the wireless terminal to show the state of the machine and transmits and receives a command to control the machine, the state of the machine transmitted from the machine, whether an alarm has occurred, an NC program command, A server which performs various matters for obtaining monitoring data such as driving position of each axis and transmitting and communicating images acquired from a USB camera installed in the machine; It is made by a ubiquitous based open machine remote control and monitoring system, characterized in that it comprises a wireless communication network for connecting the wireless terminal and the server to communicate.

Hereinafter, an example of a ubiquitous based open machine remote control and monitoring system and a method thereof according to the present invention will be described in detail with reference to the accompanying drawings.

As shown, the ubiquitous based open machine remote control and monitoring system according to the present invention includes a wireless terminal 100 having a client content module for controlling a machine, and a control signal transmitted from the wireless terminal 100. And a server 300 having a server program including a server content module 310 for transmitting to 400 and transmitting and controlling a signal transmitted from a machine to a wireless terminal.

Communication between the wireless terminal 100 and the server 300 is wirelessly performed through the base station 200, the wireless terminal 100 is a wireless mobile communication means such as a PDA mobile phone is used.

As described above, the wireless terminal 100 stores a terminal program including a client content module 110 for remotely controlling an open machine. The terminal program includes embedded Visual C ++ for use in a WinCE.Net environment. It is a completed agent.

The server 300 includes a server program including a server content module 310 which communicates with a terminal program of the wireless terminal 100 as described above, shows a state of a machine, and transmits and receives a command to control the machine. In addition, the server content module 310 is an agent produced by using Visual C ++ 6.0 and executed on a general window.

The server 300 and the wireless terminal 100 communicate with each other through a wireless telephone network and a wireless LAN.

The server 300 acquires monitoring data such as the state of the machine, whether an alarm has occurred, an NC program command, a driving position of each axis, an image from a USB camera, and performs various matters for communication from the open machine 400. do.

The client content module 110 receives data from the server and displays the data on the screen of the wireless terminal 100. The client content module 110 sends a control signal to the server 300 to remotely control a machine such as start, stop, reservation operation, and reservation stop. Play a role.

Communication between the two contents 110 and 310 is performed wirelessly as described above, and as illustrated in FIG. 1, through CDMA2000 or IMT2000 and a wireless LAN network.

The terminal program including the client content module 110 operates in a PDA, which is a wireless terminal 100 using a wireless network, and communicates with a base station 200 using a CDMA 2000 network.

The base station 200 connects the data transmitted through the CDMA2000 network to the general Internet network, and the server 300 connected in the general Internet room operates the machine or changes the state of the machine through the Internet network. 200).

That is, a terminal program including the client content module 110 is programmed with a general network program on Wince, and communication is performed by sending data to a base station and transmitting data from a base station to a server on a communication protocol.

Data communication from the server 300 to the wireless terminal 100 also has a structure as described above.

The structure of the server-side and client-side content, the server-side content, and the interface method with the real machine 400 using CDMA20000 and the WLAN network will be described in detail as follows.

First, the server-side content will be described in detail.

The server 300 may provide two models, and each method is divided into a difference in a method of interfacing and communicating with an actual machine. The communication method may include a method using OLE (OPC: OLE for Process Control). The method using the shared memory of CNCMap can be used.

2 illustrates a server model using OLE.

Initializing an OLE DLL executes OLE initialization to use OLE.

Variable initialization initializes each variable used in the program. This function is done in CKimmMCServerDlg :: OnInitDialog () function. For details, initialize basic icons and variables used in the GUI (Graphic User Interface), and initialize variables used for communication, variables for communication, etc. It's a step.

The preset network setting step is to set the status for communication in the server program. If there is too much data in one packet according to the network performance in the network, the communication tends to be difficult in the network. The port number is set, and the set value is saved in the hard disk, and the network state is initialized by reading it when the program is initialized.

OPC use initialization step is to perform OPC initialization to communicate with machine by OPC program by using OLE. It initializes variables used in OPC program and creates necessary classes.

USB camera initialization initializes the USB camera and displays the PREVIEW screen on the screen in order to enable video communication using the USB camera.

If the server 300 is based on Windows NT, the USB camera is not supported. If the video communication is to be made in NT, the program is written using a PCI board type video input board.

Wait Event is the process of waiting for the user's command in the situation where the GUI part is displayed on the screen. The command includes "Start Server", "Start CNC", "End CNC", "CNC Hold", "Dest", It consists of events such as "end".

The server operation step waits for a data transmission request from a client by operating a communication program of the server 300, and when a data request is received from the client, the server 300 creates a new class for communication with the client and is dedicated to communication.

The newly created class communicates with the client program according to the defined protocol.

The function of the event is as follows.

The CNC start commands the CNC operation start command, the CNC end commands the CNC stop command, the CNC hold command to hold the CNC operation, and the task generates an arbitrary value for the communication test when communication with the CNC is impossible. Performs a communication test, and exit terminates the program.

The above-described content program is an OPC program using OLE, which is a program having a structure for reading the state of a machine or giving an operation command.

In case of the program using the shared memory of CNCMap, it is programmed using the Realtime Kernel (RTX) API, and it is replaced by the program using the RTX in the relevant part of OPC.

The following describes the interface process between server-side content and the actual machine.

Machine to which the server side content should interface is an open CNC machine tool, Figure 3 shows the structure of the CNC machine tool controller interfaced with the server-side content.

Server-side content extracts the actual machine information such as the state of the real machine, such as whether it is running, alarm status, NC program information, stage X, Y, Z position, remote start, stop, emergency stop and reservation A method for interfacing with a machine controller in order to apply information such as start / stop is shown.

Figure 4 shows an example of the server-side content and the interface structure with the actual CNC machine tool.

The following describes the client content module program in detail.

5 illustrates a client side content module program structure.

The client program connects to the server program, reads server information, and issues commands to the server as needed.

Variable initialization is the initialization of necessary variables in the start phase, and reading a preset network IP performs a task of reading an already registered address (IP) and a port.

The program is configured to register the address and port of the server to be used. The registered address is read and displayed in the list box, and one of the displayed addresses P is selected to start communication.

The previously connected server selection selects a server to be connected from a list box.

A network connection attempts to connect to the server.

When the initial connection attempt is made, it automatically reads and sets the server's basic data. After this command is successfully executed, other commands are executed.

Disconnection disconnects the server.

Start / Stop / Hold reservation is an operation for commanding scheduled execution. It sets the scheduled start time, scheduled stop time, and scheduled hold time to give the server a command in accordance with the time set in each command. Is executed.

One time read of machine status reads one time of machine status.

Machine Status Read Auto checks the machine by reading the machine status periodically.

Receive camera image shows the image received from USB camera when USB camera is installed.

Receiving a monitor image shows the image of the monitor transmitted from the server 300, and monitor image positioning is to specify a portion of the image transmitted from the server, the monitor resolution of the server compared to data transmission and reception Since a large amount of data cannot be displayed on the wireless terminal 100, the area of the monitor image can be set to monitor a portion of interest in the wireless terminal 100.

The monitor image size designation sets the size of the image to be received from the monitor. The size information of the entire monitor is obtained through communication at initialization.

Receiving an Image Automatically receives an image of the size or location specified in the above image size or location designation.

Termination terminates the program.

The machine control process by the ubiquitous based open machine remote control and monitoring system according to the present invention configured as described above will be described.

The main functions of the present invention are as follows.

Random state generation and machine PC real-time acquisition, screen capture and transfer function with ROI (Region Of Interest) selection and capture function, USB camera capture and transfer function, actual machine state and processing information It has data transmission function, external control signal transmission and CNC control function, real-time interface between server-side contents and controller of open machine, and automatic notification of open machine alarm to PDA phone (Bidirectional communication).

Each of the main functions will be described in detail as follows.

Random state generation is used for test when real machine data acquisition is not easy. It is used to test whether communication is possible by making machine state at random.

Acquiring the state of the real machine acquires data using OPC. When the initial server program is executed, the data is automatically checked and acquired.

The screen capture function captures the screen of the PC where the server is installed and receives a command from the client. When the screen capture command is received from the client, the screen capture size and position are given as capture parameters.

According to this command, the server 300 captures the screen as much as the size commanded from a given position on the screen, compresses the screen into a predetermined compressed image such as JPEG, and then sends the compressed data to the client.

The default image size is 176x144 (QCIF). The larger the image size, the greater the amount of data. The transmitted data is shown on the server 300 screen.

The USB camera creation and transfer function initializes the USB camera in the initial startup state when the USB camera is connected to the PC and shows the screen to the server.

Like the screen capture, the video is captured and compressed after being sent at 176x144 (QCIF Size) according to the command sent from the client.

USB camera can be used in Windows environment other than Windows NT so far, but NT is not supported by OS.

The actual machine status and machining information data transmission function sends the machine data generated by OPC or random to the client according to the client's request, and the sent data is machine status, alarm status, machining NC program information, stage (Stage) Axis position information.

The external control signal transmission and control function receives commands from the client such as stop / start / hold of the machine, and the server program executes them through OPC.

Detailed description of each major function is explained as follows, divided into server side and client side.

First, the server-side content function will be described in detail.

When the server program is initially executed, it checks whether data can be acquired by OPC connection, that is, by connecting to the machine. When data acquisition is possible, the program is executed, and when it is not possible, the warning message as shown below After the message is displayed, the program is executed.

 In other words, if the connection with the OPC fails, the above screen is displayed.

 After confirming a message due to a connection failure with the OPC or after a successful connection with the OPC, a server-side content mainframe screen as shown in FIG. 6 is displayed.

The structure of the mainframe shown in FIG. 6 will be described. "1. Start server" is a button to start the server when the "3. Running state" is lit.

"Transfer No.2" is to set before transmission of server No.1, and the transmission environment is set at the time of transmission. If the transfer setting is selected, the following sub screen appears.

 The size of a packet is one byte (BYTE) data to be used for transmission, and the delay time is the delay time between transmissions of each packet. The reason for setting these two is to secure transmission stability when transmitting a large amount of data. This is because when the packet size is too large or the delay time is too small, an error of data transmission is caused.

The port number is the data transfer port and the client must communicate using this port.

&Quot; 3. Operational state " is waj or the like when the server-side content becomes normal operation.

"4. Test" is for testing data transmission when the connection with the OPC server fails, and generates random data.

"5. Screen Capture" is a window that captures and displays the screen of the PC currently running on the server. It is captured by the client's request and displayed according to the window regardless of the capture size. This allows the server administrator to know what screens are currently captured and sent.

"6. Video Capture" shows the screen of USB camera when the USB camera is set. The screen is also captured and transmitted by the client's request, and the server shows the continuous screen unlike the screen capture. .

"7. Status acquisition" is a window that shows how many times data is acquired through OPC or Random. If there is little change of data, it is difficult to know the operation of the server. You can check

"8.Machine Status" shows the status of the data acquired from the current machine.The data shows the position information of RPM 1,2,3, RPM information, Feed Rate information, operation mode, set NC program information, automatic operation status information. , Machine On / Off information, alarm information.

"9. Command reservation" shows whether there is a command reserved from the client and shows the reservation according to the date and time. This reservation can set the On / Off and HOLD time. If it comes, it is done by final booking.

"100. Number of connections" is a window showing how many clients are currently connected to the current program is programmed to be accessible to up to five clients, but this is adjustable and does not limit the scope of the claims of the present invention.

"11. Access Information" shows the connection and disconnection information of the client, and shows reservation information, control information, etc., and this information is displayed with time, which client has been connected and when it has been disconnected, You can determine what order and when.

"12. start" is a command to start the operation of the machine.

"13. HOLD" gives the machine a Hold command.

"14. STOP" issues a STOP command to the machine.

"15. End" ends the program.

Next, the function of the client-side content will be described in detail.

The client side is a program that is implemented on the PDA. It is programmed using Embedded Visual C ++ 4.0. The overall characteristics of this program are the connection with the server, the data acquisition from the server, the command transfer to the server, the acquisition and decoding of the image data from the server. And accompanying functions.

First, the client side main screen is as shown in FIG.

The connect 1 is a function of attempting to connect to the server. Before selecting this button, the connect 1 selects a server to be connected and then attempts to connect.

When the connection is established, the following message appears.

 If the connection fails, a message of connection failure is displayed. If the connection is successful, necessary commands can be executed.

In the list box 2, addresses of servers inputted through an insert 3 are displayed, and a connection server is determined by selection of the displayed address. The format displayed in the list box (2) is "xxx.xxx.xxx.xxx @PORT: yyyy", where xxx represents IP ADDRESS, yyyy represents the port number, and the addresses displayed here indicate the location of the program executable. It is stored in the directory's address list (IP_LIST) file.

INSERT (3) is a means for storing and inputting the IP address and port in the list box (2).

 After selecting and saving the IP and port number in the above screen, the specified IP and port are saved in the address list (IP_LIST) file and inserted into the list of the list box (2).

Delete 4 deletes the IP and port number displayed in the list box 2.

START RESERVATION 5 sends a command to the server to perform a START command at the server 300 at the time set in the start time setting window 6.

The STOP RESERVATION 7 sends a command to the server for the server 300 to perform a stop command to the machine at the time set in the end time setting window 8.

The hold reservation 9 sends a command to the server to perform a hold command in the server 300 at a time set in the hold time setting window 10.

START (11) sends a command to the server to execute the start command immediately at the server 300, STOP (12) sends a command to the server to execute the stop command directly at the server (300), Hold 13 sends a command to the server to immediately execute the hold command at server 300.

Start Reservation Time (14) shows the start command time already reserved by the server, Stop Reservation Time (15) shows the stop command time already reserved by the server, and hold reservation Hold Reservation Time 16 shows the hold command time already reserved by the server.

CNC Alarm 17 displays the alarm status of the machine acquired from the server, and M / AutoRun 18 displays the Auto Run status of the machine acquired from the server. The machine on / off (M / On / Off) 19 displays the On / OFF state of the machine obtained from the server.

The Get State 20 requests data from the server to show the state of the machine. The AUTO 21 periodically obtains and displays data from the server, and the display box 22 from the server. Display the received data.

The display box 23 displays the starting coordinates of the screen when the screen image is received from the server. Since the data of the screen is very large data, the size of the image can be set in consideration of the cost of transmitting the image. It is programmed to receive as much image size from the screen position.

The display box 24 displays the image transmission speed. Since the image transmission has a large amount of data, it takes time to receive a single image.

The scroll bars 25 and 27 set the starting point of the image when the image of the screen is received, and the set value is displayed on the display box 23.

The image display window 26 shows the transmitted image, the image acquisition button 28 transmits a command for acquiring one image to the server, and the image selection button 29 selects the type of image to be transmitted. Determines whether USB CAMERA (176x144) or screen image.

The image size setting window 30 sets the size of the screen image to be received when the image selected by the image selection button 29 is set to the screen. If the image size is large, the data transmission amount increases and the error rate increases, which is suitable for the system. Should be adjusted.

The image step setting window 31 adjusts the moving interval of the image displayed on the image display window 26, and the image moving button 32 moves the current screen image by the step set in the image step setting window 31 and transmits the image. To receive. In this case, the data transfer command is issued by clicking the button, which is mainly used to navigate the main part of the initial screen.

The image transmission period display window 33 is a window for selecting an image transmission period to receive data periodically when the image transmission is automatically performed, and the image automatic transmission button 34 instructs the server to automatically perform image transmission. Send button.

The ubiquitous based open machine remote control and monitoring system and method according to the present invention configured as described above can control an open machine such as a CNC machine tool in a telephone network and a wireless LAN by using a wireless communication means such as a PDA. It is possible to easily control the machine by real-time remote control, reservation control and remote monitoring regardless of the situation.

Claims (4)

In an open machine control system using a communication network, A base station responsible for wired and wireless communication with each server and terminal; A mobile content program for a client for controlling the open machine, which receives data from the server and displays it on the screen, and wirelessly transmits remote control signals such as start and stop of the machine, reservation operation and reservation stop to the server. Terminal and; It is equipped with a server content program which communicates with the wireless terminal to show the state of the machine and transmits and receives a command to control the machine. The state of the machine transmitted from the machine, whether an alarm has occurred, NC program command, driving position of each axis, etc. A server which carries out various matters for obtaining monitoring data and transmitting and communicating images acquired from a USB camera installed in the machine; Ubiquitous-based open machine remote control and monitoring system, characterized in that it comprises a wireless communication network for connecting the wireless terminal and the server to communicate. The mobile terminal of claim 1, wherein the wireless terminal is a PDA, and the mobile content program for the client is an agent completed using Embedded Visual C ++ 4.0 for system embedded so that the PDA can be executed in the operating system WINCE.NET 4.2. The ubiquitous open machine remote control and monitoring system, characterized in that the server content program provided in the server is an agent completed using Visual C ++ 6.0 to run on Windows. The client mobile content program of claim 1 or 2, wherein the client mobile content program is configured to access a server program, read information of the server, and issue a command to the server as needed, and thus initialize a variable and set a preset network address. Network IP) Read, Select connected server, Disconnect, Start / Stop / Hold, Schedule function, Machine status read once, Machine status read automatically, Receive camera image, Receive monitor image, Ubiquitous-based open machine remote control and monitoring system, which includes a monitor image sizing and automatic image acquisition. The server content program of claim 1 or 2, wherein the server content program of the server comprises a communication method using OLE (OPC: OLE for Process Control) and a communication method using a shared memory of CNCMap. Can be configured as a model, The server model using OLE has OLE DLL initialization, variable initialization, preset network setting, OPC usage initialization, USB camera initialization, wait event, server operation, and the command standby function. Ubiquitous-based open machine remote control and monitoring system, which includes "server start", "CNC start", "CNC stop", "CNC hold", "desk" and "shutdown". .

Images