WO2023276875A1 - 操作システム、処理システム、処理システムの構築方法、コンピュータ、操作方法、プログラム、及び記憶媒体 - Google Patents

操作システム、処理システム、処理システムの構築方法、コンピュータ、操作方法、プログラム、及び記憶媒体 Download PDF

Info

Publication number
WO2023276875A1
WO2023276875A1 PCT/JP2022/025277 JP2022025277W WO2023276875A1 WO 2023276875 A1 WO2023276875 A1 WO 2023276875A1 JP 2022025277 W JP2022025277 W JP 2022025277W WO 2023276875 A1 WO2023276875 A1 WO 2023276875A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
input
file
processing
display device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2022/025277
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
康徳 渕上
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toshiba Corp
Original Assignee
Toshiba Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Toshiba Corp filed Critical Toshiba Corp
Priority to JP2023531897A priority Critical patent/JP7793622B2/ja
Publication of WO2023276875A1 publication Critical patent/WO2023276875A1/ja
Priority to US18/395,856 priority patent/US20240126416A1/en
Anticipated expiration legal-status Critical
Priority to JP2025259441A priority patent/JP2026040518A/ja
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0613—The adjustment depending on the type of the information to be displayed
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00—Aspects of interface with display user

Definitions

  • the problem to be solved by the present invention is to provide an operating system, a processing system, a processing system construction method, a computer, an operating method, a program, and a storage medium that can improve convenience.
  • the operation system acquires a video signal from the first device to be operated.
  • the operation system causes a display device to display a screen based on the video signal.
  • the operation system generates an operation instruction corresponding to an input operation from a user, according to the input operation.
  • the operation system generates an operation signal corresponding to the first device based on the operation instruction and transmits the operation signal to the first device.
  • FIG. 1 is a schematic diagram showing an operating system according to an embodiment
  • FIG. 2 is a schematic diagram illustrating a screen of a display device
  • FIG. 2 is a schematic diagram illustrating a screen of a display device
  • FIG. 4 is a schematic diagram for explaining coordinate transformation in the operation system according to the embodiment
  • It is a flow chart which shows operation of the operation system concerning an embodiment.
  • It is a schematic diagram which shows the operating system based on the 1st modification of embodiment.
  • 2 is a schematic diagram illustrating a screen of a display device;
  • FIG. (a) It is a schematic diagram which illustrates a part of 1st file.
  • (b) It is a schematic diagram which illustrates a part of 2nd file.
  • FIG. 9 is a flow chart showing procedures of an automatic operation method using the operation system according to the first modified example of the embodiment;
  • FIG. 4 is a flow chart showing part of an automatic operation mode trial by the operation system according to the embodiment;
  • FIG. It is a schematic diagram which shows the operating system which concerns on the 2nd modification of embodiment. It is a schematic diagram which shows the operating system based on the 3rd modification of embodiment. It is a schematic diagram which shows the operating system based on the 4th modification of embodiment. It is a schematic diagram which shows the operating system based on the 5th modification of embodiment. It is a mimetic diagram showing a processing system concerning the 6th modification of an embodiment.
  • FIG. 21 is a schematic diagram showing an operating system according to a seventh modified example of the embodiment;
  • FIG. 20 is a schematic diagram showing an operating system according to an eighth modified example of the embodiment; It is a schematic diagram which shows a hardware configuration.
  • FIG. 1 is a schematic diagram showing an operating system according to an embodiment.
  • the processing system 1 includes an operating system 10 and a processing device 21 (first device).
  • the operation system 10 includes an acquisition device 11 , a computation device 12 , a generation device 13 , a storage device 14 , an input device 15 and a display device 16 .
  • the operating system 10 is used to operate the processing device 21 .
  • the processing device 21 includes a control unit 21a. Each component of the processing device 21 operates based on commands sent from the control unit 21a to process the work.
  • the control unit 21a includes, for example, a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), a storage device, an input interface, an output interface, a communication interface, and a bus connecting these.
  • the control unit 21a may be a dedicated computer for the processing device 21, or may be a general-purpose computer. The functions of the control unit 21a may be realized by cooperation of a plurality of computers.
  • the input device 22 is used by the user to input data to the processing device 21 .
  • a user is, for example, an operator in charge of processing performed by the processing device 21 .
  • the input device 22 includes at least one selected from, for example, a keyboard, mouse, touchpad, and microphone (voice input).
  • the display device 23 displays the video signal output from the processing device 21 so that the user can visually recognize it.
  • Display device 23 includes a monitor.
  • the computing device 12 causes the display device 16 to display a screen based on the received video signal.
  • the arithmetic device 12 receives an operation (input operation) input by a user using the input device 15 .
  • the arithmetic device 12 generates an operation instruction corresponding to the input operation according to the input operation.
  • An operation command is a command for executing the same operation content as the input operation.
  • the arithmetic device 12 transmits the operation instruction to the generation device 13 .
  • Input operations include pointer movement, selection, and character input.
  • the selection operation selects an icon, displays a menu, selects a menu, focuses an input field, and the like. Selection of a range, selection of a plurality of icons, etc. are performed by a combination of selection and movement of the pointer.
  • the computing device 12 executes coordinate conversion. Specifically, when the content displayed on the screen of the display device 23 is reduced or enlarged according to the resolution of the screen of the display device 16, the arithmetic device 12 performs coordinate transformation. In coordinate conversion, the computing device 12 acquires the coordinates selected on the screen of the display device 16 . Arithmetic device 12 converts the coordinates into coordinates on the screen of display device 23 . This is because, in general, when the types of display devices are different, the resolution, the coordinates of the origin, the coordinate system, and the like are different among the display devices.
  • the computing device 12 includes, for example, a CPU, a ROM, a RAM, a storage device, an input interface, an output interface, a communication interface, and a bus connecting these.
  • Arithmetic device 12 is a dedicated or general-purpose computer. The functions of the computing device 12 may be realized by cooperation of a plurality of computers.
  • the input device 15 includes at least one selected from, for example, a keyboard, mouse, touchpad, and microphone.
  • Display device 16 includes a monitor.
  • the generation device 13 generates an operation signal corresponding to the processing device 21 based on the operation instruction.
  • the generation device 13 inputs the generated operation signal to the processing device 21 (control unit 21a), which is an operation target.
  • the processing device 21 control unit 21a
  • the operation signal corresponds to a signal sent from the mouse or keyboard to the controller 21a.
  • the operation signal corresponds to a signal transmitted from the touch pad to the control section 21a.
  • the generation device 13 includes, for example, a microcomputer programmed to generate operation signals corresponding to signals transmitted from the input device 22 .
  • the processing device 21 Upon receiving an operation signal, the processing device 21 moves the pointer, selects an icon, inputs characters, etc. according to the operation signal.
  • the storage device 14 stores various data necessary for operating the processing device 21 .
  • the storage device 14 stores the respective resolutions, origin coordinates, coordinate systems, etc. of the display devices 16 and 23 .
  • the storage device 14 includes a hard disk drive (HDD), solid state drive (SSD), network attached hard disk (NAS), or the like.
  • FIGS. 2(a), 2(b), 3(a), and 3(b) are schematic diagrams illustrating the screen of the display device.
  • 2A and 3A are examples of screens displayed on the display device 23.
  • FIG. 2B and 3B are examples of screens displayed on the display device 16.
  • the screen resolution of the display device 23 is higher than the screen resolution of the display device 16 .
  • the entire screen of the display device 23 is reduced and displayed.
  • the screen resolution of the display device 23 is smaller than the screen resolution of the display device 16
  • the entire screen of the display device 23 is displayed on the screen of the display device 16 in the same size as the screen of the display device 23 .
  • the content displayed on the screen of the display device 23 may be enlarged according to the resolution of the screen of the display device 16 .
  • the screen displayed on the display device 16 and the screen displayed on the display device 23 are based on the same video signal. Therefore, as shown in FIGS. 2A and 2B, the screen A1 of the display device 16 displays the same content as the screen a1 of the display device 23.
  • FIG. The screen A1 displays icons B1 to B7 that are the same as the icons b1 to b7 and information C1 that is the same as the information c1.
  • the user uses the input device 15 to input an operation to the arithmetic device 12 while looking at the screen A1 of the display device 16 .
  • the user moves the pointer P to the icon B3 on the screen A1 and selects the icon B3 by clicking.
  • the computing device 12 acquires the clicked coordinates.
  • the computing device 12 accesses the storage device 14 and refers to the coordinates of the origin of the display device 16 , the coordinate system of the display device 16 , the coordinates of the origin of the display device 23 , and the coordinate system of the display device 23 .
  • FIGS. 4A and 4B are schematic diagrams for explaining coordinate transformation in the operating system according to the embodiment.
  • the resolution in the X direction of the display device 16 is Rx1
  • the X coordinate of the origin in the coordinate system of the display device 16 is Ox1
  • the resolution in the X direction of the display device 23 is Let Rx2 be the X coordinate of the origin in the coordinate system of the display device 23, and Ox2 be the origin.
  • the calculation device 12 can convert the X-direction coordinate x1 of the point clicked on the screen of the display device 16 to the X-direction coordinate x2 of the point clicked on the screen of the display device 23 by the following formula.
  • x2 (x1-Ox1) ⁇ (Rx2-Ox2)/(Rx1-Ox1)+Ox2
  • Ry1 be the resolution in the Y direction of the display device 16
  • Oy1 be the Y coordinate of the origin in the coordinate system of the display device 16
  • Ry2 be the resolution in the Y direction of the display device 23
  • Oy2 be the Y coordinate of the origin in the coordinate system of the display device 23.
  • the calculation device 12 can convert the Y-direction coordinate y1 of the point clicked on the screen of the display device 16 to the Y-direction coordinate y2 of the point clicked on the screen of the display device 23 by the following formula.
  • y2 (y1-Oy1) ⁇ (Ry2-Oy2)/(Ry1-Oy1)+Oy2
  • the generation device 13 generates an operation signal corresponding to the processing device 21 based on the operation instruction.
  • the processing device 21 moves the pointer p to the icon b3 and selects the icon b3 according to the operation signal.
  • the operation system 10 can properly operate the processing device 21 regardless of the difference between the specifications of the display device 16 and the display device 23 .
  • the resolution of display device 16 is 2000 ⁇ 1000.
  • the resolution of the display device 23 is 640 ⁇ 480.
  • the calculation device 12 converts the coordinates clicked on the screen A1 to the coordinates clicked on the screen a1 as follows, using the formulas described above.
  • FIG. 5 is a flow chart showing the operation of the operating system according to the embodiment.
  • the acquisition device 11 acquires a video signal (step S1).
  • the arithmetic device 12 causes the display device 16 to display a screen based on the video signal (step S2).
  • Arithmetic device 12 receives an input operation using input device 15 (step S3).
  • Arithmetic device 12 generates an operation instruction corresponding to the input operation in response to the reception of the input operation (step S4).
  • the generation device 13 generates an operation signal corresponding to the processing device 21 based on the operation command (step S5).
  • the generation device 13 transmits the generated operation signal to the processing device 21 (step S6).
  • the processing device 21 is operated according to the received operation signal.
  • the operation system 10 acquires a video signal from the processing device 21 and transmits an operation signal corresponding to the processing device 21 to the processing device 21 .
  • the operation system 10 transmits an operation signal corresponding to the input operation from the user to the processing device 21 .
  • a user can operate the processing device 21 without using the input device 22 by using the operation system 10 .
  • the operation system 10 By applying the operation system 10 to the existing processing device 21, the input device 22, and the display device 23, there is no need to modify the processing device 21, make communication settings for remote control, prepare special communication requirements, or the like. , the processor 21 can be easily remotely operated.
  • the operation system 10 the user can directly operate the processing device 21 using the input device 15 without storing input operations or executing stored input operations. According to the embodiment, the convenience of the operating system 10 can be improved.
  • the operation system 10 When the operation system 10 operates the processing device 21, the operation system 10 does not need to access data, etc. of the processing device 21. According to the embodiment, even when the processing device 21 is connected only to a limited network, the processing device 21 can be remotely operated, and the security of data regarding the processing device 21 can be improved.
  • remote control means operating the processing device 21 with an operating system 10 separate from the processing device 21 using electrical signals or the like.
  • the operating system 10 does not have to be provided at a location remote from the processing device 21 .
  • the operating system 10 may be provided at a location remote from the processing device 21 or may be provided adjacent to the processing device 21 .
  • the computing device 12 reduces or enlarges the screen based on the video signal according to the resolution of the display device 16. As a result, the entire screen of the display device 23 can be displayed on the display device 16, facilitating operations such as icon selection, menu display, menu selection, and focusing on input fields.
  • the usability of the processing system 1 and the operation system 10 can be improved.
  • Arithmetic unit 12 performs the coordinate transformation described above to correct the deviation. Thereby, even when the screen is enlarged or reduced, it is possible to select an appropriate position on the screen of the display device 23 .
  • FIG. 6 is a schematic diagram showing an operating system 10a according to a first modified example of the embodiment.
  • the operation system 10a according to the first modification can execute an automatic operation mode for automatically operating the processing device 21.
  • the processing system 1 a includes an operating system 10 a and a processing device 21 .
  • the storage device 14 stores an action file 14a that is referenced during the automatic operation mode.
  • the operation file 14a describes operations for the processing device 21 .
  • the user uses the input device 15 or 22 to operate the processing device 21 .
  • the processing device 21 is operated and the screen of the display device 23 changes.
  • the arithmetic device 12 determines the executed operation from the input from the input device 15 and the change of the screen, and describes it in the action file.
  • the computing device 12 In the automatic operating mode, the computing device 12 generates operating instructions based on the action file. Thereby, the operation performed by the user is automatically repeated by the operation system 10a.
  • the action file includes a first file and a second file.
  • a first file describes a generation operation for generating an operation instruction.
  • the first file is a program file describing an operation sequence for generating operation instructions and transmitting them to the generation device 13 .
  • the first file is written in a general-purpose programming language such as C language.
  • the second file is referenced when executing the generation operation.
  • the second file contains information used in identifying output signals and generating operation signals, which will be described later.
  • the second file describes, in text format, coordinates selected by the pointing device, data information referred to during image recognition, and the like.
  • the computing device 12 executes the generation operation described in the first file while referring to the information contained in the second file.
  • the computing device 12 performs image recognition processing on the screen based on the acquired video information.
  • Image recognition determines screen changes, operations performed, and the like. At least one selected from template matching, character recognition, and color recognition is performed in image recognition. Reference data necessary for motion files and image recognition are prepared in advance by the user or the operation system 10a.
  • the acquisition device 11 acquires a video signal from the processing device 21 to the display device 23 when characters are input using the keyboard.
  • the computing device 12 causes the display device 16 to display a screen based on the video signal.
  • the user moves the pointer to the text box for entering characters on the displayed screen, and selects the coordinates. This will focus the textbox.
  • the user uses the input device 15 to input characters into the text box.
  • Arithmetic device 12 describes the coordinates of the screen of display device 23 and one or more characters to be entered in the text box in the second file.
  • the arithmetic device 12 After the operation signal is sent to the processing device 21, the arithmetic device 12 performs image recognition to determine whether the processing device 21 has been operated in accordance with the operation signal. If it is determined that the operation has not been performed, the computing device 12 may transmit a notification to the display device 16 or another terminal device to the effect that the operation is not possible.
  • the file name of the template image used for image recognition, the range used for character recognition, the image and range used for color recognition, etc. are described in the second file.
  • the acquisition device 11 acquires a video signal from the processing device 21 to the display device 23 when performing image recognition.
  • the computing device 12 causes the display device 16 to display a screen based on the video signal.
  • the user uses the input device 15 to select part of the displayed screen.
  • the selected portion is stored in storage device 14 as a template image.
  • the user describes the file name of the template image to be referred to in the second file.
  • template images are prepared for all screens on which automatic operations are performed by the operation system 10a.
  • the screen changes. For example, the displayed screen is changed to another screen, or a window is displayed. A partial image that is not included in the screen before change but included in the screen after change is used as a template image.
  • the acquisition device 11 acquires the video signal from the processing device 21 to the display device 23 when the character needs to be recognized.
  • the computing device 12 causes the display device 16 to display a screen based on the video signal.
  • the user uses the input device 15 to confirm the range in which character recognition is performed on the displayed screen.
  • the user describes the range in the second file.
  • the user may select two diagonal points within which character recognition is performed.
  • the computing device 12 converts the coordinates of the two selected diagonal points into coordinates on the screen of the display device 23 .
  • the computing device 12 writes the transformed coordinates in the second file.
  • the acquisition device 11 acquires video signals from the processing device 21 to the display device 23 when it is necessary to recognize colors.
  • the computing device 12 causes the display device 16 to display a screen based on the video signal.
  • the user uses the input device 15 to select a range in which color recognition is performed on the displayed screen.
  • the image of the selected range is stored in storage device 14 .
  • the user describes the range in the second file.
  • the user may select two diagonal points of the range over which color recognition is performed.
  • the computing device 12 converts the coordinates of the two selected diagonal points into coordinates on the screen of the display device 23 .
  • the computing device 12 writes the transformed coordinates in the second file.
  • the computing device 12 compares the screen based on the video signal with the template image and determines whether the screen includes an image similar to the template image.
  • the arithmetic unit 12 cuts out an image in a pre-stored range.
  • the arithmetic unit 12 performs character recognition processing such as Optical Character Recognition (OCR) on the image.
  • OCR Optical Character Recognition
  • color recognition the arithmetic unit 12 cuts out an image of a pre-stored range.
  • Arithmetic device 12 determines whether or not the color of each part matches between the pre-stored image and the clipped image. By recognizing the image through these processes, the arithmetic unit 12 determines whether the operation to the processing unit 21 by the operation signal has been completed.
  • FIGS. 7A and 7B are schematic diagrams illustrating screens of the display device.
  • FIG. 8A is a schematic diagram illustrating part of the first file.
  • FIG. 8B is a schematic diagram illustrating part of the second file. Creation of an action file by the operation system 10a will be described with reference to a specific example.
  • screens shown in FIGS. 7A and 7B are displayed on the display device 16 based on the video signal output from the processing device 21.
  • FIG. Icons B1 to B7 and information C1 are displayed on the screen A1 shown in FIG. 7(a).
  • Icons B1 to B4, icons B11 to B14, and a schematic diagram D of the processing device 21 are displayed on the screen A2 shown in FIG. 7B.
  • the user moves the pointer P to the icon B3 on the screen A1 shown in FIG. 7(a) and selects the icon B3.
  • the computing device 12 converts the selected coordinates into coordinates on the screen of the display device 23 .
  • the arithmetic device 12 describes in the first file the operation of moving the pointer to the converted coordinates and the operation of selecting the coordinates.
  • the computing device 12 writes the converted coordinates in the second file.
  • a screen A2 shown in FIG. 7(b) is displayed on the display device 16.
  • the user cuts out a template image from screen A2 for determining transition from screen A1 to screen A2.
  • the schematic diagram D and any of the icons B11 to B14 are used as template images.
  • the user stores the clipped template image in the storage device 14 as image data.
  • the user writes in the second file the file name of the template image that is referred to when determining the transition from screen A1 to screen A2.
  • the user moves the pointer P to the icon B14 on the screen A2 and selects the icon B14.
  • the computing device 12 converts the selected coordinates into coordinates on the screen of the display device 23 .
  • the arithmetic device 12 describes in the first file the operation of moving the pointer to the converted coordinates and the operation of selecting the coordinates.
  • the computing device 12 writes the converted coordinates in the second file. Thereafter, similarly, the storage of the template image and the description of the file name in the second file are repeated.
  • a first file and a second file are prepared for operation by the operation system 10a.
  • the first file describes operations to be executed by the computing device 12, such as generation of an operation command for selecting a specific icon and reference to a template image.
  • the second file describes the coordinates to be selected, the file name of the template image to be referenced, and the like.
  • the trigger for starting the operation by the operation system 10a is arbitrary.
  • the operation may be started based on a signal input to the processing device 21 or a signal sent from another sensor, measuring instrument, or the like.
  • Operation may be initiated in response to a signal sent from another operating system 10a or from another processing device 21 operated by another operating system 10a.
  • the signal may be transmitted during operation by another operation system 10a, or may be transmitted other than during operation by another operation system 10a.
  • the operation may be started when a specific screen is displayed on the display device 23 .
  • An operation may be initiated when a user enters a specific command into computing device 12 .
  • FIG. 9 is a flow chart showing procedures of an automatic operation method using the operation system according to the first modification of the embodiment.
  • the operation system 10a executes the operations of the flowchart shown in FIG. 5 so that the user can operate the processing device 21 using the input device 15.
  • FIG. The user operates the processing device 21 so that the processing to be automatically executed by the processing device 21 is executed.
  • a first file, reference data and a second file are created (step S11).
  • the computing device 12 writes an operation sequence corresponding to the user's operation in the first file.
  • the computing device 12 writes the selected coordinates to the second file.
  • the user stores the reference data in storage device 14 .
  • the user describes the file name of the reference data and the like in the second file.
  • the operation system 10a executes the automatic operation mode of the processing device 21 using the created first file, reference data, and second file (step S12).
  • the processing device 21 can be automatically operated in the automatic operation mode.
  • the operation of the processing device 21 can be automated without modifying the processing device 21 or rewriting the program.
  • the operational files include a first file and a second file.
  • a first file describes a generation operation for generating an operation instruction.
  • the second file is created separately from the first file and is referred to when executing the generation operation based on the description of the first file.
  • a plurality of processing devices 21 of the same type may be used.
  • a plurality of processing devices 21 can be automatically operated by a plurality of operating systems 10a.
  • common motion files and common reference data may be used. For example, when an operation file and reference data for operating one processing device 21 are prepared, the operation file and reference data are duplicated and used in operations by each operation system 10a.
  • the displayed screen may be slightly different even between the processing devices 21 of the same type.
  • the position of the same icon on the same screen may differ slightly between processing devices 21 .
  • the desired icon may not be selected.
  • the appearance of the template image may differ due to the influence of noise, aged deterioration of the video signal output section of the processor 21, and the like. As a result, the accuracy of image recognition may deteriorate.
  • information used when generating operation instructions is described in a second file separate from the first file. For example, if there is a deviation in the coordinates of the icon, the description of the coordinates may be changed so as to correct the deviation. If the appearance of the template image is different, the description of the second file may be changed so that template images with different appearances are prepared and the image data thereof is referred to. According to the embodiment, the machine difference can be easily corrected, and the user's burden required for preparing the operation system 10a can be reduced.
  • the second file is, for example, a text file. Therefore, even a user who has no knowledge of programming can describe the second file in the text format and can easily modify the second file.
  • the reference data may be automatically generated by the operating system 10a.
  • the computing device 12 saves the screen before selection and the screen after selection.
  • the computing device 12 detects a change in the feature amount of the screen after selection with respect to the feature amount of the screen before selection.
  • the computing device 12 extracts a region with a large change in feature amount from the screen after selection.
  • Arithmetic device 12 stores the extracted region in storage device 14 as a template image.
  • Arithmetic device 12 describes the file name of the template image in the second file.
  • the user may try the automatic operation mode in order to check whether there is any problem in the operation of the operation system 10a before starting the production line. For example, the user checks whether the icons are properly selected, whether the images are correctly recognized, etc. in the trial of the automatic operation mode. If a problem in the automatic operation mode is confirmed, the user appropriately corrects the description in the second file.
  • the computing device 12 may automatically correct the coordinates described in the second file. For example, in the automatic operation mode trial, the computing device 12 generates a selection operation command for selecting the coordinates described in the second file and transmits it to the generation device 13 .
  • the generation device 13 generates an operation signal based on the selection operation instruction and transmits it to the processing device 21 .
  • the arithmetic device 12 recognizes the image acquired by the acquisition device 11 after the operation signal is transmitted, and determines whether the template image prepared in advance is displayed. If the template image is not displayed, the computing device 12 generates another selection operation command for selecting coordinates different from those described in the second file. For example, the other coordinates are randomly determined from near coordinates described in the second file.
  • the arithmetic device 12 sends another selection operation command to the generation device 13 .
  • the generation device 13 generates another operation signal based on another selection operation instruction and transmits it to the processing device 21 .
  • the generation of another selection operation instruction is repeated, for example, until a prepared template image is displayed or the number of generations of the selection operation instruction reaches a prescribed value.
  • Arithmetic device 12 generates another selection operation instruction so as to select another coordinate different from the previous coordinates.
  • FIG. 10 is a flow chart showing a part of the automatic operation mode trial by the operation system according to the embodiment.
  • the computing device 12 generates a selection operation command for selecting part of the screen (step S21).
  • the generation device 13 generates an operation signal based on the selection operation instruction and transmits it to the processing device 21 .
  • the arithmetic device 12 determines whether the operation to the processing device 21 by the operation signal has been completed based on the recognition result of the screen (step S22).
  • the computing device 12 determines whether the number of trials of the selection operation is less than the prescribed number (step S23). When the number of trials is less than the prescribed number, the computing device 12 generates another selection operation command for selecting another coordinate (step S24). The generation device 13 generates an operation signal based on the selection operation instruction and transmits it to the processing device 21 . When the number of trials of the selection operation reaches the specified number, the computing device 12 notifies the user (step S25). For example, the display device 16 displays information notifying that the operation cannot be executed properly.
  • step S22 when it is determined that the operation corresponding to the selection operation command has been completed, the arithmetic unit 12 changes the coordinates described in the second file to the coordinates used in the selection operation command that allowed the selection operation to be executed. Correct (step S26). Note that if the selection operation can be executed at the original coordinates described in the second file, the second file is not modified.
  • the coordinates described in the second file need to be corrected, the coordinates are automatically corrected by the processing according to the flowchart shown in FIG. Thereby, the convenience of the operation system 10a can be improved.
  • FIG. 11 is a schematic diagram showing an operation system according to a second modification of the embodiment.
  • An input display device having functions as an input device and a display device may be connected to the processing device 21 .
  • a touch panel 24 is provided as an input display device.
  • the operating system 10b according to the second modified example further includes a switching device 17 .
  • the processing system 1b includes an operation system 10b and a processing device 21.
  • the generation device 13 generates an operation signal corresponding to the signal transmitted from the touch panel 24.
  • the switching device 17 switches signals input to the processing device 21 . Specifically, a signal transmitted from the touch panel 24 and an operation signal transmitted from the generation device 13 are input to the switching device 17 .
  • the switching device 17 switches between a state in which a signal transmitted from the touch panel 24 is input to the processing device 21 and a state in which an operation signal transmitted from the generation device 13 is input to the processing device 21 .
  • the switching device 17 inputs an operation signal to the processing device 21 during operation by the operating system 10b.
  • the switching device 17 can prevent the user from operating the processing device 21 with the touch panel 24 during operation with the operation system 10b. For example, it is possible to reduce the possibility that the automatic operation mode by the operation system 10b is interrupted by transitioning to another screen by the user's operation.
  • the switching device 17 includes, for example, a relay circuit or a switching circuit. By providing the switching device 17, the processing device 21 using the touch panel 24 can be operated by the operation system 10b.
  • the touch panel 24 even if the devices are of the same type, there is a large deviation in the coordinates of the generated operation signals. This is because the positional relationship between the coordinates of the sensor that detects the touch and the display is individually adjusted. Therefore, even if a plurality of touch panels 24 of the same type are used for a plurality of processing devices 21 of the same type, the coordinates selected or referred to during automatic operation must be corrected for each processing device 21. be.
  • the invention according to the embodiment is particularly suitable for the processing device 21 in which the touch panel 24 is used. According to the second modification, it is possible to reduce the burden on the user for preparing the automatic operation mode of the processing device 21 to which the touch panel 24 is connected.
  • FIG. 12 is a schematic diagram showing an operation system according to a third modified example of the embodiment.
  • the operating system 10c according to the third modified example further includes a switching device 17 as compared with the operating system 10 .
  • a signal transmitted from the generation device 13 or the input device 22 to the processing device 21 is input to the processing device 21 via the switching device 17 .
  • the switching device 17 switches between a state in which a signal transmitted from the input device 22 is input to the processing device 21 and a state in which an operation signal transmitted from the generation device 13 is input to the processing device 21 .
  • the switching device 17 inputs an operation signal to the processing device 21 during operation by the operation system 10c. Accordingly, it is possible to prevent the user from operating the processing device 21 using the input device 22 during operation by the operation system 10c. For example, it is possible to reduce the possibility that the automatic operation mode is interrupted by the user's operation. According to the third modification, the convenience of the processing system 1c including the operation system 10c and the processing device 21 can be improved.
  • FIG. 13 is a schematic diagram showing an operating system according to a fourth modified example of the embodiment; As shown in FIG. 13, the operation system 10d according to the fourth modification further includes reading devices 18a and 18b compared to the operation system 10.
  • FIG. Readers 18a and 18b read the identification information.
  • a one-dimensional barcode, a two-dimensional barcode, or a Radio Frequency Identifier (RFID) can be used as identification information.
  • Readers 18a and 18b are barcode readers or RFID readers.
  • the reading device 18a reads the identification information of the operator in charge of the processing device 21.
  • FIG. The reading device 18b reads the identification information of the work processed by the processing device 21 .
  • the user when executing the processing by the processing device 21, the user (operator) places the work in a place where the identification information of the work can be read by the reading device 18b. After that, the user causes the reading device 18a to read his/her own identification information.
  • the computing device 12 starts operating the processing device 21 in response to reading of the identification information by the reading device 18a. For example, the computing device 12 causes the reading device 18b to read the identification information of the work, and then starts generating operation instructions.
  • the operation system 10d may generate an operation signal according to the read identification information and input it to the processing device 21.
  • the identification information may be directly input from the arithmetic device 12 to the processing device 21 via a communication port by serial communication or the like.
  • the operating system 10d may include other devices related to the processing executed by the processing device 21.
  • the operation of processing device 21 may be initiated in response to the operation of another device. Thereby, the user does not need to operate the input device 15 or 22 to start the operation.
  • the convenience of the processing system 1d including the operation system 10d and the processing device 21 can be improved.
  • FIG. 14 is a schematic diagram showing an operating system according to a fifth modification of the embodiment; An operation system 10e according to the fifth modification is connected to a management device 30 (second device) as shown in FIG.
  • the processing system 1e includes an operating system 10e, a processing device 21, and a management device 30.
  • the computing device 12 is connected to the management device 30 through a network, wired communication, or wireless communication.
  • the management device 30 is a high-level device that transmits commands to the processing device 21 .
  • the operation system 10e receives the command.
  • the operation system 10e executes operations according to instructions.
  • the arithmetic device 12 generates an operation command according to the command and transmits it to the generation device 13 .
  • the storage device 14 stores a plurality of operation files.
  • Arithmetic device 12 selects one of the plurality of operation files according to a command sent from management device 30 .
  • Arithmetic device 12 executes a program included in the selected operation file and generates an operation instruction.
  • a command transmitted from the management device 30 may be used as a trigger for starting an operation.
  • the operation system 10e may input parameters related to processing to be executed by the processing device 21 to the processing device 21 .
  • the parameters are the number of workpieces to be processed, conditions at the time of processing execution, and the like.
  • the conditions are, for example, temperature, pressure, gas or liquid flow rate, current, voltage, treatment time, and the like.
  • the operation system 10 e generates an operation signal for inputting numerical values of parameters, and transmits the signal to the processing device 21 . As a result, numerical values are entered in text boxes or the like displayed on the display device 23 .
  • the management device 30 may transmit parameters input from the operation system 10e to the processing device 21 to the operation system 10e. Commands sent from the management device 30 to the processing device 21 include parameters.
  • the operation system 10e receives a numerical value input as a parameter and generates an operation signal according to the numerical value. Thereby, the numerical value transmitted from the management device 30 is input to the processing device 21 .
  • the management device 30 may transmit information about the work to be processed to the operation system 10e. Commands sent from the management device 30 to the processing device 21 contain information about the work to be processed. For example, the management device 30 transmits work identification information (ID) to the operation system 10e. The operation system 10e inputs the identification information to the processing device 21 via the communication port. Alternatively, the operation system 10 e may generate an operation signal according to the identification information and input it to the processing device 21 .
  • ID work identification information
  • the management device 30 can manage the processing device 21 by using the operation system 10e. For example, there is no need to modify the processing device 21, and the production efficiency can be improved more easily.
  • the operation system 10 e it is possible to transmit the operating status of a single processing device 21 or a plurality of processing devices 21 to the management device 30 . Therefore, the management device 30 can easily acquire information about the operating rate or operating status of a single processing system 1e or a plurality of processing systems 1e.
  • FIG. 15 is a schematic diagram showing a processing system according to a sixth modification of the embodiment;
  • the management device 30 is connected to multiple operation systems 10e.
  • a plurality of operation systems 10e are connected to a plurality of processing devices 21, respectively.
  • the management device 30 transmits commands to the multiple processing devices 21 .
  • the plurality of operating systems 10 e respectively operate the plurality of processing devices 21 according to commands transmitted from the management device 30 .
  • the management device 30 may select one or more of the plurality of processing devices 21 and transmit commands to the selected processing devices 21 .
  • the management device 30 can acquire information on the operation rate or operating status of the plurality of processing devices 21, and the production efficiency of the plurality of processing devices 21 can be improved.
  • Operation of the processing device 21 by any operating system 10e is initiated in response to a signal sent from another operating system 10e or from another processing device 21 operated by another operating system 10e. May be.
  • the signal may be transmitted during operation by another operation system 10e, or may be transmitted other than during operation by another operation system 10e.
  • FIG. 16 is a schematic diagram showing an operation system according to a seventh modification of the embodiment;
  • the operation system 10g is connected to the terminal device 35 in the processing system 1g according to the seventh modification.
  • the operation system 10g is set to be remotely operable by the terminal device 35 .
  • the terminal device 35 can remotely control the arithmetic device 12 of the operation system 10g.
  • the user can transmit an input operation to the computing device 12 by operating the terminal device 35 .
  • the operation system 10 operates the processing device 21 according to the input operation transmitted from the terminal device 35 .
  • the user can prepare an operation file, execute an automatic operation mode by the operation system 10g, and the like.
  • the operation system 10g can be operated by the terminal device 35 from a place away from the operation system 10g. According to the seventh modified example, the convenience of the processing system 1g can be improved.
  • FIG. 17 is a schematic diagram showing an operation system according to an eighth modification of the embodiment; A plurality of operation systems 10g are connected to the terminal device 35 in the processing system 1h according to the eighth modification.
  • the terminal device 35 can remotely control the arithmetic devices 12 of the plurality of operating systems 10g.
  • one terminal device 35 can operate a plurality of operation systems 10g.
  • Setting of an automatic operation mode for operating the plurality of processing devices 21, etc. can be performed at a position away from the plurality of operation systems 10g. According to the eighth modification, it is possible to improve the convenience of the processing system 1h.
  • FIG. 18 is a schematic diagram showing a hardware configuration.
  • Each of the arithmetic device 12, the control unit 21a, the management device 30, and the terminal device 35 includes the configuration of the computer 90 shown in FIG. 18, for example.
  • Computer 90 includes CPU 91 , ROM 92 , RAM 93 , storage device 94 , input interface 95 , output interface 96 and communication interface 97 .
  • the CPU 91 includes a processing circuit.
  • the CPU 91 executes programs stored in at least one of the ROM 92 and the storage device 94 using the RAM 93 as a work memory. During program execution, the CPU 91 controls each component via the system bus 98 and executes various processes.
  • the storage device 94 stores data necessary for program execution and data obtained by program execution. Storage device 94 may be used as storage device 14 .
  • An input interface (I/F) 95 connects the computer 90 and an input device 95a.
  • the input I/F 95 is, for example, a serial bus interface such as USB.
  • CPU91 can read various data from the input device 95a via input I/F95.
  • the input device 95 a is used as the input device 15 or 22 .
  • An output interface (I/F) 96 connects the computer 90 and a display device 96a.
  • the output I/F 96 is, for example, a video output interface such as Digital Visual Interface (DVI) or High-Definition Multimedia Interface (HDMI (registered trademark)).
  • the CPU 91 can transmit data to the display device 96a via the output I/F 96 and display a screen on the display device 96a.
  • Display device 96 a is used as display device 16 or 23 .
  • a communication interface (I/F) 97 connects a server 97 a outside the computer 90 and the computer 90 .
  • Communication I/F 97 is, for example, a network card such as a LAN card.
  • the CPU 91 can read various data from the server 97 a via the communication I/F 97 .
  • Two or more computers 90 may work together to function as the computing device 12, the control unit 21a, the management device 30, or the terminal device 35.
  • a computer that functions as the arithmetic device 12 may incorporate the generation device 13 , and the computer may function as the arithmetic device 12 and the generation device 13 .
  • a program having the functions of the arithmetic device 12 and a program having the functions of the generation device 13 may be implemented in one computer.
  • the various data processing described above can be performed by using magnetic disks (flexible disks, hard disks, etc.), optical disks (CD-ROM, CD-R, CD-RW, DVD-ROM, DVD ⁇ R) as programs that can be executed by a computer. , DVD ⁇ RW, etc.), semiconductor memory, or other non-transitory computer-readable storage medium.
  • magnetic disks flexible disks, hard disks, etc.
  • optical disks CD-ROM, CD-R, CD-RW, DVD-ROM, DVD ⁇ R
  • semiconductor memory or other non-transitory computer-readable storage medium.
  • information recorded on a recording medium can be read by a computer (or embedded system). Any recording format (storage format) can be used in the recording medium.
  • a computer reads a program from a recording medium and causes a CPU to execute instructions written in the program based on the program. Acquisition (or reading) of a program in a computer may be performed through a network.
  • the processing device 21 can be easily remotely controlled, and the convenience of the processing device 21 can be improved. A similar effect can be obtained by using a program that causes a computer to execute the operation method. According to the method of constructing a processing system in which an operation system is constructed and connected to the first device, a processing system in which the processing device 21 can be easily operated can be provided.
  • (Feature 12) The operation system according to any one of features 5 to 11, wherein the automatic operation mode is executed in response to reading of identification information by a reader.
  • (Feature 13) an operating system according to any one of features 1 to 12; the first device for processing a workpiece; processing system with (Feature 14) a plurality of the first devices; a plurality of the operation systems each transmitting the operation signal to the plurality of first devices; a terminal device that transmits the input operation to the plurality of operation systems; 14.
  • the processing system of feature 13, comprising: (Feature 15) An operating system connected to a first device, comprising: obtaining a video signal from the first device; displaying a screen based on the video signal; generating an operation instruction corresponding to the input operation according to the input operation from the user; generating an operation signal corresponding to the first device based on the operation instruction and transmitting it to the first device; building the operating system; A method of constructing a processing system, wherein the operation system is set to be remotely operable from a terminal device. (Feature 16) generating an operation instruction corresponding to the input operation according to the input operation from the user; generating an operation signal corresponding to the first device to be operated, based on the operation command; A computer that transmits the operation signal to the first device. (Feature 17) 17.
  • the computer of feature 16 wherein the input operation is described in an action file containing operation details for the first device.
  • (Feature 18) 18.
  • the computer of feature 17, capable of executing an automatic operating mode for generating the operating instructions based on the operating file.
  • (Feature 19) Acquiring a video signal from the first device to be operated, causing a display device to display a screen based on the video signal; generating an operation instruction corresponding to the input operation according to the input operation from the user; An operation method, wherein an operation signal corresponding to the first device is generated based on the operation instruction and transmitted to the first device.
  • the input operation includes selection on the screen, displaying the screen based on the video signal by enlarging or reducing it according to the resolution of the display device; 20.
  • (Feature 23) A program that causes a computer to execute the operation method according to any one of features 19 to 22.
  • (Feature 24) A storage medium storing a program that causes a computer to execute the operation method according to any one of features 19 to 22.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Computer Hardware Design (AREA)
  • Operation Control Of Excavators (AREA)
PCT/JP2022/025277 2021-06-28 2022-06-24 操作システム、処理システム、処理システムの構築方法、コンピュータ、操作方法、プログラム、及び記憶媒体 Ceased WO2023276875A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2023531897A JP7793622B2 (ja) 2021-06-28 2022-06-24 操作システム、処理システム、処理システムの構築方法、コンピュータ、操作方法、プログラム、及び記憶媒体
US18/395,856 US20240126416A1 (en) 2021-06-28 2023-12-26 Operating system, processing system, computer, operating method, and storage medium
JP2025259441A JP2026040518A (ja) 2021-06-28 2025-12-17 操作システム、処理システム、処理システムの構築方法、コンピュータ、操作方法、プログラム、及び記憶媒体

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021-106283 2021-06-28
JP2021106283 2021-06-28

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/395,856 Continuation US20240126416A1 (en) 2021-06-28 2023-12-26 Operating system, processing system, computer, operating method, and storage medium

Publications (1)

Publication Number Publication Date
WO2023276875A1 true WO2023276875A1 (ja) 2023-01-05

Family

ID=84691380

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/025277 Ceased WO2023276875A1 (ja) 2021-06-28 2022-06-24 操作システム、処理システム、処理システムの構築方法、コンピュータ、操作方法、プログラム、及び記憶媒体

Country Status (4)

Country Link
US (1) US20240126416A1 (https=)
JP (2) JP7793622B2 (https=)
TW (1) TWI870676B (https=)
WO (1) WO2023276875A1 (https=)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013190714A1 (ja) * 2012-06-19 2013-12-27 日本電能株式会社 自動操作システム及び操作自動化方法
JP2017224114A (ja) * 2016-06-14 2017-12-21 キヤノン株式会社 装置、制御方法およびプログラム
JP2018535459A (ja) * 2015-07-02 2018-11-29 アクセンチュア グローバル サービスィズ リミテッド ロボットによるプロセス自動化

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006172423A (ja) * 2004-11-18 2006-06-29 Canon Inc 遠隔操作システム、遠隔操作装置、被操作装置、遠隔操作方法、コンピュータプログラム、記憶媒体
EP2932347B1 (en) * 2012-12-17 2019-06-12 Telecom Italia S.p.A. Selection system for an interactive display
JP6169990B2 (ja) * 2014-02-25 2017-07-26 Kddi株式会社 遠隔自動操作システムにおけるコントローラ代理プログラム及び方法
US10261600B2 (en) * 2016-08-09 2019-04-16 International Business Machines Corporation Remotely operating target device
KR102604570B1 (ko) * 2018-03-23 2023-11-22 삼성전자주식회사 사용자 입력 지원 방법 및 이를 지원하는 전자 장치

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013190714A1 (ja) * 2012-06-19 2013-12-27 日本電能株式会社 自動操作システム及び操作自動化方法
JP2018535459A (ja) * 2015-07-02 2018-11-29 アクセンチュア グローバル サービスィズ リミテッド ロボットによるプロセス自動化
JP2017224114A (ja) * 2016-06-14 2017-12-21 キヤノン株式会社 装置、制御方法およびプログラム

Also Published As

Publication number Publication date
US20240126416A1 (en) 2024-04-18
JP7793622B2 (ja) 2026-01-05
JPWO2023276875A1 (https=) 2023-01-05
TWI870676B (zh) 2025-01-21
TW202303375A (zh) 2023-01-16
JP2026040518A (ja) 2026-03-09

Similar Documents

Publication Publication Date Title
JP6519656B2 (ja) 製造工程管理システム、製造工程管理方法および製造工程管理プログラム
US9122269B2 (en) Method and system for operating a machine from the field of automation engineering
TWI693564B (zh) 機台自動化管理系統及其方法
JP6943830B2 (ja) 制御装置、通信端末、及び制御システム
JP6464204B2 (ja) オフラインプログラミング装置及び位置パラメータ補正方法
US10122314B2 (en) Motor control apparatus, motor control system, motor control method
CN113721808A (zh) 一种控制方法及装置
US20220281115A1 (en) Screen image transition information generation device, screen image transition information generation method, screen image transition information generation program, and screen image transition information generation system
US20100100882A1 (en) Information processing apparatus and control method thereof
CN114424175B (zh) 设备管理装置以及软件生成方法
WO2023276875A1 (ja) 操作システム、処理システム、処理システムの構築方法、コンピュータ、操作方法、プログラム、及び記憶媒体
JP2023014104A (ja) 操作システム、処理システム、操作方法、及びプログラム
JP2017017446A (ja) 情報処理装置およびその制御方法、並びにプログラム
US10388257B2 (en) Information processing apparatus, method of controlling the same and non-transitory computer-readable storage medium
CN115243085B (zh) 显示设备及设备互联方法
JP6164992B2 (ja) 電子装置、電子装置のウインドウ表示の制御方法及びその制御プログラム
WO2021039680A1 (ja) 情報処理システム及び情報処理方法
JP7829655B1 (ja) 情報処理方法、及び、情報処理装置
JP6061882B2 (ja) 画像形成装置及び画像形成装置のアプリケーション画面表示方法
JP2009169548A (ja) 情報処理装置、そのマルチウィンドウ表示方法及びプログラム
CN116189211B (zh) 显示设备和文本识别方法
WO2011148477A1 (ja) カムデータ作成装置およびカムデータ作成プログラム
JP2020042710A (ja) サポート装置、サポートプログラム、およびプログラムの生成方法
JP4366149B2 (ja) 画像処理装置、画像処理方法、プログラム及び記憶媒体
WO2023210007A1 (ja) 情報処理装置、制御システム、情報処理方法、およびプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22833022

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023531897

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22833022

Country of ref document: EP

Kind code of ref document: A1