WO2023234904A1 - Shopfloor data collection system for industrial machineries - Google Patents

Shopfloor data collection system for industrial machineries Download PDF

Info

Publication number
WO2023234904A1
WO2023234904A1 PCT/TR2023/050494 TR2023050494W WO2023234904A1 WO 2023234904 A1 WO2023234904 A1 WO 2023234904A1 TR 2023050494 W TR2023050494 W TR 2023050494W WO 2023234904 A1 WO2023234904 A1 WO 2023234904A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
image
data collection
machine
artificial intelligence
Prior art date
Application number
PCT/TR2023/050494
Other languages
English (en)
French (fr)
Inventor
Irfan COZGE
Mustafa KUCUKDEMIRCI
Ridvan INAL
Original Assignee
Cozge Irfan
Kucukdemirci Mustafa
Inal Ridvan
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cozge Irfan, Kucukdemirci Mustafa, Inal Ridvan filed Critical Cozge Irfan
Publication of WO2023234904A1 publication Critical patent/WO2023234904A1/en

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • G05B19/4183Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by data acquisition, e.g. workpiece identification
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • G05B19/4184Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by fault tolerance, reliability of production system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00Machine learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/31From computer integrated manufacturing till monitoring
    • G05B2219/31282Data acquisition, BDE MDE
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/31From computer integrated manufacturing till monitoring
    • G05B2219/31318Data analysis, using different formats like table, chart
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/32Operator till task planning
    • G05B2219/32234Maintenance planning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components

Definitions

  • the invention relates to a low-cost, user-friendly data collection and processing system for electronic controlled machines, robotic mechanisms, and devices used in industrial production, without the need for separate software and hardware.
  • PLCs can already collect data such as part count, machine status, error codes, temperature, and pressure. However, when a user wants to utilize this product, they are required to use specific software and hardware for the PLC. The cost burden of PLC systems increases when the user only wants to obtain basic data such as part count, work order, operator name, start and end times, and downtime reasons. On the other hand, traditional methods of data collection encounter various problems.
  • the invention involves a data collection system that operates in a plug-and- play manner, requiring no separate software or hardware. It incorporates a QR code embedded in a card for capturing worker information using a camera, reading the job quantity information from the machine's display using a camera and a pre-trained image processing algorithm, and capturing downtime reasons through a Human- Machine Interface (HMI). After collecting all these inputs, the system displays and reports this information in an online database.
  • HMI Human- Machine Interface
  • the system determines the maintenance frequency of machines and performs predictive analysis based on the captured downtime information displayed on the unit's screen, which is selected by the workers using buttons and recorded in the online database by the information processing unit. Additionally, the invention enables the protected data in the database to be accessible for monitoring through the control panel and provides authorized personnel with access to the obtained data. This allows for immediate notification of any disruptions or faults occurring in the machines to the relevant authorities within the company, minimizing operator dependence.
  • the invention is a low-cost and user-friendly data collection system that can be used for purposes such as gathering data from industrial machines without the need for different software and hardware configurations.
  • FIG. 1 Installation Flow Diagram View
  • the invention involves a data collection unit equipped with a camera positioned to monitor the screens of industrial machines. It collects production data by capturing the machine screen images using image processing methods. Additionally, it utilizes an RFID kit to determine the start and end times of workers' shifts. The system also incorporates an interface (HMI - Human-Machine Interface) to capture machine downtime reasons from the machine operator. All these inputs are processed by an artificial intelligence-based information processing unit, which enables quality management and machine maintenance analysis. The collected data is immediately stored in a database through the use of loT (Internet of Things) technology and seamlessly integrated with ERP (Enterprise Resource Planning) programs.
  • loT Internet of Things
  • ERP Enterprise Resource Planning
  • the dimensions for image processing are determined.
  • Options such as dilation and erosion are provided, allowing the user to observe the real-time black-and-white representation of the data on the screen.
  • the dilation feature expands the edges of the image, while the erosion feature thins them.
  • an optimal value is found for clear data understanding, which is then saved for the program's regular operation.
  • the Otsu method is employed to convert the image to a black-and- white format and remove the background. The white areas are then enclosed in frames, isolating the data individually and making them ready for the application of artificial intelligence models.
  • the artificial intelligence model consists of input, feature detector (filter) 3x3, pooling layer, feature detector (filter) 5x5, pooling layer, and output.
  • the feature detector layer extracts key features, and the pooling layer reduces the number of parameters, preventing overfitting and reducing processing power requirements.
  • the coefficients in these layers are saved as matrices for future use. In the normal operation of the program, these coefficients are applied to processed data obtained from image processing. The values are classified into the closest category, and data from buttons on the interface, RFID, or other tools are collected and transferred to the server. After obtaining fault data, outlier metrics such as mean, mode, standard deviation, and skewness are calculated.
  • the time elapsed from the reference point of the faults is determined, and a linear regression machine learning algorithm is used to identify the mathematical relationship between the increase in equipment wear and the frequency of faults. Based on this mathematical formula, the prediction of the next fault occurrence is estimated in terms of days from the reference point, and appropriate actions are recommended.
  • the model is designed to incorporate reinforcement learning, where the dataset grows and the model approaches accurate results with each iteration.
  • Shewhart Control Charts are computed using Python libraries to analyze data obtained from the human-machine interface. The quality metrics are established through collaboration with the customer company. The generated reports are then created using PDF libraries within the decision support system software platform based on node.js.
  • the invention presents a low-cost and user-friendly data collection system that can seamlessly integrate with industrial machines, enabling quality management, maintenance analysis, and real-time data recording and reporting through loT and ERP integration.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Software Systems (AREA)
  • Manufacturing & Machinery (AREA)
  • Automation & Control Theory (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Multimedia (AREA)
  • General Factory Administration (AREA)
  • Control By Computers (AREA)
PCT/TR2023/050494 2022-06-02 2023-05-31 Shopfloor data collection system for industrial machineries WO2023234904A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TR2022/009059 2022-06-02
TR2022/009059A TR2022009059A2 (tr) 2022-06-02 2022-06-02 Endüstri̇yel maki̇neler i̇çi̇n sahadan veri̇ toplama si̇stemi̇

Publications (1)

Publication Number Publication Date
WO2023234904A1 true WO2023234904A1 (en) 2023-12-07

Family

ID=84084160

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/TR2023/050494 WO2023234904A1 (en) 2022-06-02 2023-05-31 Shopfloor data collection system for industrial machineries

Country Status (2)

Country Link
TR (1) TR2022009059A2 (tr)
WO (1) WO2023234904A1 (tr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160282843A1 (en) * 2015-03-27 2016-09-29 Rockwell Automation Technologies, Inc. Systems and methods for enhancing monitoring of an industrial automation system
WO2019224906A1 (ja) * 2018-05-22 2019-11-28 東芝三菱電機産業システム株式会社 産業プラント用画像解析装置および産業プラント監視制御システム
US20200198128A1 (en) * 2018-12-21 2020-06-25 Fanuc Corporation Learning data confirmation support device, machine learning device, and failure predicting device
US20220146993A1 (en) * 2015-07-31 2022-05-12 Fanuc Corporation Machine learning method and machine learning device for learning fault conditions, and fault prediction device and fault prediction system including the machine learning device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160282843A1 (en) * 2015-03-27 2016-09-29 Rockwell Automation Technologies, Inc. Systems and methods for enhancing monitoring of an industrial automation system
US20220146993A1 (en) * 2015-07-31 2022-05-12 Fanuc Corporation Machine learning method and machine learning device for learning fault conditions, and fault prediction device and fault prediction system including the machine learning device
WO2019224906A1 (ja) * 2018-05-22 2019-11-28 東芝三菱電機産業システム株式会社 産業プラント用画像解析装置および産業プラント監視制御システム
US20200198128A1 (en) * 2018-12-21 2020-06-25 Fanuc Corporation Learning data confirmation support device, machine learning device, and failure predicting device

Also Published As

Publication number Publication date
TR2022009059A2 (tr) 2022-07-21

Similar Documents

Publication Publication Date Title
US20190012621A1 (en) Work data management system and work data management method
US9898001B2 (en) Systems and methods for enhancing monitoring of an industrial automation system
Alves et al. Deployment of a smart and predictive maintenance system in an industrial case study
Orellana et al. From legacy-based factories to smart factories level 2 according to the industry 4.0
EP2345942A2 (en) Plant analysis system
JP5045770B2 (ja) プロセス解析システム
KR20050067018A (ko) 프로세스와 품질과의 관계에 관한 모델 작성 장치 및 모델작성 방법
KR20150003201A (ko) 제조 시스템 성능을 개선시키기 위해 자동화 기술 감독 동작들을 실행하는 반-자동화된 제조 셋업(manufacturing set-up)에서의 각각의 운영자에게 트라이벌 지식을 확인하고, 획득하고, 분류하며, 전달하는 시스템 및 장치와 그 방법
JP2021077147A (ja) 工場管理システム
EP2996006A1 (de) Verfahren und vorrichtung zur überwachung eines fertigungs- und/oder montageprozesses
KR20230003819A (ko) 딥러닝을 이용하여 예지보전이 가능한 설비관리시스템
WO2023234904A1 (en) Shopfloor data collection system for industrial machineries
CN112987682A (zh) 控制方法、控制装置和机械设备
JP7474303B2 (ja) 管理システム
JP2008109101A (ja) モデル作成装置並びにプロセス異常分析装置およびそれらの方法並びにプログラム
CN111176174B (zh) 一种面向冲压车间的多功能监管系统
JP2020057089A (ja) 情報処理装置、情報処理方法、およびプログラム
WO2021111936A1 (ja) 予測システム、情報処理装置および情報処理プログラム
Oborski Integration of machine operators with shop floor control system for Industry 4.0
KR20220080983A (ko) 실시간 생산현황 모니터링을 위한 IoT 엣지 컴퓨팅 시스템
KR20200072069A (ko) 모터 정보 기반 로봇 상태 정보 제공 시스템
JP2020057090A (ja) データ構造
KR102415711B1 (ko) 실시간 데이터 전처리 및 이상치 감지를 위한 모니터링 시스템
JPH11110036A (ja) プラント運転監視支援システム装置
Gisbrecht Quantifying the impact of digitalization in a power generation company

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23816499

Country of ref document: EP

Kind code of ref document: A1