WO2023234904A1 - Shopfloor data collection system for industrial machineries - Google Patents
Shopfloor data collection system for industrial machineries Download PDFInfo
- Publication number
- WO2023234904A1 WO2023234904A1 PCT/TR2023/050494 TR2023050494W WO2023234904A1 WO 2023234904 A1 WO2023234904 A1 WO 2023234904A1 TR 2023050494 W TR2023050494 W TR 2023050494W WO 2023234904 A1 WO2023234904 A1 WO 2023234904A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- image
- data collection
- machine
- artificial intelligence
- Prior art date
Links
- 238000013480 data collection Methods 0.000 title claims abstract description 12
- 238000012545 processing Methods 0.000 claims abstract description 11
- 238000004519 manufacturing process Methods 0.000 claims abstract description 8
- 230000007246 mechanism Effects 0.000 claims abstract description 7
- 238000000034 method Methods 0.000 claims description 7
- 238000004458 analytical method Methods 0.000 claims description 6
- 238000013473 artificial intelligence Methods 0.000 claims description 6
- 238000011176 pooling Methods 0.000 claims description 6
- 238000012423 maintenance Methods 0.000 claims description 5
- 230000003628 erosive effect Effects 0.000 claims description 4
- 230000010365 information processing Effects 0.000 claims description 3
- 230000010354 integration Effects 0.000 claims description 3
- 238000007726 management method Methods 0.000 claims description 3
- 238000009776 industrial production Methods 0.000 claims description 2
- 238000012417 linear regression Methods 0.000 claims description 2
- 238000010801 machine learning Methods 0.000 claims description 2
- 238000001514 detection method Methods 0.000 claims 2
- 230000006866 deterioration Effects 0.000 claims 1
- 238000012549 training Methods 0.000 claims 1
- 238000012800 visualization Methods 0.000 claims 1
- 238000013459 approach Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000010339 dilation Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000011900 installation process Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000013442 quality metrics Methods 0.000 description 1
- 239000002994 raw material Substances 0.000 description 1
- 230000002787 reinforcement Effects 0.000 description 1
- 238000012731 temporal analysis Methods 0.000 description 1
- 238000000700 time series analysis Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
- G05B19/4183—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by data acquisition, e.g. workpiece identification
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
- G05B19/4184—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by fault tolerance, reliability of production system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/31—From computer integrated manufacturing till monitoring
- G05B2219/31282—Data acquisition, BDE MDE
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/31—From computer integrated manufacturing till monitoring
- G05B2219/31318—Data analysis, using different formats like table, chart
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/32—Operator till task planning
- G05B2219/32234—Maintenance planning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
Definitions
- the invention relates to a low-cost, user-friendly data collection and processing system for electronic controlled machines, robotic mechanisms, and devices used in industrial production, without the need for separate software and hardware.
- PLCs can already collect data such as part count, machine status, error codes, temperature, and pressure. However, when a user wants to utilize this product, they are required to use specific software and hardware for the PLC. The cost burden of PLC systems increases when the user only wants to obtain basic data such as part count, work order, operator name, start and end times, and downtime reasons. On the other hand, traditional methods of data collection encounter various problems.
- the invention involves a data collection system that operates in a plug-and- play manner, requiring no separate software or hardware. It incorporates a QR code embedded in a card for capturing worker information using a camera, reading the job quantity information from the machine's display using a camera and a pre-trained image processing algorithm, and capturing downtime reasons through a Human- Machine Interface (HMI). After collecting all these inputs, the system displays and reports this information in an online database.
- HMI Human- Machine Interface
- the system determines the maintenance frequency of machines and performs predictive analysis based on the captured downtime information displayed on the unit's screen, which is selected by the workers using buttons and recorded in the online database by the information processing unit. Additionally, the invention enables the protected data in the database to be accessible for monitoring through the control panel and provides authorized personnel with access to the obtained data. This allows for immediate notification of any disruptions or faults occurring in the machines to the relevant authorities within the company, minimizing operator dependence.
- the invention is a low-cost and user-friendly data collection system that can be used for purposes such as gathering data from industrial machines without the need for different software and hardware configurations.
- FIG. 1 Installation Flow Diagram View
- the invention involves a data collection unit equipped with a camera positioned to monitor the screens of industrial machines. It collects production data by capturing the machine screen images using image processing methods. Additionally, it utilizes an RFID kit to determine the start and end times of workers' shifts. The system also incorporates an interface (HMI - Human-Machine Interface) to capture machine downtime reasons from the machine operator. All these inputs are processed by an artificial intelligence-based information processing unit, which enables quality management and machine maintenance analysis. The collected data is immediately stored in a database through the use of loT (Internet of Things) technology and seamlessly integrated with ERP (Enterprise Resource Planning) programs.
- loT Internet of Things
- ERP Enterprise Resource Planning
- the dimensions for image processing are determined.
- Options such as dilation and erosion are provided, allowing the user to observe the real-time black-and-white representation of the data on the screen.
- the dilation feature expands the edges of the image, while the erosion feature thins them.
- an optimal value is found for clear data understanding, which is then saved for the program's regular operation.
- the Otsu method is employed to convert the image to a black-and- white format and remove the background. The white areas are then enclosed in frames, isolating the data individually and making them ready for the application of artificial intelligence models.
- the artificial intelligence model consists of input, feature detector (filter) 3x3, pooling layer, feature detector (filter) 5x5, pooling layer, and output.
- the feature detector layer extracts key features, and the pooling layer reduces the number of parameters, preventing overfitting and reducing processing power requirements.
- the coefficients in these layers are saved as matrices for future use. In the normal operation of the program, these coefficients are applied to processed data obtained from image processing. The values are classified into the closest category, and data from buttons on the interface, RFID, or other tools are collected and transferred to the server. After obtaining fault data, outlier metrics such as mean, mode, standard deviation, and skewness are calculated.
- the time elapsed from the reference point of the faults is determined, and a linear regression machine learning algorithm is used to identify the mathematical relationship between the increase in equipment wear and the frequency of faults. Based on this mathematical formula, the prediction of the next fault occurrence is estimated in terms of days from the reference point, and appropriate actions are recommended.
- the model is designed to incorporate reinforcement learning, where the dataset grows and the model approaches accurate results with each iteration.
- Shewhart Control Charts are computed using Python libraries to analyze data obtained from the human-machine interface. The quality metrics are established through collaboration with the customer company. The generated reports are then created using PDF libraries within the decision support system software platform based on node.js.
- the invention presents a low-cost and user-friendly data collection system that can seamlessly integrate with industrial machines, enabling quality management, maintenance analysis, and real-time data recording and reporting through loT and ERP integration.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Quality & Reliability (AREA)
- Software Systems (AREA)
- Manufacturing & Machinery (AREA)
- Automation & Control Theory (AREA)
- Artificial Intelligence (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Medical Informatics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Multimedia (AREA)
- General Factory Administration (AREA)
- Control By Computers (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TR2022/009059 | 2022-06-02 | ||
TR2022/009059A TR2022009059A2 (tr) | 2022-06-02 | 2022-06-02 | Endüstri̇yel maki̇neler i̇çi̇n sahadan veri̇ toplama si̇stemi̇ |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023234904A1 true WO2023234904A1 (en) | 2023-12-07 |
Family
ID=84084160
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/TR2023/050494 WO2023234904A1 (en) | 2022-06-02 | 2023-05-31 | Shopfloor data collection system for industrial machineries |
Country Status (2)
Country | Link |
---|---|
TR (1) | TR2022009059A2 (tr) |
WO (1) | WO2023234904A1 (tr) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160282843A1 (en) * | 2015-03-27 | 2016-09-29 | Rockwell Automation Technologies, Inc. | Systems and methods for enhancing monitoring of an industrial automation system |
WO2019224906A1 (ja) * | 2018-05-22 | 2019-11-28 | 東芝三菱電機産業システム株式会社 | 産業プラント用画像解析装置および産業プラント監視制御システム |
US20200198128A1 (en) * | 2018-12-21 | 2020-06-25 | Fanuc Corporation | Learning data confirmation support device, machine learning device, and failure predicting device |
US20220146993A1 (en) * | 2015-07-31 | 2022-05-12 | Fanuc Corporation | Machine learning method and machine learning device for learning fault conditions, and fault prediction device and fault prediction system including the machine learning device |
-
2022
- 2022-06-02 TR TR2022/009059A patent/TR2022009059A2/tr unknown
-
2023
- 2023-05-31 WO PCT/TR2023/050494 patent/WO2023234904A1/en unknown
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160282843A1 (en) * | 2015-03-27 | 2016-09-29 | Rockwell Automation Technologies, Inc. | Systems and methods for enhancing monitoring of an industrial automation system |
US20220146993A1 (en) * | 2015-07-31 | 2022-05-12 | Fanuc Corporation | Machine learning method and machine learning device for learning fault conditions, and fault prediction device and fault prediction system including the machine learning device |
WO2019224906A1 (ja) * | 2018-05-22 | 2019-11-28 | 東芝三菱電機産業システム株式会社 | 産業プラント用画像解析装置および産業プラント監視制御システム |
US20200198128A1 (en) * | 2018-12-21 | 2020-06-25 | Fanuc Corporation | Learning data confirmation support device, machine learning device, and failure predicting device |
Also Published As
Publication number | Publication date |
---|---|
TR2022009059A2 (tr) | 2022-07-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20190012621A1 (en) | Work data management system and work data management method | |
US9898001B2 (en) | Systems and methods for enhancing monitoring of an industrial automation system | |
Alves et al. | Deployment of a smart and predictive maintenance system in an industrial case study | |
Orellana et al. | From legacy-based factories to smart factories level 2 according to the industry 4.0 | |
EP2345942A2 (en) | Plant analysis system | |
JP5045770B2 (ja) | プロセス解析システム | |
KR20050067018A (ko) | 프로세스와 품질과의 관계에 관한 모델 작성 장치 및 모델작성 방법 | |
KR20150003201A (ko) | 제조 시스템 성능을 개선시키기 위해 자동화 기술 감독 동작들을 실행하는 반-자동화된 제조 셋업(manufacturing set-up)에서의 각각의 운영자에게 트라이벌 지식을 확인하고, 획득하고, 분류하며, 전달하는 시스템 및 장치와 그 방법 | |
JP2021077147A (ja) | 工場管理システム | |
EP2996006A1 (de) | Verfahren und vorrichtung zur überwachung eines fertigungs- und/oder montageprozesses | |
KR20230003819A (ko) | 딥러닝을 이용하여 예지보전이 가능한 설비관리시스템 | |
WO2023234904A1 (en) | Shopfloor data collection system for industrial machineries | |
CN112987682A (zh) | 控制方法、控制装置和机械设备 | |
JP7474303B2 (ja) | 管理システム | |
JP2008109101A (ja) | モデル作成装置並びにプロセス異常分析装置およびそれらの方法並びにプログラム | |
CN111176174B (zh) | 一种面向冲压车间的多功能监管系统 | |
JP2020057089A (ja) | 情報処理装置、情報処理方法、およびプログラム | |
WO2021111936A1 (ja) | 予測システム、情報処理装置および情報処理プログラム | |
Oborski | Integration of machine operators with shop floor control system for Industry 4.0 | |
KR20220080983A (ko) | 실시간 생산현황 모니터링을 위한 IoT 엣지 컴퓨팅 시스템 | |
KR20200072069A (ko) | 모터 정보 기반 로봇 상태 정보 제공 시스템 | |
JP2020057090A (ja) | データ構造 | |
KR102415711B1 (ko) | 실시간 데이터 전처리 및 이상치 감지를 위한 모니터링 시스템 | |
JPH11110036A (ja) | プラント運転監視支援システム装置 | |
Gisbrecht | Quantifying the impact of digitalization in a power generation company |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23816499 Country of ref document: EP Kind code of ref document: A1 |