TR2021021356A2

TR2021021356A2 - A CLEANING DECISION SYSTEM

Info

Publication number: TR2021021356A2
Application number: TR2021/021356A
Authority: TR
Inventors: Emre Şahna Yunus; Ceren Tari̇ Aslihan
Original assignee: Turkcell Technology Research And Development Co; Turkcell Teknoloji̇ Araştirma Ve Geli̇şti̇rme Anoni̇m Şi̇rketi̇
Priority date: 2021-12-28
Filing date: 2021-12-28
Publication date: 2022-01-21

Abstract

Bu buluş, temizlenmek istenen bölgeye yerleştirilen kameralar ile elde edilen görüntülerin görüntü işleme ve yapay zeka ile analiz edilerek temizlenecek yerlere karar verilmesini ve temizlenecek yerlerin temizlik personelleri ile paylaşılmasını sağlayan bir sistem (1) ile ilgilidir.This invention relates to a system (1) that enables the images obtained with the cameras placed in the area to be cleaned, to be analyzed with image processing and artificial intelligence, and to decide on the places to be cleaned and to share the places to be cleaned with the cleaning personnel.

Description

TARIFNAME BIR TEMIZLIK KARAR SISTEMI Teknik Alan Bu bulus, temizlenmek istenen bölgeye yerlestirilen kameralar ile elde edilen görüntülerin görüntü isleme ve yapay zeka ile analiz edilerek temizlenecek yerlere karar verilmesini ve temizlenecek yerlerin temizlik personelleri ile paylasilmasini Saglayan bir sistem ile ilgilidir. Önceki Teknik Çok sayida kisinin bir arada bulundugu ve kisi sirkülasyonun yüksek oldugu alisveris merkezi, hava alani, hastane gibi alanlarda temizlik çalisanlari ile temizlik islemleri gerçeklestirilmektedir. Söz konusu yerlerdeki temizlik isleri çogunlukla belirli zamanlarda gerçeklestirilmektedir. Bu durum aslinda kirlenmeyen yerlerin yeniden temizlenmesine, çok kirlenen yerlerin ayni oranda temizlenmesine ya da hiç temizlenmeyen yerlerin olusmasina sebep olabilmektedir. Bu durum temizlik isleminin istenilen verimde gerçeklesmemesine sebep oldugu için günümüzde kameralar ile alanlarin izlenmesini, temizlik yapilmasi gereken yerlere karar verilmesini ve söz konusu yerlerin temizlik personeli ile temizlenmesini saglayan çözümlere ihtiyaç duyulmaktadir. dokümaninda, yapay zeka izleme cihazinda görüntü çekmek kamera; yapay zeka izleme eihazindan temizlik bilgisi almak için bir iletisim birimi; ve görüntüye veya temizlik bilgilerine göre bir zemin durumunun temizlenmesi gerekip gerekmediginin belirlenmesi, zemin durumunun temizligin gerekli oldugu belirlendiginde bir temizlik alani ve temizlik tipinin belirlenmesi ve belirlenenleri içeren bir temizleme komutunun iletilmesi için bir islemci temizlik alani ve iletisim ünitesi araciligiyla yapay zekali temizleyiciye iletilmesini saglayan bir sistemden bahsedilmektedir. Söz konusu bulusta, yapay zeka temizleyicisinden temizlik bilgilerinin alinmasi için iletisim ünitesi kullanilip, görüntüden veya temizlik bilgisinden hareketle zemin durumunun temizlik ihtiyaç durumu olup olmadigini belirlemektedir. Temizlik ihtiyaç durumu olarak belirlendiginde, temizlik alani ve temizlik türü ve belirlenen temizligi içeren bir temizleme komutu verilmektedir. Mevcut bulusta, görüntüden bir nesneyi tanimlamak için görüntü tanima modeli bellekte saklanmaktadir. Islemci tanimlanan nesnenin adi ve nesnenin durum türü, ön ayar adi ve durum türüyle eslestiginde, zemin durumu temizlik ihtiyaci durumu olarak belirlenmektedir. DESCRIPTION A CLEANING DECISION SYSTEM Technical Field This invention is based on the results obtained with cameras placed in the area to be cleaned. The images are analyzed with image processing and artificial intelligence and placed in places to be cleaned. decisions are made and the places to be cleaned are shared with the cleaning personnel. It is about a system that provides. Prior Art Where a large number of people are together and the person circulation is high with cleaning staff in areas such as shopping malls, airports and hospitals cleaning operations are carried out. Cleaning works in the mentioned places It is mostly carried out at certain times. This situation is actually Non-polluted areas should be cleaned again, heavily polluted areas should be cleaned at the same rate. causing areas to be cleaned or not cleaned at all. It may happen. This means that the cleaning process cannot be carried out at the desired efficiency. Because it prevents it from happening, nowadays there are cameras and fields. monitoring, deciding on areas that need to be cleaned, and There is a need for solutions that allow places to be cleaned by cleaning personnel. is heard. camera to take images on the document, artificial intelligence tracking device; artificial intelligence a communication unit for receiving cleaning information from the monitoring device; and to the image or whether a floor condition needs to be cleaned according to the cleaning information. Determining whether the ground condition is necessary or not, cleaning is necessary Once determined, a cleaning area and cleaning type should be determined and a processor cleanup area for passing a cleanup command containing It is a device that allows the data to be transmitted to the artificial intelligence cleaner via the communication unit. system is mentioned. In the invention in question, artificial intelligence cleaner The communication unit is used to receive cleaning information from the image or Based on the cleaning information, it is determined whether the floor condition is the cleaning need. determines that it is not. When cleaning is determined as a need, a cleaning that includes the cleaning area and type of cleaning and the specified cleaning command is given. In the present invention, to identify an object from the image The image recognition model is stored in memory. The name of the object whose processor is defined and when the object's state type matches the preset name and state type, the ground state is determined as a cleaning need situation.

Bulusun Kisa Açiklamasi Bu bulusun amaci, temizlenmek istenen bölgeye yerlestirilen kameralar ile elde edilen görüntülerin görüntü isleme ve yapay zeka ile analiz edilerek temizlenecek yerlere karar verilmesini ve temizlenecek yerlerin temizlik personelleri ile paylasilmasini saglayan bir sistem gerçeklestirmektir. Brief Description of the Invention The purpose of this invention is to achieve this with cameras placed in the area to be cleaned. The captured images will be analyzed and cleaned with image processing and artificial intelligence. Deciding on the places to be cleaned and discussing the places to be cleaned with the cleaning personnel. To realize a system that enables sharing.

Bulusun Ayrintili Açiklamasi Bu bulusun amacina ulasmak için gerçeklestirilen “Bir Temizlik Karar Sistemi” ekli sekilde gösterilmis olup, bu sekil; Sekil 1. Bulus konusu bir temizlik karar sisteminin sematik görünüsüdür. Detailed Description of the Invention “A Cleaning Decision System” was developed to achieve the purpose of this invention. It is shown in the figure below; Figure 1. The schematic view of a cleaning decision system that is the subject of the invention.

Sekilde yer alan parçalar tek tek numaralandirilmis olup, bu numaralarin karsiliklari asagida verilmistir: 1. Sistem 2. Görüntü alma cihazi 3. Veri tabani 4. Sunucu Temizlenmek istenen bölgelerden toplanan görüntülerin görüntü isleme ve yapay zekâ ile analiz edilerek temizlenecek yerlere karar verilmesini ve temizlik personelleri ile paylasilmasini saglayan bulus konusu sistem (1); -herhangi bir uzak iletisim protokolünü kullanarak veri alisverisi gerçeklestirmek ve görüntü almak üzere yapilandirilan en az bir görüntü alma Cihazi (2), -içerisinde görüntü alma cihazlari (2) ile toplanan görüntüleri ve görüntü alma cihazinin bulundugu konum bilgilerini kayit altinda tutmak üzere yapilandirilan en az bir veri tabani (3) ve -herhangi bir uzak iletisim protokolünü kullanarak görüntü alma cihazi (2] ile iletisim kurmak, kurulan bu iletisim üzerinden görüntü alma cihazi (2) ile veri alisverisi gerçeklestirmek ve görüntü alma cihazi (2) ile toplanan verileri derin ögrenme islemine tabi tutarak veri tabaninda (3) kayit altina almak, veri tabanini (3) yönetmek, veri tabaninda (3 yer alan verileri yapay zeka modelleri ile islemek ve temizlenecek konumun görsellerini bir elektronik cihaza sahip olan temizlik personeli ile bir görev olarak paylasmak, temizlik personelinin temizledigi yerin görsellerini görüntü alma cihazi (2) üzerinden almak ve eslestirmek, görsellerin eslestigi durumda görevi sonlandirmak, görsellerin eslesmedigi durumda ise yeniden bir temizlik görevi olusturmak üzere yapilandirilan en az bir sunucu (4) içermektedir. The parts in the figure are numbered one by one, and these numbers The equivalents are given below: 1. System 2. Image acquisition device 3. Database 4. Server Image processing and artificial processing of images collected from the areas to be cleaned Deciding on the places to be cleaned by analyzing them with intelligence and cleaning The system of the invention (1), which enables sharing with its employees; -exchanging data using any remote communication protocol and at least one image acquisition Device (2) configured to receive images, -images collected with image acquisition devices (2) and image acquisition configured to record the location information of the device at least one database (3) and -with image acquisition device (2] using any remote communication protocol to communicate, to send data with the image acquisition device (2) through this communication. to perform data exchange and deepen the data collected with the image acquisition device (2). recording in the database (3) by subjecting it to a learning process, (3) manage, process the data in the database (3) with artificial intelligence models and the cleaning device with an electronic device that displays visuals of the location to be cleaned. to share with the staff as a task, to ensure that the cleaning staff cleans the place receiving and matching visuals via the image acquisition device (2), If the images match, end the task; if the images do not match, at least one server (4) configured to recreate a cleaning task Contains.

Bulus konusu sistemde (1) yer alan görüntü alma cihazi (2) temizlik görevi olusturulacak alanlara görsel alinmasini saglayacak sekilde yerlestirilen, görüntü isleme ve talebe bagli olarak görseli anlamlandirma özelligi içeren bir kameradir. The imaging device (2) located in the system (1) subject to the invention has a cleaning duty. placed in a way to allow visual capture to the areas to be created, It is a camera that has the feature of interpreting the image depending on the process and demand.

Görüntü alma cihazi (2), hareketli nesneleri takip etmek, hareketli nesnelerin temas ettigi hareketsiz nesnelerin konumlarini belirlemek ve sunucu (4) ile paylasmak üzere yapilandirilmaktadir. Görüntü alma cihazi (2) nesne isaretlemesi yapmak için bilgisayarla görme (computer vision) sensörü içermek üzere yapilandirilmaktadir. Görüntü alma cihazi (2), teknigin bilinen durumunda yer alan herhangi bir uzak iletisim protokolünü kullanarak sunucu (4) ile baglanti kurmak ve kurulan bu baglanti üzerinden veri alisverisi gerçeklesmesini saglamak üzere yapilandirilmaktadir. Bulusun tercih edilen uygulamasinda görüntü alma cihazi (2) sunucu (4) ile Internet seklinde bir veri yolu kullanarak veri alisverisi gerçeklestirmek üzere yapilandirilmaktadir. Image acquisition device (2), to track moving objects, to determine the positions of the stationary objects it comes into contact with and to communicate with the server (4). It is structured to share. Image acquisition device (2) object marking To include a computer vision sensor to make is being configured. The image acquisition device (2) is in the state of the art. connection with the server (4) using any remote communication protocol to establish and ensure data exchange through this established connection. It is structured as follows. Image acquisition in the preferred embodiment of the invention The device (2) exchanges data with the server (4) using a data bus in the form of the Internet. is structured to achieve this.

Bulus konusu Sistemde (1) yer alan veri tabani (3) bir bulut veri tabani olup sunucu (4) ile iletisim halinde olmak ve sunucu (4) tarafindan yönetilmek üzere yapilandirilmaktadir. Söz konusu veri tabani (3) içerisinde görüntü alma cihazi (2) ile toplanan görüntü verilerini görüntü alma cihazinin (2] bulundugu konum bilgisi ile iliskilendirilmis sekilde kayit altinda tutmak üzere yapilandirilmaktadir. The database (3) in the System (1) that is the subject of the invention is a cloud database. to be in communication with the server (4) and to be managed by the server (4) is being configured. Image acquisition device (2) within the database (3) in question The image data collected with the location of the image acquisition device (2] It is structured to keep records associated with the information.

Veri tabani (3) içerisinde ayrica temizlik personellerin iletisim bilgilerini ve personellere atanan görevleri kayit altinda tutmak üzere yapilandirilmaktadir. The database (3) also includes the contact information of cleaning personnel and It is structured to keep records of the tasks assigned to personnel.

Bulus konusu sistemde (1) yer alan sunucu (4), teknigin bilinen durumunda yer alan herhangi bir uzak iletisim protokolünü kullanarak görüntü alma cihazi (2) ile iletisim kurmak ve kurulan bu iletisim üzerinden toplanan görüntüleri veri tabaninda (3) kayit altina almak üzere yapilandirilmaktadir. Bulusun tercih edilen düzenlemesinde sunucu (4), görüntü alma cihazi (Zi ile Internet seklindeki bir veri sebekesi üzerinden iletisim kurmak üzere yapilandirilmaktadir. Sunucu (4), veri tabani (3) içerisine yeni veri kaydi yapilmasi, veri tabani (3) içerisindeki kayitli verilerin silinmesi, veri tabani (3) içerisindeki kayitli verilerin degistirilmesi ve veri tabani (3) içerisindeki kayitli verilerin güncellenmesi seklindeki islemlerle veri tabanini (3) yönetmek üzere yapilandirilmaktadir. Bulusun tercih edilen düzenlemesinde sunucu (4), veri tabaninda (3) tutulan verileri derin ögrenme algoritma ile analiz ederek anlamlandirmak, yapay zeka modelleri ile yogunluk içeren ve temasin yogun oldugu bölgeleri belirlemek ve belirlenen bölgeyi bir görsel olarak temizlik personeli ile paylasmak üzere yapilandirilmaktadir. Sunucu (4) tercih edilen uygulamada görsel üzerinde temizlenecek yerleri isaretlenmis olarak paylasmak üzere yapilandirilmaktadir. Sunucu (4) temizlik isleminin bitmesinin ardindan görüntü alma cihazindan aldigi görüntüler ile temizlik görevinde yer alan görselleri bilgisayarla görme (computer vision) kullanarak islemek ve temizligin yapilip yapilmadigina karar vermek üzere yapilandirilmaktadir. Sunucu (4) temizlik isleminin gerçeklestirilmedigine karar verdiginde yeni bir görev olustururken, temizlik isleminin gerçeklestirildigine karar verdiginde ise görevi sonlandirmaktadir. The server (4) in the system (1) subject to the invention is in the known state of the art. with the image acquisition device (2) using any remote communication protocol to establish communication and to share the images collected through this communication as data. It is configured to record in the base (3). Find the preferred In its arrangement, the server (4) is the image receiving device (a data transfer device in the form of Internet via Zi). It is configured to communicate over the network. Server (4), data recording new data into the database (3), deleting data, changing recorded data in the database (3) and through processes such as updating the recorded data in the database (3) It is configured to manage the database (3). Find the preferred In this arrangement, the server (4) uses the data kept in the database (3) for deep learning. make sense by analyzing with algorithms, intensity with artificial intelligence models to determine the areas containing intense contact and to It is configured to be shared visually with cleaning staff. Presenter (4) In the preferred application, the areas to be cleaned are marked on the visual. It is configured to be shared as. Server (4) cleaning process After it is finished, it is cleaned with the images taken from the imaging device. images in the task using computer vision. to process and decide whether cleaning has been done or not. is being configured. The server (4) decides that the cleaning process has not been carried out. When creating a new task, make sure that the cleaning process has been carried out. When he decides, he ends the task.

Sunucu (4) görseller üzerinde nerenin ne zaman temizlenecegine karar vermek için insanlarin hareketlerini ve nerelere temas etigini analiz ederek bir puan olusturmak ve söz konusu puaninin asilmasi ile temizlik islemine karar vermek üzere yapilandirilmaktadir. Bulus konusu sistem (1) kameralardan toplanan verilerin sürekli islenmesi ile insanlarin yogun oldugu ve temas ettigi yerlerin belirlenmesini, bu sayede nerelerin temizlenmesi gerektigine karar vermektedir. Server (4) decides where and when to clean the images to get a score by analyzing people's movements and where they touch to create and decide on the cleaning process when the score in question is exceeded. It is structured as follows. The system subject to the invention (1) uses data collected from cameras. With the continuous processing of data, places where people are densely populated and come into contact In this way, it decides which areas need to be cleaned.

Sistem (1) temizlenecek yerin görselini personelle paylasmakta ve ardindan görüntü alma cihazi (2) ile alinan görüntüler üzerinden söz konusu yerin temizlenip temizlenmedigine karar vermektedir. Böylelikle temizlik görevi sonlandirilabildigi gibi yeni bir temizlik görevi de olusturulabilmektedir. The system (1) shares the visual of the place to be cleaned with the personnel and then the location in question through the images taken with the image acquisition device (2). It decides whether it is cleaned or not. Thus, the cleaning task It can be terminated or a new cleaning task can be created.

BUiUS konusu sistemde (1) yer alan görüntü alma cihazi (2), veri tabani (3) ve sunucu (4) kullaniciya veri gizliligi ilkeleri dogrultusunda bilgilendirme ve onay sunmakta olup, Kisisel Verilerin Korunmasi Kanunu (KVKK) dâhilinde faaliyet göstermektedir. The image acquisition device (2), database (3) and The server (4) provides information and approval to the user in accordance with data privacy principles. and operates within the scope of the Personal Data Protection Law (KVKK). shows.

Bu temel kavramlar etrafinda, bulus konusu “Bir Temizlik Karar Sistemi (1)” ile ilgili çok çesitli uygulamalarin gelistirilmesi mümkün olup, bulus burada açiklanan örneklerle sinirlandirilamaz, esas olarak istemlerde belirtildigi gibidir. Around these basic concepts, the subject of the invention is "A Cleaning Decision System (1)" It is possible to develop a wide variety of related applications, and the invention is presented here. It cannot be limited to the examples described, but is essentially as stated in the claims.

Claims

1. At least one image acquisition device (2) configured to exchange data and take images using any remote communication protocol, enabling the images collected from the areas to be cleaned to be analyzed by image processing and artificial intelligence, to decide on the places to be cleaned and to share them with the cleaning personnel. , - at least one database (3) configured to record the images collected by the image acquisition devices (2) and the location information of the image acquisition device, and - to communicate with the image acquisition device (2) using any remote communication protocol, Exchanging data with the image acquisition device (2) through this communication and recording the data collected by the image acquisition device (2) in the database (3) by subjecting it to deep learning process, managing the database (3), storing data in the database (3 places) Processing field data with artificial intelligence models and sharing the images of the location to be cleaned as a task with the cleaning personnel who have an electronic device, receiving and matching the images of the location cleaned by the cleaning personnel via the image acquisition device (2), ending the task if the images match, and in case the images do not match. a system (1) characterized by at least one server (4) configured to create a cleaning task again.

2. A system (1) as in Claim 1, characterized by the image acquisition device (2), which is a camera that is placed in a way to capture images in the areas where cleaning tasks will be performed, and includes the feature of image processing and giving meaning to the image depending on the demand.

3. A system (1) as in Claim 1 or 2, characterized by an image acquisition device (2) configured to track moving objects, determine the positions of stationary objects that the moving objects come into contact with, and share them with the server (4).

4. A system (1) as in any of the above claims, characterized by an image acquisition device (2) configured to establish a connection with the server (4) using any remote communication protocol in the state of the art and to enable data exchange through this connection. .

5. A system (1) as in any of the above claims, characterized by the image receiving device (2) configured to exchange data with the server (4) using a data bus in the form of the Internet.

6. A system (1) as in any of the above claims, which is a cloud database and is characterized by the database (3) configured to be in communication with the server (4) and to be managed by the server (4).

7. A system (1) as in any of the above claims, characterized by a database (3) configured to record the image data collected by the image acquisition device (2) in association with the location information of the image acquisition device (2).

8. A system (1) as in any of the above claims, characterized by a database (3) configured to record the contact information of the cleaning personnel and the tasks assigned to the personnel.

9. A server (any of the above claims characterized by 4l) configured to communicate with the image acquisition device (2) using any remote communication protocol in the state of the art and to record the images collected through this communication in the database (3).

10. One of the above claims, characterized by the server (4) configured to make sense of the data kept in the database (3) by analyzing it with a deep learning algorithm, to identify dense and high-contact areas with artificial intelligence models, and to share the determined area visually with the cleaning personnel. a system like any other (1).

11. Any of the above claims, characterized by the server (4) configured to share marked areas on the image to be cleaned

12. A system (1) as in any of the above claims, characterized by a server (4) configured to process the images taken from the image taking device and the images included in the cleaning task using computer vision after the cleaning process is completed, and to decide whether the cleaning has been done or not. .

13. A system (1) as in any of the above claims, characterized by a server (4) configured to create a score by analyzing people's movements and where they touch in order to decide where and when to clean the images, and to decide on the cleaning process when the said score is exceeded. ).