TR202020465A2

TR202020465A2 - ONE COPY DETECTION SYSTEM

Info

Publication number: TR202020465A2
Application number: TR2020/20465A
Authority: TR
Inventors: Pars Sümeyye; Yelmen İlkay
Original assignee: Turkcell Technology Research And Development Co
Priority date: 2020-12-14
Filing date: 2020-12-14
Publication date: 2021-01-21

Abstract

Bu buluş, online ortamlarda gerçekleştirilen eğitimler sonrası yapılan sınavlarda kopya çeken kullanıcıların otomatik olarak tespit edilmesini sağlayan bir sistem (1) ile ilgilidir.This invention relates to a system (1) that enables automatic detection of users who cheat in exams conducted after online training.

Description

TARIFNAME BIR KOPYA TESPIT SISTEMI Teknik Alan Bu bulus, online ortamlarda gerçeklestirilen egitimler sonrasi yapilan sinavlarda kopya çeken kullanicilarin otomatik olarak tespit edilmesini saglayan bir sistem ile Önceki Teknik Günümüzde online egitim platformlarinin yaygin olarak kullanilmasi ile birlikte yapilacak sinavlarin da online ve gözetimli bir sekilde yapilmasina olan ihtiyaç artmaktadir. Özellikle egitim/sinav platformlarini kullanan kisi sayisindaki artis ve sinav sayilarindaki artisla birlikte sinav esnasindaki manuel gözetim süreci artik yetersiz hale gelmekte, elektronik Cihazi karsisinda sinava giren kullanicilarin kopya çekme ihtimali artmaktadir. Bu sebeple manuel gözetim/denetim sürecinin insandan bagimsiz yapilmasina ve kopya çekme vakalarini güvenilir sekilde tespit etmeye yarayan yeni sistemlere ihtiyaç duyulmaktadir. DESCRIPTION A COPY DETECTION SYSTEM Technical Area This invention can be found in the exams held after the trainings held in online environments. with a system that automatically detects cheating users Prior Art Today, with the widespread use of online education platforms, the need for online and supervised exams increasing. In particular, the increase in the number of people using education/exam platforms and With the increase in the number of exams, the manual surveillance process during the exam is now becomes insufficient, the users who take the exam against their electronic device The probability of cheating increases. For this reason, the manual oversight/audit process reliably detecting human-independent cheating and cheating new systems are needed.

Teknigin bilinen durumunda yer alan CNl 1 1539313 sayili Çin patent dokümaninda sinavda kopya çekilmesini tespit etmek üzere yapilandirilan bir sistemden bahsedilmektedir. Söz konusu bulusta sinava giren kisinin görüsünün izlenmesini saglamak ve sinava giren kisinin Video verilerinin gerçek zamanli olarak toplanmasi saglanmaktadir. Toplanan veriler analiz edilerek bir kopyanin gerçek zamanli olarak tespit edilebilmesinden bahsedilmektedir. Söz konusu bulusta sinava giren kisinin görme hareketinin takip edilerek analiz edilmekte ve sinava giren kisinin görüs hareket araligi daha önceden belirlenen normal degerler disinda ise sinava giren kisinin kopya ihtimalinin oldugunu tespit etmektedir. Söz konusu bulusta sinava giren kisinin kimlik bilgileri, yüz bilgileri, iris bilgileri gibi bilgilerin toplanmasini saglanmakta ve veri tabaninda kayit altinda tutulmaktadir. Sinava giren kisinin yüz bilgileri sinav sirasinda kontrol edilmekte ve yüz tanimlanmasinin yapilmasi saglanmaktadir. Söz konusu bulusta sinava giren kisinin video verileri analizi sirasinda derin ögrenme algoritmalari kullanilmakta ve kopya tespitinin dogrulugunun arttirilmasi saglanmaktadir. Ayrica söz konusu bulusta belirlenen kopya davranislarinin raporlanmasi ve söz konusu davranisin kayit altina alinmasi saglanmaktadir. In the Chinese patent document numbered CNl 1 1539313, which is in the state of the art, from a system configured to detect cheating on an exam is mentioned. In the said invention, it is necessary to monitor the opinion of the person who took the exam. real-time collection of video data of the test taker to provide is provided. The collected data is analyzed and a real-time view of a copy mentioned as detectable. The one who took the exam in the said invention It is analyzed by following the visual movement of the person and it is determined that the person taking the exam If the visual range of motion is outside the predetermined normal values, the exam It detects that the person entering has a copy probability. In the invention in question information such as identity information, face information, iris information of the person taking the exam. are collected and recorded in the database. exam The face information of the person entering is checked during the exam and the face identification is checked. is provided to be done. Video data of the person who took the exam in the said invention During the analysis, deep learning algorithms are used and copy detection is increased accuracy is provided. In addition, as determined in the said invention, reporting cheating behaviors and recording the said behavior is provided.

Bulusun Kisa Açiklamasi Bu bulusun amaci, online ortamlarda gerçeklestirilen egitimler sonrasi yapilan Sinavlarda kopya çeken kullanicilarin otomatik olarak tespit edilmesini saglayan bir S istem gerçeklestirmektir. Brief Description of the Invention The purpose of this invention is to provide trainings after trainings in online environments. A program that automatically detects users who cheat in exams. The system is to realize.

Bulusun Ayrintili Açiklamasi Bu bulusun amacina ulasmak için gerçeklestirilen “Bir Kopya Tespit Sistemi” ekli sekilde gösterilmis olup, bu sekil; Sekil 1. Bulus konusu sistemin sematik görünüsüdür. Detailed Description of the Invention Attached "A Duplicate Detection System" implemented to achieve the purpose of this invention shown in the figure, this figure; Figure 1. The subject of the invention is the schematic view of the system.

Sekilde yer alan parçalar tek tek numaralandirilmis olup, bu numaralarin karsiliklari asagida verilmistir: 1. Sistem 2. Elektronik cihaz 3. Uygulama 4. Veritabani . Sunucu Online ortamlarda gerçeklestirilen egitimler sonrasi yapilan sinavlarda kopya çeken kullanicilarin Otomatik olarak tespit edilmesini saglayan bulus konusu sistem (1); -üzerinde en azindan bir uygulama yürütebilen ve herhangi bir uzak iletisim protokolünü kullanarak uzak sunucular ile iletisim kurabilen en az bir elektronik -elektronik cihaz (2) üzerinde yürütülen, en azindan kullanicilarin online sinavlara katilabilmesini ve sinavlar sirasinda kullanicilarin izlenebilmesini saglamak üzere yapilandirilan en az bir uygulama (3), -içerisinde kullanicilarin uygulama (3) üzerinden alinan video kayitlarinda tespit edilen yüz ve iris hareketlerinin ve yüz ve iris hareketleri degisimine göre kopya çekme durumunu belirlemeyi saglayan kurallarin kayit altinda tutulmasini saglayan en az bir veri tabani (4), -herhangi bir uzaktan iletisim protokolünü kullanarak elektronik cihaz (2) ile iletisim kurmak ve kurulan bu iletisim üzerinden elektronik cihaz (2) üzerinde yürütülen uygulama (3) ile veri alisverisi gerçeklestirmek, uygulama (3) sayesinde elektronik cihaz (2) kamerasi araciligiyla alinan video kayitlarindan kullanicinin yüz ve iris hareketlerini belirlemek, belirlenen yüz ve iris hareketlerini veri tabaninda (4) saklanan kopya çekme durumlarini ifade eden kurallar üzerinde kontrol etmek, kontrol sonucu kopya çeken kullanicilari otomatik olarak tespit etmek ve veri tabanini (4) yönetmek üzere yapilandirilan en az bir sunucu (5) içermektedir. The parts in the figure are numbered one by one and the corresponding numbers are given below: 1. System 2. Electronic device 3. Application 4. Database . Server Cheating in the exams held after the online trainings the subject of the invention system (1) that provides automatic identification of users; - any remote communication capable of running at least one application on it At least one electronic device that can communicate with remote servers using the protocol - at least the users are required to take the online exams conducted on the electronic device (2). to ensure that users can participate and be monitored during exams. configured at least one application (3), -Detection of users in video recordings taken from the application (3) copy according to the change of facial and iris movements and facial and iris movements which ensures that the rules that determine the withdrawal status are kept under record at least one database (4), - with electronic device (2) using any remote communication protocol to communicate and over the electronic device (2) through this established communication. performing data exchange with the running application (3), thanks to the application (3) from the video recordings taken through the electronic device (2) camera, determine facial and iris movements, on the rules expressing cheating situations stored in the base (4) checking, automatically detecting users who cheat as a result of checking at least one server (5) configured to contains.

Bulus konusu sistemde (1) yer alan elektronik cihaz (2), tus veya dokunmatik ekran seklindeki bir girdi birimine, ses çikisini saglayan en az bir hoparlöre, ses girisini saglayan en az bir mikrofona ve görüntü alinmasini saglayan en az bir kameraya sahip akilli telefon, tablet bilgisayar, masa üstü bilgisayar veya tasinabilir bilgisayar olan bir cihazdir. Bulusun tercih edilen düzenlemesinde elektronik cihaz (2), üzerinde kullanicilara online sinavlara katilma imkani sunan en az bir uygulama (3) yürütmek üzere yapilandirilmaktadir. Söz konusu elektronik cihaz (2), teknigin bilinen durumunda yer alan herhangi bir uzak iletisim protokolünü kullanarak sunucu (5) ile baglanti kurmak ve kurulan bu baglanti üzerinden uygulama (3) ve sunucu (5) arasinda veri alisverisi gerçeklesmesini saglamak üzere yapilandirilmaktadir. Bulusun tercih edilen uygulamasinda elektronik cihaz (2) sunucu (5) ile veri yolu olarak Internet kullanarak veri alisverisi gerçeklestirmek üzere yapilandirilmaktadir. Electronic device (2), key or touch screen in the inventive system (1) to an input unit in the form of at least one speaker providing sound output, at least one microphone that provides smartphone, tablet, desktop or portable computer is a device. In the preferred embodiment of the invention, the electronic device (2), At least one application (3) that allows users to participate in online exams on is configured to execute. Said electronic device (2) using any remote communication protocol in its known state to establish a connection with the server (5) and the application (3) and to enable data exchange between the server (5). is being configured. In the preferred embodiment of the invention, the electronic device (2) to exchange data with the server (5) using the Internet as a bus is configured to.

Bulus konusu sistemde (1) yer alan uygulama (3), elektronik cihaz (2) üzerinde yürütülmekte olup, elektronik cihaz (2) ile sunucu (5) arasinda kurulan iletisim üzerinden sunucu (5) ile veri alisverisi gerçeklestirmek üzere yapilandirilmaktadir. The application (3) in the system (1), which is the subject of the invention, is on the electronic device (2). communication between the electronic device (2) and the server (5). It is configured to perform data exchange with the server (5) via the server.

Söz konusu uygulama (3), kullanicilarin kisisel bilgileri ile kaydolmasini ve bu bilgiler ile servisi kullanmak için giris yapmasini saglayacak en az bir arayüz sunmak üzere yapilandirilmaktadir. Uygulama (3), kullaniciya katilmak istedigi online egitim veya sinava iliskin erisim bilgilerini içeren verinin girilmesini saglayan en az bir ara yüz sunmak üzere yapilandirilmaktadir. Uygulama (3), kullaniciya katildigi sinav süresi boyunca kendisine ait Video kaydinin elektronik cihaz (2) kamerasi üzerinden alinmakta oldugu bilgisini göstermek üzere yapilandirilmaktadir. Uygulama (3), sinav sirasinda kopya çektigi tespit edilen kullanici bilgilerinin sinav yetkilileri tarafindan görüntülenmesini saglamak üzere yapilandirilmaktadir. The said application (3) allows users to register with their personal information and at least one interface to log in to use the service with information is made to offer. The application (3) sends the user that he wants to join. Entering data containing access information about online education or exam It is configured to offer at least one interface that provides Application (3), During the exam period that the user attends, the electronic video recording of his/her own to show the information that it is being received over the device (2) camera. is being configured. The application (3), which is found to be cheating during the exam, to enable the user information to be viewed by the exam authorities. is being configured.

Bulus konusu sistemde (1) yer alan veri tabani (4), sunucu (5) ile iletisim halinde olup sunucu (5) tarafindan yönetilmek üzere yapilandirilmaktadir. Bulusun tercih edilen düzenlemesinde veri tabani (4] içerisinde kullanicinin uygulama (3) sayesinde sinav süresinCe kaydedilen Video verilerinin kayit altinda tutulmasini saglamak üzere yapilandirilmaktadir. Veri tabani (4), kullanicinin sinav süresince kaydedilmis video verilerindEn tespit edilen yüz ve iris hareketlerine ait resimlerin kayit altinda tutulmasini saglamak üzere yapilandirilmaktadir. Veri tabani (4), kopya çekmekte olan bir kullanicini yüz ve iris hareketlerinin ne sekilde olduguna iliskin görüntü verilerinin, görüntülerdeki kopya vakasi tespitine yönelik standart kurallarin ve uygulama ile ilgili bilgilerin kayit altinda tutulmasini saglamak üzere yapilandirilmaktadir. The database (4) in the inventive system (1) is in communication with the server (5). and is configured to be managed by the server (5). Find your choice The user's application (3) in the database (4] Thanks to the video data recorded during the exam, it is possible to keep a record. It is configured to provide. The database (4) is used by the user during the exam. images of face and iris movements detected from recorded video data. It is configured to ensure that it is kept under record. database (4), how the face and iris movements of a cheating user standard for detecting duplicate cases in images to ensure that the rules and information about the application are kept under record. is being configured.

Bulus konusu sistemde (1) yer alan sunucu (5), herhangi bir uzaktan iletisim protokolünü kullanarak elektronik cihaz (2) ile iletisim kurmak ve kurulan bu iletisim üzerinden elektronik Cihaz (2) üzerinde yürütülen uygulama (3) ile veri alisverisi gerçeklestirmek üzere yapilandirilmaktadir. Sunucu (5), veri tabani (4) içerisine yeni veri kaydi yapilmasi, veri tabani (4) içerisindeki kayitli verilerin silinmesi ya da veri tabani (4) içerisindeki kayitli verilerin degistirilmesi ve veri tabani (4) içerisindeki kayitli verilerin güncellenmesi seklindeki islemlerle veri tabanini (4) yönetmek üzere yapilandirilmaktadir. Söz konusu sunucu (5), uygulamaya (3) giris yapan ve uygulamayi (3) bir sinava katilmak için kullanmaya baslayan kullanicinin elektronik cihaz (2) kamerasinin aktif hale getirilmesini ve video kaydi baslatmasini saglamak üzere yapilandirilmaktadir. Sunucu (5), kamera sayesinde alinan Video kayitlarini resim verilerine ayirmak ve ayrilan resim verilerini veri tabanina (4) iletmek üzere yapilandirilmaktadir. Sunucu (5), Video kayitlarindan ayrilmis resim verileri üzerinde kullaniciya ait hareketler ile beraber yüz ve iris tanima islemlerini gerçeklestirmek üzere yapilandirilmaktadir. Sunucu (5), kullaniciya ait alinan ve veri tabanina (4) Ileti len yüz ve iris hareketlerine iliskin resimler ile veri tabaninda (4) saklanan kopya çekme durumunda yüz ve iris hareketlerinin ne sekilde olduguna iliskin standart kurallar arasinda analiz gerçeklestirmek üzere yapilandirilmaktadir. Sunucu (5), gerçeklestirilen analiz sonucunda kullaniciya ait yüz ve iris hareketlerinin kopya çekme tespiti saglayan kurallardaki yüz ve iris hareketleri ile eslesmemesi durumunda kullanicinin kopya çekmedigini belirleyerek herhangi bir aksiyon almamak üzere yapilandirilmaktadir. The server (5) in the system (1), which is the subject of the invention, cannot be used for any remote communication. To communicate with the electronic device (2) using the protocol and data with the application (3) executed on the electronic device (2) over the communication is configured to perform the exchange. Server (5), database (4) recording new data in the database (4) deletion or modification of the recorded data in the database (4) and data data with operations such as updating the recorded data in the base (4). It is configured to manage its base (4). The said server (5), logging into the application (3) and using the application (3) to participate in an exam Activating the electronic device (2) camera of the starting user and is configured to enable video recording to start. Presenter (5), camera to separate the video recordings taken by means of the image data into picture data and It is configured to transmit its data to the database (4). Presenter (5), Video together with the user's movements on the picture data separated from the records. It is configured to perform face and iris recognition operations. Server (5) regarding facial and iris movements received from the user and transmitted to the database (4) face and iris in case of copying stored in the database (4) with pictures analysis among the standard rules of how they move is structured to do so. Server (5), analysis performed As a result, it provides cheating detection of the user's face and iris movements. If it does not match the facial and iris movements in the rules, the user's copy It is configured not to take any action by determining that it does not pull.

Sunucu (5), gerçeklestirilen analiz sonucunda kullaniciya ait yüz ve iris hareketlerinin kopya çekme tespiti saglayan kurallardaki yüz ve iris hareketleri ile eslesmesi durumunda kullanicinin kopya çektigini belirleyerek raporlamak ve raporu sinav yetkililerine iletmek üzere yapilandirilmaktadir. Sunucu (5), kopya çektigi belirlenen kullanicilarin yüz ve iris hareketlerine ait verilerin veri tabanina (4) iletilerek veri tabaninda (4) saklanan kopya tespit kurallarini sürekli olarak egiteeek bir model olusturulmasini saglamak üzere yapilandirilmaktadir. Sunucu (5 ), yapay zeka teknolojisi; Derin Ögrenme Evrisimsel Sinir Aglari (Convolutional Neural Networks) (CNN) kullanilarak veri tabaninda (4) saklanan kopya tespit kurallarinin olusturulan model sayesinde sürekli egitilmesini saglamak üzere yapilandirilmaktadir. Sunucu (5), kullanicilara ait alinan yeni iris ve yüz hareket resimlerini sürekli egitilen kopya tespit modelindeki resimler ile analiz ederek kopya çekme vakalarini güvenilir sekilde tespit etmek üzere yapilandirilmaktadir. Server (5), as a result of the analysis performed, the face and iris of the user with the facial and iris movements in the rules that provide cheating detection. if it matches, to identify and report that the user cheated, and It is structured to transmit the report to the exam authorities. Server (5), copy The data of the facial and iris movements of the users determined to be taken into the database. (4) continuously repeats the copy detection rules stored in the database (4) by transmitting It is configured to enable the creation of an educational model. Server (5), artificial intelligence technology; Deep Learning Convolutional Neural Networks Duplicate detection stored in database (4) using Neural Networks (CNN) in order to ensure that the rules are constantly trained thanks to the created model. is being configured. Server (5), new iris and facial movements received from users by analyzing the images in the continuously trained copy detection model. It is configured to reliably detect cheating cases.

Bulus konusu sistem (1) sayesinde, online platformlar üzerinden gerçeklestirilen sinavlarda kopya çekme vakalarinin tespiti için ihtiyaç duyulan manuel gözetim ve denetim süreci insandan bagimsiz otomatik hale getirilmektedir. Söz konusu sistem (1), kural tabanli bir sistem olup, veri tabaninda (4) saklanan ve parametrik olarak tanimlanan statik kurallar tespit edilen kopya vakalarindaki veriler dogrultusunda degistirilerek güncel lenebilmektedir. Thanks to the system (1), which is the subject of the invention, the manual surveillance needed to detect cheating in exams, and the inspection process is automated independently of the human being. The system in question (1) is a rule-based system that is stored in the database (4) and parametrically static rules defined in accordance with the data in detected duplicate cases can be changed and updated.

Bu temel kavramlar etrafinda, bulus konusu “B ir Kopya Tespit Sistemi (1)” ile ilgili çok çesitli uygulamalarin gelistirilmesi mümkün olup, bulus burada açiklanan örneklerle sinirlandirilamaz, esas olarak istemlerde belirtildigi gibidir. Around these basic concepts, the subject of the invention is "A Copy Detection System (1)". It is possible to develop a wide variety of applications, the invention being described herein. not limited to examples, essentially as specified in the claims.

Claims

REQUESTS . It ensures that users who cheat in the exams held after the online trainings are automatically detected; - at least one electronic device (2) that can run at least one application on it and communicate with remote servers using any remote communication protocol, at least one configured application (3) and -at least one database (4) which ensures that the face and iris movements detected in the video recordings of the users taken over the application (3) and the rules that determine the cheating status according to the face and iris movements change are recorded. ), - to communicate with the electronic device (2) using any remote communication protocol and to exchange data with the application (3) executed on the electronic device (2) over this communication, the electronic device (2) camera via the application (3) The user's face and iris color from the video recordings received via with at least one server (5) configured to identify tags, check the determined facial and iris movements on rules expressing cheating situations stored in the database (4), automatically detect users who cheat as a result of the check, and manage the database (4) a characterized. An electronic device, in the form of a smartphone, tablet computer, desktop computer, or portable computer, having an input unit in the form of a key or a touch screen, at least one speaker for sound output, at least one microphone for sound input, and at least one camera for video capture. A system as in Claim 1, characterized by the device (2). A system (1) as in Claim 1 or Zi, characterized by an electronic device (2) that is configured to run at least one application (3) on which users can participate in online exams. Any of the above requests, characterized by an electronic device (2) configured to establish a connection with the server (5) using any remote communication protocol and to exchange data between the application (3) and the server (5) over this connection. A system (1) as in Claim 4, characterized by an electronic device (2) that is configured to exchange data with the server (5) using the Internet as a data bus. It is run on the electronic device (2), and the electronic device (Z} and the server A system (1) as in any of the above prompts, characterized by the application (3) configured to exchange data with the server (5) over the communication established between (5). A system (1) as in any of the above claims, characterized by an application (3) configured to present at least one interface. Application configured to present at least one interface (3 A system (1) as in any one of the above claims, characterized by ]. A system (1) as in any one of the above claims, characterized by an application (3} configured to show the user that the video recording belonging to him is being taken over the electronic device (2) camera during the exam period he/she attends. Any of the above prompts, characterized by the application (3], which is configured to ensure that the user information detected as cheating during the exam is displayed by the exam authorities, is in communication with the Server (5) and is in contact with the database (4), which is characterized by the database (4) that is configured to be managed by the server (5). A system (1) as in any of the prompts (1). Any of the above prompts, characterized by a database (4), which is configured to keep the video data recorded during the exam by the application (3) of the user under record, is the face and iris detected from the video data recorded during the exam of the user. A system (1) as in any of the above claims, characterized by a database (4) configured to keep the pictures of the movements of the person under record. A system (1) as in any one of the above claims, characterized by a database (4] configured to keep records of data, standard rules for detecting duplicate cases in images, and application-related information. A system as in any of the above claims, characterized by the server (5) configured to communicate with the electronic device (2) using any remote communication protocol and to exchange data with the application (3) executed on the electronic device (2) over this communication. (one). To manage the database (4) with operations such as recording new data in the database (4), deleting the recorded data in the database (4) or changing the recorded data in the database (4) and updating the recorded data in the database (4). A system (1) as in any one of the above claims, characterized by the configured server (5). A system as in any one of the above claims, characterized by the server (5) configured to enable the electronic device (2) camera of the user who logs into the application (3) and starts to use the application (3) to participate in an exam and to start the video recording. ). To perform face and iris recognition operations together with the user's movements on the picture data separated from the video records as in any of the above claims, characterized by the server (5) that is configured to separate the video records taken by the camera into picture data and to transmit the separated picture data to the database (4). A system (1) as in any one of the above claims, characterized by the server (5) configured to One of the above claims, characterized by the server (5) configured to perform analysis between the pictures of the user's face and iris movements received and transmitted to the database (4) and the standard rules about how the face and iris movements are stored in the database (4) in case of cheating. a system as in any (1). A system as in any of the above prompts, characterized by the server (5), which is configured to not take any action by determining that the user is not cheating if the facial and iris movements of the user do not match with the facial and iris movements in the rules providing cheating detection as a result of the analysis performed. A system as in any of the above prompts, characterized by the server (5), which is configured to detect and report that the user is cheating and to transmit the report to the exam authorities in case the face and iris movements match the face and iris movements in the rules providing for cheating detection. Characterized by the Server (5), which is configured to ensure the creation of a model that will continuously train the duplicate detection rules stored in the database (4) by transmitting the data belonging to the database (4) to the database (4). A system (1) as in any one of the preceding claims. Artificial intelligence technology; Using Deep Learning Convolutional Neural Networks, a system like in Item 23 (1), characterized by the server (5), which is configured to ensure that the duplicate detection rules stored in the database (4) are continuously trained thanks to the created model. a system (1) as in any of the above claims, characterized by the server (5) configured to reliably detect cheating cases by analyzing them with images in the continuously trained cheat detection model.