KR102307798B1 - Control method of system real time monitoring fraudulent behavior in virtual test using xr decive and application - Google Patents

Abstract

Provided is a control method of a system for monitoring a fraudulent act of a virtual test in real-time using an eXtended reality (XR) device by one embodiment of the present invention that provides an online learning evaluation management system for a practical and practical training subject using a result of a virtual reality experience. The control method of the system comprises: a step of connecting wirelessly or wired; a step of receiving the virtual test-related XR content; a step of transmitting to an XR device; a step of determining whether a command has been received; a step of extracting information related to a first authentication; a step of transmitting; a step of primary determining whether the user is authenticated; a step of requesting; a step of extracting information related to a second authentication; a step of transmitting to the at least one server; a step of secondary determining whether the user is authenticated; and a step of triggering the XR content.

Description

Control method and application of a system that monitors fraudulent behavior of virtual tests in real time using XR devices

The present invention is applicable to various XR (eXtended Reality) technologies. XR technology, for example, refers to an immersive technology that provides content without temporal and spatial constraints in a virtual space similar to reality using, for example, VR (Virtual Reality), AR (Augmented Reality), MR (Mixed Reality), hologram, etc. .

Recently, various HMD (Head Mounted Display), smart glass, smart watch, etc., which are grafted with XR technology, are being released by various companies. However, the above-described HMD, smart glasses, smart watch, etc. are mainly being developed by focusing on the game.

However, recently, due to the corona virus, etc., there is a trend that users' demands for non-face-to-face services are increasing.

To this day, each school has provided online classes simply using PCs and smartphones. However, according to the prior art, research on the technology of individually managing the academic schedule of users such as students and conducting practical tests only for authenticated users is weak.

In particular, if you use various wearable devices (for example, HMD, glasses, etc.) that incorporate XR technologies such as AR, VR, and MR, online learning evaluation of practical skills and practical subjects may also be possible. There is still no system to fundamentally remove

An embodiment of the present invention is to provide an online learning evaluation management system for practical skills and practical subjects utilizing the results of virtual reality experience.

Another embodiment of the present invention is to provide a solution capable of performing an appropriate evaluation in connection with a student's learning activity in a curriculum operating an online class and preventing the proxy test and cheating.

In addition, another embodiment of the present invention is to provide an appropriate evaluation system in consideration of experiential learning and ability to cope with situations that are difficult to actually come in contact with.

According to an embodiment of the present invention, there is provided a control method of a system for monitoring fraudulent behavior of a virtual test in real time using an eXtended Reality (XR) device, wherein the XR device and the mobile device are wirelessly or a wired connection; receiving, by the mobile device, the virtual test-related XR content from at least one server; and transmitting, by the mobile device, the received XR content to the XR device; Determining whether a command for triggering content is received; when the command is received, extracting, by the XR device, first authentication-related information about the user; Transmitting information to the at least one server via the mobile device, and the at least one server primarily determining whether to authenticate a user based on first human body information about a specific user stored in a memory and, when the user authentication is primarily successful, the at least one server requests second authentication-related information for the user, and according to the request, the XR controller is extracting information; transmitting the extracted second authentication-related information to the at least one server via the mobile device; Secondary determining whether the user is authenticated based on the human body information; and, if the user authentication is secondarily successful, triggering the XR content by the XR device.

The control method of the system may include, after the XR content is triggered, monitoring, by the XR device, whether the first authentication-related information is changed based on a first preset criterion, and the XR controller includes: and monitoring whether the second authentication-related information is changed based on a preset second criterion.

In particular, the first criterion and the second criterion are characterized in that they are different from each other.

More specifically, for example, only when the time during which the user is not detected by the infrared sensor of the XR device exceeds the preset T1 reference time, it is considered that the first criterion is satisfied.

In addition, it is considered that the second criterion is satisfied only when the time when the XR controller deviates from the field of view (FOV) that can be photographed by the external camera attached to the XR device exceeds the preset T2 reference time. .

The first biometric information includes, for example, at least one of an iris or a full face of the user, and the second biometric information includes, for example, a fingerprint of the user.

According to another embodiment of the present invention, there is provided a method for controlling a server for monitoring in real time a fraudulent activity of a virtual test using an eXtended Reality (XR) device, wherein the virtual test-related XR content is mobile with an encryption key value. Transmitting to a device or an XR device, receiving first authentication-related information about a user wearing the XR device from the mobile device or the XR device, and first body information about a specific user stored in a memory first determining whether or not the user is authenticated based on Receiving the second authentication-related information for the user holding the , from the mobile device or the XR device, and secondarily determining whether to authenticate the user based on the second human body information about the specific user stored in the memory and transmitting, to the mobile device or the XR device, a release key value that can normally trigger the XR content when the user authentication is secondarily successful.

Furthermore, the control method of the server includes the steps of receiving, from the mobile device or the XR device, a signal indicating whether the user is wearing the XR device in a P1 cycle, and the user is wearing the XR device The method further includes transmitting a command to drive an internal camera of the XR device when it is detected that there is no.

In addition, the control method of the server includes the steps of: receiving, from the mobile device or the XR device, a signal indicating whether the user is holding the XR controller in a P2 cycle, and the user is not holding the XR controller The method further includes transmitting a command to drive the fingerprint sensor of the XR controller when it is detected that the computer is not.

Finally, the control method of the server includes increasing the value of the P1 period only when there is no change in the user wearing the XR device as a result of driving the internal camera, and as a result of driving the fingerprint sensor, the XR The method further includes increasing the value of the P2 period only when there is no change in the user holding the controller.

According to an embodiment of the present invention, there is a technical effect of providing an online learning evaluation management system for practical skills and practical subjects utilizing the results of virtual reality experience.

According to another embodiment of the present invention, it is possible to provide a solution capable of performing an appropriate evaluation in connection with the student's learning activity in a curriculum operating an online class and preventing the proxy test and fraudulent activity. do.

In particular, a technical effect that can strengthen the user authentication process in a virtual environment by first authenticating the user wearing the XR device and secondarily authenticating the same user holding the XR controller at the first time the virtual test is triggered Furthermore, it has an excellent technical effect by additionally suggesting a solution that efficiently monitors user changes in the middle of the virtual test.

And, according to another embodiment of the present invention, there is also an advantage of providing an appropriate evaluation system in consideration of experiential learning for situations that are difficult to actually come in contact with and ability to cope with them.

However, in addition to the above-mentioned technical effects, various technical effects that can be easily recognized by those skilled in the art will be described later in more detail with reference to a plurality of drawings.

1 is a block diagram illustrating a schematic configuration of a system for monitoring cheating of a virtual test in real time using an XR device, according to at least one embodiment of the present invention.
FIG. 2 is a diagram for explaining a main function of each configuration shown in FIG. 1 .
3 is a diagram for describing in detail a device group for a virtual test according to at least one embodiment of the present invention.
FIG. 4 is a flowchart illustrating a control method of a system for monitoring fraudulent behavior of a virtual test in real time using an XR device, according to at least one embodiment of the present invention.
And, FIG. 5 is a flowchart illustrating a control method of a server for monitoring fraudulent behavior of a virtual test in real time using an XR device, according to at least one embodiment of the present invention.

Embodiments disclosed herein will be described in detail with reference to the accompanying drawings, and overlapping descriptions will be omitted for convenience of description, but those skilled in the art can easily understand the present invention through the gist of the entire specification.

The suffixes "module" and "part" for the components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have a meaning or role distinct from each other by themselves.

In addition, in describing the embodiments disclosed in the present specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in the present specification, the detailed description thereof will be omitted.

In addition, it should be noted that the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and should not be construed as limiting the technical spirit disclosed herein by the accompanying drawings.

1 is a block diagram illustrating a schematic configuration of a system for monitoring fraudulent behavior of a virtual test in real time using an XR device, according to at least one embodiment of the present invention.

A system according to an embodiment of the present invention includes a management client 100, a server 200, and a device group 300 for a virtual test (VT) shown in FIG. 1 . However, this is only one example, and deleting, changing, or adding some components according to the needs of those skilled in the art may also fall within the scope of other rights of the present invention.

The management client 100 shown in FIG. 1 develops and uploads various XR contents to the server 200 so that education and virtual tests based on XR technology can be provided to users.

More specifically, the management client 100 corresponds to, for example, a personal computer (PC), a notebook computer, a tablet PC, etc. managed at a school or a private institute.

The server 200 shown in FIG. 1 is designed to transmit various XR contents received from the management client 100 to the device group 300 for which user authentication has been completed.

The device group 300 shown in FIG. 1 is an entity in which a virtual test is actually implemented while providing various XR contents to a user. More specifically, a mobile device (ex: smart phone, etc.), an XR device, and an XR controller correspond to this, and specific embodiments will be described in more detail below in FIGS. 2, 3, 4 and 5, and the like.

FIG. 2 is a diagram for explaining a main function of each configuration shown in FIG. 1 .

As previously described in FIG. 1, the system according to an embodiment of the present invention shown in FIG. 2 also includes a management client 100, a server 200, and a device group 300 for VT (Virtual Test). contains at least one. However, unlike FIG. 1 , in FIG. 2 , various specific functions of each entity are defined.

The management client 100 shown in FIG. 2 performs a first function (Function 1) and a second function (Function 2). The first function means, for example, developing learning content/evaluation content and the like and uploading data. The second function means, for example, extracting evaluation criteria data and uploading the data.

Furthermore, the management client 100 additionally generates XR content (for learning: modular practice configuration, for evaluation: step-by-step academic achievement configuration), and also generates video content suitable for practice subjects/tests. It will be said that referring to the aforementioned management client 100 as an instructor block also falls within the scope of other rights of the present invention.

The device group 300 shown in FIG. 2 performs a third function (Function 3) and a fourth function (Function 4). The third function means, for example, to provide UX/UI for the user to participate in virtual reality for learning/evaluation. The fourth function means, for example, uploading result data of participating in virtual reality to the server 200 .

The server 200 illustrated in FIG. 2 performs a fifth function (Function 5), a sixth function (Function 6), a seventh function (Function 7), and an eighth function (Function 8).

The fifth function means, for example, creating a database (DB) for learning and evaluation criteria. The sixth function is defined to mean creating a database (DB) for learning and evaluation results based on data received by the device group 300 .

The seventh function means, for example, comparing and determining the DB generated in the fifth function and the DB generated in the sixth function. Furthermore, it includes a function of transmitting the comparison result as feedback data back to the device group 300 .

The eighth function, for example, generates guidelines according to academic achievement and test results, calculates the likelihood of passing related certifications, and recommends insufficient subjects.

Furthermore, a method of configuring a virtual subject class according to an embodiment of the present invention will be briefly described as follows.

1. Step 1 (Online Course)

The first XR content for online lectures is composed based on 7 weeks of the first half (or first semester).

The second XR content for online lectures is composed based on 7 weeks of the second half (or second semester).

2. Step 2 (Evaluation)

A virtual test is performed based on the first XR content and the second XR content.

3. Step 3 (Databaseization)

It compares the virtual test results and reference database, calculates grades, and provides information on related certifications.

The above-described XR contents may be configured with contents reflecting academic achievement for each subject (certificate), for example. In addition, the XR contents can be changed in real time according to the results for each academic achievement level. In addition, it is also possible to automatically generate evaluation basis data by collecting process data for the virtual reality experience and comparing it with the curriculum completion standard data.

On the other hand, the above-described third and fourth functions are usually performed by devices owned by users such as students, and since these devices are most likely located in the houses of students, etc., A technology for real-time monitoring of cheating is required.

Specific embodiments for implementing this will be described below in detail with reference to FIGS. 3 to 5 .

3 is a diagram for describing in detail a device group for a virtual test according to at least one embodiment of the present invention.

The device group (No. 300 in FIG. 1 and No. 300 in FIG. 2) for the virtual test described in the previous drawings is the mobile device 330 shown in (a) of FIG. 3, ( It is designed to include both the XR device 310 shown in b) and the XR controller 320 shown in FIG. 3(c).

Furthermore, the mobile device 330 is connected to the XR device 310 through wired or wireless short-range communication (eg, Bluetooth), and the XR device 310 is connected to the XR controller 320 through wired or wireless short-range communication again. connected. Of course, the XR controller 320 is directly connected to the mobile device 330 through wired or wireless short-range communication also falls within the scope of other rights of the present invention.

In the process of testing practical tests based on XR technologies such as AR, VR, etc., the most technically required is to monitor and prevent a substitute test by a user other than an authenticated user.

The present invention provides a solution for fundamentally eliminating user changes during the virtual test as well as the initial authentication process.

In order to implement this, as shown in (b) of FIG. 3 , the XR device 310 includes an external camera 311 , a first internal camera 312 , a second internal camera 313 , and an infrared detection sensor 314 . ) is designed to be additionally provided.

According to an embodiment of the present invention, the external camera 311 is additionally used to monitor the XR controller 320 . For example, when a virtual test (VT) is first performed, a method for monitoring whether an appropriate user grips the XR controller 320 but changes to another user during the test is required. To implement this, the external camera 311 is designed to detect whether the XR controller 320 is out of a field of view (FOV) range that can be photographed.

In addition, the first internal camera 312 is used to recognize the pupil, iris, and face of the user wearing the XR device 310 .

On the other hand, if the first internal camera 312 is designed to continuously take pictures, problems such as battery consumption and CPU performance degradation may occur.

To solve this problem, the XR device 310 according to an embodiment of the present invention additionally includes a second internal camera 313 and an infrared sensor 314 .

For example, if an object (EX: user) is not detected by the infrared sensor 314 after the virtual test, it may be assumed that the user undergoing the test is likely to be changed.

However, at this time, instead of automatically driving the first internal camera 312 , it is designed to preferentially drive the second internal camera 313 . When the user wears the XR device 310 for the first time, an image of the user's back head captured by the second internal camera 313 is stored in a memory (not shown) of the XR device 310 .

And, when the infrared sensor 314 detects that the user took off the XR device 310 and put it back on in the middle of the test, the second internal camera 313 re-photographs the user's back, and the degree of image change If is less than a preset threshold, the first internal camera 312 is not driven, and it is assumed that the user is the same (ie, no cheating occurs). Accordingly, there is an advantage in that unnecessary use of iris recognition and face recognition algorithms can be minimized.

Furthermore, as shown in (c) of FIG. 3 , the XR controller 320 is designed to include at least one fingerprint recognition sensor 321 . Furthermore, since the XR controller 320 is also provided with a motion recognition sensor (not shown), it is an essential component in order to virtually perform a practical test.

More specific embodiments will be described later in detail with reference to FIGS. 4 and 5 .

4 is a flowchart illustrating a control method of a system for monitoring fraudulent behavior of a virtual test in real time using an XR device, according to at least one embodiment of the present invention.

Those skilled in the art can supplementary interpretation of FIG. 4 with reference to FIGS. 3 and 5 . Furthermore, the steps shown in FIG. 4 are only an example, and changes, additions, or deletions in order according to the needs of those skilled in the art also fall within the scope of other rights of the present invention.

As shown in FIG. 4 , the XR controller 400 and the XR device 410 are connected wirelessly (eg, Bluetooth, etc.) or wired based on short-range communication ( S401 ).

Furthermore, the XR device 410 and the mobile device 420 are also designed to be connected wirelessly (eg, Bluetooth, etc.) or wired based on short-range communication (S402).

The mobile device 420 receives virtual test (VT) related XR content from at least one server 430 ( S403 ). The VT-related XR content corresponds to, for example, virtual content related to a practical test provided by a school/academy/national institution, and there is no particular limitation.

The mobile device 420 forwards the received XR content to the XR device 410 (S404).

The XR device 410 determines whether a command for triggering the XR content is received (S405). For example, when a graphic image inquiring whether to start the corresponding virtual test is displayed on the screen of the XR device 410 and a command to approve it is received, the XR device 410 performs the first authentication for the user The related information is extracted (S406). That is, at this time, the first internal camera 312 shown in FIG. 3 is designed to photograph the user's face or iris.

The XR device 410 transmits the extracted first authentication-related information to the at least one server 430 via the mobile device 420 (S407). Of course, direct communication of the XR device 410 with the server 430 also falls within the scope of other rights of the present invention.

The at least one server 430 primarily determines whether to authenticate the user based on the first human body information about the specific user stored in the memory (S408). The first biometric information includes, for example, at least one of an iris or an entire face of the user.

As a result of the determination (S408), when the user authentication is primarily successful, the at least one server 430 transmits a signal requesting second authentication-related information about the user to the XR controller 400 (S409) ). By designing in this way, a technical effect that can fundamentally prevent others from acting as a substitute for the practical test is expected.

Of course, passing through at least one of the XR device 410 or the mobile device 420 also falls within the other scope of the present invention.

In response to the request, the XR controller 400 extracts second authentication-related information about the user (eg, a fingerprint of a user holding the XR controller) (S410).

At this time, the fingerprint sensor 321 shown in FIG. 3 is designed to operate. Unlike the prior art, by designing the XR controller 400 to perform secondary user authentication, there is a technical effect that can fundamentally prevent illegal acts representing the practical test.

The XR controller 400 is designed to transmit the extracted second authentication-related information back to the at least one server 430 via the mobile device 420 .

The at least one server 430 determines whether or not the user is authenticated based on the second human body information stored in the memory (S411), and only when the user authentication is secondarily successful, the The XR device 410 may receive the final command for triggering the XR content to the server 430 (S412).

Therefore, even when the user inputs a command for the practical test in step S405 described above, the virtual practical test can be started only when both the first and second authentication described above are successful. There is an advantage in that surrogate testing can be fundamentally eliminated.

However, as described above in FIG. 4 , even if the user authentication is perfectly performed at the time of starting the virtual test, the possibility of a proxy test may occur in the middle of the test. Another embodiment of the present invention for solving such a problem will be described.

Although not shown in FIG. 4 , even after the XR content is triggered (S412), the XR device 410 monitors whether the first authentication-related information has changed based on a preset first criterion, and the XR controller 400 is designed to monitor whether the second authentication-related information is changed based on a preset second criterion. In particular, it is very important to experimentally design the first criterion and the second criterion to be different from each other, and will be described in more detail as follows.

Whether the time when the user is not detected by the infrared sensor of the XR device (No. 314 shown in FIG. 3, of course, replacing it with another proximity sensor is also within the scope of the present invention) exceeds the preset T1 reference time decide whether The reason for this determination is that if the user took off the XR device in the middle of the test, there is a possibility that someone else had to wear the XR device for cheating.

Therefore, only when the T1 reference time is exceeded, it is considered that the first criterion is satisfied. That is, only in this case, whether the first authentication-related information is changed or not is monitored.

However, even in this case, activating the user's face recognition or iris recognition immediately becomes a disadvantage in terms of battery consumption.

Therefore, the second internal camera 313 compares the first image taken and stored in the memory at the time when the first virtual test was started, and the second image taken again when the user is worn out after detection by the infrared sensor. process first.

When it is determined that the first image and the second image are the same, by maintaining the first internal camera (No. 312 in FIG. 3) for face recognition, iris recognition, etc. in a disabled state, unnecessary battery consumption/CPU There is a technical effect that can minimize the function.

The XR controller determines whether the time at which the external camera (No. 311 in FIG. 3 ) attached to the XR device deviated from the recordable Field Of View (FOV) exceeds a preset T2 reference time.

The reason that the XR controller has been moved to another location for a long time is because it is possible that someone else was holding the XR controller in the middle of the test.

Therefore, only when the T2 reference time is exceeded, it is considered that the second criterion is satisfied. That is, only in this case, whether the second authentication-related information is changed or not is monitored.

On the other hand, although only the first authentication-related information and the second authentication-related information have been described in FIG. 4 (of course, the server 430 maps to an ID for each user before the virtual test, and information such as a face, iris, fingerprint, etc. for each user) In addition, according to another embodiment of the present invention, the server 430 is designed to manage the user's third authentication-related information.

For example, before the virtual test, the mobile device 420 displays a graphical user interface (GUI) that induces/guides a user (examinee or student) to read a specific sentence.

The server 430 stores the voice data received from the mobile device 420 in a database by mapping it to an ID for each user.

Then, immediately after the command for triggering the virtual test shown in FIG. 4 is received (S405), the mobile device 420 displays a GUI for inducing/guiding to read the specific sentence again.

At this time, only when the received voice data is the same as the voice data pre-stored in the DB of the server 430, step S406 is designed to start. This is called speaker identification technology, and it is a technology that uses people's voices to identify who is speaking. Since each person has different voice characteristics depending on the voice organ and is affected by the individual's vocal habit, it is possible to distinguish the voices. For example, a Mel-Frequency Cepstral Coefficient (MFCC) algorithm may be adopted, but the scope of the present invention is not necessarily limited thereto.

Accordingly, the present invention has a technical effect of more completely blocking the illegal proxy of the virtual test by using three different types of authentication-related information.

And, FIG. 5 is a flowchart illustrating a control method of a server for monitoring fraudulent behavior of a virtual test in real time using an XR device, according to at least one embodiment of the present invention.

With reference to previous Figures 3 and 4, those skilled in the art supplementary interpretation of Figure 5 also falls within the other scope of the present invention.

In particular, while FIG. 4 mainly describes the operation of the entire system, FIG. 5, which will be described later, is described from the viewpoint of a server, which is a main entity for preventing fraudulent behavior of virtual tests.

According to an embodiment of the present invention, the server that monitors the fraudulent behavior of a virtual test using an eXtended Reality (XR) device in real time performs the following operations. Of course, deleting, adding, or changing some steps according to the needs of those skilled in the art also falls within the scope of the present invention.

Meanwhile, production and distribution of an application or software program in which all or some of the steps shown in FIG. 5 can be implemented also fall within the scope of the present invention.

The server according to an embodiment of the present invention transmits the virtual test-related XR content together with the encryption key value to the mobile device or the XR device (S510).

Of course, it is assumed that the mobile device, the XR device, and the XR controller are communicatively connected to each other by wire or wirelessly.

The server receives the first authentication related information about the user wearing the XR device from the mobile device or the XR device (S520).

The server primarily determines whether or not the user is authenticated based on the first human body information about the specific user stored in the memory (S530), and only when the user authentication is primarily successful as a result of the determination (S530), the user It is designed to request the second authentication-related information (eg, fingerprint information) for the mobile device or the XR device (S540).

The server receives the second authentication-related information about the user holding the XR controller from the mobile device or the XR device (S550).

The server determines whether user authentication is secondarily based on the second human body information about the specific user stored in the memory (S560), and only when the user authentication is secondarily successful as a result of the determination (S560), the A release key value capable of normally triggering XR content is transmitted to the mobile device or the XR device (S570).

In the previous figure 4, the XR device or XR controller has focused on actively detecting whether the user is not wearing, but the embodiment of FIG. 5 is designed to actively monitor whether the user is not wearing it from the server's point of view. There is a difference.

For example, the server transmits a request signal for whether the user is wearing the XR device to the mobile device or the XR device in a P1 cycle.

In addition, the server receives a signal indicating whether the user is wearing the XR device from the mobile device or the XR device.

When it is detected that the user is not wearing the XR device, the server is designed to transmit a command to drive an internal camera of the XR device (at least one of No. 312 or No. 313 shown in FIG. 3 ).

Meanwhile, the server transmits a request signal for whether the user is holding the XR controller to the mobile device or the XR device in a P2 cycle.

In addition, the server receives a signal indicating whether the user is holding the XR controller from the mobile device or the XR device.

When it is detected that the user is not holding the XR controller, the server is designed to transmit a command to drive the fingerprint sensor (No. 321 shown in FIG. 3 ) of the XR controller.

As a result of driving the internal camera (at least one of 312 or 313 shown in FIG. 3 ), the server is designed to increase the value of the P1 period only when there is no change in the user wearing the XR device. Accordingly, there is a technical effect of reducing both the amount of communication data and battery consumption between the server and other devices.

Furthermore, it will be said that designing the P1 period value in consideration of the total test time of the virtual test and the previous history pattern in which the user takes off the XR device for a while during the test is also within the scope of other rights of the present invention. More specifically, for example, if the same user took off the XR device 50 times or more out of 10 or more virtual tests, but the same user is still recognized again, the user is likely to be a simple pattern rather than cheating. It is more efficient to reduce the check process for

As a result of driving the fingerprint sensor (No. 321 shown in FIG. 3 ), the server is designed to increase the value of the P2 period only when there is no change in the user holding the XR controller.

In other words, by separately managing the act of not holding the XR controller and then again holding the XR device and the act of not wearing the XR device and then re-wearing it, it is possible to individually monitor fraudulent acts that may occur during the virtual test. It works.

The above description is merely illustrative of the technical spirit of the present invention, and various modifications and variations will be possible without departing from the essential characteristics of the present invention by those skilled in the art to which the present invention pertains.

Therefore, the embodiments disclosed in the present invention are not intended to limit the technical spirit of the present invention, but to explain, and the scope of the technical spirit of the present invention is not limited by these embodiments.

The protection scope of the present invention should be construed by the following claims, and all technical ideas within the equivalent range should be construed as being included in the scope of the present invention.

100: management client 200: server
300: device group 310: XR device
311: external camera 312: first internal camera
313: second internal camera 314: infrared detection sensor
320: XR controller 321: fingerprint sensor
330: mobile device

Claims (10)

In the control method of a system for monitoring the fraudulent behavior of a virtual test in real time using an XR (eXtended Reality) device,
connecting the XR device and the mobile device wirelessly or wired based on short-distance communication;
receiving, by the mobile device, the virtual test-related XR content from at least one server;
transmitting, by the mobile device, the received XR content to the XR device;
determining whether a command for triggering the XR content has been received;
extracting, by the XR device, first authentication-related information about the user when the command is received;
transmitting the extracted first authentication-related information to the at least one server via the mobile device;
determining, by the at least one server, whether or not the user is authenticated based on first human body information about a specific user stored in a memory;
requesting, by the at least one server, second authentication-related information for the user when the user authentication is primarily successful;
extracting, by the XR controller, second authentication-related information about the user according to the request;
transmitting the extracted second authentication-related information to the at least one server via the mobile device;
determining, by the at least one server, whether or not the user is authenticated, based on second human body information about a specific user stored in a memory; and
When the user authentication is secondarily successful, the XR device triggers the XR content
A control method of a system comprising a. According to claim 1,
After the XR content is triggered,
monitoring, by the XR device, whether the first authentication-related information has changed based on a preset first criterion; and
The XR controller includes the step of monitoring whether the second authentication-related information is changed based on a preset second criterion,
The method of controlling a system, characterized in that the first criterion and the second criterion are different from each other. 3. The method of claim 2,
The method of controlling a system, characterized in that it is considered that the first criterion is satisfied only when the time in which the user is not detected by the infrared sensor of the XR device exceeds a preset T1 reference time. 4. The method of claim 3,
The second criterion is considered to be satisfied only when the time when the XR controller deviates from a field of view (FOV) that can be photographed by an external camera attached to the XR device exceeds a preset T2 reference time system control method. 5. The method of claim 4,
The first body information includes at least one of the user's iris and the entire face,
The second body information, the control method of the system, characterized in that it includes the user's fingerprint. In the control method of a server for monitoring in real time the fraudulent behavior of a virtual test using an XR (eXtended Reality) device,
transmitting the virtual test-related XR content together with an encryption key value to a mobile device or an XR device;
Receiving first authentication-related information for a user wearing the XR device, from the mobile device or the XR device;
first determining whether or not the user is authenticated based on first human body information about a specific user stored in a memory;
requesting second authentication-related information about the user to the mobile device or the XR device when the user authentication is primarily successful;
receiving, from the mobile device or the XR device, second authentication-related information for a user holding an XR controller;
secondarily determining whether to authenticate the user based on second human body information about the specific user stored in the memory; and
When the user authentication is secondarily successful, transmitting a release key value capable of normally triggering the XR content to the mobile device or the XR device
A server control method comprising a. 7. The method of claim 6,
receiving, from the mobile device or the XR device, a signal indicating whether the user is wearing the XR device in a P1 cycle; and
transmitting a command for driving an internal camera of the XR device when it is detected that the user is not wearing the XR device
Control method of the server comprising a, 8. The method of claim 7,
receiving, from the mobile device or the XR device, a signal indicating whether the user is holding the XR controller in a P2 period; and
transmitting a command for driving a fingerprint sensor of the XR controller when it is detected that the user is not holding the XR controller
A server control method comprising a. 9. The method of claim 8,
increasing the value of the P1 period only when there is no change in the user wearing the XR device as a result of driving the internal camera; and
Increasing the value of the P2 period only when there is no change in the user holding the XR controller as a result of driving the fingerprint sensor
A server control method comprising a. delete

Images