WO2019019404A1

WO2019019404A1 - Safety education system based on image simulation technology

Info

Publication number: WO2019019404A1
Application number: PCT/CN2017/105550
Authority: WO
Inventors: 卢炀; 赵鹏祥; 刘胜强
Original assignee: 深圳市鹰硕技术有限公司
Priority date: 2017-07-25
Filing date: 2017-10-10
Publication date: 2019-01-31
Also published as: CN107402633B; CN107402633A

Abstract

Disclosed is a safety education system based on image simulation technology for K12-stage safety education, in particular for child users. According to the system, a main scene and a sub-scene are used, wherein the sub-scene simulates the case where a user observes a partial view of the main scene from a short distance; and a virtual image is generated by means of combining a collected image of a user with the main scene and the sub-scene, so that the user is in a specific test scene, and the safety protection awareness of the user can be determined objectively under safe conditions. Due to the absence of questioning or guidance, the user completes the test where no negative reminder is given, and the curiosity of the user is distinguished from the lack of safety awareness, and thus the development of the safety awareness of the user is determined more objectively.

Description

A Security Education System Based on Image Simulation Technology

Technical field

The present application relates to an education system based on image simulation technology, in particular to a security education system based on image simulation technology applied to the K12 stage, preferably for children.

Background technique

Whether in developed or developing countries, the harm of children’s injuries to physical and mental health and socio-economic losses is enormous. The prevention and control of accidental injuries in children has become one of the prominent public health problems. The occurrence of accidental injury is synchronous with economic development. In China, although economic development has just started, accidental injury has become a serious health problem in childhood, and due to the characteristics of certain economic, cultural and traditional customs in our country, children are made. The level of accidental injuries is at a very high level. At present, China is entering a period of frequent child safety accidents. From childhood to young adulthood is a period of strongest vitality, least health problems and lowest mortality, but children are at high risk of harm. Children are always vulnerable groups. They have the right to adequate security and guardianship. It is an important part of quality education to receive exercise and enhance their emergency response capabilities. It is important for educators to strengthen the protection of children, but more importantly, to help children enhance their self-protection, develop good behaviors and lifestyles, and create a safe cultural environment for them. Through various ways and means, we will conduct safety education for parents and children of all families, improve the awareness of safety and security of the whole society as soon as possible, especially strengthen the alertness and responsibility of adults, and realize the transformation of the safety education model. Prerequisites and guarantees for child injury prevention.

However, children's safety education work has its particularity. First, the children's mental development is not synchronized, which makes children of the same age have greater cognitive differences. Secondly, children's ability to express is limited, and it is difficult to understand their inner meaning through their language expression. In addition, when guiding children to raise awareness of safety precautions, it is difficult to grasp the scale of guidance. If they let go of their play or contact with dangerous goods, they may lead to serious accidents. If they are too strict, they may be the talent for their love. The suppression, for example, whether children in the kitchen who are boiling water can enter, is a difficult question. On the one hand, children of different ages with different mental developments will have different safety awareness, and even if the child can accurately tell the kettle It is a dangerous point, but because children's ability to move is weak, it is prone to deviations between behavior and thoughts, which may overturn the kettle that is boiling water and cause danger. If the adult repeatedly reminds the child to stay away from the kettle, in psychology, this is a negative reminder, which further stimulates the child’s inner subconscious to pay attention to the pot that is boiling water, or to make it a little kettle for a long time. The danger is similar to the story of "Wolf is coming."

There are very few safety education systems designed for children. Even if they are concerned, they only pay attention to educational content. Slightly the form of education, such as the Chinese invention patent CN102521784A discloses a child traffic safety club system, which includes a total platform application module, a back-end database, a sub-platform application module, a background maintenance management module, and the background maintenance management module includes a total platform background management module. a sub-platform background management module, wherein the background database is read and written by the background management module and the sub-platform application module, and the total platform application module reads from the background database, and the sub-platform background management module controls the management office. Referring to the sub-platform application module, the total platform background management module controls and manages the total platform application module. This technical solution does not differ from the ordinary adult education system if it excludes the content of the back-end database about children's education.

CN105279721A discloses a comprehensive management system for student off-campus activities, a student function module, a parent function module, a merchant function module, a platform management module and a third-party interface module. The hardware device includes an identification device, a supervision device and a virtual reality device, and the identification device includes Identification cards, smart phones and wearable devices; supervisory devices include identification device readers and cameras, network video recorders, and check-in sensing devices; virtual reality devices conduct virtual reality learning education through virtual wearable devices. The system can standardize the management of student custody, counseling and training institutions, improve the quality of service management and service quality, enable parents to understand the learning and training of students, and strengthen the relationship between student custody, counseling and training institutions and parents, students and businesses. And to effectively supervise the child's personal safety and diet health, and let the children through the virtual reality equipment, access to the latest technology, entertain and educate, and promote comprehensive development. In particular, VR devices are used to simulate real-world scenarios, but this technical solution also stays at the level of hardware connectivity and business models.

Many scholars have also joined this field to explore child safety education. "Research on interactive experience training system for children's traffic safety education based on VR", it is considered that virtual reality technology is used to create a three-dimensional virtual traffic experience scene and realize human-computer interaction function. The traffic safety education and training system not only allows the children and young people to be immersed in the virtual traffic environment, but also learns various traffic behaviors to learn traffic safety knowledge, and can also safely cross the road in a realistic virtual traffic environment. Training to improve their ability to cross the road correctly, avoid collisions with motor vehicles, and reduce traffic accidents. However, it is very important for safety education to discover the details of children's cognitive bias. The scene environment of VR simulation is too single, which is not conducive to the deepening of education.

In the prior art, there is also proposed a virtual reality human-computer interaction child education experience system based on a mobile terminal, including a mobile device terminal, a large-screen display device, a somatosensory interaction device, and a background server, wherein the mobile device terminal is provided with graphic recognition data. The identification module and the data interaction client, the graphic identification data identification module and the data interaction client respectively connect to the background server through the network, and the background The server is connected to the somatosensory interaction device, and the somatosensory interaction device and the data interaction client are respectively connected to the large-screen display device; compared with the prior art, the present invention can be presented in a dynamic sound, image, and interactive manner, so that the youth can be more imaged. A more thorough understanding of scientific knowledge in a three-dimensional way enhances the child's ability to do things. However, this system actually only allows the child to passively accept the predetermined information. The child feels novelty in addition to seeing that his actions are fitted into the scene, and does not have the subjective will to actively think and act autonomously.

There is also proposed a virtual reality device and a virtual reality image generation method, the virtual reality device comprising a plurality of scene cameras, two display screens, a central processing unit, an optical system, a field programmable gate array and a nine-axis motion sensor, and a plurality of The scene camera is connected to the field programmable gate array, the field programmable gate array is connected to the central processing unit, the nine-axis motion sensor is connected to the central processing unit, the two display screens are connected to the central processing unit, and the optical system is fixed to the user's eyes when in use. And between the two display screens, the central processing unit is connected with the field programmable gate array, the two display screens and the nine-axis motion sensor to generate a virtual reality image by combining the real scene image, the user body part motion information and the virtual scene image, thereby The user can view the virtual reality scene combined with the real scene through the display to improve the availability of the virtual reality device. Similarly, in this system, in addition to seeing that their actions are fitted into the scene, the child does not have the subjective will to actively think and act autonomously.

In addition, in the prior art, more attention is paid to the hardware, such as the naked-eye 3D technology, the optical acquisition unit uses a multi-eye actual camera to form a stereo camera array, and captures the actual camera image of the actual scene at multiple angles, and interacts. The unit issues triggers and manipulation commands to the three-dimensional rendering unit according to the position, posture or motion of the viewer, and the three-dimensional rendering unit renders the three-dimensional virtual objects and scenes in real time, and transmits them to the naked-eye 3D synthesis unit together with the actual camera images to perform images. Superimposing, obtaining a mixed image of the actual camera image and the rendered image as a parallax image, outputting to the naked-eye 3D display unit for three-dimensional display; the viewer can see the three-dimensional display effect of the actual scene and the virtual scene, and mix the virtual The superposition of the object and the actual scene, and the viewer can interact with the virtual object, greatly increasing the interest of the naked-eye 3D display unit, and more easily attracting people's attention. This technique is only virtual and more realistic, but can not solve the child safety protection. The issue of awareness education.

Another example is the method of operating a computer and a mobile phone in a virtual world. The two lasers on the glasses and the two cameras acquire human body image information to control the body of the virtual world on which the two projectors on the glasses are projected onto the eyes. Operate computers and mobile phones in the virtual world, and better experience somatosensory games and virtual reality; devices that operate computers and mobile phones in the virtual world, including: glasses, main body (mobile phone system, CPU, GPU, ROM, RAM) , hard drive, external storage, Bluetooth, wireless connection, Gyros, sensors, batteries), microphones, speakers, lasers, cameras, projectors. Two projectors on the glasses are connected to the main body to project the virtual world onto the eyes; the laser and the camera acquire the human body image information and transmit it to the main body for processing to control the body in the virtual world, realizing the real world body control projector projection The body in the virtual world; the real world body controls the virtual world's body to operate the virtual world's computers and mobile phones, thereby replacing all functions of the computer and mobile phone, in which the virtual world projected by the projector is controlled by the body in the real world. The body inside, processed by the host operating software, can zoom in and out of the virtual world screen, move the position and angle. If the virtual world screen displays a 3D picture, it can be processed by the virtual reality software in the host, and you can choose to zoom in and out. The world becomes a new virtual world. It can also exit the new virtual world and return to the original virtual world through actions or gestures. It can simultaneously operate several computers and mobile phones in the virtual world. It can be seen from the above description that the technology of the main scene and the sub-scene has appeared in the prior art, but the system cannot be used to educate children on the awareness of security protection. The above technology emphasizes that the operation in the virtual world replaces the actual operation. However, children's education on safety awareness needs to evaluate children's cognition of an event by presupposing various triggering conditions. In other words, the prior art emphasizes the use and control of the system by humans. People need a lot of time to master, and children's education on safety awareness is used to systematically examine and evaluate people. This system does not require children to control the system. Children only need to act according to their own instinctive actions. Just fine. Therefore, from the perspective of the system's construction, the difference between the two is huge.

How to make an objective judgment on children's safety awareness, how to provide tests without negative reminders to children is a technical problem that psychologists or educators have long expected to solve.

Summary of the invention

It is an object of the present invention to provide an educational system based on image simulation technology that allows a user of the K12 stage, particularly a child user, to assess the development of a child's safety awareness without guiding, augmenting or interfering with the child.

Specifically, the present invention is achieved by the following technical solutions:

A security education system based on image simulation technology, characterized in that it comprises:

a camera unit that captures an image of at least a portion of a user's body,

a monitoring processing module, which generates an image of the three-dimensional stereoscopic image by the image captured by the camera unit;

a master control unit that generates a virtual image by jointly acquiring a three-dimensional stereo image generated by the processing module and scene information of the database;

a display module, configured to display the virtual image;

The scene information includes a main scene and a plurality of sub-scenarios. The main scene is provided with a preset condition for triggering a sub-scene according to a preset three-dimensional stereo image, and the sub-scene is an enlarged display of a partial image of the main scene, and the total control unit is configured according to the user. The three-dimensional image in the sub-scene evaluates the user's security awareness.

The camera unit includes at least a first camera device and a second camera device. The first camera device and the second camera device simultaneously collect images of motion of at least a portion of the user's body. The control unit includes a control unit, a database, a data processing module, and an image. Output module,

The monitoring processing module sends the three-dimensional stereo image to the control unit, and the control unit sends the three-dimensional stereo image to the data processing module, the database sends the scene information to the data processing module, and the data processing module generates the virtual image and sends the virtual image to the display module through the image output module. display.

The three-dimensional image of the user is generated together with the main scene, and the virtual image is displayed on the display module. In the main scene, the trigger condition of the captured three-dimensional image of the user is triggered to enter a sub-scene.

The sub-scene is an enlarged image created based on at least part of the data of the main scene or a part of the image, which simulates the user to closely observe the details of the image in the main scene, and presets the three-dimensional image of the collected user to trigger and enter The trigger condition of the next sub-scenario or the trigger condition for returning to the main scene or ending the evaluation.

The triggering condition of the three-dimensional image of the user that is collected by the preset is triggered in the sub-scene to enter other sub-scenarios of the same level.

The control unit is connected to the server through the network, and the server is connected to multiple security education systems. When multiple security education systems are in the same sub-scene state, any security education system will acquire the movement of at least a part of the body of the user of other security education systems. Image.

Wherein, the camera unit further comprises a wide-angle camera placed above the field of the safety education system.

A security education method based on image simulation technology, which is based on the aforementioned security education system,

S1: The main control unit creates a main scene and displays it on the display module;

S2: the monitoring processing module controls the camera unit to collect the user image, and generates a three-dimensional stereoscopic image;

S3: the main control unit simulates the main scene and the three-dimensional stereo image into a virtual image and displays on the display module; if the three-dimensional stereo image satisfies the trigger condition of the main scene, the main control unit creates a sub-scene corresponding to the trigger condition and displays Displayed on the module;

S4: The main control unit simulates the sub-scene and the three-dimensional stereo image into a virtual image and displays on the display module If the three-dimensional stereoscopic image satisfies the trigger condition of the sub-scene, the master control unit creates another sub-scenario of the same level, the next-level sub-scene or the main scene corresponding to the trigger condition and displays on the display module, or if the three-dimensional stereoscopic image When the exit condition is satisfied, the evaluation is exited, and the master control unit evaluates the user's security awareness according to the three-dimensional image of the user in the sub-scene.

Among them, S2 includes:

S21: The wide-angle camera acquires an image of the preset area;

S22: The monitoring processing module performs two-dimensional coordinate processing on the image of the preset area;

S23: The monitoring processing module sends the image of the two-dimensional coordinate processing to the control unit of the main control unit;

S24: The control unit of the master control unit determines whether a portrait is detected in the image of the preset area, and if so, executes S25, and if not, executes S21;

S25: The control unit transmits the coordinates of the portrait in the wide-angle camera image to the first imaging device and the second imaging device of the imaging unit, according to which the first imaging device and the second imaging device can respectively collect at least a part of the user's body. Moving two-dimensional image, then enter S26, if not, return to S21;

S26: the motion graphics processing module obtains the motion image, the motion graphics processing module is connected to the conversion unit, and the conversion unit processes the image in S25 into a three-dimensional stereo image;

S27: The control unit determines whether there is a gesture for triggering the main scene or the sub-scene or exiting the evaluation in the three-dimensional stereoscopic image in S26, and if so, executing S29, and if not, executing S25.

S28: The control unit instructs the database to call the scene data corresponding to the gesture or exits the evaluation.

The triggering condition is that the entering gesture is a finger forward image, and the exit is a swinging image. When the fingertip of the finger image points to a partial image in the main scene or the sub-scene, the database invokes the sub-scene corresponding to the partial image or the next. A sub-scenario or other sub-scenario at the same level.

The beneficial effects of the invention are:

For the characteristics of the K12 stage user, the present application combines the captured user image with the main scene and the sub-scene to generate a virtual image, so that the user is in a specific test scenario, and sets the trigger sub-scenario according to the actual requirements of the security education. The condition can be objectively judged by the user's security awareness under safe conditions. The sub-scene is the local information of the main scene or the pattern enlarged pattern, which simulates that the user will pay more attention and more visual attention. Projecting to the scene pattern or scene information of interest, if the user loses interest, he can return by gestures, etc., which is also the expression of the subjective will of the user. Since there is no question or guidance during the whole evaluation process, the user does not have a negative reminder. After the test is completed, all the behaviors are subjective manifestations of the user. The user triggers the sub-scene but as long as the dangerous action corresponding to the preset trigger condition is not made, the behavior is not dangerous, so Differentiate the user's curiosity from the lack of security awareness, and judge the development of user's security awareness more objectively.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

1 is a schematic structural diagram of a security education system based on image simulation technology provided by the present invention;

2 is a schematic diagram of a virtual image of the present invention;

Description of the reference numerals

In order to further clearly illustrate the structure of the present invention and the connection relationship between the components, the following reference numerals are given and explained.

Display module 1, monitoring processing module 2, motion graphics processing module 21, conversion unit 22, overall control unit 3, control unit 31, database 32, data processing module 33, image output module 34, imaging unit 4

The technical solutions of the present invention can be more clearly understood and described in conjunction with the embodiments of the present invention.

Detailed ways

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. The following description refers to the same or similar elements in the different figures unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with aspects of the invention as detailed in the appended claims.

The terminology used in the present invention is for the purpose of describing particular embodiments, and is not intended to limit the invention. The singular forms "a", "the" and "the" It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

It should be understood that although the terms first, second, third, etc. may be used to describe various information in the present invention, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. separate. For example, the first information may also be referred to as the second information without departing from the scope of the invention. Similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "when" or "when" or "in response to determination."

The invention will be described in detail below by way of examples.

A security education system based on image simulation technology, which is mainly used for preschool users (children) to evaluate the self-security protection awareness of users at this age. The specific method is that the camera unit 4 acquires an image of the user, and the camera unit 4 There are two or more imaging devices, and in one embodiment, the imaging device is a first camera and a second camera, and the monitoring processing module 2 is configured to process the image collected by the imaging unit 4, and A camera and a second camera are configured to capture user images from different angles.

The monitoring processing module 2 controls the imaging unit 4 to collect images of the user at a predetermined frequency, and the collected images are sent to the motion graphics processing module 21, and the images that are continuously acquired are numbered in the order of acquisition.

The action graphic processing module 21 of the monitoring processing module 2 is connected with a converting portion 22, and the converting portion 22 processes the continuously acquired image into a three-dimensional image, that is, collects different angles obtained by the first camera and the second camera. The image generates a three-dimensional image. Specifically, the first camera obtains a first motion trajectory of the user's body in the first projection direction, and the second motion trajectory of the second camera in the second projection direction, the first motion trajectory and the second motion trajectory are A three-dimensional motion trajectory is spatially fitted, that is, all planes passing through the first motion trajectory intersect with all planes passing through the second motion trajectory, and a unique three-dimensional motion trajectory is obtained.

The conversion unit 22 of the monitoring processing module 2 is connected to the control unit 31 of the overall control unit 3, and the control unit 31 is also connected to the database 32 and the data processing module 33.

The database 10 stores scene data corresponding to different evaluation topics. Such as scene mode, sound data and so on.

The control unit 31 transmits the image information transmitted from the conversion unit 22 to the data processing module 33, and controls the database 10 to call and send the corresponding scene data to the data processing module 33. In the data processing module, the user image and the scene data are simulated. A virtual image is sent to the display module via image output module 34.

A security education method based on image simulation technology, which is based on the aforementioned security education system, specifically:

S1: The main control unit 3 creates a main scene and displays it on the display module 1;

S2: the monitoring processing module 2 controls the camera unit 4 to collect the user image, and generates a three-dimensional stereoscopic image;

S3: The main control unit 3 simulates the main scene and the three-dimensional stereo image into a virtual image and displays it on the display module 1; if the three-dimensional stereo image satisfies the trigger condition of the main scene, the main control unit 3 creates a sub-scene corresponding to the trigger condition. And displayed on the display module 1;

S4: the main control unit 3 simulates the sub-scene and the three-dimensional stereo image into a virtual image and displays it on the display module 1; if the three-dimensional stereo image satisfies the trigger condition of the sub-scene, the main control unit 3 creates the same corresponding to the trigger condition. The other sub-scene, the next sub-scenario, and the main scene are displayed on the display module 1, and the main control unit 3 evaluates the user's security awareness according to the three-dimensional image of the user in the sub-scene.

Preferably, the camera unit 4 further includes a wide-angle camera. Since the test site is large, the first camera device and the second camera device are difficult to accurately align an image of a part of the user's body, so the user is pre-positioned by the wide-angle camera. The position of the user is aligned with the first camera device and the second camera device, specifically:

S21: The wide-angle camera acquires an image of the preset area;

S22: The monitoring processing module 2 performs two-dimensional coordinate processing on the image of the preset area;

S23: The monitoring processing module 2 sends the image of the two-dimensional coordinate processing to the control unit 31 of the main control unit 3;

S24: The control unit 31 of the master control unit 3 determines whether a portrait is detected in the image of the preset area, and if so, executes S25, and if not, executes S1;

S25: The control unit 31 transmits the coordinates of the portrait in the wide-angle camera image to the first imaging device and the second imaging device of the imaging unit 4, according to which the first imaging device and the second imaging device can each collect at least the user's body. a part of the moving two-dimensional image, then enter S6, if not, return to S1;

S26: the motion graphics processing module 21 obtains the motion image, the motion graphics processing module 21 is connected to the conversion unit 22, and the conversion unit 22 processes the image in S5 into a three-dimensional stereo image;

S27: The control unit 31 determines whether there is a gesture for triggering the main scene or the sub-scene or exiting the evaluation in the three-dimensional stereoscopic image in S6, and if so, executing S9, and if not, executing S5.

S28: The control unit 31 instructs the database to call the scene data corresponding to the gesture or exits the evaluation.

The trigger condition is that the enter gesture is a finger forward image, and the exit is a swing hand image. When the fingertip of the finger image points to a partial image in the main scene or the sub scene, the database invokes the sub scene corresponding to the partial image or the next level. Scene or other sub-scenario at the same level.

An example of a virtual image is shown in Fig. 2. After the user's hand moves the displacement of a spatial curve, the displacement of the spatial curve is fitted with the scene data. For example, in the display module, the user can Seeing that your hand moves the displacement of a spatial curve, and that displacement will have a preset reference in the scene to increase the realism of the scene. That is, the user will have a scene in which the predetermined theme is placed.

In the scene data, the scene will be recorded in the form of a main scene and a sub-scene, and a certain sub-scene is triggered according to the action of the user in the main scene, and the control unit 31 evaluates the user's awareness of the security protection according to the data in the sub-scene. Development, specifically including:

Generating a main scene, and preset a trigger condition of the captured user's image to enter a sub-scene, and the user image is generated together with the main scene to generate a virtual image;

If the trigger condition is triggered, the sub-scene is generated, and the sub-scene is based on the partial data of the main scene or the enlarged image created by the partial image, and presets the trigger condition of the captured user's image to enter the next-level sub-scene. Or return to the main scene or end the assessment.

During the test, the user will be in a main scene that is common in life. There is no obvious guiding sign in the scene. The user completely makes an action based on his own judgment to trigger the entry into the sub-scene. The priority is in the main scene. Provide trigger conditions for multiple sub-scene.

Preferably, the control unit 31 is connected to the server through the network, and the server can be connected to the plurality of systems for evaluation at the same time. The control unit 31 uploads the local sub-scene to the server, and the server matches the data according to the sub-scene, if another The system also uploads the same subsystem, and the image of the customer of the other system will also be sent to the control part of the system to fit the scene data together with the user image of the system.

Example 1:

The main scene is a kitchen. The kitchen is equipped with a storage rack and a kitchen cabinet. The storage rack is placed on a biscuit bucket and a tall glass placed on one side of the cabinet. The kitchen cabinet has an apple and a pear. A kettle that is boiling water and steaming, the apple is away from the kettle, and the pear is close to the kettle. This is a very common life scene. For the user, there is no special guidance in the scene. In the main scene, the cookie bucket, apple, pear, and kettle are the trigger conditions for the four sub-scene, and the user uses the preset gesture to trigger the entry. A sub-scene, if you point to an item by hand, enters the sub-scene. When entering the sub-scene of the cookie bucket, the user will control the image of his own hand to coincide with the image of the cookie bucket to simulate the pickup action. The user tries to avoid the image of his hand and the reference object of the tall glass, indicating that the user has certain security awareness; if the user triggers the apple sub-scene, because the user does not have any danger, the user will image the hand with the apple. After the reference object is overlapped, the evaluation will be withdrawn; if the user enters the sub-scenario of the pear, if the user tries to avoid the image of his hand and the reference object of the kettle, the user has a certain sense of safety protection; if the user enters the kettle Sub-scenario, this does not mean that the user does not have Safety awareness, this may be caused by user curiosity, or it may be that the user wants to see if the kettle faucet really emits a large amount of steam to judge whether the water is open or not. If the user further makes a reference to the kettle. The gesture of the object indicates that the user's security awareness is very poor. If the user makes a gesture of returning to the main scene, the user has a certain awareness of security protection.

Throughout the evaluation process, only one user is active in the scene, there is no guidance or guidance from the adult, and there is no guidance or guidance of the scene itself. For the sub-scene, there is no additional safety or unsafe evaluation. Rather, there is an unsafe evaluation gesture path in the sub-scene, and only when the user moves the gesture along the unsafe path will there be an unsafe evaluation.

Example 2:

The main scene is a wild scene. The wild scene is set up with a small river and a tree. A dog and a well are lying in a meadow. This is a very common field scene. For the user, there is no special guidance in the scene. In the main scene, a small river, a tree, and a well are the trigger conditions of the sub-scene, and the user triggers with a preset gesture. Enter one of the sub-scene, when entering the sub-scenario of the creek, if the user will control his body image away from the image of the tree near the river, enter the sub-scenario of the tree, this time does not make an evaluation but enters the next Round evaluation, if the exit gesture is made, the sub-scene is exited, indicating that the user has a certain awareness of security protection; if the user enters a sub-scenario of a dog or a well, this does not mean that the user does not have a security awareness, which may be user curious Due to the heart, it may be that the user wants to observe the dog and the well at a close distance. If the user further makes an action near the dog and the well, the user's safety awareness is poor, if the user makes a return to the main scene. Gestures indicate that the user has a certain sense of security protection. Further, in the sub-scenario of the well, the flower image away from the well or close to the well can be added, and the flower is used as the next sub-scenario to further test the user's safety awareness.

If in the online mode, that is, multiple systems are connected through the server, multiple users enter the dog's sub-scene at the same time. If the image of one of the users' hands is close to the dog's image, the other users exit the test or return to the main scene. Have a certain sense of security protection. This online mode is a good way to simulate real-world scenarios, especially to alert users to large-scale group stamping events or insecure environmental chain reaction events.

The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalents, improvements, etc., which are made within the spirit and principles of the present invention, should be included in the present invention. Within the scope of protection.

Industrial applicability

The application uses the collected image of the user to generate a virtual image in combination with the main scene and the sub-scene, so that the user is in a specific test scenario, and according to the actual requirements of the security education, the conditions for triggering the sub-scene are set, which can be safe. Under the conditions, the user's security awareness is objectively judged.

Claims

A security education system based on image simulation technology, characterized in that it comprises:

a camera module that captures an image of at least a portion of a user's body,

a monitoring processing module, which generates an image of the three-dimensional stereoscopic image by the image captured by the camera module;

a master control module, which combines the three-dimensional stereo image generated by the monitoring processing module with the scene information of the database to generate a virtual image;

a display module, configured to display the virtual image;

The master control module evaluates the user's security awareness based on the user's three-dimensional image in the database scene.
The security education system according to claim 1, wherein the scene information comprises a main scene and a plurality of sub-scene, and the main scene is provided with a preset condition for triggering the sub-scene according to the preset three-dimensional stereo image, and the sub-scene is mainly An enlarged display of a partial image of the scene, the master control module evaluates the user's security awareness according to the three-dimensional image of the user in the sub-scene.
The security system according to claim 2, wherein the camera module comprises at least a first camera device and a second camera device, wherein the first camera device and the second camera device simultaneously capture images of motion of at least a portion of the user's body, and the overall control The module includes a control unit, a database, a data processing module, and an image output module.

The monitoring processing module sends the three-dimensional stereo image to the control unit, and the control unit sends the three-dimensional stereo image to the data processing module, the database sends the scene information to the data processing module, and the data processing module generates the virtual image and sends the virtual image to the display module through the image output module. display,

Wherein, the camera unit further comprises a wide-angle camera placed above the field of the safety education system.
The security system according to claim 2, wherein the user three-dimensional image is generated together with the main scene and the virtual image is displayed on the display module, and the three-dimensional image of the user that is preset is triggered in the main scene to enter a The trigger condition of the sub-scene.
The security education system according to claim 4, wherein the sub-scene is an enlarged image created based on at least part of data or a partial image of the main scene, which simulates a user to closely observe details of an image in the main scene, and pre-predicts The three-dimensional stereoscopic image of the collected user is triggered to enter the trigger condition of the next-level sub-scene or the trigger condition for returning to the main scene or ending the evaluation.
The security education system according to claim 5, wherein the sub-scene presets the trigger condition of the captured three-dimensional image of the user to enter other sub-scenarios of the same level.
The security education system according to claim 6, wherein the control unit communicates with the network The servers are connected, and the server is connected to a plurality of security education systems. When multiple security education systems are in the same sub-scene state, any one of the security education systems will acquire images of movements of at least a portion of the user's body of other security education systems.
A security education method based on image simulation technology, based on the security education system according to claims 1-7, characterized in that:

S1: the master control module creates a main scene and displays it on the display module;

S2: the monitoring processing module controls the camera module to collect the user image, and generates a three-dimensional stereoscopic image;

S3: the master control module simulates the main scene and the three-dimensional stereo image into a virtual image and displays on the display module; if the three-dimensional stereo image satisfies the trigger condition of the main scene, the master control module creates a sub-scene corresponding to the trigger condition and displays Displayed on the module;

S4: the master control module simulates the sub-scene and the three-dimensional stereo image into a virtual image and displays on the display module; if the three-dimensional stereo image satisfies the trigger condition of the sub-scene, the master control module creates another sub-scenario of the same level corresponding to the trigger condition. The next-level sub-scene or main scene is displayed on the display module, or if the three-dimensional stereo image satisfies the exit condition, the evaluation is exited, and the overall control module evaluates the user's security awareness according to the user's three-dimensional image in the sub-scene.
The security education method based on image simulation technology according to claim 8, wherein S2 comprises:

S21: The wide-angle camera acquires an image of the preset area;

S22: The monitoring processing module performs two-dimensional coordinate processing on the image of the preset area;

S23: The monitoring processing module sends the image of the two-dimensional coordinate processing to the control unit of the master control module;

S24: The control unit of the master control module determines whether a portrait is detected in the image of the preset area, and if so, executes S25, and if not, executes S21;

S25: The control unit sends the coordinates of the portrait in the wide-angle camera image to the first imaging device and the second imaging device of the camera module, and according to the coordinates, if the first imaging device and the second imaging device are capable of collecting at least a part of the user's body Moving two-dimensional image, then enter S26, if not, return to S21;

S26: the motion graphics processing module obtains the motion image, the motion graphics processing module is connected to the conversion unit, and the conversion unit processes the image in S25 into a three-dimensional stereo image;

S27: The control unit determines whether there is a gesture for triggering the main scene or the sub-scene or exiting the evaluation in the three-dimensional stereoscopic image in S26, and if so, executing S29, if not, executing S25;

S28: The control unit instructs the database to call the scene data corresponding to the gesture or exits the evaluation.
The security education method based on image simulation technology according to claim 8, wherein The trigger condition is that the enter gesture is a finger forward image, and the exit is a swing hand image. When the fingertip of the finger image points to a partial image in the main scene or the sub scene, the database invokes the sub scene corresponding to the partial image or the next level. Scene or other sub-scenario at the same level.