TWM537675U - Interactive virtual input augmented-reality device - Google Patents

Description

Interactive virtual input augmented reality device

This creative department is about an interactive virtual input augmented reality device, especially a device that allows users to immerse themselves in the simulation scene and conduct interactive learning through augmented reality to obtain good problem processing capabilities.

According to the geographical location of Taiwan, natural disasters such as earthquakes, typhoons, floods, and earth-rock flows continue to occur, and man-made disasters such as fires, dust explosions, and poisonous gas leaks are also emerging. Whether it is natural disasters or human accidents, disasters are brought to people. Heavy casualties and threats.

When disasters such as earthquakes, typhoons, floods, landslides and fires occur, in addition to relying on firefighting units and other aids, the emergency response capability of the people is even more important. When disasters such as earthquakes, typhoons, floods, landslides and fires come, the general public With sufficient knowledge of disaster prevention, you can have enough ability to protect yourself. Therefore, disaster prevention education and training is an indispensable course for modern people. It should even be trained as a habitual reflex action in earthquakes and typhoons. When disasters such as floods, landslides, and fires occur, the shortest time can be used to make a correct judgment, and various disaster prevention and refuge equipment should be used to escape the scene to ensure that they face earthquakes, typhoons, floods, landslides, and fires. We will not lose our ability to survive because of panic, so it is extremely important to implement disaster prevention education so that people can understand how to protect themselves in the first time facing various disasters.

In the past two decades, the Ministry of Education and other units have many plans for disaster prevention education. And textbooks, but they are mainly based on prevention knowledge, and these materials lack interaction, fun and authenticity, it is difficult to attract learners' motivation and interest, and lack of live simulation and specific experience. Therefore, it is difficult for learners to internalize the knowledge they have learned and to acquire the ability to apply such knowledge. In the event of a real disaster, they often fail to effectively protect themselves and lose the opportunity to survive. To enable learners to reflect through specific experiences or experiences, internalize knowledge and acquire the ability to use knowledge, and help to improve people's ability to prevent disasters.

The reason is that this creator has not only made it difficult for learners to interest, but also to internalize the knowledge learned, in order to obtain the lack of substantive protection and self-ability, in view of the lack of interactivity, fun, authenticity and experience of the existing disaster prevention education. After discussing this with many disaster prevention experts, the creator has been assisting in creating this creation through many years of experience in manufacturing and design and knowledge in related fields.

This creative department is about an interactive virtual input augmented reality device, the main purpose of which is to provide a user with the ability to immerse in the simulation field and conduct interactive learning through augmented reality to obtain good problem processing ability. Device.

In order to achieve the above-mentioned implementation purposes, the present author has developed the following interactive virtual input augmented reality device, which mainly comprises: a head-mounted display, which is provided with a set of standings in front of the head-mounted display, and the head is The wearable display device is formed with at least one window portion on the inner side of the set of the mobile device; the mobile electronic device is configured to implement the processing unit, a data storage unit, a photographing unit, an operation and display unit, and a communication unit. And make this The data storage unit, the photographing unit, the operation and display unit, and the communication unit are coupled to the processing unit, and the mobile electronic device is disposed in the group of the head mounted display, and the operation and display of the mobile electronic device are performed. The unit faces the window portion on the inner side of the head mounted display, and the camera unit of the mobile electronic device faces the outside of the head mounted display; a cloud server establishes a processing unit, a database and the cloud server a communication unit, and the database and the communication unit are coupled to the processing unit thereof, and the communication unit of the cloud server is communicatively coupled with the communication unit of the mobile electronic device; a human-computer interaction program enables the human-computer interaction The program is stored in the database of the cloud server, and the human-computer interactive program includes a virtual reality module, an augmented reality module, a scenario module, a problem module, a status simulation module, and a The problem solving module and a program management module are connected to each module by the processing unit of the cloud server.

The interactive virtual input augmented reality device as described above, wherein the head mounted display is further provided with a stereoscopic imaging optical component in its window portion.

The interactive virtual input augmented reality device as described above, wherein the head mounted display is provided with two opposite window portions, and a stereoscopic imaging optical component is further disposed in each of the two window portions.

The interactive virtual input augmented reality device as described above, wherein the interactive virtual input augmented reality device further comprises an application for storing the application in a database of the cloud server for The mobile electronic device is downloaded and installed to its data storage unit, so that the mobile electronic device is connected to the human-computer interaction program of the cloud server via the application.

In this way, when the creation is implemented, the user is wearing a wearable display. The mobile device is provided with mobile electronic devices, and the mobile electronic device is connected with a human-computer interaction program stored in a cloud server to display a virtual live image on the mobile electronic device, so that the user is immersed in the simulation site, and Through the augmented reality of the headset, the virtual input method is used to enhance the interaction with the user, so that the user can internalize the knowledge through the specific experience and experience. According to this, the user can effectively assist the user to experience the actual situation. Problem handling ability.

(1)‧‧‧ head mounted display

(11)‧‧‧Three-dimensional imaging optical components

(2) ‧‧‧Mobile electronic devices

(21) ‧‧‧Processing unit

(22)‧‧‧ Data storage unit

(23)‧‧‧Photographic unit

(24)‧‧‧Operation and display unit

(25) ‧‧‧Communication unit

(3) ‧‧‧Cloud Server

(31)‧‧‧Processing unit

(32)‧‧‧Database

(33) ‧‧‧Communication unit

(4) ‧ ‧ human-computer interaction program

(41) ‧‧‧Virtual Reality Module

(42) ‧‧‧Augmented Reality Module

(43) ‧‧‧ Drama Module

(44)‧‧‧ Problem Module

(45) ‧‧‧Status Simulation Module

(46)‧‧‧Question module

(47) ‧‧‧Program Management Module

(5)‧‧‧Applications

The first picture: the architecture diagram of this creation

The second picture: the flow chart of the use state of this creation

The third picture: the state of use of this creation (1)

The fourth picture: the state of use of this creation (2)

In order to make the technical means of this creation and the effects it can achieve, it can be more completely and clearly disclosed. For details, please refer to the drawings and drawings of the disclosure: First, please refer to the first figure. The interactive virtual input augmented reality device of the present invention mainly comprises: a head-mounted display (1), which is provided with a set of vertical parts in front of the head-mounted display (1), and the head wear is The display (1) is formed on the inner side of the group of the at least one window portion. The second embodiment is a preferred embodiment, and a stereo imaging optical component (11) is disposed in each of the two window portions; a mobile electronic device (2), which can be a smart phone, a personal digital assistant (PDA) or a tablet computer, etc., such that the mobile electronic device (2) has a processing unit (21), a data storage unit (22), a photography unit (2 3), an operation and display unit (24) and a communication unit (25), the processing unit (21) is a microprocessor, the data storage unit (22) is a memory, and the photography unit (23) is For the photographic lens, the operation and display unit (24) is a touch screen or the like, and the communication unit (25) is a communication component for connecting a wireless network such as 3G, 4G or Wi-Fi, and the data storage unit is 22), the photographing unit (23), the operation and display unit (24) and the communication unit (25) are coupled to the processing unit (21), and the mobile electronic device (2) is set on the head mounted display ( 1) positioning the set up portion, and causing the operation and display unit (24) of the mobile electronic device (2) to face the two stereoscopic imaging optical components (11) of the inner window portion of the head mounted display (1), Further, the camera unit (23) of the mobile electronic device (2) faces the outside of the head mounted display (1); a cloud server (3) causes the cloud server (3) to mainly have a processing unit ( 31), a database (32) and a communication unit (33), the processing unit (31) is a microprocessor, the data storage unit (32) is a hard disk, and the communication unit (33) is Connecting a communication component of a wireless network such as 3G, 4G or Wi-Fi, and coupling the database (32) and the communication unit (33) with the processing unit (31), and the cloud server (3) The communication unit (33) is communicatively coupled to the communication unit (25) of the mobile electronic device (2); a human-computer interaction program (4) is configured to store the human-computer interaction program (4) in the cloud server (3) The database (32), the human-computer interaction program (4) includes a virtual reality module (41), an augmented reality module (42), a story module (43), and a problem module ( 44), a situation simulation module (45), a problem solving module (46) and a program management module (47) and other program modules, and the cloud server (3) The processing unit (31) is connected to each module; an application (5) is configured to store the application (APP) (5) in the database (32) of the cloud server (3) to provide the action The electronic device (2) is downloaded and installed to its data storage unit (22), and the mobile electronic device (2) is connected to the human-machine interaction program (4) of the cloud server (3) via the application (5). link.

Accordingly, when the interactive virtual input augmented reality device of the present creation is implemented, please refer to the second and third figures together, and the user first uses the mobile electronic device (2) such as the smart phone. The cloud server (3) is connected to download an application (APP) (5) stored in the cloud server (3) and installed to enable the mobile electronic device (2) to communicate with the mobile device (2) via the application (5) The human-computer interaction program (4) is connected, and then the user installs his mobile electronic device (2) on the set-up portion of the head-mounted display (1) to fix the mobile electronic device (2). In the head mounted display (1), the head mounted display (1) equipped with the mobile electronic device (2) is attached to the head thereof, and the operation and display of the mobile electronic device (2) is performed. The unit (24) is located in front of the eye and passes through two stereoscopic imaging optical components (11) corresponding to the left and right eye positions of the user to be played by the mobile electronic device (2) and its display unit (24) The resulting image is converted into a 3D stereoscopic image.

This creation is now described in the example of simulating the occurrence of fire. When the user enters the human-computer interaction program of the creation (4) to construct the environment, the first thing that comes to mind is the virtual reality module (41). In the three-dimensional virtual reality scene, the user can view the scene and the various objects in the scene from different angles. Please refer to the fourth picture, and then the program management module (47) will be arranged according to the preset program. , to drive the plot module (43) to appear a preset fire situation, such as: room fire, etc. after the screaming fire, what to do next, and so on, When the problem module (44) is driven to encounter the fire situation, the system should "take the wet towel to swear away from the mouth" or "crash away from the scene" and other options, and construct the scene in the virtual reality module (41). The middle department will have virtual objects corresponding to the problem, such as: washstand and towel, and the door leading to the corridor from the room, etc., to provide the user as an answer option. At this time, the user can select the correct solution. The augmented reality module (42) technology principle of the present invention is a preset touch detection block in the virtual reality module (41) construction scene when the augmented reality design is performed [the virtual object is The corresponding touch detection block is detected by the camera unit (23) during the augmented reality operation to detect whether the preset touch detection block is covered (eg: The limb enters the block], when the photographing unit (23) detects the covered condition, the processing unit (21) of the mobile electronic device (2) returns the preset touch detection via the communication unit (25) The blocked parameter of the block is sent to the cloud server (3), and the parameter is received by the cloud server (3). After that, we see information [such as: display messages and objects Bofang animation], to achieve the effect of the virtual input.

Accordingly, when the user selects the option of touching the door and leaving the room directly, the camera unit (23) of the mobile electronic device (2) will capture the user's hand motion and transmit the user's hand motion image instantly. To the cloud server (3), the operation of the augmented reality module (42) can cause the user's hand image to touch the door in the virtual scene, and the condition simulation module (45) After the user selects this option, the story animation of what happens will occur, and after the animation is finished, the question answering module (46) appears whether the option is correct, and the disaster prevention concept corresponding to the problem is correct or The reason for the error, when the question answering module (46) provides the answer and the correct prevention concept, the program management module (47) will judge whether there is a next story, and leave the teaching system without the next story.

If there is another story, the program management module (47) will drive the story module (43) to continue playing the next scenario. If the user chooses to open the door, the story module (43) will play. After the door is opened, the story is run in the corridor and the smoke is thrown out of the room. After the story animation ends, the virtual reality module (41) constructs the virtual object of the upper stairs and the lower stairs. The problem module (44) will display the option to "escape upstairs" or "escape downstairs" for the user to answer. If the user touches the stairs upstairs, the mobile electronic The photographing unit (23) of the device (2) synchronously captures the user's hand motion and transmits the image back to the cloud server (3) so that the augmented reality module (42) corresponds to the user's hand touch. Touching the image of the stairs upstairs, following the program management module (47) will drive the situation simulation module (45) to play the user's choice to escape to the upper floor, what kind of scene situation will happen, and The problem solving module (46) appears that the user's way of running upstairs is wrong. The answer shows that "the smoke will only go up, the smoke rises by 3 to 5 meters per second, the speed of the person is far from the smoke, so it will be killed by the smoke" and the correct concept of disaster prevention.

In this way, the user can effectively improve the motivation and interest of the user through the substantial somatosensory operation and the experience of the sense of presence, and help the user to internalize the knowledge learned to obtain the good use of the knowledge. In this way, when a disaster such as a fire occurs, the user can generate an intuitive reflex action and have a good emergency response capability, so as to make a correct judgment in the shortest time, efficiently escape from the scene, and not face the fire, etc. In the event of a disaster, the situation of survival is lost due to panic, and accordingly, the self-effect is achieved.

The foregoing embodiments or drawings are not limited to the implementation of the interactive virtual input augmented reality device of the present creation, and the creation can be applied not only to fire disaster prevention teaching, but also to earthquakes and stations. Natural disasters such as wind, flood, earth and stone flow, and man-made disasters such as fires, dust explosions, and toxic gas leaks can be used in this creative human-computer interaction program (4) to input various disaster-related teaching contents. The teaching theory is effectively implemented through on-the-spot simulation experience, and deep internalization is an intuitive response to greatly enhance the people's ability to respond to various disasters. In addition to providing disaster prevention teaching, this creation can also be used in human-computer interaction programs. 4) After inputting relevant medical, scientific or health education, etc., to provide medical, scientific or health education.

According to the above structure and implementation, the author has the following advantages:

1. The interactive virtual input augmented reality device of this creation uses the augmented reality of the headset as a medium for teaching or training to immerse the user in the simulation scene and use the virtual input operation mode to improve Interacting with the user, in this way, in an immersive and interactive way, to achieve effective improvement in learning and other effects.

2. The interactive virtual input augmented reality device of this creation allows users to use experiential learning to allow users to internalize knowledge through specific experiences and experiences, thereby effectively assisting users in encountering real scenes. The ability to respond urgently.

In summary, the embodiment of the present creation can achieve the expected effect, and the specific structure disclosed therein has not been seen in the same kind of products, nor has it been disclosed before the application, and has fully complied with the provisions of the Patent Law. It is required that if an application for a new type of patent is filed in accordance with the law, and the application for a patent is granted, the patent will be granted.

(1)‧‧‧ head mounted display

(11)‧‧‧Three-dimensional imaging optical components

(2) ‧‧‧Mobile electronic devices

(21) ‧‧‧Processing unit

(22)‧‧‧ Data storage unit

(23)‧‧‧Photographic unit

(24)‧‧‧Operation and display unit

(25) ‧‧‧Communication unit

(3) ‧‧‧Cloud Server

(31)‧‧‧Processing unit

(32)‧‧‧Database

(33) ‧‧‧Communication unit

(4) ‧ ‧ human-computer interaction program

(41) ‧‧‧Virtual Reality Module

(42) ‧‧‧Augmented Reality Module

(43) ‧‧‧ Drama Module

(44)‧‧‧ Problem Module

(45) ‧‧‧Status Simulation Module

(46)‧‧‧Question module

(47) ‧‧‧Program Management Module

(5)‧‧‧Applications

Claims (4)

An interactive virtual input augmented reality device mainly comprises: a head mounted display, wherein the head mounted display is provided with a set of standing portions in front of the head mounted display, and the head mounted display is formed at least one side of the set of the standing portion a mobile device for constructing a processing unit, a data storage unit, a photographing unit, an operation and display unit, and a communication unit, and the data storage unit, the photographing unit, and the operation unit The cum display unit and the communication unit are coupled to the processing unit, and the mobile electronic device is disposed at the assembly of the head mounted display, and the operation and display unit of the mobile electronic device is oriented toward the inside of the head mounted display. The window portion further faces the camera unit of the mobile electronic device toward the outside of the head mounted display; the cloud server establishes a processing unit, a database and a communication unit in the cloud server, and makes the data The library and the communication unit are coupled to the processing unit thereof, and the communication unit of the cloud server and the mobile electronic device are communicated with each other. a communication link; the human-computer interaction program is configured to store the human-computer interaction program in a database of the cloud server, the human-computer interaction program includes a virtual reality module, an augmented reality module, and a drama model. The group, the problem module, the state simulation module, the question answering module and the program management module are connected to each module by the processing unit of the cloud server. The interactive virtual input augmented reality device of claim 1, wherein the head mounted display further comprises a stereoscopic imaging optical component in the window portion thereof. The interactive virtual input augmented reality device of claim 1, wherein the head mounted display is provided with two opposite window portions, and a stereo imaging optical component is further disposed in each of the two window portions. . The interactive virtual input augmented reality device according to claim 1, wherein the interactive virtual input augmented reality device further comprises an application, wherein the application is stored in the cloud And a database of the server for downloading and installing the mobile electronic device to the data storage unit, so that the mobile electronic device is connected to the human-machine interaction program of the cloud server via the application.