TWI778621B - Smart wearable system and reality training learning method thereof - Google Patents

Abstract

A smart wearable system applied to reality training learning method of bridge engineering. The smart wearable system includes a control module, a man-machine interface module, a handle, a bracket, a somatosensory interaction area, and a simulated environment module. First of all, the user conducts on-site exploration of the environment near the bridge project and confirms the location of the somatosensory interaction area. Then, according to the exploration results of the environment near the bridge project, the animation script and the interactive script are planned. Afterwards, create virtual reality data according to the animation script and the interactive script, and the virtual reality data is stored in the memory of the control module. Finally, the display shows the three-dimensional picture in the three-dimensional space, and the interactive information is generated by the handle. At the same time, observe whether there are errors in the three-dimensional images and interactive information in the three-dimensional space to correct the virtual reality data. In this way, the user's vigilance during the construction process is improved, and the accidents that may occur during the construction process are reduced.

Description

Smart wearable system and its real-world training learning method

The present invention relates to a smart wearable system, in particular to a smart wearable system and its real-world training and learning method.

In recent years, with the rapid development of digital technology and the increasingly refined and sophisticated products, the application development of interactive design has become more and more rapid and developed. As far as development is concerned, the well-known somatosensory game consoles of Xbox 360, Wii, and PS4 in recent years all talk with the machine through voice, touch or human movement, attracting users to use it continuously.

In addition, virtual reality (Virtual Reality, VR), Augmented Reality (AR), Mixed Reality (MR), etc., the above types of interactive design are mainly based on realistic 3D virtual environment and visual The impact brought by the above has become the new favorite of the technological era, allowing digital media to break through the limitations of time and space, providing users with a good immersive experience with its "realism", "interactivity" and other characteristics. In view of this, simulating high-risk work has also become a major feature of virtual reality (Virtual Reality, VR) applications, users can simulate high-risk work in a relatively safe environment, and in a similar environment. Learn new techniques.

However, since the negligence of the user in the virtual environment does not affect the real environment, when the user uses the virtual reality to simulate high-risk work, the alertness and attention may be reduced due to the psychology of being in a safe environment, so that the application When virtual reality simulates high-risk work, immediate feedback and interaction become the key. Only when users are highly focused and alert, they can correct mistakes in the virtual environment in real time, so as to help users to repeatedly try and practice until they succeed in learning , and effectively alert users to mistakes, so as to reduce accidents at work.

In view of the above-mentioned shortcomings, the inventors have researched ways to improve these shortcomings, and finally the present invention is produced.

The main purpose of the present invention is to provide a smart wearable system, which is applied to the real-world training and learning of a bridge project. The area is set in the environment near the bridge project, and the simulation environment module simulates the scene in the real environment, so that the user's immersion in the real-world training and learning of the bridge project is greatly enhanced, and the current situation is improved. The user feels a sense of fear when the operation is wrong, thereby improving the user's vigilance during the construction process, thereby reducing possible accidents during the construction process.

Another object of the present invention is to provide a smart wearable system, which is coupled to a control module through a simulation environment module, and the control module controls the simulation environment module according to the interactive information and the position information, and the simulation The environment module generates a simulation message. Thereby, the variable factors in the virtual scene when the user uses the smart wearable system according to the present invention are enhanced, so as to increase and control the user's sense of reality. In addition, the present invention is designed according to the construction conditions of the suspension bridge and the needs of workers through the long-term accumulated experience of those with ordinary knowledge in the field. When converted into a real environment, the experience can be used to improve the professional ability and familiarity of workers.

In order to achieve the above objects and effects, the present invention provides a smart wearable system, which is applied to the real-world training and learning of a bridge project. The smart wearable system includes: a control module, which includes a memory, The memory is used to store a virtual reality data, the virtual reality data is formed through the environment near the bridge project; the human-machine interface module is connected with the control module information, the human-machine interface module is A display is a detachable assembly structure, the human-machine interface module is electrically connected to the display; a handle, which is coupled to the human-machine interface module; a bracket, which can be simply erected on the display The environment near the bridge project, the support is used to support the weight of the user; the one-body interactive area is set in the environment near the bridge project, and the somatosensory interactive area is used for the user to stand in it to start the process. Real-world training and learning of bridge engineering; at least one simulated environment module, which is arranged around the somatosensory interaction area; wherein, the display is used to display a three-dimensional image of a three-dimensional space, and the three-dimensional image of the three-dimensional space is based on the The virtual reality data is formed, and the handle is used for the user to interact with the three-dimensional image of the three-dimensional space to generate interactive information.

Preferably, according to the smart wearable system of the present invention, the simulated environment module is one or a combination of an electric fan, a bracket spring and a speaker.

Preferably, according to the smart wearable system of the present invention, the bracket includes: an upper row of brackets, which is arranged above the somatosensory interaction area, the upper row of brackets is used for setting a blocking cloth, the The cloth is used to block sunlight and rain; a corner bracket is coupled to the upper row bracket, and the corner bracket is used to set at least one space locator, the space locator is coupled to the control module, the The spatial positioner generates a position information according to the position of the handle; a pedal is arranged in the somatosensory interaction area, the pedal is used for the user to stand on it; a plurality of bottom plates are coupled to the corner The brackets, the number and shape of the base plates vary according to the environment in the vicinity of the bridge project.

Preferably, according to the smart wearable system of the present invention, the control module can be one or a combination of a computer, a smart handheld device and a server, but the present invention is not limited thereto.

Preferably, according to the smart wearable system of the present invention, the human-machine interface module further includes a communication unit, and the communication unit is used for communicating with the control module and receiving the virtual reality data.

Preferably, according to the smart wearable system of the present invention, the base plate includes a plurality of fixing holes, and at least one screw is passed through the fixing holes of the base plate, so that the bracket is erected on the environment near the bridge project. .

Preferably, according to the smart wearable system of the present invention, the simulated environment module is further coupled to the control module, and the control module controls the simulated environment module according to the interaction information and the position information, The simulation environment module generates simulation information.

Preferably, according to the smart wearable system of the present invention, the communication unit can communicate through radio frequency circuits (RFID), Near Field Communication (NFC), Bluetooth, third-generation mobile One of the wireless communication protocols of communication (3G), fourth-generation mobile communication (4G), wireless local area network (Wi-Fi), wireless local area network (WLAN), and fifth-generation mobile communication (5G) receives the virtual real-world data, however the invention is not so limited.

In addition, in order to achieve the above-mentioned purpose, the present invention is based on the above-mentioned smart wearable system, and further provides a real-world training and learning method for executing the above-mentioned smart wearable system, which comprises: a prospecting step, to the vicinity of the bridge project In a planning step, according to the results of the exploration step, an animation script and an interactive script are planned, and the animation script and the interactive script are applied to the bridge project an animation production step, producing the virtual reality data according to the animation script and the interactive script, the virtual reality data is formed through the environment near the bridge project and stored in the control module of the control module a memory; an erecting step of erecting the stand and the simulated environment module in the somatosensory interaction area; a modification step of displaying the three-dimensional image of the three-dimensional space by the display in the somatosensory interaction area, and The handle interacts with the three-dimensional image of the three-dimensional space to generate interactive information, so as to observe whether the three-dimensional image of the three-dimensional space and whether the interactive information has errors with the environment near the bridge project, so as to correct the virtual reality data.

Preferably, according to the real-world training and learning method of the present invention, the simulated environment module is further coupled to the control module, the real-world training and learning method further includes a simulated environment step, and the control module is The simulation environment module is controlled according to the interactive information and a position information generated by at least one spatial locator, and the simulation environment module generates simulation information.

To sum up, the smart wearable system provided by the present invention greatly enhances the user's immersion in the real-world training and learning of bridge engineering, and enhances the user's sense of fear when operating errors, thereby improving the user's ability to Vigilance in the construction process, thereby reducing the accidents that may occur in the construction process.

In order for those skilled in the art to understand the purpose, features and effects of the present invention, the present invention is described in detail as follows by means of the following specific embodiments and in conjunction with the accompanying drawings.

The inventive concept will now be explained more fully hereinafter with reference to the accompanying drawings in which exemplary embodiments of the inventive concept are shown. The advantages and features of the inventive concept, as well as methods for achieving the same, will become apparent from the following exemplary embodiments, which are set forth in more detail with reference to the accompanying drawings. However, it should be noted that the inventive concept is not limited to the following exemplary embodiments, but may be implemented in various forms. Therefore, the exemplary embodiments are provided merely to disclose the inventive concept and to make aware of the class of the inventive concept to those skilled in the art. In the drawings, the exemplary embodiments of the inventive concept are not limited to the specific examples provided herein and are exaggerated for clarity.

The terminology used herein is used to describe particular embodiments only, and is not intended to limit the invention. As used herein, the singular terms "a" and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may be present.

Similarly, it will be understood that when an element (eg, a layer, region, or substrate) is referred to as being "on" another element, it can be directly on the other element or intervening elements may be present. In contrast, the term "directly" means that no intervening elements are present. It should be further understood that when the terms "comprising" and "comprising" are used herein, it is intended to indicate the presence of stated features, integers, steps, operations, elements, and/or components, but does not exclude one or more other features , integers, steps, operations, elements, components, and/or the presence or addition of groups thereof.

Furthermore, exemplary embodiments in the detailed description are set forth in cross-section illustrations that are idealized exemplary illustrations of the inventive concepts. Accordingly, the shapes of the exemplary figures may be modified according to manufacturing techniques and/or tolerable errors. Thus, exemplary embodiments of the inventive concept are not limited to the specific shapes shown in the exemplary figures, but may include other shapes that may be produced according to manufacturing processes. The regions illustrated in the figures have general characteristics and are used to illustrate specific shapes of elements. Therefore, this should not be construed as limiting the scope of the inventive concept only.

It will also be understood that, although the terms "first," "second," "third," etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish each element. Thus, a first element in some embodiments could be termed a second element in other embodiments without departing from the teachings of the present invention. Exemplary embodiments of aspects of the inventive concepts illustrated and described herein include their complementary counterparts. Throughout this specification, the same reference numbers or the same designators refer to the same elements.

Furthermore, example embodiments are described herein with reference to cross-sectional and/or plan views, which are illustrations of idealized example illustrations. Accordingly, deviations from the shapes shown, for example, caused by manufacturing techniques and/or tolerances, are expected. Accordingly, the exemplary embodiments should not be considered limited to the shapes of the regions shown herein, but are intended to include deviations in shapes resulting from, for example, manufacturing. Thus, the regions illustrated in the figures are schematic and their shapes are not intended to illustrate the actual shape of a region of a device and are not intended to limit the scope of example embodiments.

Please refer to FIG. 1 , which is a system schematic diagram of a smart wearable system according to the present invention. As shown in FIG. 1, according to the smart wearable system 100 of the present invention, it is applied to the real-world training and learning of bridge engineering (not shown). The smart wearable system 100 includes: a control module 11, a human-machine interface module Group 12 , handle 13 , bracket 14 , somatosensory interaction area 15 and simulated environment module 16 .

Specifically, as shown in FIG. 1, the control module 11 includes a memory 111, and the memory 111 is used to store the virtual reality data 31, and the virtual reality data 31 is formed through the environment near the bridge project, The control module 11 can be one or a combination of a computer, a smart handheld device and a server, but the invention is not limited thereto.

Specifically, the human-machine interface module 12 is informationally connected with the control module 11. In a preferred embodiment of the present invention, the human-machine interface module 12 may be a VR headset, but the present invention does not Limited to this, the human-machine interface module 12 is a detachable assembly structure with the display 21, and the human-machine interface module 12 is electrically connected with the display 21, wherein the display 21 is used for displaying the three-dimensional space of the three-dimensional space. The screen 32, the three-dimensional screen 32 of the three-dimensional space is formed according to the virtual reality data 31, and the three-dimensional screen 32 of the three-dimensional space provides the immersion effect of the user in the virtual environment. Wherein, the display 21 can be selected from an organic light emitting diode display (OLED), a light emitting diode display (LED), or a quantum dot display (QLED), but the present invention is not limited thereto.

Specifically, the handle 13 is coupled to the human-machine interface module 12, and the handle 13 is used for the user to interact with the three-dimensional image 32 in the three-dimensional space to generate interactive information 33, and the interactive information 33 includes After the user uses the handle 13 to interact with the three-dimensional image 32 in the three-dimensional space, when touching an object in the three-dimensional image 32 in the three-dimensional space, a proper feedback effect can be given.

Specifically, the bracket 14 can be simply erected in the environment near the bridge project, the bracket 14 is used to support the weight of the user, wherein the material of the bracket 14 can be selected from zinc, aluminum, magnesium, cadmium, lead, One or a combination of metal elements such as titanium is combined, but the present invention is not limited thereto. It is worth mentioning that when a zinc alloy or an aluminum alloy is used as the material of the bracket 14, the bracket 14 can have characteristics such as low weight and high strength, thereby achieving the functions of portability and durability. However, using a zinc alloy or an aluminum alloy as the bracket 14 When the material of the bracket 14 is used, the cost of the bracket 14 will be increased at the same time, and the user can choose which material is more appropriate according to their needs.

Specifically, the somatosensory interaction area 15 is set in the environment near the bridge project, and the somatosensory interaction area 15 is used for users to stand in it to start the actual training and learning of the bridge project, according to the present invention The smart wearable system 100 uses the somatosensory interaction area 15, which is set in the environment near the bridge project, so as to enhance the user's virtual experience when using the smart wearable system 100 according to the present invention. Visual changes, sound auditory changes and height changes in the scene in order to increase and control the realism and feedback felt by the user.

Specifically, the simulated environment module 16 is arranged around the somatosensory interaction area 15, wherein the simulated environment module 16 can be selected from one or a combination of an electric fan, a bracket spring and a speaker, but the present invention Not limited to this. The simulation environment module 16 is used for simulating a scene in a real environment. In an embodiment of the present invention, the simulation environment module 16 is a fan, thereby simulating the change of wind speed when the staff moves the truss between valleys in bridge engineering , while controlling the size of the wind speed to add realism. In another embodiment of the present invention, the simulated environment module 16 is a bracket spring. When the user stands in the somatosensory interaction area 15, the wooden board will also shake like a suspension bridge as it moves, thereby simulating the bridge engineering. In the situation of the suspension bridge, the user combines visual senses in the operation, and can also improve the user's crisis awareness during the practical training and learning of bridge engineering when shaking in the high air.

Please refer to FIG. 2 in conjunction with FIG. 1 and FIG. 3 . FIG. 2 is a block diagram illustrating the steps of the real-world training and learning method of the smart wearable system according to the present invention. The present invention is based on the smart wearable system 100, and further provides a real-world training and learning method for executing the smart wearable system 100, which includes the following steps:

In the exploration step S1, the user conducts field exploration in the environment near the bridge project, and confirms the position of the somatosensory interaction area 15, and then executes the planning step S2.

In the planning step S2, according to the result of the exploration step S1, the planning of the animation script 34 and the interactive script 35 is carried out. The animation script 34 and the interactive script 35 are applied to the actual training and learning of the bridge project, wherein the animation script 34 is for three-dimensional space. The three-dimensional picture 32 is planned, and the interactive script 35 is planned for the interactive information 33 generated by the handle 13, and then the animation production step S3 is executed.

In the animation production step S3, the virtual reality data 31 is produced according to the animation script 34 and the interactive script 35. The virtual reality data 31 is formed through the environment near the bridge project and stored in the memory 111 of the control module 11, Next, the erection step S4 is performed.

In the erection step S4 , the user erects the stand 14 and the simulated environment module 16 in the somatosensory interaction area 15 , and then executes the correction step S5 .

In the modification step S5, the user displays the three-dimensional image 32 of the three-dimensional space in the somatosensory interaction area 15 through the display 21, and interacts with the three-dimensional image 32 of the three-dimensional space through the handle 13 to generate interactive information 33 to observe the three-dimensional space. Whether there is an error between the three-dimensional image 32 of the space and the interactive information 33 and the environment near the bridge project, so as to correct the virtual reality data 31 .

It should be further explained that the animation script 34 according to a preferred embodiment of the present invention includes: after the user wears the man-machine interface module 12, he enters the system by picking up the safety helmet on the screen, and then uses The operator will enter the pre-construction mode, the safety instructions will be described in the teaching video, and the safety dress will be taught; then the guide mode will be entered. Operation prompts will be given in the navigation mode screen, which are four stages: fixing the truss with the wire rope and iron hook, controlling the crane to move forward, fixing the steel beam with the electric screw, and untying the steel wire rope; The previous steps and precautions are performed again. In this mode, there is no operation prompt. When the operation is completed, if the steps are not completed or the operation is wrong, the user will fall into the valley in the virtual environment and start again. Example: If the steel wire rope is not fixed, the steel bar that the user is standing on will lose its tension and fall into the valley together with the steel bar when lifting. It is understandable that different steps will have corresponding results. When the steps are completed correctly After that, the construction completion screen will be presented, but the present invention is not limited to this.

It is worth mentioning that the interactive script 35 according to a preferred embodiment of the present invention includes: at the beginning of the interactive operation, the user will conduct an operation teaching guide according to the voice and text description, and learn how to operate and the construction process. , and then carry out the actual operation process. When the user enters the truss after completing the safety measures, he can see that each wire rope hook emits light to signal the user to click. The crane can only be controlled by engaging with the truss, and an arrow will appear in the middle of the truss to indicate to the user to click to control the crane to move the truss forward. Thereby, the user is made aware of the safety of the wire rope and remembers the safe operation link, but the present invention is not limited to this.

In order to further understand the structural features of the present invention, the application of technical means and the expected effect, the actual implementation process of the present invention is described here.

Please refer to FIG. 3 , in conjunction with FIG. 1 and FIG. 2 . FIG. 3 is a flow chart illustrating the steps of the real-world training and learning method actually performed by the smart wearable system according to the present invention. The actual implementation of the real-world training and learning method according to the smart wearable system of the present invention is described as follows: first, the exploration step S1 is performed, and the user goes to the environment near the bridge project to conduct field exploration and interviews with people, and confirm the position of the somatosensory interaction area 15; Executing the planning step S2, the user performs the planning of the animation script 34 and the interactive script 35 according to the result of the exploration step S1. The animation script 34 and the interactive script 35 are applied to the actual training and learning of the bridge project, wherein the animation script 34 is a The three-dimensional image 32 in the three-dimensional space is planned, and the interactive script 35 is planned for the interactive information 33 generated by the handle 13 ; then the animation production step S3 is executed, and the user creates the virtual reality according to the animation script 34 and the interactive script 35 Data 31, the virtual reality data 31 is formed through the environment near the bridge project, and the virtual reality data 31 is stored in the memory 111 of the control module 11; then the erection step S4 is executed, when the virtual reality data 31 After the completion, the user goes to the somatosensory interaction area 15 selected in the exploration step S1, and sets up the bracket 14 and the simulation environment module 16; finally, the correction step S5 is executed to complete the installation of the bracket 14 and the simulation environment module 16. The somatosensory interaction area 15 displays the three-dimensional image 32 of the three-dimensional space through the display 21, and generates interactive information 33 by interacting with the three-dimensional image 32 of the three-dimensional space through the handle 13, so as to observe the three-dimensional image 32 of the three-dimensional space and interact with it. Whether there is an error between the information 33 and the environment near the bridge project, so that the virtual reality data 31 can be corrected.

Therefore, it can be seen from the above description that the present invention uses the somatosensory interaction area 15 and the simulated environment module 16 to set the somatosensory interaction area 15 in the environment near the bridge project, and uses the simulated environment module 16 to use It is used to simulate the scene in the real environment. In this way, the user's immersion in the real-world training and learning of bridge engineering is greatly enhanced, and the sense of fear that the user feels when the user makes a mistake is increased, so as to improve the user's experience in the construction process. The vigilance, thereby reducing the accident that may occur during the construction process.

(1st embodiment)

Hereinafter, an embodiment of the first embodiment of the smart wearable system of the present invention will be described with reference to the drawings.

Please refer to FIG. 4 , which is a system schematic diagram of a smart wearable system according to a first embodiment of the present invention. As shown in FIG. 4 , the smart wearable system 100 according to the first embodiment of the present invention includes: a control module 11 , a human-machine interface module 12 , a handle 13 , a bracket 14 , a somatosensory interaction area 15 and a simulated environment model Group 16.

Specifically, the control module 11 includes a memory 111. The memory 111 is used to store the virtual reality data 31. The virtual reality data 31 is formed through the environment near the bridge project. The control module 11 can It is one or a combination of a computer, an intelligent handheld device and a server, but the present invention is not limited to this.

Specifically, the human-machine interface module 12 is informationally connected with the control module 11. In this embodiment, the human-machine interface module 12 can be a VR helmet device, but the present invention is not limited to this. The human-machine interface module 12 and the display 21 are in a detachable assembly structure, and the human-machine interface module 12 is electrically connected to the display 21, wherein the display 21 is used for displaying a three-dimensional image 32 in a three-dimensional space, and the The three-dimensional image 32 in the three-dimensional space is formed according to the virtual reality data 31 , and the three-dimensional image 32 in the three-dimensional space provides the user with an immersive effect in the virtual environment. Wherein, the display 21 can be selected from an organic light emitting diode display (OLED), a light emitting diode display (LED), or a quantum dot display (QLED), but the present invention is not limited thereto.

It should be further noted that the human-machine interface module 12 according to the first embodiment of the present invention further includes a communication unit 121 , and the communication unit 121 is used for communicating with the control module 11 and receiving the virtual reality data 31 . Specifically, the communication unit 121 according to the first embodiment of the present invention is for information transmission of wireless signals, which is selected from radio frequency circuits (RFID), or Near Field Communication (NFC), Bluetooth ( Bluetooth), third generation mobile communication (3G), fourth generation mobile communication (4G), wireless local area network (Wi-Fi), wireless local area network (WLAN), fifth generation mobile communication (5G) wireless communication protocol one of them; and, the signal transmission element of the communication unit 121 is the information transmission of wired signals, which is an Ethernet, and the communication unit 121 can be used to receive the virtual reality data 31, or to communicate The unit 121 can be used for information communication with an external terminal device, such as a personal computer, a smart phone or a tablet computer, etc., but the present invention is not limited to this.

Specifically, the handle 13 is coupled to the human-machine interface module 12, and the handle 13 is used for the user to interact with the three-dimensional image 32 in the three-dimensional space to generate interactive information 33, and the interactive information 33 includes After the user uses the handle 13 to interact with the three-dimensional image 32 in the three-dimensional space, when touching an object in the three-dimensional image 32 in the three-dimensional space, a proper feedback effect can be given.

Please refer to FIG. 5 and FIG. 7 . FIG. 5 is a schematic diagram of the structure of the bracket according to the first embodiment of the present invention. In this embodiment, the bracket 14 includes: an upper bracket 141 , a corner bracket 142 , a pedal 143 and a bottom plate 144 . The upper brackets 141 are arranged above the somatosensory interaction area 15, the upper brackets 141 are used for installing a blocking cloth 1411, and the blocking cloth 1411 is used to block sunlight and rain; the corner brackets 142 are Coupled to the upper bracket 141 , the corner bracket 142 is used to set the spacer 22 , the spacer is coupled to the control module 11 , and the spacer 22 generates position information 36 according to the position of the handle 13 ; pedal 143, which is arranged in the somatosensory interaction area 15, the pedal 143 is used for the user to stand on it; the bottom plate 144, which is coupled to the corner bracket 142, the number and shape of the bottom plate 144 are Changes according to the environment near the bridge project. In this way, the bracket 14 according to the first embodiment of the present invention can be erected on any environment near the bridge project. Generally speaking, the environment near the bridge project may have an uphill or a downhill slope. The bracket 14 of the present invention can pass through The base plates 144 conform to the environment near the bridge construction, so that the smart wearable system 100 according to the present invention has high applicability and practicality.

It should be further explained that the bracket 14 can be simply erected in the environment near the bridge project, the bracket 14 is used to support the weight of the user, and the material of the bracket 14 can be selected from zinc, aluminum, magnesium, cadmium , lead, titanium and other metal elements are combined with one or a combination thereof, but the present invention is not limited thereto. It is worth mentioning that when a zinc alloy or an aluminum alloy is used as the material of the bracket 14, the bracket 14 can have characteristics such as low weight and high strength, thereby achieving the functions of portability and durability. However, using a zinc alloy or an aluminum alloy as the bracket 14 When the material of the bracket 14 is used, the cost of the bracket 14 will be increased at the same time, and the user can choose which material is more appropriate according to their needs.

Specifically, as shown in FIG. 5 , the base plate 144 according to the first embodiment of the present invention includes a plurality of fixing holes 1441 , and at least one screw 1442 passes through the fixing holes 1441 of the base plate 144 to make the bracket 14 It is erected on the environment near the bridge project, but the present invention is not limited to this.

Specifically, the somatosensory interaction area 15 is set in the environment near the bridge project, and the somatosensory interaction area 15 is used for users to stand in it to start the actual training and learning of the bridge project, according to the present invention The smart wearable system 100 uses the somatosensory interaction area 15, which is set in the environment near the bridge project, so as to enhance the user's virtual experience when using the smart wearable system 100 according to the present invention. Visual changes, sound auditory changes and height changes in the scene in order to increase and control the realism and feedback felt by the user.

Specifically, the simulated environment module 16 is arranged around the somatosensory interaction area 15, wherein the simulated environment module 16 can be selected from one or a combination of an electric fan, a bracket spring and a speaker, but the present invention Not limited to this. The simulation environment module 16 is used for simulating a scene in a real environment. In an embodiment of the present invention, the simulation environment module 16 is a fan, thereby simulating the change of wind speed when the staff moves the truss between valleys in bridge engineering , while controlling the size of the wind speed to add realism. In another embodiment of the present invention, the simulated environment module 16 is a bracket spring. When the user stands in the somatosensory interaction area 15, the wooden board will also shake like a suspension bridge as it moves, thereby simulating the bridge engineering. In the situation of the suspension bridge, the user combines visual senses in the operation, and can also improve the user's crisis awareness during the practical training and learning of bridge engineering when shaking in the high air.

It should be further explained that, please refer to FIG. 4 and FIG. 7 , in this embodiment, the simulation environment module 16 is further coupled to the control module 11 , and the control module 11 is based on the interaction information 33 and the location information 36 The simulation environment module 16 is controlled, so that the simulation environment module 16 generates simulation information 37, thereby increasing the variation factors in the virtual scene when the user uses the smart wearable system 100 according to the present invention, and greatly increasing the user experience in the virtual scene sense of reality. In addition, the present invention is designed according to the construction conditions of the suspension bridge and the needs of workers through the long-term accumulated experience of those with ordinary knowledge in the field. When converted into a real environment, the experience can be used to improve the professional ability and familiarity of workers. However, the present invention is not limited to this.

Please refer to FIG. 6 in conjunction with FIGS. 4 to 7 . FIG. 6 is a block diagram illustrating steps of a real-world training and learning method for a smart wearable system according to a first embodiment of the present invention. The present invention is based on the smart wearable system 100, and further provides a real-world training and learning method for executing the smart wearable system 100, which includes the following steps:

In the exploration step S1 ′, the user conducts field exploration in the environment near the bridge project, and confirms the position of the somatosensory interaction area 15 , and then executes the planning step S2 ′.

The planning step S2', according to the result of the exploration step S1', the planning of the animation script 34 and the interactive script 35 is carried out. The animation script 34 and the interactive script 35 are applied to the actual training and learning of the bridge project, wherein the animation script 34 is aimed at The three-dimensional image 32 in the three-dimensional space is planned, the interactive script 35 is planned for the interactive information 33 generated by the handle 13, and then the animation production step S3' is executed.

In the animation production step S3 ′, the virtual reality data 31 is produced according to the animation script 34 and the interactive script 35 , and the virtual reality data 31 is formed through the environment near the bridge project and stored in the memory 111 of the control module 11 , and then execute the erection step S4'.

In the erection step S4 ′, the user erects the stand 14 and the simulated environment module 16 in the somatosensory interaction area 15 , and then executes the correction step S5 ′.

In the modification step S5 ′, the user displays the three-dimensional image 32 in the three-dimensional space in the somatosensory interaction area 15 through the display 21 , and interacts with the three-dimensional image 32 in the three-dimensional space through the handle 13 to generate interactive information 33 , and use the handle 13 to generate interactive information 33 . The position information 36 is generated by the spatial locator 22 according to the position of the handle 13, and the three-dimensional image 32 and the interactive information 33 in the three-dimensional space are observed whether there is an error with the environment near the bridge project, so as to correct the virtual reality data 31, and then The simulation environment step S6' is executed.

In the simulation environment step S6 ′, the control module 11 controls the simulation environment module 16 according to the interactive information 33 and the position information 36 generated by the spatial locator 22 , and the simulation environment module 16 generates simulation information, thereby improving the The variable factors in the virtual scene when the user uses the smart wearable system 100 according to the present invention.

It should be further explained that, according to the animation script 34 of the first embodiment of the present invention, the animation script 34 includes: after the user wears the man-machine interface module 12, he enters the system by picking up the safety helmet on the screen, and then the user enters the system by picking up the safety helmet on the screen. It will enter the pre-construction mode, the safety instructions will be described in the teaching video, and safety dress will be taught; then the guide mode will be entered. Operation prompts will be given in the navigation mode screen, which are four stages: fixing the truss with the wire rope and iron hook, controlling the crane to move forward, fixing the steel beam with the electric screw, and untying the steel wire rope; The previous steps and precautions are performed again. In this mode, there is no operation prompt. When the operation is completed, if the steps are not completed or the operation is wrong, the user will fall into the valley in the virtual environment and start again. Example: If the steel wire rope is not fixed, the steel bar that the user is standing on will lose its tension and fall into the valley together with the steel bar when lifting. It is understandable that different steps will have corresponding results. When the steps are completed correctly After that, the construction completion screen will be presented, but the present invention is not limited to this.

It is worth mentioning that, according to the interactive script 35 of the first embodiment of the present invention, it includes: at the beginning of the interactive operation, the user will conduct an operation teaching guide according to the voice and text description, learn how to operate and the construction process, Then proceed to the actual operation process. When the user enters the truss after completing the safety measures, he can see that each wire rope hook emits light to signal the user to click. The crane can only be controlled by engaging with the truss, and an arrow will appear in the middle of the truss to indicate to the user to click to control the crane to move the truss forward. Thereby, the user is made aware of the safety of the wire rope and remembers the safe operation link, but the present invention is not limited to this.

In order to further understand the structural features of the present invention, the application of technical means and the expected effect, the actual implementation process of the present invention is described here.

Please refer to FIG. 7 , in conjunction with FIGS. 4 to 6 . FIG. 7 is a flow chart illustrating the steps of the real-world training and learning method actually performed by the smart wearable system according to the first embodiment of the present invention. According to the smart wearable system of the present invention, the actual practice training and learning method is described as follows: firstly, the exploration step S1' is performed, and the user goes to the environment near the bridge project to conduct field exploration and character interviews, and confirm the position of the somatosensory interaction area 15; Next, the planning step S2' is executed. The user plans the animation script 34 and the interactive script 35 according to the result of the exploration step S1'. The animation script 34 and the interactive script 35 are applied to the actual training and learning of the bridge project. The script 34 is planned for the three-dimensional image 32 in the three-dimensional space, and the interactive script 35 is planned for the interactive information 33 generated by the handle 13 ; after that, the animation production step S3 ′ is executed, and the user is produced according to the animation script 34 and the interactive script 35 . The virtual reality data 31, the virtual reality data 31 is formed through the environment near the bridge project, and the virtual reality data 31 is stored in the memory 111 of the control module 11; then the erection step S4' is executed, when After the virtual reality data 31 is completed, the user goes to the somatosensory interaction area 15 selected in the exploration step S1, and sets up the stand 14 and the simulation environment module 16; and then executes the correction step S5', and completes the erection of the stand 14 and the simulation environment model. In the group 16, the user displays the three-dimensional image 32 in the three-dimensional space through the display 21 in the somatosensory interaction area 15, and interacts with the three-dimensional image 32 in the three-dimensional space through the handle 13 to generate interactive information 33, and through the space The locator 22 generates position information 36 according to the position of the handle 13, observes whether the three-dimensional image 32 and the interactive information 33 have errors with the environment near the bridge project, so as to correct the virtual reality data 31; finally, the simulation is performed In the environment step S6 ′, the control module 11 controls the simulation environment module 16 according to the interactive information 33 and the position information 36 generated by the spatial locator 22 , and the simulation environment module 16 generates simulation information.

Thereby, the present invention has the following implementation effect and technical effect:

First, the present invention uses the somatosensory interaction area 15, which is set in the environment near the bridge project, thereby enhancing the user to use the smart wearable system 100 according to the present invention in a virtual scene. Visual changes, sound auditory changes and height changes in order to increase and control the realism and feedback felt by the user.

Second, the present invention uses the simulation environment module 16, which is coupled to the control module 11, and the control module 11 controls the simulation environment module 16 according to the interaction information 33 and the position information 36, so that the simulation environment module 16 generates The simulation information 37 is used to increase the variation factors in the virtual scene when the user uses the smart wearable system 100 according to the present invention, thereby greatly increasing the sense of reality felt by the user in the virtual scene.

Third, the present invention is designed according to the construction conditions of the suspension bridge and the needs of workers through the long-term accumulated experience of those with ordinary knowledge in the field. When converted into a real environment, the experience can be used to improve the professional ability and familiarity of the workers. .

Fourth, the present invention greatly enhances the user's sense of immersion in the real-world training and learning of bridge engineering by using the somatosensory interaction area 15 and matching the simulated environment module 16, and enhances the user's sense of fear when operating errors. In this way, the user's vigilance during the construction process is improved, thereby reducing the accidents that may occur during the construction process.

The embodiments of the present invention are described above by means of specific embodiments. Those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the scope of the present invention; all other equivalent changes or modifications made without departing from the spirit disclosed in the present invention shall be included in the following patent scope Inside.

100: Smart Wearable System

11: Control module

111: Memory

12: Human-machine interface module

121: Communication unit

13: Handle

14: Bracket

141: Upper row bracket

142: Corner Bracket

143: Pedal

144: Bottom plate

1441:Fixing hole

1442: Screws

15: Somatosensory interaction area

16: Simulation environment module

21: Display

22: Spatial Locator

31: Virtual reality information

32: Stereoscopic picture of three-dimensional space

33: Interactive Information

34: Animation Script

35: Interactive Script

36: Location Information

37: Simulation Information

S1: Exploration step

S2: Planning step

S3: Animation production steps

S4: erection steps

S5: Correction steps

S1': Exploration step

S2': Planning step

S3': Animation production steps

S4': erection steps

S5': Correction step

S6': Simulate environment step

1 is a system schematic diagram of a smart wearable system according to the present invention; 2 is a block diagram illustrating steps of a real-world training and learning method for an intelligent wearable system according to the present invention; 3 is a flow chart illustrating the steps of the actual implementation of the real-world training learning method in the smart wearable system according to the present invention; 4 is a system schematic diagram of a smart wearable system according to the first embodiment of the present invention; FIG. 5 is a schematic structural diagram of a bracket according to the first embodiment of the present invention; 6 is a block diagram illustrating the steps of the real-world training and learning method of the smart wearable system according to the first embodiment of the present invention; FIG. 7 is a flow chart illustrating the steps of actually executing the real-world training learning method by the smart wearable system according to the first embodiment of the present invention.

100: Smart Wearable System

11: Control module

111: Memory

12: Human-machine interface module

13: Handle

14: Bracket

15: Somatosensory interaction area

16: Simulation environment module

21: Display

Claims (10)

A smart wearable system, which is applied to the real-world training and learning of a bridge project, the smart wearable system includes: a control module including a memory for storing a virtual reality data formed through the environment near the bridge project; a human-machine interface module, which is informationally connected with the control module, the human-machine interface module is a detachable assembly structure with a display, and the human-machine interface module is electrically connected with the display; a handle, which is coupled to the human-machine interface module; a bracket, which can be simply erected in the environment near the bridge project, the bracket is used to support the user's weight; A one-body interactive area, which is set in the environment near the bridge project, and the somatosensory interactive area is used for users to stand in it to start real-world training and learning of the bridge project; at least one simulated environment module, which is arranged around the somatosensory interaction area; Wherein, the display is used for displaying a three-dimensional image of a three-dimensional space, and the three-dimensional image of the three-dimensional space is formed according to the virtual reality data, and the handle is used for the user to interact with the three-dimensional image of the three-dimensional space to generate a three-dimensional image. Interactive information. The smart wearable system according to claim 1, wherein the simulated environment module is one or a combination of an electric fan, a bracket spring and a speaker. The smart wearable system according to claim 1, wherein the bracket comprises: an upper row of brackets, which is arranged above the somatosensory interaction area, and the upper row of brackets is used for setting a blocking cloth, and the blocking cloth is used to block sunlight and rain; A corner bracket is coupled to the upper bracket, the corner bracket is used to set at least one spacer, the spacer is coupled to the control module, and the spacer is based on the handle location generates a location information; a pedal, which is arranged in the somatosensory interaction area, the pedal is used for the user to stand on it; A plurality of base plates are coupled to the corner brackets, and the number and shape of the base plates are changed according to the environment near the bridge project. The smart wearable system according to claim 1, wherein the control module is one of a computer, a smart handheld device and a server or a combination thereof. The smart wearable system according to claim 1, wherein the human-machine interface module further comprises a communication unit, and the communication unit is used for communicating with the control module and receiving the virtual reality data. The smart wearable system according to claim 3, wherein the base plate includes a plurality of fixing holes, and at least one screw member passes through the fixing holes of the base plate, so that the bracket is erected on the environment near the bridge project. The smart wearable system according to claim 3, wherein the simulated environment module is further coupled to the control module, and the control module controls the simulated environment module according to the interaction information and the position information, and the The simulated environment module generates a simulated information. The smart wearable system according to claim 5, wherein the communication unit uses a radio frequency circuit (RFID), Near Field Communication (NFC), Bluetooth, third-generation mobile communication ( 3G), fourth generation mobile communication (4G), wireless local area network (Wi-Fi), wireless local area network (WLAN), fifth generation mobile communication (5G) one of the wireless communication protocols to receive the virtual reality material. A real-world training and learning method, which is applied to the smart wearable system as described in claim 1, the real-world training and learning method comprises the following steps: In the first exploration step, conduct on-site exploration to the environment near the bridge project, and confirm the location of the somatosensory interaction area; a planning step, according to the result of the exploration step, planning an animation script and an interactive script, the animation script and the interactive script are applied to the real-world training and learning of the bridge project; an animation production step, producing the virtual reality data according to the animation script and the interactive script, the virtual reality data is formed through the environment near the bridge project and stored in the memory of the control module; an erecting step, erecting the bracket and the simulated environment module in the somatosensory interaction area; In a modification step, the user displays the three-dimensional image of the three-dimensional space through the display in the somatosensory interaction area, and generates interactive information by interacting with the three-dimensional image of the three-dimensional space through the handle, so as to observe the three-dimensional image of the three-dimensional space. And whether there is an error between the interactive information and the environment near the bridge project, so that the virtual reality data can be corrected. The real-world training and learning method according to claim 9, wherein the simulated environment module is further coupled to the control module, the real-world training and learning method further comprises a simulated environment step, and the control module is based on The interactive information and a position information generated by at least one spatial locator control the simulated environment module, and the simulated environment module generates a simulated information.

Images