CN114546118B - VR technology-based safety prompt method, device, medium and equipment - Google Patents
VR technology-based safety prompt method, device, medium and equipment Download PDFInfo
- Publication number
- CN114546118B CN114546118B CN202210159384.6A CN202210159384A CN114546118B CN 114546118 B CN114546118 B CN 114546118B CN 202210159384 A CN202210159384 A CN 202210159384A CN 114546118 B CN114546118 B CN 114546118B
- Authority
- CN
- China
- Prior art keywords
- virtual
- user
- preset
- virtual scene
- pupil
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000005516 engineering process Methods 0.000 title claims abstract description 46
- 238000000034 method Methods 0.000 title claims abstract description 43
- 210000001747 pupil Anatomy 0.000 claims abstract description 64
- 230000001960 triggered effect Effects 0.000 claims abstract description 11
- 230000003993 interaction Effects 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 5
- 230000002452 interceptive effect Effects 0.000 claims description 5
- 230000004044 response Effects 0.000 claims description 5
- 238000004088 simulation Methods 0.000 claims description 5
- 230000000875 corresponding effect Effects 0.000 description 45
- 238000010586 diagram Methods 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 230000006378 damage Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 2
- 230000009977 dual effect Effects 0.000 description 2
- WABPQHHGFIMREM-UHFFFAOYSA-N lead(0) Chemical compound [Pb] WABPQHHGFIMREM-UHFFFAOYSA-N 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000009526 moderate injury Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000009419 refurbishment Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application provides a safety prompting method, a device, a medium and equipment based on VR technology, wherein the method comprises the following steps: the method comprises the steps of obtaining pupil images of a user, determining a virtual scene according to the pupil images, responding to an operation instruction input by the user in the virtual scene, determining a target position corresponding to the operation instruction from a preset library, calling controllable virtual equipment corresponding to the target position, and generating prompt information to prompt the user to perform corresponding operation according to the prompt information if the virtual equipment is triggered and is not operated within a preset time period. Through an operation instruction input by a user in the virtual scene, a first target position corresponding to the operation instruction is determined, and controllable virtual equipment is called, so that a worker can control the virtual equipment in the virtual scene, and the worker can properly provide a correct operation flow when misoperation or long-time no operation is performed on the virtual scene.
Description
Technical Field
The application relates to the technical field of safety operation, in particular to a safety prompting method, device, medium and equipment based on VR technology.
Background
At present, with the development and progress of technology, a real scene can be restored through a VR virtual reality technology, so that a user can experience the real scene in the virtual scene. Such as hawaii beach. VR virtual reality is called "information space", "artificial reality", "synthetic environment", etc., and is an advanced computer user interface, which provides various visual and natural real-time perception interaction means such as viewing, listening, sniffing, touching, etc. for a user at the same time, so as to facilitate the operation of the user to the greatest extent, thereby improving the working efficiency of the whole system. With respect to the definition of virtual reality, it can be understood simply that: and a man-machine interaction system which is generated by a computer and can give people various sensory stimuli. However, for inexperienced operators working in the power system, once the operators are in misoperation in the real power system field, serious harm is generated, and the virtual scene constructed in the prior art only displays the scene, and the operators do not provide operation flow prompt information when operating the virtual scene.
Disclosure of Invention
The present application has been made to solve the above-mentioned technical problems. The embodiment of the application provides a safety prompt method, device, medium and equipment based on VR technology, which solves the problem that an operator does not provide operation flow prompt information when operating a virtual scene.
According to one aspect of the application, a safety prompting method based on VR technology is provided, which comprises the steps of obtaining pupil images of a user; determining a virtual scene according to the pupil image; responding to an operation instruction input by the user in the virtual scene; determining a first target position corresponding to the operation instruction from the preset library; invoking controllable virtual equipment corresponding to the first target position; and if the virtual equipment is triggered within a preset time period and is not operated according to the target rule, generating prompt information to prompt the user to perform corresponding operation of the prompt information.
In an embodiment, the determining the virtual scene from the pupil image includes: determining a pupil position in the pupil image; and determining the virtual scene according to the pupil position.
In an embodiment, the determining the virtual scene according to the pupil position includes: obtaining a center coordinate corresponding to the pupil position; and determining the virtual scene according to the central coordinate and a preset coordinate interval.
In an embodiment, the preset coordinate interval is a first preset coordinate interval and a second preset coordinate interval, and a direction of the first preset coordinate interval and a direction of the second preset coordinate interval are opposite coordinate directions, where determining the virtual scene according to the center coordinate and the preset coordinate interval includes: if the center coordinates are in the first preset coordinate interval, displaying a first virtual scene; the first virtual scene is a virtual indoor scene; and if the center coordinate is in the second preset coordinate interval, displaying a second virtual scene; the second virtual scene is a virtual outdoor scene.
In an embodiment, the virtual device includes a line device, and the invoking the controllable virtual device corresponding to the first target location includes: invoking controllable virtual equipment corresponding to the first target position; the target position comprises a prompt sign, and the prompt sign points to the virtual device.
In an embodiment, the VR technology-based security prompting method further includes: if an instruction that the virtual equipment is operated by mistake is received, feedback information is generated; transmitting the feedback information to the interaction equipment so as to enable the interaction equipment to vibrate; the interaction device is used for the user-operated device.
In an embodiment, after the generating the feedback information, the VR technology based security prompting method further includes: and if the hazard degree corresponding to the false operation of the virtual equipment is greater than or equal to a preset hazard degree threshold, generating a simulation animation to display the hazard generated by the false operation of the virtual equipment.
According to another aspect of the present application, there is provided a safety prompting device based on VR technology, including: the acquisition module is used for acquiring pupil images of the user; the virtual scene determining module is used for determining a virtual scene according to the pupil image; the response module is used for responding to an operation instruction input by the user in the virtual scene; the calling module is used for calling the controllable virtual equipment corresponding to the target position; and the generation module is used for generating prompt information to prompt the user to perform corresponding operation according to the prompt information if the virtual equipment is triggered and is not operated within a preset time period.
According to another aspect of the present application, there is provided a computer-readable storage medium storing a computer program for executing any one of the above VR technology based safety prompting methods.
According to another aspect of the present application, there is provided an electronic device including: a processor; a memory for storing the processor-executable instructions; the processor is configured to execute any one of the above-described VR technology-based security prompting methods.
The application provides a safety prompting method, a device, a medium and equipment based on VR technology, wherein the method comprises the following steps: the method comprises the steps of obtaining pupil images of a user, determining a virtual scene according to the pupil images, responding to an operation instruction input by the user in the virtual scene, determining a target position corresponding to the operation instruction from a preset library, calling controllable virtual equipment corresponding to the target position, and generating prompt information to prompt the user to perform corresponding operation according to the prompt information if the virtual equipment is triggered and is not operated within a preset time period. Through an operation instruction input by a user in the virtual scene, a first target position corresponding to the operation instruction is determined, and controllable virtual equipment is called, so that a worker can control the virtual equipment in the virtual scene, and the worker can properly provide a correct operation flow when misoperation or long-time no operation is performed on the virtual scene.
Drawings
The above and other objects, features and advantages of the present application will become more apparent by describing embodiments of the present application in more detail with reference to the attached drawings. The accompanying drawings are included to provide a further understanding of embodiments of the application and are incorporated in and constitute a part of this specification, illustrate the application and together with the embodiments of the application, and not constitute a limitation to the application. In the drawings, like reference numerals generally refer to like parts or steps.
Fig. 1 is a flowchart of a VR technology-based security prompt method according to an exemplary embodiment of the present application.
Fig. 2 is a flowchart of a security prompting method based on VR technology according to another exemplary embodiment of the present application.
Fig. 3 is a flowchart of a security prompting method based on VR technology according to another exemplary embodiment of the present application.
Fig. 4 is a flowchart of a security prompting method based on VR technology according to another exemplary embodiment of the present application.
Fig. 5 is a flowchart of a security prompting method based on VR technology according to another exemplary embodiment of the present application.
Fig. 6 is a flowchart of a security prompting method based on VR technology according to another exemplary embodiment of the present application.
Fig. 7 is a schematic structural diagram of a safety prompting device based on VR technology according to an exemplary embodiment of the present application.
Fig. 8 is a schematic structural diagram of a safety prompting device based on VR technology according to another exemplary embodiment of the present application.
Fig. 9 is a block diagram of an electronic device according to an exemplary embodiment of the present application.
Detailed Description
Hereinafter, exemplary embodiments according to the present application will be described in detail with reference to the accompanying drawings. It should be apparent that the described embodiments are only some embodiments of the present application and not all embodiments of the present application, and it should be understood that the present application is not limited by the example embodiments described herein.
Fig. 1 is a flowchart of a VR technology-based security prompt method according to an exemplary embodiment of the present application. As shown in fig. 1, the VR technology-based security prompting method includes:
step 110: a pupil image of the user is acquired.
The pupil image of the user can be acquired through the interaction host, and the interaction host can be provided with a display and a camera. The camera may capture an image of the pupil of the user. The camera can also be a left camera and a right camera, pupil images of the user are shot through the left camera and the right camera to obtain left images and right images, and the left images are selected to be subjected to image processing or the right images are selected to be subjected to image processing, so that pupil images of the user are obtained.
Step 120: and determining a virtual scene according to the pupil image.
And performing image processing on the pupil image to obtain a new pupil image, and determining a virtual scene according to the position or coordinate point of the pupil in the pupil image. For example, if the pupil of the user is detected to be at the far left or near left hand, then a corresponding virtual scene in the room may be acquired. And detecting that the pupil of the user is at the rightmost side or near the right hand direction, and correspondingly acquiring an outdoor virtual scene.
Step 130: and responding to an operation instruction input by a user in the virtual scene.
The user inputs an operation instruction in the virtual scene through the interaction device, wherein the operation instruction can be a walking instruction, a rotation instruction in a target direction and the like, and the interaction device can be a keyboard, a mouse, a handle and the like. And generating an operation instruction through the operation of the user on the interaction equipment and inputting the operation instruction into the virtual scene. And responding to the operation instruction to enable the display device of the interaction device to display corresponding actions.
Step 140: and determining a target position corresponding to the operation instruction from a preset library.
The preset library can be set and stored to store a plurality of target positions and operation instructions corresponding to the plurality of positions, for example, a preset number of keys can be set on a keyboard, each key corresponds to one target position, if the operation instruction of pressing the R key is obtained, the position of the electrical cabinet corresponding to the operation instruction of pressing the R key can be determined from the preset library, and the electrical cabinet is displayed on the display device of the interaction host.
Step 150: and calling the controllable virtual equipment corresponding to the target position.
Each target location may correspond to a virtual device or virtual object, then a controllable virtual device corresponding to the target location may be invoked, where the controllable virtual device may be a wire connection in the virtual device, a faulty wire removal, a refurbishment of a faulty main transformer, a device installation, etc. And the operation flow corresponding to the virtual equipment can be fetched, the first operation flow in the operation flows is displayed, and after the user of the first operation flow operates successfully, the second operation flow in the operation flows is displayed. It should be appreciated that the target location may be a target point on a road in a virtual scene, not just the target location to which the device corresponds.
Step 160: if the virtual equipment is triggered and is not operated within the preset time period, generating prompt information to prompt a user to perform corresponding operation according to the prompt information.
If the virtual device is triggered and does not operate according to the target flow (target operation flow) within the preset time period, generating prompt information to prompt a user to perform corresponding operation according to the prompt information. For example, the user activates a virtual device (helmet), but after 3 minutes does not bring the helmet up, so a prompt is generated to prompt the user that the user needs to bring up the helmet, and the instruction to bring up the helmet can be generated by the user operating a keyboard, mouse, handle, or the like. Also for example, a user may grasp the dual control harness with his hand, and if not operating, will alert that the dual control harness is being taken. Also for example, standing on the transformer cross arm grounds the high side low side. The safety belt hook is hung on the cross arm (if the hook is not hung on the cross arm, the staff is enabled to have a high falling feeling at the moment, and after falling sounds are made, the staff is reminded of violating the safety regulations at the moment, and the user is required to hang the hook on the cross arm and then continue to operate). The transformer is removed, the low-voltage side disconnecting link of the transformer is opened, the old transformer is removed from the lead wire, and the secondary metering lead wire is replaced (the strong wind is simulated at the moment, so that staff has the sense of falling down, and the voice reminding is carried out to replace the metering device in the platform area, and attention is paid to weather changes so as not to be dangerous). And placing a dangerous point safety measure text, reminding signature confirmation through a user interface, and if the user interface is not operated, reminding that the dangerous point safety measure signature confirmation is carried out before the operation. The prompt information can also be provided with a voice prompt function, and the user can be prompted by voice, wherein the voice prompt comprises wrong operation, next operation, stop operation and the like.
The application provides a safety prompting method based on VR technology, which comprises the following steps: the method comprises the steps of obtaining pupil images of a user, determining a virtual scene according to the pupil images, responding to an operation instruction input by the user in the virtual scene, determining a target position corresponding to the operation instruction from a preset library, calling controllable virtual equipment corresponding to the target position, and generating prompt information to prompt the user to perform corresponding operation according to the prompt information if the virtual equipment is triggered and is not operated within a preset time period. Through an operation instruction input by a user in the virtual scene, a first target position corresponding to the operation instruction is determined, and controllable virtual equipment is called, so that a worker can control the virtual equipment in the virtual scene, and the worker can properly provide a correct operation flow when misoperation or long-time no operation is performed on the virtual scene.
Fig. 2 is a flowchart of a security prompting method based on VR technology according to another exemplary embodiment of the present application. As shown in fig. 2, step 120 may include:
step 121: pupil position in the pupil image is determined.
The coordinates corresponding to the pupil position can be determined by setting up a coordinate system, selecting a plurality of edge points for the pupil position in the pupil image, and determining the coordinate system of the plurality of edge points.
Step 122: and determining a virtual scene according to the pupil position.
The coordinate interval may be set to verify whether the coordinate systems of the plurality of edge points are all within the coordinate interval, or the number of the coordinate systems of the plurality of edge points within the coordinate interval is greater than or equal to a first preset number threshold. For example, if there are 5 edge points, but 4 are within the coordinate interval, then it is determined that the pupil position is within the coordinate interval. The coordinate interval may correspond to a virtual scene, and if there are a plurality of coordinate intervals, a plurality of virtual scenes are corresponding.
Fig. 3 is a flowchart of a security prompting method based on VR technology according to another exemplary embodiment of the present application. As shown in fig. 3, step 122 may include:
step 1221: and obtaining the center coordinates corresponding to the pupil positions.
The pupil image is divided so as to be divided into a plurality of images with equal areas, namely, the pupil image is divided by lines in the transverse line, the vertical line and other directions, and the intersection point of the final lines is the center coordinate corresponding to the pupil position.
Step 1222: and determining the virtual scene according to the central coordinate and the preset coordinate interval.
And setting a preset coordinate interval, and determining a corresponding virtual scene when the central coordinate is in the preset coordinate interval.
In an embodiment, the preset coordinate interval is a first preset coordinate interval and a second preset coordinate interval, and the direction of the first preset coordinate interval and the direction of the second preset coordinate interval are opposite coordinate directions, and step 1222 may be implemented as follows: if the center coordinates are within the first preset coordinate interval, displaying a first virtual scene, wherein the first virtual scene is a virtual indoor scene, and if the center coordinates are in the second preset coordinate interval, displaying a second virtual scene, wherein the second virtual scene is a virtual outdoor scene.
And if the center coordinates are in the first preset coordinate interval, displaying a first virtual scene, wherein the first virtual scene is a virtual indoor scene. And if the center coordinates are in the second preset coordinate interval, displaying a second virtual scene, wherein the second virtual scene is a virtual outdoor scene.
Fig. 4 is a flowchart of a security prompting method based on VR technology according to another exemplary embodiment of the present application. The virtual device comprises a line device, and step 150 may comprise:
Step 151: and calling the controllable virtual device corresponding to the target position, wherein the target position comprises a prompt sign, and the prompt sign points to the virtual device.
Because the number of the invoked virtual devices may be plural, a hint symbol may be displayed when the virtual device is displayed, the hint symbol pointing to the virtual device, so that the user may determine the target virtual device, i.e., the virtual device being viewed. If the number of the called virtual devices is 1, the user can intuitively determine the target virtual device.
Fig. 5 is a flowchart of a security prompting method based on VR technology according to another exemplary embodiment of the present application. As shown in fig. 5, the VR technology-based security prompt method may further include:
step 170: and if an instruction that the virtual equipment is operated by mistake is received, generating feedback information.
If an instruction that the virtual equipment is operated by mistake is received, namely the virtual equipment is not operated according to the operation prompt in the target flow, feedback information is generated, and the feedback information is provided with a vibration instruction. For example, if the operation prompt should first connect the insulating sheet and then connect the wire, and the user connects the wire directly, i.e. does not operate according to the operation prompt in the target flow, then feedback information is generated, and the feedback information has a vibration instruction to prompt the user to perform wrong operation.
Step 180: and sending the feedback information to the interactive equipment so as to enable the interactive equipment to vibrate, wherein the interactive equipment is equipment directly operated by a user.
And sending the vibration instruction carried by the feedback information to the interaction equipment so as to enable the interaction equipment to vibrate, thereby enabling a user to clearly know that the operation is wrong. For example, when the VR substation electric energy meter is tested, in the process of current string and voltage, the short circuit piece should be connected first, and if the short circuit piece is not connected first but other operations are performed, the handle feeds back the vibration sense of electric shock.
Fig. 6 is a flowchart of a security prompting method based on VR technology according to another exemplary embodiment of the present application. As shown in fig. 6, after step 180, the VR technology based security prompt method may further include:
Step 190: if the hazard degree grade corresponding to the false operation of the virtual equipment is larger than or equal to the preset hazard degree grade threshold, generating a simulation animation to display a hazard scene generated by the false operation of the virtual equipment.
If the hazard degree level corresponding to the false operation of the virtual equipment is greater than or equal to the preset hazard degree level threshold, generating a simulation animation, wherein the simulation animation simulates the occurrence of a real situation, so that a user can intuitively see the serious hazard caused by the false operation. The hazard degree level can be set to 3 levels, namely high, medium and low, and the high level indicates that the hazard degree is large, and the personal safety can be seriously influenced. The medium grade indicates moderate damage degree, equipment damage is easy to cause, and the low grade indicates lower damage degree and has less influence on the damage of the equipment.
In addition, if the virtual device is finished according to the operation of the preset operation flow, a score interface is generated.
The score interface displays the times of user misoperation, the severity level when the user misoperation is performed, and the like, so that the user can intuitively know the defects of the user. If the virtual equipment is finished according to the operation of the preset operation flow, storing the video animation in the operation process and storing the video animation in a video library, wherein a user can download the video animation into a mobile phone or other mobile equipment and watch the video animation at any time and any place.
After the score interface is generated, if an instruction of freely observing the virtual scene by the user is received, the user can freely observe and operate the virtual scene without operating according to a preset flow, so that the user can freely operate any equipment of the virtual scene, the user can not be prompted any more, and only an operation animation is generated. If the user has wrong operation in free operation, the operation animation can also display the harm brought by operation, so that the user can more intuitively see the running state of each device and how to operate the device correctly.
Fig. 7 is a schematic structural diagram of a safety prompting device based on VR technology according to an exemplary embodiment of the present application. As shown in fig. 7, the VR technology-based safety prompting device 20 includes: the system comprises an acquisition module 201, a virtual scene determination module 202, a response module 203, a target position determination module 204, a retrieval module 205 and a generation module 206, wherein the acquisition module is used for acquiring pupil images of a user, the virtual scene determination module 202 is used for determining a virtual scene according to the pupil images, the response module 203 is used for responding to an operation instruction input by the user in the virtual scene, the target position determination module 204 is used for determining a target position corresponding to the operation instruction from a preset library, the retrieval module 205 is used for retrieving controllable virtual equipment corresponding to the target position, and the generation module 206 is used for generating prompt information to prompt the user to perform corresponding operation according to the prompt information if the virtual equipment is triggered and is not operated within a preset time period.
The application provides a safety prompting device based on VR technology, which is characterized in that an acquisition module 201 acquires pupil images of a user, a virtual scene determining module 202 determines a virtual scene according to the pupil images, a response module 203 responds to an operation instruction input by the user in the virtual scene, a target position determining module 204 determines a target position corresponding to the operation instruction from a preset library, a calling module 205 calls controllable virtual equipment corresponding to the target position, and a generating module 206 generates prompting information to prompt the user to perform corresponding operation according to the prompting information if the virtual equipment is triggered and is not operated within a preset time period. Through an operation instruction input by a user in the virtual scene, a first target position corresponding to the operation instruction is determined, and controllable virtual equipment is called, so that a worker can control the virtual equipment in the virtual scene, and the worker can properly provide a correct operation flow when misoperation or long-time no operation is performed on the virtual scene.
Fig. 8 is a schematic structural diagram of a safety prompting device based on VR technology according to another exemplary embodiment of the present application. As shown in fig. 8, the virtual scene determination module 202 may include: a pupil position determination unit 2021 for determining a pupil position in the pupil image, and a virtual scene determination subunit 2022 for determining a virtual scene from the pupil position.
In an embodiment, the virtual scene determination subunit 2022 may be specifically configured to: obtaining a center coordinate corresponding to the pupil position; and determining the virtual scene according to the central coordinate and the preset coordinate interval.
In an embodiment, the preset coordinate interval is a first preset coordinate interval and a second preset coordinate interval, and the direction of the first preset coordinate interval and the direction of the second preset coordinate interval are opposite coordinate directions, where the virtual scene determination subunit 2022 may be specifically configured to: if the center coordinates are in the first preset coordinate interval, displaying a first virtual scene; the first virtual scene is a virtual indoor scene; and if the center coordinate is in the second preset coordinate interval, displaying a second virtual scene; the second virtual scene is a virtual outdoor scene.
In an embodiment, the virtual device comprises a line device, wherein the invoking module 205 may comprise: the retrieving subunit 2051 is configured to retrieve a controllable virtual device corresponding to a target location, where the target location includes a hint symbol, and the hint symbol points to the virtual device.
In one embodiment, the VR technology based safety reminder device 20 may include: a generating unit 207, configured to generate feedback information if an instruction that the virtual device is operated by mistake is received; and a sending unit 208, configured to send the feedback information to the interaction device to generate vibration on the interaction device, where the interaction device is a device directly operated by the user.
In one embodiment, the VR technology based safety reminder device 20 may include: the simulated animation unit 209 is configured to generate a simulated animation to display a hazard scene generated by the virtual device being operated by mistake if the hazard level corresponding to the virtual device being operated by mistake is greater than or equal to the preset hazard level threshold.
Fig. 9 illustrates a block diagram of an electronic device according to an embodiment of the application.
As shown in fig. 9, the electronic device 10 includes one or more processors 11 and a memory 12.
The processor 11 may be a Central Processing Unit (CPU) or other form of processing unit having data processing and/or instruction execution capabilities, and may control other components in the electronic device 10 to perform desired functions.
Memory 12 may include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, random Access Memory (RAM) and/or cache memory (cache), and the like. The non-volatile memory may include, for example, read Only Memory (ROM), hard disk, flash memory, and the like. One or more computer program instructions may be stored on the computer readable storage medium that can be executed by the processor 11 to implement the VR technology based security prompting method and/or other desired functions of the various embodiments of the application described above. Various contents such as an input signal, a signal component, a noise component, and the like may also be stored in the computer-readable storage medium.
In one example, the electronic device 10 may further include: an input device 13 and an output device 14, which are interconnected by a bus system and/or other forms of connection mechanisms (not shown).
When the electronic device is a stand-alone device, the input means 13 may be a communication network connector for receiving the acquired input signals from the first device and the second device.
In addition, the input device 13 may also include, for example, a keyboard, a mouse, and the like.
The output device 14 may output various information to the outside, including the determined distance information, direction information, and the like. The output means 14 may include, for example, a display, speakers, a printer, and a communication network and remote output devices connected thereto, etc.
Of course, only some of the components of the electronic device 10 that are relevant to the present application are shown in fig. 9 for simplicity, components such as buses, input/output interfaces, etc. are omitted. In addition, the electronic device 10 may include any other suitable components depending on the particular application.
The computer program product may write program code for performing operations of embodiments of the present application in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server.
The computer readable storage medium may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may include, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The foregoing description has been presented for purposes of illustration and description. Furthermore, this description is not intended to limit embodiments of the application to the form disclosed herein. Although a number of example aspects and embodiments have been discussed above, a person of ordinary skill in the art will recognize certain variations, modifications, alterations, additions, and subcombinations thereof.
Claims (8)
1. The safety prompting method based on the VR technology is characterized by comprising the following steps:
Acquiring pupil images of a user;
Determining a pupil position in the pupil image;
obtaining a center coordinate corresponding to the pupil position;
determining a virtual scene according to the central coordinate and a preset coordinate interval;
responding to an operation instruction input by the user in the virtual scene;
Determining a target position corresponding to the operation instruction from a preset library;
invoking controllable virtual equipment corresponding to the target position; and
If the virtual equipment is triggered and is not operated within a preset time period, generating prompt information to prompt the user to perform corresponding operation according to the prompt information;
The obtaining the center coordinates corresponding to the pupil position includes:
And dividing the pupil image, wherein the pupil image is divided into a plurality of images with equal areas by lines in the transverse line, the vertical line and other directions, and the intersection point of the final lines is the center coordinate corresponding to the pupil position.
2. The VR technology-based safety prompting method of claim 1, wherein the preset coordinate interval is a first preset coordinate interval and a second preset coordinate interval, and a direction of the first preset coordinate interval and a direction of the second preset coordinate interval are opposite coordinate directions, and wherein determining the virtual scene according to the center coordinate and the preset coordinate interval includes:
If the center coordinates are in the first preset coordinate interval, displaying a first virtual scene; the first virtual scene is a virtual indoor scene; and
If the center coordinates are in the second preset coordinate interval, displaying a second virtual scene; the second virtual scene is a virtual outdoor scene.
3. The VR technology based security prompt method of claim 1, wherein the virtual device comprises a line device, and wherein the invoking the controllable virtual device corresponding to the target location comprises:
invoking controllable virtual equipment corresponding to the target position; the target position comprises a prompt sign, and the prompt sign points to the virtual device.
4. The VR technology based safety prompting method of claim 1, further comprising:
If an instruction that the virtual equipment is operated by mistake is received, feedback information is generated; and
Transmitting the feedback information to an interactive device to enable the interactive device to vibrate; the interaction device is a device directly operated by the user.
5. The VR technology security prompt method of claim 4, further comprising, after the generating the feedback information:
And if the hazard degree grade corresponding to the false operation of the virtual equipment is greater than or equal to a preset hazard degree grade threshold, generating a simulation animation to display a hazard scene generated by the false operation of the virtual equipment.
6. Safety suggestion device based on VR technique, characterized by, include:
the acquisition module is used for acquiring pupil images of the user;
The virtual scene determining module is used for determining the pupil position in the pupil image;
obtaining a center coordinate corresponding to the pupil position;
determining the virtual scene according to the central coordinate and a preset coordinate interval;
The obtaining the center coordinates corresponding to the pupil position includes:
dividing the pupil image, wherein the pupil image is divided by lines in the transverse line, the vertical line and other directions so as to be divided into a plurality of images with equal areas, and the intersection point of the final lines is the center coordinate corresponding to the pupil position;
the response module is used for responding to an operation instruction input by the user in the virtual scene;
The target position determining module is used for determining a target position corresponding to the operation instruction from a preset library;
the calling module is used for calling the controllable virtual equipment corresponding to the target position; and
And the generation module is used for generating prompt information to prompt the user to perform corresponding operation according to the prompt information if the virtual equipment is triggered and is not operated within a preset time period.
7. A computer readable storage medium storing a computer program for executing the VR technology based security prompt method of any one of the preceding claims 1-5.
8. An electronic device, the electronic device comprising:
A processor;
a memory for storing the processor-executable instructions;
The processor is configured to perform the VR technology based security prompt method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210159384.6A CN114546118B (en) | 2022-02-21 | 2022-02-21 | VR technology-based safety prompt method, device, medium and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210159384.6A CN114546118B (en) | 2022-02-21 | 2022-02-21 | VR technology-based safety prompt method, device, medium and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114546118A CN114546118A (en) | 2022-05-27 |
| CN114546118B true CN114546118B (en) | 2024-08-20 |
Family
ID=81677861
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210159384.6A Active CN114546118B (en) | 2022-02-21 | 2022-02-21 | VR technology-based safety prompt method, device, medium and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114546118B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106843150A (en) * | 2017-02-28 | 2017-06-13 | 清华大学 | A kind of industry spot simulation method and device |
| CN113534959A (en) * | 2021-07-27 | 2021-10-22 | 咪咕音乐有限公司 | Screen display method, screen display device, virtual reality equipment and program product |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100376415B1 (en) * | 2000-11-27 | 2003-03-19 | 주식회사 알파엔지니어링 | Pupil acquisition method using eye image |
| KR101255219B1 (en) * | 2011-10-13 | 2013-04-24 | 상명대학교 산학협력단 | Method of eye-gaze tracking and system adopting the method |
| US10284839B2 (en) * | 2015-01-21 | 2019-05-07 | Chengdu Idealsee Technology Co., Ltd. | Binocular see-through AR head-mounted display device and information display method therefor |
| TWI557601B (en) * | 2015-10-30 | 2016-11-11 | 由田新技股份有限公司 | A puppil positioning system, method, computer program product and computer readable recording medium |
| CN105511618A (en) * | 2015-12-08 | 2016-04-20 | 北京小鸟看看科技有限公司 | 3D input device, head-mounted device and 3D input method |
| CN111124133A (en) * | 2019-12-30 | 2020-05-08 | 腾讯科技（深圳）有限公司 | Method, device, equipment and storage medium for danger prompt information in virtual scene |
| CN113703574A (en) * | 2021-08-26 | 2021-11-26 | 南京邮电大学盐城大数据研究中心 | VR medical learning method and system based on 5G |
-
2022
- 2022-02-21 CN CN202210159384.6A patent/CN114546118B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106843150A (en) * | 2017-02-28 | 2017-06-13 | 清华大学 | A kind of industry spot simulation method and device |
| CN113534959A (en) * | 2021-07-27 | 2021-10-22 | 咪咕音乐有限公司 | Screen display method, screen display device, virtual reality equipment and program product |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114546118A (en) | 2022-05-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106530887B (en) | Fire scene simulating escape method and device | |
| CN104184731A (en) | Information display method, device and system | |
| US9472119B2 (en) | Computer-implemented operator training system and method of controlling the system | |
| CN111049687B (en) | Equipment maintenance video operation guide file processing method and device and AR terminal | |
| CN109829300A (en) | APP dynamic depth malicious act detection device, method and system | |
| CN103093279A (en) | Emergency command system and method | |
| CN110706542A (en) | Electric power operation somatosensory training system based on immersion virtual technology | |
| CN101859228A (en) | User interface control method and terminal equipment | |
| CN109147450A (en) | A kind of electric shock accidents dummy emulation method, device and server | |
| CN112286411A (en) | Display mode control method and device, storage medium and electronic equipment | |
| CN110175061B (en) | Animation-based interaction method and device and electronic equipment | |
| CN108470131A (en) | Method and apparatus for generating prompt message | |
| US20200273120A1 (en) | Power grid decision-making support device and method, and system applying same | |
| CN114546118B (en) | VR technology-based safety prompt method, device, medium and equipment | |
| CN115047976A (en) | Multi-level AR display method and device based on user interaction and electronic equipment | |
| WO2024114245A1 (en) | Power scenario electric shock experience simulation method and apparatus based on virtual reality | |
| CN110943958B (en) | State supervision method, device, server and storage medium | |
| CN209486946U (en) | Protection simulation training platform system based on VR technology | |
| EP4336843A1 (en) | Touch animation display method and apparatus, device, and medium | |
| KR102274853B1 (en) | Undergrounding and maintenance method of power lines | |
| CN115062182A (en) | Fire-fighting component calibration method and device, electronic equipment and storage medium | |
| CN108874141A (en) | A kind of body-sensing browsing method and device | |
| CN107808080A (en) | The management method and electric terminal of application program | |
| CN111598445A (en) | Safety measure arrangement scheme design method and device | |
| CN117995035A (en) | Nuclear power plant emergency repair operation training system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |