CN107024982A - A kind of method for safety monitoring of virtual reality device, device and virtual reality device - Google Patents

A kind of method for safety monitoring of virtual reality device, device and virtual reality device Download PDF

Info

Publication number
CN107024982A
CN107024982A CN201611129582.9A CN201611129582A CN107024982A CN 107024982 A CN107024982 A CN 107024982A CN 201611129582 A CN201611129582 A CN 201611129582A CN 107024982 A CN107024982 A CN 107024982A
Authority
CN
China
Prior art keywords
virtual reality
picture
environmental information
sound
preset security
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201611129582.9A
Other languages
Chinese (zh)
Inventor
柳林东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201611129582.9A priority Critical patent/CN107024982A/en
Publication of CN107024982A publication Critical patent/CN107024982A/en
Priority to TW106132246A priority patent/TWI687901B/en
Priority to PCT/CN2017/113604 priority patent/WO2018103567A1/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/20Scenes; Scene-specific elements in augmented reality scenes

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the present application discloses a kind of method for safety monitoring of virtual reality device, device and virtual reality device.This method includes:Whether the environmental information that monitoring of environmental awareness apparatus is obtained matches with preset security critical message;When the environmental information monitored is matched with preset security critical message, the real scene picture that picture pick-up device is shot is shown in the display page of virtual reality scenario.Using the embodiment of the present application, it may assist in and rapidly enter real scene using the user of virtual reality device, and then ensure the safety of user, lift Consumer's Experience.

Description

A kind of method for safety monitoring of virtual reality device, device and virtual reality device
Technical field
The application is related to technical field of information processing, more particularly to a kind of method for safety monitoring of virtual reality device, dress Put and virtual reality device.
Background technology
Virtual reality (Virtual Reality, VR) technology is a kind of can to create the computer with the experiencing virtual world Analogue system, it generates the interactive Three-Dimensional Dynamic what comes into a driver's that a kind of simulated environment is a kind of Multi-source Information Fusion using computer With the system emulation of entity behavior, user is set to be immersed in the environment.
Increasingly mature with VR technologies, the application based on VR technologies is also increasing, such as VR aobvious equipment is gradually Gradually turn into one of amusement equipment essential in the life of people.In general, VR aobvious equipment can be divided into three classes:Circumscribed Aobvious equipment, mobile termination show equipment and the aobvious equipment of integral type.Wherein, circumscribed head shows equipment, and better user experience possesses Independent screen, but product structure is complicated, and technology content is higher, and is fettered by data wire, and user can not be freely movable;It is mobile Termination shows equipment, may be viewed by as long as being put into the mobile terminal devices such as mobile phone, easy to use;The aobvious equipment of integral type, without by means of Any input-output equipment is helped just to experience the visual impact that 3D third dimensions are brought heartily in the virtual world.But in user During using VR aobvious equipment, temporarily it can be immersed in virtual environment, and true environment is isolated, therefore, user can not discover The safety problem such as collision present in true environment.For example, user is while using VR aobvious equipment, while when moving, because The situation do not seen desk at the moment in time and wounded.Therefore, one kind is needed to make for VR aobvious equipment in the prior art Occur during temporarily isolated because of user with true environment caused by safety problem treatment mechanism.
The content of the invention
The purpose of the embodiment of the present application is to provide a kind of method for safety monitoring of virtual reality device, device and virtual reality Equipment, to rapidly enter real scene, it is ensured that the safety of user, lifts Consumer's Experience.
In order to solve the above technical problems, what the embodiment of the present application was realized in:
A kind of method for safety monitoring of virtual reality device, including:
Whether the environmental information that monitoring of environmental awareness apparatus is obtained matches with preset security critical message;
When the environmental information monitored is matched with preset security critical message, show in the display page of virtual reality scenario Show the real scene picture that picture pick-up device is shot.
A kind of safety monitoring device of virtual reality device, including:
Monitoring modular, for monitoring of environmental awareness apparatus obtain environmental information whether with preset security critical message phase Match somebody with somebody;
Display module, for when the environmental information monitored is matched with preset security critical message, in virtual reality The display page of scape shows the real scene picture that picture pick-up device is shot.
A kind of virtual reality device, including:
Processor, for performing computer program instructions, the computer program instructions include:Monitoring of environmental awareness apparatus Whether the environmental information of acquisition matches with preset security critical message;When the environmental information monitored and the critical letter of preset security During breath matching, the display page for being sent in virtual reality scenario shows the instruction for the real scene picture that picture pick-up device is shot;
Environment sensing equipment, is coupled in the processor, for obtaining environmental information;
Picture pick-up device, is coupled in the processor, for shooting real scene picture;
Display device, is coupled in the processor, for showing that the shooting is set in the display page of virtual reality scenario The standby real scene picture shot.
The technical scheme provided from above the embodiment of the present application, the embodiment of the present application passes through monitoring of environmental awareness apparatus Whether the environmental information of acquisition matches with preset security critical message can monitor collision that may be present around user in real time Situations such as, then, when the environmental information monitored is matched with preset security critical message, that is, having found that it is likely that the danger of presence , can be by the side for showing the real scene picture that page display picture pick-up device is shot of virtual reality scenario during dangerous situation condition Formula, takes in the premise of virtual reality device without cumbersome, allows user to rapidly enter in real scene, and then can keep away Exempt from the safety problems such as collision, it is ensured that safety of the user during using virtual reality device.
Brief description of the drawings
, below will be to embodiment or existing in order to illustrate more clearly of the embodiment of the present application or technical scheme of the prior art There is the accompanying drawing used required in technology description to be briefly described, it should be apparent that, drawings in the following description are only this Some embodiments described in application, for those of ordinary skill in the art, are not paying the premise of creative labor Under, other accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 is a kind of schematic flow sheet of embodiment of the method for safety monitoring for the virtual reality device that the application is provided;
Fig. 2 is that the display page in virtual reality scenario that the application is provided shows that the real scene that picture pick-up device is shot is drawn A kind of schematic diagram of embodiment in face;
Fig. 3 is that the display page in virtual reality scenario that the application is provided shows that the real scene that picture pick-up device is shot is drawn The schematic diagram of another embodiment in face;
Fig. 4 is a kind of structural representation of embodiment of the safety monitoring device for the virtual reality device that the application is provided;
Fig. 5 is a kind of structural representation of the embodiment for the virtual reality device that the application is provided;
Fig. 6 is a kind of structural representation of the embodiment for a kind of VR aobvious equipment that the application is provided;
Fig. 7 is the structural representation of another embodiment for a kind of VR aobvious equipment that the application is provided.
Embodiment
The embodiment of the present application provides a kind of method for safety monitoring of virtual reality device, device and virtual reality device.
In order that those skilled in the art more fully understand the technical scheme in the application, it is real below in conjunction with the application The accompanying drawing in example is applied, the technical scheme in the embodiment of the present application is clearly and completely described, it is clear that described implementation Example only some embodiments of the present application, rather than whole embodiments.Based on the embodiment in the application, this area is common The every other embodiment that technical staff is obtained under the premise of creative work is not made, should all belong to the application protection Scope.
Hereinafter implementing for the embodiment of the present application is described in detail with several specific examples.
Introduce a kind of embodiment of the method for safety monitoring of virtual reality device of the application first below.Fig. 1 is the application A kind of schematic flow sheet of embodiment of the method for safety monitoring of the virtual reality device of offer, this application provides such as embodiment Or the method operating procedure described in flow chart, but based on conventional or can include without performing creative labour more or less Operating procedure.The step of being enumerated in embodiment order is only a kind of mode in numerous step execution sequences, is not represented unique Execution sequence., can be according to embodiment or method shown in the drawings when system or client production in practice is performed Order is performed or parallel execution (environment of such as parallel processor or multiple threads).Specifically as shown in figure 1, described Method can include:
S110:Whether the environmental information that monitoring of environmental awareness apparatus is obtained matches with preset security critical message.
In the embodiment of the present application, the environmental information, which can combine specific environment sensing equipment, includes one or more instead Reflect the information of ambient condition.For example when the environment sensing equipment is sound transducer, the environmental information can include sound The information such as loudness, the tone of sound.Specifically, the preset security critical message can include combining practical situations and environment The information for the safety critical state that the environmental information that awareness apparatus is obtained is pre-set.Specifically, the environment sensing equipment can To be external in corresponding VR aobvious equipment, can also be integrated with corresponding VR aobvious equipment, the embodiment of the present application and with the above State and be limited.Specifically, the environment sensing equipment can at least include it is following in one kind:
Sound transducer, light sensor, radar sensor, picture pick-up device.
Furthermore, it is necessary to which explanation, environment sensing equipment described in the embodiment of the present application is not limited in above-mentioned enumerate Sensor, picture pick-up device, in actual applications, can also include other equipment that can perceive environment, such as temperature sensor The environmental information obtained Deng, herein described sound transducer, light sensor, radar sensor, picture pick-up device can include Environmental information under the most of dangerous situations run into people's daily life, and then can ensure using virtual reality device The safety of user, improves Consumer's Experience, improves user's buying rate, but the embodiment of the present application is not limited with above-mentioned.
Specifically, the environmental information whether with preset security critical message match can include the environmental information with Whether the preset security critical message meets both matched rules pre-set.Such as, when the environmental information can be with When being quantified as specific numerical value, whether the environmental information matches with preset security critical message can include environment letter Whether breath is more than the preset security critical message.Accordingly, matched rule here can include environmental information more than default Safety critical information.
S120:When the environmental information monitored is matched with preset security critical message, in the display of virtual reality scenario The page shows the real scene picture that picture pick-up device is shot.
, can be virtual when the environmental information monitored is matched with preset security critical message in the embodiment of the present application The display page of reality scene shows the real scene picture that picture pick-up device is shot.So user can directly be seen that true ring Border, into real scene, it is to avoid because user can not discover safety problem caused by true environment.
Specifically, the environmental information monitored is matched with preset security critical message can include the environmental information Meet the matched rule between the two pre-set between the preset security critical message.
Specifically, working as the environment sensing equipment includes sound transducer, and when meeting at least one of following conditions, It is determined that the environmental information monitored matches with preset security critical message:
Monitor that the loudness of sound in the sound wave that sound transducer is detected is more than default loudness value;
The tone and preset tones for monitoring sound in the sound wave that sound transducer is detected match;
Monitor that the sound wave that sound transducer is detected includes default vocabulary.
In a specific embodiment, when user is using VR aobvious equipment, and during moving, it is assumed that i.e. When will bump against a certain article, someone shouts prompting.Accordingly, the loudness for the sound shouted can reach certain value, can To be monitored by way of monitoring the loudness of the sound in the sound wave that sound transducer is detected and whether being more than default loudness value A certain article situation may be bumped against by going out user in above-mentioned scene.Specifically, the sound wave conversion that sound transducer can be detected Into electric wave, and further recognize the loudness of sound.Accordingly, the loudness of sound here is the environmental information.Specifically, this Apply in embodiment, the default loudness value can include the numerical value pre-set according to practical situations.
In another specific embodiment, VR aobvious equipment is used when user is waiting car, it is assumed that just nearby have car In reversing, accordingly, the car send frequency fixation " dichloro-diphenyl-dichlorothane " sound (assuming that frequency be 3Hz).Assuming that preset tones include institute State frequency fix (3Hz) " dichloro-diphenyl-dichlorothane ".Accordingly, can be by monitoring the sound of sound in the sound wave that sound transducer is detected Adjust whether the mode matched with preset tones detects the situation that user may be knocked down by car in above-mentioned scene.Specifically, The sound wave that sound transducer is detected can be converted into electric wave, and further recognize the tone of sound.Accordingly, sound here The tone of sound is the environmental information.Specifically, in the embodiment of the present application, the preset tones can include according to practical application The tone for the specific frequency that situation is pre-set, the preset tones can include one or more different tones.The prison The tone and preset tones for measuring sound in the sound wave that sound transducer is detected, which match, can include monitoring sound sensor The corresponding frequency of the tone of sound frequency corresponding with the tone that the preset tones are included is consistent in the sound wave that device is detected.
In another specific embodiment, when user is when using VR aobvious equipment, it is assumed that just someone pushes a pile Article passes through, and needs user's avoidance to ensure not collided by article, general, the people for pushing away article, which can loudly shout, " to take care, allows One allows ".Assuming that default vocabulary includes taking care or allowed, accordingly, it can be detected by monitoring sound transducer Whether include default vocabulary in sound wave and detect the situation that user may be collided by article in above-mentioned scene.Specifically, can be with The sound wave that sound transducer is detected is converted into electric wave, and further identifies vocabulary therein.Accordingly, sound wave here For the environmental information.Specifically, in the embodiment of the present application, the default vocabulary can include advance according to practical situations The vocabulary of setting.The vocabulary that the default vocabulary can constitute for single word or multiple words.In addition, described in the embodiment of the present application Default vocabulary be not limited in it is above-mentioned take care or allow, in practical application, other vocabulary can also be included, for example carefully Deng the embodiment of the present application is not limited with above-mentioned.
Specifically, working as the environment sensing equipment includes light sensor, and when meeting at least one of following conditions, It is determined that the environmental information monitored matches with preset security critical message:
Monitor that the amplitude of variation of luminous intensity that light sensor detects in the unit interval is more than predetermined threshold value;
Monitor that the change frequency for the luminous intensity that light sensor is detected is more than predeterminated frequency value.
In a specific embodiment, when user is when using VR aobvious equipment, around it is likely to occur dimmed suddenly Potential danger situation.Accordingly, can be by monitoring the amplitude of variation of luminous intensity that light sensor detects in the unit interval Whether it is more than the mode of predetermined threshold value to detect the situation that user is in dark suddenly.Accordingly, luminous intensity here is The environmental information.Specifically, in the embodiment of the present application, the predetermined threshold value can include being set in advance according to practical situations The numerical value put.In addition, when user is when using VR aobvious equipment, around it is likely to occur and becomes very bright emergency case and (for example occur Blast), by monitoring whether the amplitude of variation of luminous intensity that light sensor detects in the unit interval is more than predetermined threshold value Mode can detect user and be in the larger situation of intensity variation suddenly.
In another specific embodiment, when user is when using VR aobvious equipment, luminous intensity is around likely to occur not The potential danger situation of disconnected change.Accordingly, can be by monitoring the change frequency of the luminous intensity that light sensor is detected The situation that user is in during luminous intensity is continually changing is detected more than the mode of predeterminated frequency value.Accordingly, light intensity here The change frequency of degree is the environmental information.Specifically, in the embodiment of the present application, the predeterminated frequency value can include according to reality The numerical value that border applicable cases are pre-set.
Specifically, working as the environment sensing equipment includes radar sensor, and when meeting at least one of following conditions, It is determined that the environmental information monitored matches with preset security critical message:
Monitor that the distance apart from obstruction that radar sensor is detected is less than pre-determined distance value.
It is above-mentioned when user is using VR aobvious equipment in a specific embodiment, and during moving, if In the embodiment that a certain article will be bumped against, the distance apart from obstruction that can also be detected by monitoring radar sensor is The no mode less than pre-determined distance value may bump against a certain article situation to detect user.Specifically, distance here hinders The distance of thing is the environmental information.Specifically, in the embodiment of the present application, the pre-determined distance value can include being answered according to actual The numerical value pre-set with situation.
Specifically, working as the environment sensing equipment includes picture pick-up device, and when meeting at least one of following conditions, really Surely the environmental information monitored matches with preset security critical message:
Monitor the corresponding change information of real scene picture and default dangerous picture change information that picture pick-up device is shot Match.
In a specific embodiment, above-mentioned when user is when using VR aobvious equipment, just someone pushes a pile thing Product pass through embodiment in, can also by monitor picture pick-up device shoot the corresponding change information of real scene picture whether The mode matched with default dangerous picture change information may bump against a certain article situation to detect user.Specifically, this In default dangerous picture change information can include the things not occurred in picture before occurring in current picture or people Picture change information.Specifically, the corresponding change information of real scene picture here is the environmental information.
Furthermore, it is necessary to which explanation, determines that the environmental information monitored is faced with preset security described in the embodiment of the present application Boundary's information match needs the condition met, is not limited in above-mentioned condition, in actual applications, can also include other, The embodiment of the present application is not limited with above-mentioned.
In a specific embodiment, it is true that the display page in virtual reality scenario shows that picture pick-up device is shot Real scenic picture can include:
Current virtual reality scene is exited, the real scene picture that picture pick-up device is shot is shown in the display page.
Exemplified by moving termination and show equipment connection smart mobile phone progress VR video playbacks, as shown in Fig. 2 the application is carried The display page in virtual reality scenario supplied shows a kind of schematic diagram of embodiment of real scene picture that picture pick-up device is shot. It can be seen that picture pick-up device photographs the real scene picture including chest, by the real scene picture including chest User is showed, user can timely avoid the chest, it is to avoid the situation of the chest of user's collision, it is ensured that Yong Hu Use safety during VR title equipment.Specifically, picture pick-up device here is the camera of mobile phone terminal, and in actual applications, institute The picture pick-up device that picture pick-up device can also be other forms is stated, the shooting that such as VR aobvious equipment is carried is first-class, and the application is implemented The example picture pick-up device is not limited with above-mentioned.
In another specific embodiment, the display page in virtual reality scenario shows what picture pick-up device was shot Real scene picture can include:
The real scene picture that picture pick-up device is shot is shown in the predeterminable area of the display page of virtual reality scenario.
As shown in Fig. 3 it is true that the display page in virtual reality scenario that the application is provided shows that picture pick-up device is shot The schematic diagram of real another embodiment of scenic picture.As can be seen from Fig. 3, the video of VR scenes is not exited currently, but will The video pause of VR scenes, and virtual reality scenario the display page predeterminable area show picture pick-up device photograph it is true Scenic picture.Specifically, the part that the predeterminable area can be included in the display page of the virtual reality scenario shows page Face.
Furthermore, it is necessary to which the display page in explanation, the embodiment of the present application in virtual reality scenario shows picture pick-up device The form of the real scene picture of shooting is not limited in the form shown in above-mentioned Fig. 2 and Fig. 3, in actual applications can be with Including other forms, the embodiment of the present application is not limited with above-mentioned.
As can be seen here, a kind of embodiment of the method for safety monitoring of virtual reality device of the application is visible, and the application passes through Whether the environmental information that monitoring of environmental awareness apparatus is obtained matches with preset security critical message can monitor user's week in real time Situations such as enclosing collision that may be present, then, when the environmental information monitored is matched with preset security critical message, that is, , can be true by showing that picture pick-up device is shot in the display page of virtual reality scenario when having found that it is likely that the dangerous situation of presence The mode of real scenic picture, takes in the premise of virtual reality device without cumbersome, allows user to rapidly enter real field Jing Zhong, and then can be with safety problems such as collision frees, it is ensured that safety of the user during using virtual reality device.With showing There is technology to compare, the technical scheme provided using the embodiment of the present application may assist in quick using the user of virtual reality device Into real scene, and then ensure the safety of user, improve Consumer's Experience.
On the other hand the application also provides a kind of safety monitoring device of virtual reality device, and Fig. 4 is that the application is provided The structural representation of a kind of embodiment of the safety monitoring device of virtual reality device, as shown in figure 4, shown device 400 can be with Including:
Monitoring modular 410, can be used for whether the environmental information that monitoring of environmental awareness apparatus detects faces with preset security Boundary's information match;
Display module 420, can be used for when the environmental information monitored is matched with preset security critical message, virtual The display page of reality scene shows the real scene picture that picture pick-up device is shot.
In another embodiment, the environment sensing equipment at least can include it is following in one kind:
Sound transducer, light sensor, radar sensor, picture pick-up device.
In another embodiment, when the environment sensing equipment include sound transducer, and meet it is following at least During a kind of condition, it is determined that the environmental information monitored matches with preset security critical message:
Monitor that the loudness of sound in the sound wave that sound transducer is detected is more than default loudness value;
The tone and preset tones for monitoring sound in the sound wave that sound transducer is detected match;
Monitor that the sound wave that sound transducer is detected includes default vocabulary.
In another embodiment, when the environment sensing equipment include light sensor, and meet it is following at least During a kind of condition, it is determined that the environmental information monitored matches with preset security critical message:
Monitor that the amplitude of variation of luminous intensity that light sensor detects in the unit interval is more than predetermined threshold value;
Monitor that the change frequency for the luminous intensity that light sensor is detected is more than predeterminated frequency value.
In another embodiment, when the environment sensing equipment include radar sensor, and meet it is following at least During a kind of condition, it is determined that the environmental information monitored matches with preset security critical message:
Monitor that the distance apart from obstruction that radar sensor is detected is less than pre-determined distance value.
In another embodiment, when the environment sensing equipment include picture pick-up device, and meet it is following at least one During the condition of kind, it is determined that the environmental information monitored matches with preset security critical message:
Monitor the corresponding change information of real scene picture and default dangerous picture change information that picture pick-up device is shot Match.
Another embodiment, the display module 420 can include:
First display processing unit, can be used for exiting current virtual reality scene, and picture pick-up device is shown in the display page The real scene picture of shooting.
Another embodiment, the display module 420 can include:
Second display processing unit, the predeterminable area that can be used in the display page of virtual reality scenario shows that shooting is set The standby real scene picture shot.
On the other hand the application also provides a kind of virtual reality device, and Fig. 5 is the virtual reality device that the application is provided A kind of structural representation of embodiment, as shown in figure 5, including:
Processor, can be used for performing computer program instructions, the computer program instructions include:Monitoring of environmental is perceived Whether the environmental information that equipment is obtained matches with preset security critical message;When the environmental information monitored and preset security face During boundary's information matches, the display page for being sent in virtual reality scenario shows the finger for the real scene picture that picture pick-up device is shot Order;
Environment sensing equipment, is coupled in the processor, can be used for obtaining environmental information;
Picture pick-up device, is coupled in the processor, can be used for shooting real scene picture;
Display device, is coupled in the processor, and the display page that can be used in virtual reality scenario shows described take the photograph The real scene picture shot as equipment.
Furthermore, it is necessary to explanation, when environment sensing equipment described in the embodiment of the present application is picture pick-up device, the environment Awareness apparatus can be same equipment with the picture pick-up device for shooting real scene picture, or different equipment.
Specifically, in the embodiment of the present application, described processor can include central processing unit (CPU), naturally it is also possible to Including other single-chip microcomputer, logic gates, integrated circuits with logic processing capability etc., or its is appropriately combined.It is described aobvious Show that equipment can include mobile terminal display screen, separate display screens etc..
As shown in fig. 6, Fig. 6 is a kind of structural representation of the embodiment for a kind of VR aobvious equipment that the application is provided.Figure Middle environment awareness apparatus and picture pick-up device are directly connected in described VR aobvious equipment, furthermore, it is necessary to explanation, the application The virtual reality device is not limited in shown in above-mentioned Fig. 6, and other structures form, example can also be included in actual applications Environment sensing equipment, the picture pick-up device can be communicated with the virtual reality device as described, but not be integral knots Configuration formula, for example, the environment sensing equipment, the picture pick-up device are installed in the family of user, by way of radio communication It is attached with the virtual reality device, specifically, as shown in fig. 7, Fig. 7 is a kind of VR aobvious equipment that the application is provided Another structural representation of embodiment, but the embodiment of the present application is not limited with above-mentioned.
As can be seen here, the reality of a kind of method for safety monitoring of virtual reality device of the application, device and virtual reality device Apply that example is visible, whether the environmental information that the application is obtained by monitoring of environmental awareness apparatus matches with preset security critical message Situations such as collision that may be present around user being monitored in real time, then, when the environmental information monitored and preset security face During boundary's information matches, that is, when having found that it is likely that the dangerous situation of presence, can be shown by the display page in virtual reality scenario Show the mode for the real scene picture that picture pick-up device is shot, taking in the premise of virtual reality device without cumbersome, allow use Family is rapidly entered in real scene, and then can be with safety problems such as collision frees, it is ensured that user is set using virtual reality Safety during standby.Compared with prior art, the technical scheme provided using the embodiment of the present application may assist in using empty The user for intending real world devices rapidly enters real scene, and then ensures the safety of user, improves Consumer's Experience.
In the 1990s, for a technology improvement can clearly distinguish be on hardware improvement (for example, Improvement to circuit structures such as diode, transistor, switches) or software on improvement (for the improvement of method flow).So And, with the development of technology, the improvement of current many method flows can be considered as directly improving for hardware circuit. Designer nearly all obtains corresponding hardware circuit by the way that improved method flow is programmed into hardware circuit.Cause This, it cannot be said that the improvement of a method flow cannot be realized with hardware entities module.For example, PLD (Programmable Logic Device, PLD) (such as field programmable gate array (Field Programmable Gate Array, FPGA)) it is exactly such a integrated circuit, its logic function is determined by user to device programming.By designer Voluntarily programming comes a digital display circuit " integrated " on a piece of PLD, without asking chip maker to design and make Special IC chip.Moreover, nowadays, substitution manually makes IC chip, and this programming is also used instead mostly " patrols Volume compiler (logic compiler) " software realizes that software compiler used is similar when it writes with program development, And the source code before compiling also write by handy specific programming language, this is referred to as hardware description language (Hardware Description Language, HDL), and HDL is also not only a kind of, but have many kinds, such as ABEL (Advanced Boolean Expression Language)、AHDL(Altera Hardware Description Language)、Confluence、CUPL(Cornell University Programming Language)、HDCal、JHDL (Java Hardware Description Language)、Lava、Lola、MyHDL、PALASM、RHDL(Ruby Hardware Description Language) etc., VHDL (Very-High-Speed are most generally used at present Integrated Circuit Hardware Description Language) and Verilog.Those skilled in the art also should This understands, it is only necessary to slightly programming in logic and be programmed into method flow in integrated circuit with above-mentioned several hardware description languages, The hardware circuit for realizing the logical method flow can be just readily available.
Controller can be implemented in any suitable manner, for example, controller can take such as microprocessor or processing Device and storage can by the computer of the computer readable program code (such as software or firmware) of (micro-) computing device Read medium, gate, switch, application specific integrated circuit (Application Specific Integrated Circuit, ASIC), the form of programmable logic controller (PLC) and embedded microcontroller, the example of controller includes but is not limited to following microcontroller Device:ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320, are deposited Memory controller is also implemented as a part for the control logic of memory.It is also known in the art that except with Pure computer readable program code mode is realized beyond controller, can be made completely by the way that method and step is carried out into programming in logic Obtain controller and come real in the form of gate, switch, application specific integrated circuit, programmable logic controller (PLC) and embedded microcontroller etc. Existing identical function.Therefore this controller is considered a kind of hardware component, and various for realizing to including in it The device of function can also be considered as the structure in hardware component.Or even, can be by for realizing that the device of various functions is regarded For that not only can be the software module of implementation method but also can be the structure in hardware component.
Device, module or unit that above-described embodiment is illustrated, can specifically be realized, Huo Zheyou by computer chip or entity Product with certain function is realized.It is a kind of typically to realize that equipment is computer.Specifically, computer for example can be individual People's computer, laptop computer, cell phone, camera phone, smart phone, personal digital assistant, media player, navigation Any equipment in equipment, electronic mail equipment, game console, tablet PC, wearable device or these equipment Combination.
For convenience of description, it is divided into various modules during description apparatus above with function to describe respectively.Certainly, this is being implemented The function of each module can be realized in same or multiple softwares and/or hardware during application.
It should be understood by those skilled in the art that, embodiments of the invention can be provided as method, device or computer program Product.Therefore, the present invention can be using the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware Apply the form of example.Moreover, the present invention can be used in one or more computers for wherein including computer usable program code The computer program production that usable storage medium is implemented on (including but is not limited to magnetic disk storage, CD-ROM, optical memory etc.) The form of product.
The present invention is the flow with reference to method according to embodiments of the present invention, equipment (device) and computer program product Figure and/or block diagram are described.It should be understood that can be by every first-class in computer program instructions implementation process figure and/or block diagram Journey and/or the flow in square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided The processor of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce A raw machine so that produced by the instruction of computer or the computing device of other programmable data processing devices for real The device for the function of being specified in present one flow of flow chart or one square frame of multiple flows and/or block diagram or multiple square frames.
These computer program instructions, which may be alternatively stored in, can guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which is produced, to be included referring to Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram or The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that in meter Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, thus in computer or The instruction performed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one The step of function of being specified in individual square frame or multiple square frames.
In a typical configuration, computing device includes one or more processors (CPU), input/output interface, net Network interface and internal memory.
Internal memory potentially includes the volatile memory in computer-readable medium, random access memory (RAM) and/or The forms such as Nonvolatile memory, such as read-only storage (ROM) or flash memory (flash RAM).Internal memory is computer-readable medium Example.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method Or technology come realize information store.Information can be computer-readable instruction, data structure, the module of program or other data. The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), moved State random access memory (DRAM), other kinds of random access memory (RAM), read-only storage (ROM), electric erasable Programmable read only memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc read-only storage (CD-ROM), Digital versatile disc (DVD) or other optical storages, magnetic cassette tape, the storage of tape magnetic rigid disk or other magnetic storage apparatus Or any other non-transmission medium, the information that can be accessed by a computing device available for storage.Define, calculate according to herein Machine computer-readable recording medium does not include temporary computer readable media (transitory media), such as data-signal and carrier wave of modulation.
It should also be noted that, term " comprising " "comprising" or its any other variant are intended to the bag of nonexcludability Contain, so that process, method, commodity or equipment including a series of key elements are not only including those key elements, but also including Other key elements being not expressly set out, or also include for this process, method, commodity or the intrinsic key element of equipment. In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including the key element Process, method, commodity or equipment in also there is other identical element.
It will be understood by those skilled in the art that embodiments herein can be provided as method, device or computer program product. Therefore, the application can be using the embodiment in terms of complete hardware embodiment, complete software embodiment or combination software and hardware Form.Deposited moreover, the application can use to can use in one or more computers for wherein including computer usable program code The shape for the computer program product that storage media is implemented on (including but is not limited to magnetic disk storage, CD-ROM, optical memory etc.) Formula.
The application can be described in the general context of computer executable instructions, such as program Module.Usually, program module includes performing particular task or realizes routine, program, object, the group of particular abstract data type Part, data structure etc..The application can also be put into practice in a distributed computing environment, in these DCEs, by Remote processing devices connected by communication network perform task.In a distributed computing environment, program module can be with Positioned at including in the local and remote computer-readable storage medium including storage device.
Each embodiment in this specification is described by the way of progressive, identical similar portion between each embodiment Divide mutually referring to what each embodiment was stressed is the difference with other embodiment.It is real especially for device Apply for example, because it is substantially similar to embodiment of the method, so description is fairly simple, related part is referring to embodiment of the method Part explanation.
Embodiments herein is the foregoing is only, the application is not limited to.For those skilled in the art For, the application can have various modifications and variations.It is all any modifications made within spirit herein and principle, equivalent Replace, improve etc., it should be included within the scope of claims hereof.

Claims (17)

1. a kind of method for safety monitoring of virtual reality device, it is characterised in that including:
Whether the environmental information that monitoring of environmental awareness apparatus is obtained matches with preset security critical message;
When the environmental information monitored is matched with preset security critical message, show and take the photograph in the display page of virtual reality scenario The real scene picture shot as equipment.
2. according to the method described in claim 1, it is characterised in that the environment sensing equipment at least include it is following in one Kind:
Sound transducer, light sensor, radar sensor, picture pick-up device.
3. the method according to any one of claim 1 or 2, it is characterised in that when the environment sensing equipment includes sound Sound sensor, and when meeting at least one of following conditions, it is determined that the environmental information monitored and preset security critical message Match:
Monitor that the loudness of sound in the sound wave that sound transducer is detected is more than default loudness value;
The tone and preset tones for monitoring sound in the sound wave that sound transducer is detected match;
Monitor that the sound wave that sound transducer is detected includes default vocabulary.
4. the method according to any one of claim 1 or 2, it is characterised in that when the environment sensing equipment includes light Line sensor, and when meeting at least one of following conditions, it is determined that the environmental information monitored and preset security critical message Match:
Monitor that the amplitude of variation of luminous intensity that light sensor detects in the unit interval is more than predetermined threshold value;
Monitor that the change frequency for the luminous intensity that light sensor is detected is more than predeterminated frequency value.
5. the method according to any one of claim 1 or 2, it is characterised in that when the environment sensing equipment includes thunder Up to sensor, and when meeting at least one of following conditions, it is determined that the environmental information monitored and preset security critical message Match:
Monitor that the distance apart from obstruction that radar sensor is detected is less than pre-determined distance value.
6. the method according to any one of claim 1 or 2, it is characterised in that when the environment sensing equipment includes taking the photograph As equipment, and when meeting at least one of following conditions, it is determined that the environmental information monitored and preset security critical message phase Matching:
Monitor the corresponding change information of real scene picture and default dangerous picture change information phase of picture pick-up device shooting Match somebody with somebody.
7. the method according to any one of claim 1 or 2, it is characterised in that the display in virtual reality scenario The page shows that the real scene picture that picture pick-up device is shot includes:
Current virtual reality scene is exited, the real scene picture that picture pick-up device is shot is shown in the display page.
8. the method according to any one of claim 1 or 2, it is characterised in that the display in virtual reality scenario The page shows that the real scene picture that picture pick-up device is shot includes:
The real scene picture that picture pick-up device is shot is shown in the predeterminable area of the display page of virtual reality scenario.
9. a kind of safety monitoring device of virtual reality device, it is characterised in that including:
Whether monitoring modular, the environmental information obtained for monitoring of environmental awareness apparatus matches with preset security critical message;
Display module, for when the environmental information monitored is matched with preset security critical message, in virtual reality scenario Show that the page shows the real scene picture that picture pick-up device is shot.
10. device according to claim 9, it is characterised in that the environment sensing equipment at least include it is following in one Kind:
Sound transducer, light sensor, radar sensor, picture pick-up device.
11. the device according to any one of claim 9 or 10, it is characterised in that when the environment sensing equipment includes Sound transducer, and when meeting at least one of following conditions, it is determined that the environmental information monitored and the critical letter of preset security Manner of breathing is matched:
Monitor that the loudness of sound in the sound wave that sound transducer is detected is more than default loudness value;
The tone and preset tones for monitoring sound in the sound wave that sound transducer is detected match;
Monitor that the sound wave that sound transducer is detected includes default vocabulary.
12. the device according to any one of claim 9 or 10, it is characterised in that when the environment sensing equipment includes Light sensor, and when meeting at least one of following conditions, it is determined that the environmental information monitored and the critical letter of preset security Manner of breathing is matched:
Monitor that the amplitude of variation of luminous intensity that light sensor detects in the unit interval is more than predetermined threshold value;
Monitor that the change frequency for the luminous intensity that light sensor is detected is more than predeterminated frequency value.
13. the device according to any one of claim 9 or 10, it is characterised in that when the environment sensing equipment includes Radar sensor, and when meeting at least one of following conditions, it is determined that the environmental information monitored and the critical letter of preset security Manner of breathing is matched:
Monitor that the distance apart from obstruction that radar sensor is detected is less than pre-determined distance value.
14. the device according to any one of claim 9 or 10, it is characterised in that when the environment sensing equipment includes Picture pick-up device, and when meeting at least one of following conditions, it is determined that the environmental information monitored and preset security critical message Match:
Monitor the corresponding change information of real scene picture and default dangerous picture change information phase of picture pick-up device shooting Match somebody with somebody.
15. the device according to any one of claim 9 or 10, it is characterised in that the display module includes:
First display processing unit, for exiting current virtual reality scene, shows that picture pick-up device is shot true in the display page Real scenic picture.
16. the device according to any one of claim 9 or 10, it is characterised in that the display module includes:
Second display processing unit, the predeterminable area for the display page in virtual reality scenario shows what picture pick-up device was shot Real scene picture.
17. a kind of virtual reality device, it is characterised in that including:
Processor, for performing computer program instructions, the computer program instructions include:Monitoring of environmental awareness apparatus is obtained To environmental information whether match with preset security critical message;When the environmental information monitored and preset security critical message During matching, the display page for being sent in virtual reality scenario shows the instruction for the real scene picture that picture pick-up device is shot;
Environment sensing equipment, is coupled in the processor, for obtaining environmental information;
Picture pick-up device, is coupled in the processor, for shooting real scene picture;
Display device, is coupled in the processor, for showing that the picture pick-up device is clapped in the display page of virtual reality scenario The real scene picture taken the photograph.
CN201611129582.9A 2016-12-09 2016-12-09 A kind of method for safety monitoring of virtual reality device, device and virtual reality device Pending CN107024982A (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN201611129582.9A CN107024982A (en) 2016-12-09 2016-12-09 A kind of method for safety monitoring of virtual reality device, device and virtual reality device
TW106132246A TWI687901B (en) 2016-12-09 2017-09-20 Security monitoring method and device of virtual reality equipment and virtual reality equipment
PCT/CN2017/113604 WO2018103567A1 (en) 2016-12-09 2017-11-29 Virtual reality equipment safety monitoring method and device, and virtual reality equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611129582.9A CN107024982A (en) 2016-12-09 2016-12-09 A kind of method for safety monitoring of virtual reality device, device and virtual reality device

Publications (1)

Publication Number Publication Date
CN107024982A true CN107024982A (en) 2017-08-08

Family

ID=59525532

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611129582.9A Pending CN107024982A (en) 2016-12-09 2016-12-09 A kind of method for safety monitoring of virtual reality device, device and virtual reality device

Country Status (3)

Country Link
CN (1) CN107024982A (en)
TW (1) TWI687901B (en)
WO (1) WO2018103567A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018103567A1 (en) * 2016-12-09 2018-06-14 阿里巴巴集团控股有限公司 Virtual reality equipment safety monitoring method and device, and virtual reality equipment
CN108961669A (en) * 2018-07-19 2018-12-07 上海小蚁科技有限公司 The safe early warning method and device, storage medium, server of net about vehicle
WO2019113939A1 (en) * 2017-12-15 2019-06-20 歌尔科技有限公司 Vr device and experience control method, system, apparatus, and storage medium thereof
CN111108746A (en) * 2017-09-22 2020-05-05 惠普发展公司,有限责任合伙企业 Detection of objects
CN112185415A (en) * 2020-09-10 2021-01-05 珠海格力电器股份有限公司 Sound visualization method and device, storage medium and MR mixed reality equipment
CN112748807A (en) * 2021-01-13 2021-05-04 温州大学瓯江学院 Head-mounted virtual reality equipment
CN113920688A (en) * 2021-11-24 2022-01-11 青岛歌尔声学科技有限公司 Collision early warning method and device, VR head-mounted equipment and storage medium

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109143248A (en) * 2018-07-19 2019-01-04 中山大学深圳研究院 A kind of real collision-proof method of VR interaction based on ultrasonic distance measurement
US11493764B2 (en) * 2020-06-04 2022-11-08 Htc Corporation Method for dynamically displaying real-world scene, electronic device, and computer readable medium
CN113179377B (en) * 2021-03-17 2022-11-08 青岛小鸟看看科技有限公司 Signal switching method of VR equipment and VR equipment
CN113055597B (en) * 2021-03-25 2022-06-28 联想(北京)有限公司 Camera calling implementation method and device and electronic equipment
US12085714B2 (en) 2021-12-20 2024-09-10 International Business Machines Corporation Device management in a smart environment
CN114928706A (en) * 2022-03-28 2022-08-19 岚图汽车科技有限公司 Application method and device based on in-vehicle scene
CN114999128A (en) * 2022-04-15 2022-09-02 英华达(上海)科技有限公司 Reminding method, device and system in virtual and actual scenes and related equipment
CN115174887A (en) * 2022-06-30 2022-10-11 歌尔股份有限公司 Visual angle expanding method and device, terminal equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5900849A (en) * 1995-05-25 1999-05-04 U.S. Philips Corporation Display headset
CN104750249A (en) * 2015-03-02 2015-07-01 联想(北京)有限公司 Information processing method and electronic device
CN105630164A (en) * 2015-12-24 2016-06-01 惠州Tcl移动通信有限公司 Virtual reality spectacle case system and reminding method thereof
CN105721700A (en) * 2016-02-22 2016-06-29 上海理工大学 Voice help-seeking system based on Android phone
CN205507937U (en) * 2016-03-08 2016-08-24 天津中恒慧科技发展有限公司 District security protection control system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI492592B (en) * 2007-10-24 2015-07-11 社交通訊公司 Automated real-time data stream switching in a shared virtual area communication environment
US10424103B2 (en) * 2014-04-29 2019-09-24 Microsoft Technology Licensing, Llc Display device viewer gaze attraction
US9727136B2 (en) * 2014-05-19 2017-08-08 Microsoft Technology Licensing, Llc Gaze detection calibration
US9736580B2 (en) * 2015-03-19 2017-08-15 Intel Corporation Acoustic camera based audio visual scene analysis
CN107024982A (en) * 2016-12-09 2017-08-08 阿里巴巴集团控股有限公司 A kind of method for safety monitoring of virtual reality device, device and virtual reality device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5900849A (en) * 1995-05-25 1999-05-04 U.S. Philips Corporation Display headset
CN104750249A (en) * 2015-03-02 2015-07-01 联想(北京)有限公司 Information processing method and electronic device
CN105630164A (en) * 2015-12-24 2016-06-01 惠州Tcl移动通信有限公司 Virtual reality spectacle case system and reminding method thereof
CN105721700A (en) * 2016-02-22 2016-06-29 上海理工大学 Voice help-seeking system based on Android phone
CN205507937U (en) * 2016-03-08 2016-08-24 天津中恒慧科技发展有限公司 District security protection control system

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018103567A1 (en) * 2016-12-09 2018-06-14 阿里巴巴集团控股有限公司 Virtual reality equipment safety monitoring method and device, and virtual reality equipment
CN111108746A (en) * 2017-09-22 2020-05-05 惠普发展公司,有限责任合伙企业 Detection of objects
US11335177B2 (en) 2017-09-22 2022-05-17 Hewlett-Packard Development Company, L.P. Detection of objects based on change in wireless signal
WO2019113939A1 (en) * 2017-12-15 2019-06-20 歌尔科技有限公司 Vr device and experience control method, system, apparatus, and storage medium thereof
CN108961669A (en) * 2018-07-19 2018-12-07 上海小蚁科技有限公司 The safe early warning method and device, storage medium, server of net about vehicle
CN112185415A (en) * 2020-09-10 2021-01-05 珠海格力电器股份有限公司 Sound visualization method and device, storage medium and MR mixed reality equipment
CN112748807A (en) * 2021-01-13 2021-05-04 温州大学瓯江学院 Head-mounted virtual reality equipment
CN113920688A (en) * 2021-11-24 2022-01-11 青岛歌尔声学科技有限公司 Collision early warning method and device, VR head-mounted equipment and storage medium
WO2023092641A1 (en) * 2021-11-24 2023-06-01 歌尔股份有限公司 Collision early warning method and apparatus, and head-mounted vr device, and storage medium

Also Published As

Publication number Publication date
WO2018103567A1 (en) 2018-06-14
TW201822164A (en) 2018-06-16
TWI687901B (en) 2020-03-11

Similar Documents

Publication Publication Date Title
CN107024982A (en) A kind of method for safety monitoring of virtual reality device, device and virtual reality device
US11145096B2 (en) System and method for augmented reality interaction
TW202004638A (en) Bill photographing interaction method and apparatus, processing device, and client
CN105389040A (en) Electronic device including touch sensitive display and method for operating the same
US20150193111A1 (en) Providing Intent-Based Feedback Information On A Gesture Interface
WO2017092332A1 (en) Method and device for image rendering processing
CN104240680A (en) Method for adjusting brightness of touch screen and touch display device
US9749494B2 (en) User terminal device for displaying an object image in which a feature part changes based on image metadata and the control method thereof
CN107003727A (en) Run the electronic equipment of multiple applications and the method for control electronics
CN103608761A (en) Input device, input method and recording medium
US20210191133A1 (en) External recording indicators
JP2020095712A (en) Information handling method, information handling device, and storage medium
KR20170049991A (en) Method for providing user interaction based on force touch and electronic device using the same
CN117321537A (en) Dynamic power configuration for eyewear devices
CN107404427A (en) One kind chat background display method and device
CN104035544A (en) Method for controlling electronic device and electronic device
CN106293030B (en) A kind of information processing method and electronic equipment
US20150331484A1 (en) Eye tracking laser pointer
US20230083758A1 (en) Display Tracking Systems and Methods
WO2022073386A1 (en) Control method, control device, electronic device and readable storage medium
TWI622901B (en) Gaze detection apparatus using reference frames in media and related method and computer readable storage medium
CN110009770A (en) A kind of method of identity user, equipment and entrance guard device
US12014019B2 (en) Display method, apparatus and computer readable storage medium
CN110245516A (en) A kind of message treatment method and device
US20240107092A1 (en) Video playing method and apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1241480

Country of ref document: HK

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20170808

REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1241480

Country of ref document: HK