CN112036388B - Multi-user experience control method and device based on VR equipment and readable storage medium - Google Patents
Multi-user experience control method and device based on VR equipment and readable storage medium Download PDFInfo
- Publication number
- CN112036388B CN112036388B CN202011228557.2A CN202011228557A CN112036388B CN 112036388 B CN112036388 B CN 112036388B CN 202011228557 A CN202011228557 A CN 202011228557A CN 112036388 B CN112036388 B CN 112036388B
- Authority
- CN
- China
- Prior art keywords
- experience
- user
- area
- current
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
- G06V20/53—Recognition of crowd images, e.g. recognition of crowd congestion
Abstract
The invention relates to a multi-user experience control method and device based on VR equipment and a readable storage medium, wherein the method comprises the following steps: when the VR equipment is in a working state, collecting face images in a preset range, counting and counting to obtain the number of gathering personnel, and calculating according to the number of the gathering personnel to obtain the current crowd density; when the current crowd density is judged to be larger than a preset density threshold value, starting timing to obtain first time, and when the first time is judged to be larger than the first preset time, calculating according to the current crowd density to obtain the corresponding current optimal experience number; the corresponding number of iris shot-light is controlled according to the current best experience number of people to throw, and the VR display screen is divided into the same number of VR small screens as the current best experience number of people to display. The multi-user experience control method based on the VR equipment can achieve the effect of VR experience of multiple users at the same time, effectively relieves the queuing waiting pressure, and improves the use efficiency of products and the user experience.
Description
Technical Field
The invention relates to the technical field of VR equipment control, in particular to a multi-user experience control method and device based on VR equipment and a readable storage medium.
Background
As is well known, VR (Virtual Reality) technology generates a three-dimensional environment simulating a Virtual world by a computer simulation system. In particular to a multi-source information fusion interactive three-dimensional dynamic visual and entity behavior system simulation, which can immerse a user in the environment so as to experience a virtual world in the environment.
VR technology mainly includes aspects of simulating environment, perception, natural skills, and sensing devices. In particular, a simulated environment refers to a three-dimensional stereoscopic realistic image generated by a computer to be dynamic in real time. Perception means that an ideal VR should have the perception that everyone has. In addition to the visual perception generated by computer graphics technology, there are also perceptions such as auditory sensation, tactile sensation, force sensation, and movement, and even olfactory sensation and taste sensation, which are also called multi-perception. The natural skills refer to head rotation, eyes, gestures or other human body behavior actions of a person, data adaptive to the actions of the participants are processed by a computer, and real-time response is carried out on the input of the user and is respectively fed back to the five sense organs of the user. The sensing device refers to a three-dimensional interaction device, wherein the VR device is a hardware device for implementing VR technology, and includes a modeling device (such as a 3D scanner), a three-dimensional visual display device (such as a 3D display system, a large projection system, a head-mounted stereo display, etc.), a sound device (such as a three-dimensional sound system and a stereo sound in an unconventional sense), and an interaction device (including a position tracker, a data glove, a 3D input device), a motion capture device, an eye tracker, a force feedback device, and other interaction devices.
However, most existing VR experience devices only allow one user to experience. When the number of people to be experienced is too many, for example, when the exhibition is carried out, a more serious waiting congestion problem is easily generated, and the experience of the user is greatly reduced.
Disclosure of Invention
Based on the above, the invention aims to solve the problem that most of the existing VR experience equipment can only allow one user to experience, and when the number of people to be experienced is too many, serious waiting congestion is easily caused.
The invention provides a multi-user experience control method based on VR equipment, wherein the VR equipment at least comprises a controller, a plurality of visual cameras, a plurality of aperture spot lights, a plurality of mobile interaction terminal equipment and a VR display screen, the controller is electrically connected with the plurality of visual cameras, the plurality of aperture spot lights, the plurality of mobile interaction terminal equipment and the VR display screen respectively, the visual cameras are used for collecting face images, the aperture spot lights are used for projecting area apertures at preset positions, and a user corresponds to each area aperture, wherein the method comprises the following steps:
when the VR equipment is in a working state, acquiring face image information in a preset range through a plurality of visual cameras, counting and counting to obtain the number of gathering personnel, and calculating according to the number of the gathering personnel to obtain the current crowd density;
when the current crowd density is judged to be larger than a preset density threshold value, immediately starting timing to obtain first time, and when the first time is judged to be larger than the first preset time, calculating according to the current crowd density to obtain the corresponding current optimal experience number;
and controlling the corresponding number of the aperture spot lamps to project at a preset position according to the current optimal experience number of people, and dividing the VR display screen into a plurality of VR small screens with the corresponding number of the current optimal experience number of people for split screen display.
The method for controlling multi-user experience based on VR equipment comprises the following steps that after the VR equipment switches states according to the current optimal experience number of people, the method further comprises the following steps:
when the VR equipment is judged to be switched in state according to the current optimal experience number, timing is started immediately to obtain second time;
when the second time is larger than the second preset time and the current crowd intensity corresponding to the preset range is larger than the preset intensity threshold value, generating first prompt information, wherein the first prompt information is used for prompting that the VR equipment exceeds the reception quantity of experience personnel so as to prompt part of users to leave.
The VR device-based multi-user experience control method includes that the preset range includes a first area and a second area, the second area is located outside the first area, and projection positions corresponding to a plurality of iris lamps are located in the first area, and the method further includes:
when the number of the gathered people in the first area is larger than the current optimal experience number of people, the VR equipment is controlled to be in a locking state, second prompt information is generated, and the second prompt information is used for prompting that the current experience number of people in the first area exceeds the current optimal experience number of people.
The VR device based multi-person experience control method comprises the following steps:
when the number of gathering personnel in the first area is smaller than half of the current optimal experience number of people, and the current crowd intensity corresponding to the preset range is larger than the preset intensity threshold value, the VR equipment is controlled to be in a locking state, third prompt information is generated, the third prompt information is used for reminding a user that the area aperture is still vacant at present to allow the user to enter, and the mobile interaction terminal equipment is used for experiencing.
The method for controlling multi-user experience based on VR equipment comprises the following steps that after the VR equipment switches states according to the current optimal experience number of people, the method further comprises the following steps:
when the VR equipment is judged to be switched in state according to the current optimal experience number, timing is started immediately to obtain third time;
when the third time is judged to be greater than a third preset time and the VR equipment is in a normal working state, detecting the number of the mobile interactive terminal equipment in a using state;
and when the number of the mobile interaction terminal devices in the using state is judged to be less than the current optimal experience number, uniformly dividing the VR display screen into the same number as the mobile interaction terminal devices in the using state.
The multi-user experience control method based on the VR equipment comprises the following steps that after the VR equipment is switched in state according to the current optimal experience number of people:
according to the face image information collected by the visual camera, determining the age and sex information of the user in each area aperture according to the face image information;
and controlling the VR small screen corresponding to each area aperture to be switched into a corresponding display theme according to the age and sex information of the user in each area aperture.
The VR device-based multi-user experience control method further includes, in the preset range, a waiting area configured to allow only one user to wait, where the waiting area is located outside the first area and inside the second area, and the method further includes:
acquiring face image information within a preset range according to the visual camera, and correspondingly generating and storing accumulated experience times for each user after each user finishes the experience of the VR equipment;
and when the accumulated experience times corresponding to the users in the waiting area is judged to be larger than the experience times corresponding to the users in the first area, generating fourth prompt information, wherein the fourth prompt information is used for prompting the users in the waiting area to leave.
The VR device-based multi-user experience control method further includes, in the preset range, a waiting area configured to allow only one user to wait, where the waiting area is located outside the first area and inside the second area, and the method further includes:
acquiring face image information within a preset range according to the visual camera, and correspondingly generating and storing accumulated experience times for each user after each user finishes the experience of the VR equipment;
determining age and gender information corresponding to each user according to the face image information;
generating corresponding waiting priority according to the accumulated experience times and the age and gender information corresponding to each user;
and generating a ranking list according to the waiting priority of each user and correspondingly prompting the corresponding users to enter the waiting area in sequence.
The invention also provides a multi-user experience control device based on VR equipment, the device is a controller, the controller is applied to the VR equipment, the VR equipment further comprises a plurality of vision cameras, a plurality of aperture spot lamps, a plurality of mobile interaction terminal equipment and a VR display screen, the controller is electrically connected with the vision cameras, the aperture spot lamps, the mobile interaction terminal equipment and the VR display screen, the vision cameras are used for collecting face images, the aperture spot lamps are used for projecting area apertures at preset positions, and a user corresponds to each area aperture, wherein the device comprises:
the first calculation module is used for acquiring face image information in a preset range through the plurality of visual cameras and counting to obtain the number of gathering personnel when the VR equipment is in a working state, and calculating to obtain the current crowd density according to the number of the gathering personnel;
the second calculation module is used for immediately starting timing to obtain first time when the current crowd density is judged to be greater than a preset density threshold value, and calculating to obtain the corresponding current optimal experience number according to the current crowd density when the first time is judged to be greater than the first preset time;
and the screen splitting control module is used for controlling the corresponding number of the current optimal experience number of people to project the aperture spot light at a preset position and dividing the VR display screen into a plurality of VR small screens with the corresponding number of the current optimal experience number of people for screen splitting display.
The invention also proposes a readable storage medium on which a computer program is stored, wherein said program, when executed by a processor, implements a VR device based multi-user experience control method as defined in any of the above.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
Fig. 1 is a flowchart of a VR device based multi-user experience control method according to a first embodiment of the present invention;
fig. 2 is a schematic structural diagram of a VR device in a first embodiment of the present invention;
fig. 3 is an effect diagram of the VR device in actual use in the first embodiment of the present invention;
fig. 4 is a flowchart of a VR device based multi-user experience control method according to a second embodiment of the present invention;
fig. 5 is a flowchart of a VR device based multi-user experience control method according to a third embodiment of the present invention;
fig. 6 is a flowchart of a VR device based multi-user experience control method according to a fourth embodiment of the present invention;
fig. 7 is a flowchart of a VR device based multi-user experience control method according to a fifth embodiment of the present invention;
fig. 8 is a flowchart of a VR device based multi-user experience control method according to a sixth embodiment of the present invention;
fig. 9 is a flowchart of a VR device based multi-user experience control method according to a seventh embodiment of the present invention;
fig. 10 is a diagram showing effects of VR devices in actual use in the seventh embodiment of the present invention;
fig. 11 is a flowchart of a VR device based multi-user experience control method according to an eighth embodiment of the present invention;
fig. 12 is a schematic structural diagram of a multi-user experience control apparatus based on a VR device according to a ninth embodiment of the present invention.
Detailed description of the invention
To facilitate an understanding of the invention, the invention will now be described more fully with reference to the accompanying drawings. Preferred embodiments of the present invention are shown in the drawings. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
Most of the existing VR experience equipment can only allow one user to experience. When the number of people to be experienced is too many, for example, when the exhibition is carried out, a more serious waiting congestion problem is easily generated, and the experience of the user is greatly reduced.
The first embodiment is as follows:
as shown in fig. 1 to fig. 3, a method for controlling a multi-user experience based on a VR device according to a first embodiment of the present invention specifically includes the following steps:
s101, when the VR equipment is in a working state, the number of gathering personnel is obtained by collecting face image information in a preset range through a plurality of visual cameras, counting and counting, and the current crowd density is obtained by calculation according to the number of the gathering personnel.
It is preferred to note that in this embodiment, as shown in fig. 2, the VR device includes a controller. Wherein, this controller and a plurality of vision cameras, a plurality of light ring shot-light, a plurality of mobile interaction terminal equipment and VR display screen electric connection. It can be understood that the vision camera is used for collecting face images, and the aperture spot light is used for projecting an area aperture at a preset position. Additionally, in the normal experience process, a user corresponds to the area aperture projected by each aperture spotlight.
As shown in fig. 3, the preset range includes a first area and a second area. The area aperture is projected within a first area, i.e. the first area is a user experience area. When the VR device is in a normal operating state, the plurality of visual cameras may scan all the face images in the first area and the second area, that is, scan all the face images in the preset range to obtain face image information.
Further, after the face image information is obtained through calculation, the physiological characteristics of each user are determined according to the face image information, and the number of the gathering personnel is obtained through counting and counting. It can be understood that the current crowd density can be further calculated according to the counted number of the gathered people.
S102, when the current crowd density is judged to be larger than a preset density threshold value, timing is immediately started to obtain first time, and when the first time is judged to be larger than the first preset time, the corresponding current optimal experience number is calculated according to the current crowd density.
After the current population density is calculated, the current population density is compared to a preset density threshold, as described above. In this step, when it is determined that the current population density is greater than the preset density threshold, it indicates that there are more people waiting for experience and watching in the preset range, and at this time, it may be determined as a crowded state.
In this step, to effectively alleviate this congestion state, specifically: when the current crowd density is judged to be larger than the preset density threshold value, timing is started to obtain the first time. And when the first time is judged to be greater than a first preset time, calculating to obtain the corresponding current optimal experience number according to the current crowd intensity. The specific value of the first preset time can be set according to the actual situation, and is not limited to a specific value. For example, in the present embodiment, the first preset time is 3 min. And when the state is judged to be in the crowded state within 3min, the state is not relieved, and the controller calculates the current optimal experience number according to the current crowd density.
It should be noted here that the current best experience population is calculated by: and determining the corresponding intensity level according to the current crowd intensity, and then inquiring and determining the corresponding current optimal experience population in a preset intensity-population mapping table according to the intensity level.
For example, if 2 people experience the situation at the same time, the situation still causes congestion waiting. In order to alleviate the problem of congestion, the controller calculates and obtains the corresponding current optimal experience number according to the current crowd density. For example, the density level determined according to the current crowd density is four levels, and in the preset density-population mapping table, the current optimal experience population corresponding to the four levels of density is 5. It can be understood that if the original 2-person simultaneous experience is switched to 5-person simultaneous experience, the congestion situation will be alleviated to a great extent.
S103, controlling the corresponding number of the iris spot lamps to project at a preset position according to the current optimal experience number, and dividing the VR display screen into a plurality of VR small screens with the corresponding number of the current optimal experience number to display in a split screen mode.
As described above, after the current optimal number of experienced persons is calculated, the controller may control the aperture spot lights of the corresponding number to project at the preset position according to the calculated current optimal number of experienced persons. For example, if the calculated optimal number of experience persons is 5, 5 aperture lamps are correspondingly controlled to project.
In the actual experience process, only one user is allowed to enter the area aperture projected by each aperture spotlight for experience. It can be understood that, in order to realize the effect of action interaction experience, the controller divides the display screen into the small VR screens with the same number as the number of experience people, so that each user has a small VR screen corresponding to the number of experience people for VR interaction experience.
It should be noted that, in order to ensure the VR experience effect, the VR display screen cannot be divided without limitation. For example, a whole block of VR display screen can only be divided into 6 small screens at most, that is, the maximum value of the current best experience people number calculated by the controller is less than or equal to the number of divided blocks of the VR display screen.
In practical application, the multi-user experience control method based on the VR equipment obtains the current crowd density through real-time calculation, and can judge whether the current crowd is crowded or not. If the crowd state is determined, calculating according to the current crowd density to obtain the corresponding current optimal experience number, then controlling the aperture spot lamps which are the same as the current optimal experience number and correspondingly dividing the VR display screen into the VR small screens with the same number for split-screen display, thereby improving the experience bearing capacity of the VR equipment on the premise of ensuring the experience effect, effectively relieving the problem of user congestion and improving the experience of the user.
Example two:
referring to fig. 4, for a method for controlling a multi-user experience based on a VR device according to a second embodiment of the present invention, the method includes the following steps:
s201, when the VR equipment is judged to be switched in state according to the current best experience number of people, timing is started immediately to obtain second time.
As described in the first embodiment, when it is detected that the user is currently in a crowded state, the controller calculates the current best experience number according to the current crowd density, and switches the states. The number of the aperture spot lights and the number of the VR display screens are divided into the number which is the same as the current best experience number.
In this embodiment, there is a possibility that the congestion may be excessive in practical use. That is, even if the VR device experiences the number of people simultaneously through the increase, the problem of congestion still can not effectively be alleviated. For such a situation, in this embodiment, after the VR device switches the state according to the current best experience number, timing is immediately started to obtain the second time.
S202, judging whether the second time is greater than a second preset time.
It should be noted that the second preset time is not limited to a specific value, and can be specifically limited according to the actual application. For example, in the present embodiment, the second preset time is set to 8 min. In this embodiment, when the second time is longer than the second preset time, the system starts to automatically determine that the current state is still in the congestion state.
S203, whether the corresponding current crowd density in the preset range is larger than a preset density threshold value or not.
In this step, it is determined whether the current population intensity within the preset range is greater than a preset intensity threshold.
S204, generating first prompt information to prompt a part of users to leave.
It can be understood that, in the above step S201, the VR device has switched states according to the current best experience population. Theoretically, crowding of people can be relieved to a certain extent. However, in this step, if the state is switched for a while, the congestion state is still not relieved. At this time, it is considered that the crowd is overcrowded. VR devices have been unable to further alleviate the congestion problem for users by increasing the carrying capacity. Therefore, in this step, the controller generates a first prompt message, where the first prompt message is used to prompt a part of the users to leave, so as to relieve the current congestion level, thereby providing a better VR experience environment.
Example three:
referring to fig. 5, for a method for controlling a multi-user experience based on a VR device according to a third embodiment of the present invention, the method includes the following steps;
s301, the VR equipment performs state switching according to the current optimal experience number of people.
According to the first embodiment, the VR device switches the state according to the current best experience population.
S302, whether the number of the gathered people in the first area is larger than the current optimal experience number is judged.
It should be noted that, after the VR device switches states according to the current best experience number, as shown in fig. 3, the aperture lamp projects a plurality of area apertures in the first area. Where only one user is allowed to perform a VR experience per zone aperture. However, in practical applications, the problem that the user experience in the area aperture is affected due to the appearance of idle people in the first area is inevitable.
In order to effectively solve the problem, in the step, whether the number of the gathered people in the first area is larger than the current optimal experience number is judged.
And S303, controlling the VR equipment to be in a locked state and generating second prompt information.
As described in step S302, it is determined whether the number of people gathered in the first area is greater than the current optimal number of people experiencing experience. Further, when the number of the gathered people in the first area is judged to be larger than the current optimal experience number, the controller can control the VR equipment to be in a locking state and generate second prompt information. The second prompt information is used for prompting that the current experience number in the first area exceeds the current optimal experience number, and prompting people in the first area and out of the aperture of each area to leave.
It can be understood that the method provided by this embodiment can effectively avoid the problem that the user in the area aperture is affected by the idle personnel in the first area (experience area) to perform normal experience, thereby ensuring the experience effect.
Example four:
referring to fig. 6, for a method for controlling a multi-user experience based on a VR device according to a fourth embodiment of the present invention, the method includes the following steps;
s401, switching states of the VR equipment according to the current optimal experience number.
As described in the first embodiment, when it is detected that the user is currently in a crowded state, the controller calculates the current best experience number according to the current crowd density, and switches the states. The number of the aperture spot lights and the number of the VR display screens are divided into the number which is the same as the current best experience number.
S402, whether the number of the gathered people in the first area is less than half of the current optimal experience number is judged.
It can be understood that, after the controller calculates the current optimal number of people experiencing experience, the number of the aperture spot lights and the number of the VR display screens are divided into the number equal to the current optimal number of people experiencing. However, in the actual experience process, the number of experience persons may be too small, so that resources may be wasted and congestion may not be relieved effectively.
In this embodiment, it is determined whether the number of people gathered in the first area is less than half of the current best experience number. For example, the controller calculates that the current best experience population is 5 people, that is, the VR device can currently accommodate 5 people for experience at the same time. If the number of the gathering personnel in the current first area is 2, serious resource waste is undoubtedly caused.
And S403, judging whether the corresponding current crowd density in the preset range is greater than a preset density threshold value.
As described in the step S402, if the number of the aggregated people in the first area is less than half of the current best experience number, it can be considered that the experience resources are wasted because the current experience number is greatly different from the experience number that can be borne.
In this step, it is determined whether the current population density corresponding to the predetermined range (the first region and the second region) is greater than a predetermined density threshold. The setting is mainly to judge whether the current state is still in a congestion state.
And S404, controlling the VR equipment to be in a locked state and generating third prompt information.
Finally, if it is determined in the step S402 that the number of aggregated people in the first area is less than half of the current best experience number, the experience resource waste is caused. And the user in the preset range is still in a congestion state, and at the moment, the controller controls the VR equipment to be in a locking state and generates third prompt information. And the third prompt message is used for reminding the user that the current area aperture still has vacancy for the user to enter and using the mobile interactive terminal equipment for experience.
It can be understood that, the method provided by this embodiment can effectively avoid resource waste caused by a large difference between the number of experience people in the first area and the current optimal number of experience people, and can not effectively alleviate the problem of user congestion.
Example five:
referring to fig. 7, for a method for controlling a multi-user experience based on a VR device according to a fifth embodiment of the present invention, the method includes the following steps;
s501, switching states of the VR equipment according to the current optimal experience number.
As described in the first embodiment, when it is detected that the user is currently in a crowded state, the controller calculates the current best experience number according to the current crowd density, and switches the states. The number of the aperture spot lights and the number of the VR display screens are divided into the number which is the same as the current best experience number.
And S502, starting to count time to obtain a third time.
After the VR device is switched, the controller starts to count time to obtain a third time.
And S503, whether the third time is greater than a third preset time.
It should be noted that the third preset time is not limited to a specific value, and can be specifically limited according to the actual application. For example, in the present embodiment, the third preset time is 3 min.
And S504, judging whether the VR equipment is in a normal working state or not.
And S505, judging whether the number of the mobile interactive terminal devices in the using state is less than the current optimal experience number.
Because the current optimal experience number is the ideal number calculated by the controller, the number of users in the first area is not necessarily the same as the current optimal experience number in the actual experience process. For example, the current number of the best experience people is 5, and the current number of the actual experience people is 4, that is, the number of the mobile interactive terminal devices currently in use is 4.
However, at the last state switching, the VR screen is divided into the same number of blocks as the current best experience number (5), and the current actual experience number is 4 at this time. And at the moment, a divided VR small screen is in an idle state.
S506, uniformly dividing the VR display screen into the same number of mobile interactive terminal devices in the using state.
As described in step S505 above, since one VR small screen is in an idle state. In order to improve the overall display effect, the user is provided with a visual interaction experience of a larger screen. In this step, the VR display screens are evenly divided to be the same as the number of mobile interactive terminal devices in use. I.e. subdividing the VR display into 4 VR widgets.
It can be understood that the method provided by the embodiment can effectively solve the problem of poor experience effect caused by the fact that the division number of the VR display screen is inconsistent with the current actual experience number.
Example six:
referring to fig. 8, for a VR device based multi-user experience control method according to a sixth embodiment of the present invention, the method includes the following steps;
s601, determining the age and gender information of the user in each area aperture according to the face image information collected by the visual camera and the face image information.
As described above, the VR device includes a plurality of visual cameras. The visual camera can collect the face image information of the user within a preset range and transmit the face image information to the storage module in the controller for storage. The controller can determine the age and sex information of the user in each area aperture by adopting a face recognition technology according to the acquired face image information.
And S602, controlling the VR small screen corresponding to the area aperture to be switched to the corresponding display theme according to the age and sex information of the user in each area aperture.
In the actual experience process, the experience population comprises children, teenagers, young adults, middle-aged adults and old people. In this step, in order to improve the actual experience effect, the corresponding display theme can be called by the controller in the storage module to be displayed according to the age group and gender of the user. For example, if a boy is within a certain area aperture, a theme corresponding to "boy" is selected and displayed. Wherein, the theme corresponding to the boy can be the themes of a cucurbit doll, an ultraman, a ironmen and the like. When selecting, the switching can be performed sequentially or randomly.
It can be understood that, the method provided by the embodiment can specifically select the corresponding display theme according to the age and the gender of the user, thereby improving the actual use experience of the user.
Example seven:
referring to fig. 9 and 10, it can be seen from fig. 10 that a waiting area is provided in the second area, and the waiting area allows only one user to wait. The waiting area is positioned outside the first area and in the second area. For a VR device based multi-user experience control method as set forth in the seventh embodiment of the present invention, the method includes the following steps;
and S701, acquiring the face image information in a preset range according to the visual camera.
As described above, the VR device includes a plurality of visual cameras. The visual camera can collect the face image information of the user within a preset range and transmit the face image information to the storage module in the controller for storage.
And S702, after each user finishes the experience of the VR equipment, correspondingly generating and storing the accumulated experience times of each user.
The face image information corresponding to the user within the preset range is stored by the storage module in the controller. In this step, after each user completes the experience of the VR device, the cumulative experience times for each user are correspondingly generated and stored. For example, after user A completes a VR experience, the cumulative number of experiences is incremented by 1.
S703, judging whether the accumulated experience times corresponding to the users in the waiting area is larger than the experience times corresponding to the users in the first area.
In this step, it is necessary to determine whether the cumulative number of experiences of the user in the waiting area is greater than the number of experiences of the user in the first area. For example, the user in the second area may unknowingly enter the waiting area. However, the user has performed VR experiences on the VR device many times before, and at this time, other users who do not perform any experience should be given preference to perform VR experiences.
S704, generating a fourth prompt message for prompting the user in the waiting area to leave.
As described in step S703 above, when the user B enters the waiting area from the second area, the cumulative number of experiences of the user B on the VR device is greater than the number of experiences corresponding to the user in the first area. For example, the cumulative number of experiences of the user B on the VR device is 3, and the number of experiences corresponding to the users in the first area is less than 3. In order to effectively avoid the problem of congestion caused by repeated experience of the user, the controller generates fourth prompt information for prompting the user B to leave the waiting area and the second area so as to perform experience on other unexperienced users or users with fewer experience times.
It can be understood that the method provided by the embodiment can effectively avoid the problem of congestion caused by repeated experience of the user.
Example eight:
referring to fig. 11, for a VR device based multi-user experience control method according to an eighth embodiment of the present invention, the method includes the following steps;
and S801, acquiring human face image information in a preset range according to the visual camera.
As described above, the VR device includes a plurality of visual cameras. The visual camera can collect the face image information of the user within a preset range and transmit the face image information to the storage module in the controller for storage.
S802, after each user completes the experience of the VR device, the accumulated experience times for each user are correspondingly generated and stored.
The face image information corresponding to the user within the preset range is stored by the storage module in the controller. In this step, after each user completes the experience of the VR device, the cumulative experience times for each user are correspondingly generated and stored. For example, after user A completes a VR experience, the cumulative number of experiences is incremented by 1.
And S803, determining age and gender information corresponding to each user according to the face image information.
The controller can determine the age and sex information of the user in each area aperture by adopting a face recognition technology according to the acquired face image information.
S804, according to the accumulated experience times and the age and sex information corresponding to each user, a corresponding waiting priority is generated.
As described above, after the cumulative number of experiences, the age, and the gender corresponding to each user are obtained, the corresponding integral value is calculated according to the cumulative number of experiences, the age, and the gender of each user, and the corresponding waiting priority is determined in the preset priority list according to the integral value.
It should be noted that, in the step of calculating the point value, the cumulative number of experiences, age, and sex corresponding to the user may be determined according to actual conditions with respect to the weight of the result of calculating the point value.
In the present embodiment, the calculation formula of the integral value is:
wherein the content of the first and second substances,
for the value of the integral corresponding to each user,a、b、crespectively the accumulated experience times, the weight values corresponding to age and gender,lfor the purpose of the cumulative number of experiences,nis an age value.
It should be noted that, if the user is a female, the corresponding calculation formula is:
if the user is male, the corresponding calculation formula is as follows:
in the present embodiment, the higher the numerical value of the integrated value, the higher the corresponding priority level. And after the integral value corresponding to each user is obtained through calculation, determining the corresponding waiting priority in the preset priority list according to each integral value.
And S805, generating a ranking list according to the waiting priority of each user and correspondingly prompting the corresponding users to enter the waiting area in sequence.
Furthermore, after the waiting priority corresponding to each user is obtained through calculation, an ordered list is generated according to the waiting priority, and the users enter the waiting area in sequence according to the ordered sequence of the users in the list. Here, if a plurality of users are determined to be in the same priority level, the users are sorted by the highest value and the lowest value of the integral value in the same level.
Example nine:
the invention also provides a multi-user experience control device based on the VR equipment, wherein the device is a controller, and the controller is applied to the VR equipment.
As shown in fig. 2, the VR device further includes a plurality of vision cameras, a plurality of aperture spot lights, a plurality of mobile interactive terminal devices, and a VR display screen. Wherein, the controller is electric connection with a plurality of vision cameras, a plurality of light ring shot-light, a plurality of mutual terminal equipment of removal and VR display screen equally divide respectively.
Referring to fig. 12, in particular, the apparatus includes a first calculating module 11, a second calculating module 12 and a split-screen control module 13 connected in sequence;
the first calculating module 11 is specifically configured to:
when the VR equipment is in a working state, acquiring face image information in a preset range through a plurality of visual cameras, counting and counting to obtain the number of gathering personnel, and calculating according to the number of the gathering personnel to obtain the current crowd density;
the second calculating module 12 is specifically configured to:
when the current crowd density is judged to be larger than a preset density threshold value, immediately starting timing to obtain first time, and when the first time is judged to be larger than the first preset time, calculating according to the current crowd density to obtain the corresponding current optimal experience number;
the split-screen control module 13 is specifically configured to:
and controlling the corresponding number of the aperture spot lamps to project at a preset position according to the current optimal experience number of people, and dividing the VR display screen into a plurality of VR small screens with the corresponding number of the current optimal experience number of people for split screen display.
The invention also proposes a readable storage medium on which a computer program is stored, wherein said program, when executed by a processor, implements a VR device based multi-user experience control method as defined in any of the above.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
Those skilled in the art will appreciate that all or part of the steps in the method for implementing the above embodiments may be implemented by a program instructing the relevant hardware. The program may be stored in a computer-readable storage medium. Which when executed comprises the steps of the method described above. The storage medium includes: ROM/RAM, magnetic disk, optical disk, etc.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. The utility model provides a control method is experienced to many people based on VR equipment, VR equipment includes a controller, a plurality of vision camera, a plurality of light ring shot-light, a plurality of mobile interaction terminal equipment and VR display screen at least, the controller with a plurality of vision camera, a plurality of light ring shot-light, a plurality of mobile interaction terminal equipment and each in the VR display screen is equallyd divide and is electric connection respectively, wherein the vision camera is used for gathering the face image, the light ring shot-light is used for throwing regional light ring at preset position, wherein corresponds there is a user in every regional light ring, its characterized in that, the method includes:
when the VR equipment is in a working state, acquiring face image information in a preset range through a plurality of visual cameras, counting and counting to obtain the number of gathering personnel, and calculating according to the number of the gathering personnel to obtain the current crowd density;
when the current crowd density is judged to be larger than a preset density threshold value, immediately starting timing to obtain first time, and when the first time is judged to be larger than the first preset time, calculating according to the current crowd density to obtain the corresponding current optimal experience number;
and controlling the corresponding number of the aperture spot lamps to project at a preset position according to the current optimal experience number, and dividing the VR display screen into a plurality of VR small screens with the number corresponding to the current optimal experience number to perform split screen display so as to complete state switching.
2. The VR device based multi-user experience control method of claim 1, wherein after the VR device switches states based on the current best experience user number, the method further includes:
when the VR equipment is judged to be switched in state according to the current optimal experience number, timing is started immediately to obtain second time;
when the second time is larger than the second preset time and the current crowd intensity corresponding to the preset range is larger than the preset intensity threshold value, generating first prompt information, wherein the first prompt information is used for prompting that the VR equipment exceeds the reception quantity of experience personnel so as to prompt part of users to leave.
3. The VR device-based multi-user experience control method of claim 1, wherein the preset range includes a first area and a second area, the second area is located outside the first area, the plurality of projected positions corresponding to the aperture lamps are all located in the first area, and when the VR device switches states according to the current optimal number of people experiencing the VR device, the method further includes:
when the number of the gathered people in the first area is larger than the current optimal experience number of people, the VR equipment is controlled to be in a locking state, second prompt information is generated, and the second prompt information is used for prompting that the current experience number of people in the first area exceeds the current optimal experience number of people.
4. The VR device based multi-user experience control method of claim 3, wherein after the VR device switches states based on the current best experience user number, the method further includes:
when the number of gathering personnel in the first area is smaller than half of the current optimal experience number of people, and the current crowd intensity corresponding to the preset range is larger than the preset intensity threshold value, the VR equipment is controlled to be in a locking state, third prompt information is generated, the third prompt information is used for reminding a user that the area aperture is still vacant at present to allow the user to enter, and the mobile interaction terminal equipment is used for experiencing.
5. The VR device based multi-user experience control method of claim 1, wherein after the VR device switches states based on the current best experience user number, the method further includes:
when the VR equipment is judged to be switched in state according to the current optimal experience number, timing is started immediately to obtain third time;
when the third time is judged to be greater than a third preset time and the VR equipment is in a normal working state, detecting the number of the mobile interactive terminal equipment in a using state;
and when the number of the mobile interaction terminal devices in the using state is judged to be less than the current optimal experience number, uniformly dividing the VR display screen into the same number as the mobile interaction terminal devices in the using state.
6. The VR device based multi-user experience control method of claim 1, wherein after the VR device switches states based on the current best experience user number, the method further includes:
according to the face image information collected by the visual camera, determining the age and sex information of the user in each area aperture according to the face image information;
and controlling the VR small screen corresponding to each area aperture to be switched into a corresponding display theme according to the age and sex information of the user in each area aperture.
7. The VR device-based multi-user experience control method of claim 3, further comprising a waiting area within the predetermined range, the waiting area being configured to allow only one user to wait, the waiting area being located outside the first area and within the second area, and when the VR device switches states according to the current best experience number, the method further comprising:
acquiring face image information within a preset range according to the visual camera, and correspondingly generating and storing accumulated experience times for each user after each user finishes the experience of the VR equipment;
and when the accumulated experience times corresponding to the users in the waiting area is judged to be larger than the experience times corresponding to the users in the first area, generating fourth prompt information, wherein the fourth prompt information is used for prompting the users in the waiting area to leave.
8. The VR device-based multi-user experience control method of claim 3, further comprising a waiting area within the predetermined range, the waiting area being configured to allow only one user to wait, the waiting area being located outside the first area and within the second area, and when the VR device switches states according to the current best experience number, the method further comprising:
acquiring face image information within a preset range according to the visual camera, and correspondingly generating and storing accumulated experience times for each user after each user finishes the experience of the VR equipment;
determining age and gender information corresponding to each user according to the face image information;
generating corresponding waiting priority according to the accumulated experience times and the age and gender information corresponding to each user;
and generating a ranking list according to the waiting priority of each user and correspondingly prompting the corresponding users to enter the waiting area in sequence.
9. The utility model provides a controlling means is experienced to many people based on VR equipment, the device is a controller, the controller is applied to in the VR equipment, the VR equipment still includes a plurality of vision cameras, a plurality of light ring shot-light, a plurality of mobile interaction terminal equipment and VR display screen, the controller is with a plurality of vision camera, a plurality of light ring shot-light, a plurality of mobile interaction terminal equipment and each in the VR display screen is equallyd divide and is do not electric connection, wherein the vision camera is used for gathering the face image, light ring shot-light is used for throwing regional light ring at preset position, wherein corresponds in every regional light ring has a user, its characterized in that, the device includes:
the first calculation module is used for acquiring face image information in a preset range through the plurality of visual cameras and counting to obtain the number of gathering personnel when the VR equipment is in a working state, and calculating to obtain the current crowd density according to the number of the gathering personnel;
the second calculation module is used for immediately starting timing to obtain first time when the current crowd density is judged to be greater than a preset density threshold value, and calculating to obtain the corresponding current optimal experience number according to the current crowd density when the first time is judged to be greater than the first preset time;
and the screen splitting control module is used for controlling the corresponding number of the current optimal experience number of people to project the aperture spot light at a preset position and dividing the VR display screen into a plurality of VR small screens with the corresponding number of the current optimal experience number of people for screen splitting display.
10. A readable storage medium having stored thereon a computer program, which when executed by a processor implements the VR device based multi-user experience control method of any of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011228557.2A CN112036388B (en) | 2020-11-06 | 2020-11-06 | Multi-user experience control method and device based on VR equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011228557.2A CN112036388B (en) | 2020-11-06 | 2020-11-06 | Multi-user experience control method and device based on VR equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112036388A CN112036388A (en) | 2020-12-04 |
| CN112036388B true CN112036388B (en) | 2021-01-15 |
Family
ID=73572784
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011228557.2A Active CN112036388B (en) | 2020-11-06 | 2020-11-06 | Multi-user experience control method and device based on VR equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112036388B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105898342A (en) * | 2015-12-30 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Video multipoint co-screen play method and system |
| CN107016321A (en) * | 2016-01-28 | 2017-08-04 | 青岛海尔智能技术研发有限公司 | Commercial cabinet personnel flow detection statistical method |
| CN108874341A (en) * | 2018-06-13 | 2018-11-23 | 深圳市东向同人科技有限公司 | Screen prjection method and terminal device |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9898864B2 (en) * | 2015-05-28 | 2018-02-20 | Microsoft Technology Licensing, Llc | Shared tactile interaction and user safety in shared space multi-person immersive virtual reality |
| US9981182B2 (en) * | 2016-02-12 | 2018-05-29 | Disney Enterprises, Inc. | Systems and methods for providing immersive game feedback using haptic effects |
| CN106803966B (en) * | 2016-12-31 | 2020-06-23 | 北京星辰美豆文化传播有限公司 | Multi-user network live broadcast method and device and electronic equipment thereof |
| CN108595004A (en) * | 2018-04-23 | 2018-09-28 | 新华网股份有限公司 | More people's exchange methods, device and relevant device based on Virtual Reality |
| CN110084726A (en) * | 2019-04-01 | 2019-08-02 | 广东芬莱信息科技有限公司 | Multiple person cooperational training control method, device and storage medium based on virtual reality |
| CN111475022A (en) * | 2020-04-03 | 2020-07-31 | 上海唯二网络科技有限公司 | Method for processing interactive voice data in multi-person VR scene |
-
2020
- 2020-11-06 CN CN202011228557.2A patent/CN112036388B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105898342A (en) * | 2015-12-30 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Video multipoint co-screen play method and system |
| CN107016321A (en) * | 2016-01-28 | 2017-08-04 | 青岛海尔智能技术研发有限公司 | Commercial cabinet personnel flow detection statistical method |
| CN108874341A (en) * | 2018-06-13 | 2018-11-23 | 深圳市东向同人科技有限公司 | Screen prjection method and terminal device |
Non-Patent Citations (1)
| Title |
|---|
| Development of an Effective 3D VR-Based Manipulation System for Industrial Robot Manipulators;Y. H. Su,;《2019 12th Asian Control Conference (ASCC)》;20190609;第890-894页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112036388A (en) | 2020-12-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3365724B1 (en) | Selecting virtual objects in a three-dimensional space | |
| US20170123505A1 (en) | Method to Control Perspective for a Camera-Controlled Computer | |
| CN106139587B (en) | Method and system for avoiding real environment obstacles based on VR game | |
| US8009022B2 (en) | Systems and methods for immersive interaction with virtual objects | |
| CN101966393B (en) | Display viewing system and methods for optimizing display view based on active tracking | |
| EP3628381A1 (en) | Game picture display method and apparatus, storage medium and electronic device | |
| CN106730815B (en) | Somatosensory interaction method and system easy to realize | |
| EP3332565A1 (en) | Mixed reality social interaction | |
| CN108596106B (en) | Visual fatigue recognition method and device based on VR equipment and VR equipment | |
| CN108282648A (en) | A kind of VR rendering intents, device, Wearable and readable storage medium storing program for executing | |
| CN112641610B (en) | Amblyopia training method, device and system | |
| CN106445157A (en) | Method and device for adjusting image display orientation | |
| CN109656504A (en) | Screen eye care method, device, terminal and storage medium | |
| CN113206993A (en) | Method for adjusting display screen and display device | |
| CN112036388B (en) | Multi-user experience control method and device based on VR equipment and readable storage medium | |
| CN104185986A (en) | Image processing device, image processing method and program | |
| CN113315999A (en) | Virtual reality optimization method, device, equipment and storage medium | |
| US11881192B2 (en) | Compensating for latency in a streaming virtual reality environment | |
| CN110413109A (en) | Generation method, device, system, electronic equipment and the storage medium of virtual content | |
| CN113960788B (en) | Image display method, device, AR glasses and storage medium | |
| CN112882674B (en) | Virtual reality image data display method and equipment | |
| CN114669046A (en) | Control method and control device | |
| Helbig et al. | Haptic perception in interaction with other senses | |
| CN113101158A (en) | VR-based binocular video fusion training method and device | |
| CN113855987B (en) | Three-dimensional content sleep aiding method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |