CN107577344B - Interactive mode switching control method and system of MR head display equipment - Google Patents
Interactive mode switching control method and system of MR head display equipment Download PDFInfo
- Publication number
- CN107577344B CN107577344B CN201710781260.0A CN201710781260A CN107577344B CN 107577344 B CN107577344 B CN 107577344B CN 201710781260 A CN201710781260 A CN 201710781260A CN 107577344 B CN107577344 B CN 107577344B
- Authority
- CN
- China
- Prior art keywords
- head display
- interaction
- display device
- interactive
- acquisition request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The embodiment of the invention discloses an interactive mode switching control method and system of MR head display equipment, wherein the method comprises the following steps: and when the service equipment judges that other MR head display equipment in a moving state exists in the geographic position where the MR head display equipment is located, the service equipment controls the MR head display equipment to switch the interactive mode into the MR interactive mode. Therefore, the embodiment of the invention can automatically switch the interaction mode of the MR head display equipment into the MR interaction mode without manual switching by a user, is fast and efficient, captures real-time scenes through the double cameras in the MR interaction mode and replaces the background in the real-time scenes into the mapping of the virtual digital space in the entity environment, and the mode of combining the virtual digital space and the entity environment integrates the functions of VR and AR, can accurately identify other people in the same scene, improves the safety of using the MR head display equipment, and brings more vivid, more three-dimensional and safer diversified experiences to the user.
Description
Technical Field
The invention relates to the technical field of media Mediated Reality (MR), in particular to an interactive mode switching control method and system of MR head display equipment.
Background
Currently, with the rapid development of electronic technology, Virtual Reality (VR) technology is also more and more widely applied, wherein the most common application of VR technology is embodied as its application in game, that is, rich perception capability and 3D display environment make VR devices ideal video game tools, for example, after a user wears the VR device, the user can experience the stimulus when sitting on a mountain bike through the 3D virtual scene displayed by the VR device or interact with the virtual character in the 3D virtual scene, so that the user can be personally on the scene to increase the interest of game. In actual operation, in order to further improve the user experience, the related devices including the VR device can provide multiple interaction modes for the user to select, and how to quickly switch between the interaction modes is very important.
Disclosure of Invention
The embodiment of the invention discloses an interactive mode switching control method and system of MR head display equipment, which can automatically switch the interactive mode of the MR head display equipment into an MR interactive mode when other MR head display equipment in a moving state exists in the environment of the MR head display equipment, does not need manual switching by a user, and is quick and efficient.
The first aspect of the embodiment of the invention discloses an interactive mode switching control method of MR head display equipment, which comprises the following steps:
the MR head display equipment locates the current geographical position of the MR head display equipment in a default interaction mode, and sends an interaction condition acquisition request comprising the current geographical position to service equipment, wherein the default interaction mode is a VR mode or an AR mode;
the service equipment detects whether at least one other MR head display equipment in a moving state exists in the current geographic position according to the interactive condition acquisition request, and returns an interactive condition acquisition response aiming at the interactive condition acquisition request to the MR head display equipment sending the interactive condition acquisition request when detecting that the at least one other MR head display equipment exists, wherein the interactive condition acquisition response comprises a mode switching instruction;
the MR head display equipment which sends the interactive condition acquisition request receives the interactive condition acquisition response, and switches the interactive mode of the MR head display equipment which sends the interactive condition acquisition request from the default interactive mode to the MR interactive mode according to the mode switching instruction which is included in the interactive condition acquisition response, wherein the MR interactive mode is an interactive mode which outputs an entity scene in a real-time scene captured by the double cameras and a virtual scene matched with a background scene in the real-time scene.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after detecting that the at least one other MR head display device exists, and before the service device returns an interaction acquisition response to the interaction acquisition request to the MR head display device that sends the interaction acquisition request, the method further includes:
the service equipment determines a first three-dimensional coordinate of the MR head display equipment sending the interactive condition acquisition request in the current geographic position and a second three-dimensional coordinate of each other MR head display equipment in the current geographic position, and determines a distance value from the MR head display equipment sending the interactive condition acquisition request to each other MR head display equipment according to the first three-dimensional coordinate and each second three-dimensional coordinate;
the service equipment judges whether a target distance value smaller than or equal to a preset distance threshold exists in the distance values from the MR head display equipment sending the interactive condition acquisition request to each other MR head display equipment, and when the target distance value is judged to exist, the service equipment triggers and executes the operation of returning an interactive condition acquisition response aiming at the interactive condition acquisition request to the MR head display equipment sending the interactive condition acquisition request.
As an optional implementation manner, in the first aspect of this embodiment of the present invention, the method further includes:
the service equipment determines a target MR head display equipment corresponding to the target distance value from the at least one other MR head display equipment and acquires the moving direction of the target MR head display equipment;
the service equipment judges whether the moving direction is close to the MR head display equipment sending the interactive condition acquisition request, and when the moving direction is judged to be close to the MR head display equipment sending the interactive condition acquisition request, the service equipment sends an equipment identifier of the target MR head display equipment to the MR head display equipment sending the interactive condition acquisition request;
the MR head display equipment which sends the interactive condition acquisition request receives the equipment identification sent by the service equipment, and establishes interactive connection with the target MR head display equipment in the MR interactive mode according to the equipment identification.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after determining that the moving direction is a direction close to the MR head display device that sends the interactive situation acquisition request, and before the service device sends the device identifier of the target MR head display device to the MR head display device that sends the interactive situation acquisition request, the method further includes:
and the service equipment determines the interactive attribute of the target MR head display equipment, judges whether the interactive attribute indicates that the target MR head display equipment allows the interactive connection to be established with the target MR head display equipment, and triggers and executes the operation of sending the equipment identifier of the target MR head display equipment to the MR head display equipment which sends the interactive condition acquisition request when the interactive attribute indicates that the target MR head display equipment allows the interactive connection to be established with the target MR head display equipment.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after determining that the interaction attribute indicates that the target MR head display device allows establishing an interactive connection therewith, and before the service device sends the device identifier of the target MR head display device to the MR head display device that sends the interaction condition acquisition request, the method further includes:
the service equipment acquires the current interaction mode of the target MR head display equipment, judges whether the current interaction mode is the MR interaction mode or not, and triggers and executes the operation of sending the equipment identification of the target MR head display equipment to the MR head display equipment which sends the interaction condition acquisition request when the current interaction mode is judged to be the MR interaction mode.
The second aspect of the embodiment of the present invention discloses an interactive mode switching control system for MR head display equipment, the system includes MR head display equipment and service equipment, the MR head display equipment includes a positioning unit, a first communication unit and a switching unit, the service equipment includes a second communication unit, a detection unit and a third communication unit, wherein:
the positioning unit is used for positioning the current geographic position of the mobile terminal in a default interaction mode, wherein the default interaction mode is a VR mode or an AR mode;
the first communication unit is used for sending an interaction condition acquisition request comprising the current geographic position to service equipment;
the second communication unit is used for receiving the interactive situation acquisition request sent by the first communication unit;
the detection unit is used for detecting whether at least one other MR head display device in a moving state exists in the current geographic position according to the interaction condition acquisition request;
the third communication unit is configured to, when the detection unit detects that the at least one other MR head display device exists, return an interaction condition acquisition response to the interaction condition acquisition request to the MR head display device that sends the interaction condition acquisition request, where the interaction condition acquisition response includes a mode switching instruction;
the first communication unit is further configured to receive the interaction condition acquisition response;
the switching unit is used for switching the interaction mode of the MR head display equipment which sends the interaction condition acquisition request from the default interaction mode to an MR interaction mode, wherein the MR interaction mode is an interaction mode of outputting an entity scene in a real-time scene captured by the double cameras and a virtual scene matched with a background scene in the real-time scene.
As an optional implementation manner, in a second aspect of the embodiment of the present invention, the service device further includes a determining unit and a determining unit, where:
the determining unit is configured to determine, after the detecting unit detects that the at least one other MR head display device exists and before the third communication unit returns an interaction acquisition response for the interaction acquisition request to the MR head display device that sends the interaction acquisition request, a first three-dimensional coordinate of the MR head display device that sends the interaction acquisition request in the current geographic location and a second three-dimensional coordinate of each of the other MR head display devices in the current geographic location, and determine, according to the first three-dimensional coordinate and each of the second three-dimensional coordinates, a distance value from the MR head display device that sends the interaction acquisition request to each of the other MR head display devices;
the judgment unit is used for judging whether a target distance value smaller than or equal to a preset distance threshold exists in the distance values from the MR head display equipment sending the interaction condition acquisition request to each other MR head display equipment;
the third communication unit is specifically configured to, when the detection unit detects that the at least one other MR head display device exists and the determination unit determines that the target distance value exists, return an interaction condition acquisition response to the interaction condition acquisition request to the MR head display device that sends the interaction condition acquisition request.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the determining unit is further configured to determine, from the at least one other MR head display device, a target MR head display device corresponding to the target distance value;
the service device further comprises an acquisition unit and a fourth communication unit, wherein:
the acquisition unit is used for acquiring the moving direction of the target MR head display equipment;
the judging unit is further configured to judge whether the moving direction is a direction close to the MR head display device that sends the interaction condition acquisition request;
the fourth communication unit is configured to send the device identifier of the target MR head display device to the MR head display device that sent the interaction condition acquisition request when the determination unit determines that the moving direction is a direction close to the MR head display device that sent the interaction condition acquisition request;
the first communication unit is further configured to receive the device identifier sent by the serving device;
the MR head display device that sends the interactive situation acquisition request further includes an interaction unit, wherein:
and the interaction unit is used for establishing interactive connection with the target MR head display equipment in the MR interaction mode according to the equipment identification.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the determining unit is further configured to determine the interaction attribute of the target MR head display device after the determining unit determines that the moving direction is a direction close to the MR head display device that sends the interaction condition acquisition request, and before the fourth communication unit sends the device identifier of the target MR head display device to the MR head display device that sends the interaction condition acquisition request;
the judging unit is further configured to judge whether the interaction attribute indicates that the target MR head display device allows an interactive connection to be established therewith;
the fourth communication unit is specifically configured to send the device identifier of the target MR head display device to the MR head display device that sends the interaction condition acquisition request when the determination unit determines that the moving direction is a direction close to the MR head display device that sends the interaction condition acquisition request and determines that the interaction attribute indicates that the target MR head display device allows the interactive connection to be established therewith.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the obtaining unit is further configured to obtain a current interaction mode of the target MR head display device after the determining unit determines that the interaction attribute indicates that the target MR head display device allows establishing an interaction connection therewith and before the third communication unit sends the device identifier of the target MR head display device to the MR head display device that sends the interaction condition obtaining request;
the judging unit is further configured to judge whether the current interaction mode is the MR interaction mode;
the fourth communication unit is specifically configured to send the device identifier of the target MR head display device to the MR head display device that sent the interaction condition acquisition request when the determination unit determines that the moving direction is a direction close to the MR head display device that sent the interaction condition acquisition request, determines that the interaction attribute indicates that the target MR head display device allows an interactive connection to be established therewith, and determines that the current interaction mode is the MR interaction mode.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, MR head display equipment locates the current geographical position of the MR head display equipment in a default interaction mode, and sends an interaction condition acquisition request comprising the current geographical position to service equipment, wherein the default interaction mode is a VR mode or an AR mode; the service equipment detects whether at least one other MR head display equipment in a moving state exists in the current geographic position according to the interaction condition acquisition request, and returns an interaction condition acquisition response aiming at the interaction condition acquisition request to the MR head display equipment when detecting that the at least one other MR head display equipment exists, wherein the interaction condition acquisition response comprises a mode switching instruction; the MR head display equipment receives the interaction condition acquisition response, switches the interaction mode of the MR head display equipment from the default interaction mode to an MR interaction mode according to a mode switching instruction included in the interaction condition acquisition response, and the MR interaction mode is an interaction mode of outputting an entity scene in a real-time scene captured by the double cameras and a virtual scene matched with a background scene in the real-time scene. Therefore, the embodiment of the invention can automatically switch the interaction mode of the MR head display equipment into the MR interaction mode when other MR head display equipment in a moving state exists in the environment of the MR head display equipment, the manual switching by a user is not needed, the operation is fast and efficient, and in the MR interaction mode, the user can accurately identify other people in the same scene through the MR head display equipment, the safety of the user when using the MR head display equipment is improved, and more vivid, three-dimensional and safer diversified interaction experience is brought to the user.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic flowchart of an interactive mode switching control method for an MR head display device according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of another interactive mode switching control method for an MR head display device according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an interactive mode switching control system of an MR head display device according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an interactive mode switching control system of another MR head display device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "comprises" and "comprising," and any variations thereof, of embodiments of the present invention are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses an interactive mode switching control method and system of MR head display equipment, which can automatically switch the interactive mode of the MR head display equipment into an MR interactive mode when other MR head display equipment in a moving state exists in the environment of the MR head display equipment, does not need manual switching by a user, is fast and efficient, and can accurately identify other characters in the same scene through the MR head display equipment in the MR interactive mode, thereby improving the safety of the user when using the MR head display equipment and bringing more vivid, more three-dimensional and more safe diversified interactive experience to the user. The following detailed description is made with reference to the accompanying drawings.
Example one
Referring to fig. 1, fig. 1 is a schematic flowchart illustrating an interactive mode switching control method of an MR head display device according to an embodiment of the present invention. As shown in fig. 1, the method for controlling the switching of the interactive mode of the MR head display device may include the following operations:
101. the MR head display equipment locates the current geographic position of the MR head display equipment in a default interaction mode, and sends an interaction condition acquisition request comprising the current geographic position to the service equipment.
In the embodiment of the present invention, the MR head display device may have at least three interaction modes, such as a VR mode, an AR mode, and a VR + AR MR interaction mode, and when the MR head display device is started, the MR head display device may start the VR mode or the AR mode, or may start the MR interaction mode, and when the started interaction mode is a default interaction mode (the VR mode or the AR mode), the MR head display device triggers to execute steps 101 to 104.
In the embodiment of the invention, the MR head display equipment is provided with two cameras, and the two cameras are used for simulating the real-time scene in the field of view of the human eye work acquisition, rendering the acquired real-time scene (or called digital picture) in real time, and superposing part of the virtual scene to realize an AR mode, or completely superposing the virtual scene to realize a VR mode.
In the embodiment of the present invention, the positioning, by the MR head display device, the current geographical location where the MR head display device is located in the default interaction mode may include:
the method comprises the steps that MR head display equipment obtains at least two different positioning interfaces configured on the MR head display equipment;
the MR head display equipment sends the positioning request to the at least two different positioning interfaces so as to trigger each positioning interface to respectively send the received positioning request to the corresponding positioning server;
the MR head display equipment acquires the position information sent by a positioning server corresponding to at least one positioning interface;
the MR head display equipment acquires response time from a first moment to a second moment, wherein the first moment is the moment when each positioning interface sends a positioning request, and the second moment is the moment when each positioning interface receives position information;
the MR head display equipment compares the response time corresponding to each positioning interface with a response threshold value;
and the MR head display equipment extracts the position information with the highest positioning precision from the position information received by the positioning interface of which the response time does not exceed the response threshold value as the current geographic position of the MR head display equipment. This may improve the accuracy of the determined current geographical location of the MR head display device.
102. The service device receives the interaction condition acquisition request, detects whether at least one other MR head display device in a moving state exists in the current geographic location according to the interaction condition acquisition request, and triggers execution of step 103 when the detection result of step 102 is yes, and may end the process when the detection result of step 102 is no.
In this embodiment of the present invention, when the detection result in step 102 is yes, that is, when the service device detects that there is another MR head display device in a moving state at the current geographic location, the service device needs to control the MR head display device to perform switching of the interactive mode.
103. And the service equipment returns an interaction condition acquisition response aiming at the interaction condition acquisition request to the MR head display equipment, wherein the interaction condition acquisition response comprises a mode switching instruction.
In an embodiment of the present invention, the mode switching instruction is used to instruct the MR head display device to switch the interactive mode to the MR interactive mode.
104. And the MR head display equipment receives the interaction condition acquisition response, and switches the interaction mode of the MR head display equipment from the default interaction mode to the MR interaction mode according to a mode switching instruction included in the interaction condition acquisition response.
In the embodiment of the invention, the MR interactive mode is specifically that the MR head display equipment acquires the real-time scene of the current geographic position of the MR head display equipment through two cameras, and obtains the background scene and the entity scene by separating the background and the foreground entity in the acquired real-time scene through the preset background color; sending a rendering request comprising the background scene to a service device, wherein the rendering request is used for requesting to acquire a virtual scene matched with the background scene; receiving a rendering response returned by the service equipment for the rendering request, wherein the rendering response comprises a virtual scene matched with the background scene determined by the service equipment; and replacing the background scene included in the real-time scene with a virtual scene matched with the background scene, and outputting the virtual scene and the entity scene. The background color of the background scene is matched with the preset background color, optionally, the preset background color may be green or blue, and the embodiment of the present invention is not limited. Specifically, in practical applications, a green screen (preset background color is green) or a blue screen (preset background color is blue) of a movie special effect can be applied to a separation process of a background and a foreground entity, that is, a part or all of a specific physical environment can be arranged as the green screen or the blue screen in advance, the MR head display device determines a scene with the same color as or matched with the preset background color as a background scene in an MR mode by identifying the preset background color, and determines a scene with the different color from or not matched with the preset background color as an entity scene of the foreground entity.
Therefore, the method for switching the interaction mode of the MR head display device described in fig. 1 can automatically switch the interaction mode of the MR head display device to the MR interaction mode when other MR head display devices in a moving state exist in the environment where the MR head display device is located, manual switching by a user is not needed, the method is fast and efficient, and in the MR interaction mode, the user can accurately identify other people in the same scene through the MR head display device, so that the safety of the user when using the MR head display device is improved, and more vivid, three-dimensional and safer diversified interaction experience is brought to the user.
Example two
Referring to fig. 2, fig. 2 is a schematic flowchart illustrating another interactive mode switching control method for an MR head display device according to an embodiment of the present invention. As shown in fig. 2, the method for controlling the switching of the interactive mode of the MR head display device may include the following operations:
201. the MR head display equipment locates the current geographic position of the MR head display equipment in a default interaction mode, and sends an interaction condition acquisition request comprising the current geographic position to the service equipment.
In this embodiment of the present invention, the default interaction mode is a VR mode or an AR mode, and may also be other interaction modes besides an MR interaction mode.
202. The service device receives the interaction condition acquisition request, detects whether at least one other MR head display device in a moving state exists in the current geographic location according to the interaction condition acquisition request, and when the detection result of step 202 is yes, triggers execution of step 203, and when the detection result of step 202 is no, may end the process.
203. The service device determines a first three-dimensional coordinate of the MR head display device in the current geographic position and a second three-dimensional coordinate of each other MR head display device in the current geographic position.
As an alternative embodiment, the determining, by the service device, the three-dimensional sitting of any one of the MR head display devices in the current geographic location may include:
the method comprises the steps that the service equipment identifies at least three feature points in a background scene sent by any MR head display equipment, wherein the background scene is separated from a real-time scene captured by the double cameras of the MR head display equipment according to a preset background color;
the service equipment determines the three-dimensional coordinates of any MR head display equipment in the current geographic position according to a physical shape surrounded by at least three characteristic points in a background scene sent by the MR head display equipment, the position of the physical shape in the background scene and a three-dimensional space model of the current geographic position pre-stored in the service equipment; alternatively, the first and second electrodes may be,
the service equipment acquires images aiming at any one MR head display equipment from at least three cameras installed at the current geographic position, and determines the three-dimensional coordinates of any one MR head display equipment in the current geographic position according to the position and the size of the any one MR head display equipment in each image and the installation positions of the at least three cameras in a pre-stored three-dimensional space model of the current geographic position.
As can be seen, this alternative embodiment can improve the accuracy of the determined three-dimensional coordinates of the MR head display device in the current geographical position.
204. And the service device determines the distance value from the MR head display device to each other MR head display device according to the first three-dimensional coordinates and each second three-dimensional coordinate.
205. The service device determines whether a target distance value less than or equal to a preset distance threshold exists in the distance values from the MR head display device to each of the other MR head display devices, and if the determination result in step 205 is yes, the step 206 is triggered to be executed, and if the determination result in step 205 is no, the process may be ended.
206. And the service equipment returns an interaction condition acquisition response aiming at the interaction condition acquisition request to the MR head display equipment, wherein the interaction condition acquisition response comprises a mode switching instruction.
207. And the MR head display equipment receives the interaction condition acquisition response, and switches the interaction mode of the MR head display equipment from the default interaction mode to the MR interaction mode according to a mode switching instruction included in the interaction condition acquisition response.
Therefore, by implementing the method for controlling the interactive mode switching of the MR head display device described in fig. 2, when the service device detects that the mobile state exists at the same geographic position and the distance value from the MR head display device is less than or equal to the preset distance threshold, the MR head display device can be controlled to switch the interactive mode to the MR interactive mode, so that the reliability and the accuracy of the interactive mode switching of the MR head display device are improved.
In an optional embodiment, the method for controlling the interactive mode switching of the MR head display device may further include the following operations:
the service equipment determines a target MR head display equipment corresponding to the target distance value from the at least one other MR head display equipment and acquires the moving direction of the target MR head display equipment;
the service equipment judges whether the moving direction is close to the MR head display equipment or not, and sends the equipment identification of the target MR head display equipment to the MR head display equipment when the moving direction is judged to be close to the MR head display equipment;
and the MR head display equipment receives the equipment identification sent by the service equipment and establishes interactive connection with the target MR head display equipment under the MR interactive mode according to the equipment identification.
Therefore, the optional embodiment can further control the MR head display device to be in interactive connection with the target MR head display device when it is determined that the target MR head display device which is in the moving state and has the distance value smaller than or equal to the preset distance threshold value exists and the moving direction of the target MR head display device is the direction towards the MR head display device, so that the interactive performance of the MR head display device is enriched, and the use experience of a user is further improved.
In this optional embodiment, further optionally, after determining that the moving direction is a direction approaching the MR head display device, and before the service device sends the device identifier of the target MR head display device to the MR head display device, the method for controlling switching of the interaction mode of the MR head display device may further include the following operations:
and the service equipment determines the interactive attribute of the target MR head display equipment, judges whether the interactive attribute indicates that the target MR head display equipment allows the interactive connection to be established with the target MR head display equipment, and triggers and executes the operation of sending the equipment identifier of the target MR head display equipment to the MR head display equipment when the interactive attribute indicates that the target MR head display equipment allows the interactive connection to be established with the target MR head display equipment. Therefore, the safety of interaction can be improved, and the probability of successful interaction is improved.
In this optional embodiment, still further optionally, after determining that the interaction attribute indicates that the target MR head display device allows to establish an interactive connection therewith, and before the service device sends the device identifier of the target MR head display device to the MR head display device, the method for controlling switching of the interaction mode of the MR head display device may further include the following operations:
and the service equipment acquires the current interaction mode of the target MR head display equipment, judges whether the current interaction mode is the MR interaction mode, and triggers and executes the operation of sending the equipment identifier of the target MR head display equipment to the MR head display equipment when judging that the current interaction mode is the MR interaction mode. Therefore, the interactive modes are controlled to be the interactive connection mode established between the MR head display devices in the MR interactive modes, so that the users of the MR head display devices can accurately identify the users of the MR head display devices interacting with the MR head display devices, the interaction safety is further improved, and the probability that the users of the MR head display devices are physically injured in the interaction process is reduced.
It should be noted that the interactive connection allows transmission of voice messages and text messages between the MR head display devices that establish the interactive connection, and may also allow sharing of a display screen between the MR head display devices, which is not limited in the embodiment of the present invention.
It can be seen that, by implementing the method for controlling switching of the interaction mode of the MR head display device described in fig. 2, when there are other MR head display devices in a moving state in the environment where the MR head display device is located, the interaction mode of the MR head display device can be automatically switched to the MR interaction mode, manual switching by a user is not required, and the method is fast and efficient.
EXAMPLE III
Referring to fig. 3, fig. 3 is a schematic structural diagram of an interactive mode switching control system of an MR head display device according to an embodiment of the present invention. As shown in fig. 3, the interactive mode switching control system of the MR head display apparatus may include an MR head display apparatus 301 and a service apparatus 302, the MR head display apparatus 301 may include a positioning unit 3011, a first communication unit 3012 and a switching unit 3013, and the service apparatus 302 may include a second communication unit 3021, a detection unit 3022 and a third communication unit 3023, where:
the positioning unit 3011 is configured to position a current geographic location of the mobile device in a default interaction mode, where the default interaction mode is a VR mode or an AR mode.
The first communication unit 3012 is configured to send an interaction obtaining request including the current geographic location located by the location unit 301 to the service device 302.
The second communication unit 3021 is configured to receive the interaction situation obtaining request sent by the first communication unit 3012.
A detecting unit 3022, configured to detect whether there is at least one other MR head display device in a moving state in the current geographic location according to the interaction situation acquisition request received by the second communication unit 3021.
A third communication unit 3023, configured to, when the detection unit 3022 detects that at least one other MR head display apparatus exists, return an interaction situation acquisition response to the interaction situation acquisition request to the MR head display apparatus 301, where the interaction situation acquisition response includes a mode switching instruction.
The first communication unit 3012 is further configured to receive the interaction obtaining response.
The switching unit 3013 is configured to switch an interaction mode of the MR head display device from the default interaction mode to an MR interaction mode, where the MR interaction mode is an interaction mode that outputs a real scene in a real-time scene captured by the dual cameras and a virtual scene matched with a background scene in the real-time scene.
In an optional embodiment, the service device 302 may further include a determining unit 3024 and a determining unit 3025, in this case, the structure of the interactive mode switching control system of the MR head display device may be as shown in fig. 4, and fig. 4 is a schematic structural diagram of another interactive mode switching control system of an MR head display device disclosed in the embodiment of the present invention. Wherein:
a determining unit 3024, configured to determine, after the detecting unit 3022 detects that at least one other MR head display apparatus exists and before the third communicating unit 3023 returns an interaction acquisition response to the interaction acquisition request to the MR head display apparatus 301, a first three-dimensional coordinate of the MR head display apparatus in the current geographic location and a second three-dimensional coordinate of each other MR head display apparatus in the current geographic location, and determine a distance value from the MR head display apparatus 301 to each other MR head display apparatus according to the first three-dimensional coordinate and each second three-dimensional coordinate.
Optionally, the specific way for the determining unit 3024 to determine the three-dimensional sitting of any MR head display device in the current geographic location is as follows:
identifying at least three feature points in a background scene sent by any MR head display equipment, wherein the background scene is separated from a real-time scene captured by the double cameras of the MR head display equipment according to a preset background color;
determining the three-dimensional coordinates of any one MR head display device in the current geographic position according to a physical shape surrounded by at least three characteristic points in a background scene sent by the MR head display device, the position of the physical shape in the background scene and a three-dimensional space model of the current geographic position pre-stored in the service device 302; alternatively, the first and second electrodes may be,
and acquiring images for any one MR head display device from at least three cameras installed at the current geographic position, and determining the three-dimensional coordinates of any one MR head display device in the current geographic position according to the position and the size of the any one MR head display device in each image and the installation positions of the at least three cameras in a pre-stored three-dimensional space model of the current geographic position.
A judging unit 3025 configured to judge whether there is a target distance value equal to or less than a preset distance threshold value among the distance values of the MR head display apparatus 301 to each of the other MR head display apparatuses.
The third communication unit 3023 is specifically configured to return an interaction situation acquisition response to the interaction situation acquisition request to the MR head display apparatus 301 when the detection unit 3022 detects that the at least one other MR head display apparatus exists and when the determination unit 3025 determines that the target distance value exists.
Further optionally, the determining unit 3024 may be further configured to determine a target MR head display apparatus corresponding to the target distance value from the at least one other MR head display apparatus, and as shown in fig. 4, the service apparatus 302 may further include an obtaining unit 3026 and a fourth communication unit 3027, where:
an acquiring unit 3026 configured to acquire a moving direction of the target MR head display apparatus.
The determination unit 3025 is further configured to determine whether the movement direction acquired by the acquisition unit 3026 is a direction approaching the MR head display apparatus 301.
A fourth communication unit 3027, configured to send the device identifier of the target MR head display device to the MR head display device 301 when the determination unit 3025 determines that the moving direction is a direction approaching the MR head display device 301.
The first communication unit 3012 is further configured to receive the device identifier sent by the service device 302.
Therein, as shown in fig. 4, the MR head up display device 301 further comprises an interaction unit 3014, wherein:
and the interaction unit 3014 is configured to establish an interactive connection with the target MR head display device in an MR interaction mode according to the device identifier received by the first communication unit 3012.
Still further optionally, the determining unit 3024 is further configured to determine the interaction attribute of the target MR head display apparatus after the determining unit 3025 determines that the moving direction is a direction approaching the MR head display apparatus 301 and before the fourth communication unit 3027 sends the apparatus identifier of the target MR head display apparatus to the MR head display apparatus 301.
The judging unit 3025 is further configured to judge whether the interaction attribute determined by the determining unit 3024 indicates that the target MR head display apparatus allows an interactive connection to be established therewith.
The fourth communication unit 3027 is specifically configured to send the device identifier of the target MR head display device to the MR head display device 301 when the determining unit 3025 determines that the moving direction is a direction approaching the MR head display device 301 and that the interaction attribute indicates that the target MR head display device allows an interactive connection to be established therewith.
Still further optionally, the obtaining unit 3026 is further configured to obtain a current interaction mode of the target MR head display apparatus after the determining unit 3025 determines that the interaction attribute indicates that the target MR head display apparatus allows establishing an interaction connection therewith, and before the fourth communication unit 3027 sends the apparatus identifier of the target MR head display apparatus to the MR head display apparatus 301.
The determining unit 3025 is further configured to determine whether the current interaction mode acquired by the acquiring unit 3026 is an MR interaction mode.
The fourth communication unit 3027 is specifically configured to send the device identifier of the target MR head display device to the MR head display device 301 when the determining unit 3025 determines that the moving direction is a direction approaching the MR head display device 301, determines that the interaction attribute indicates that the target MR head display device allows to establish an interaction connection with the target MR head display device, and determines that the current interaction mode is an MR interaction mode.
It can be seen that, when there are other MR head display devices in a moving state in the environment where the MR head display device 301 is located, the interactive mode switching control system implementing the MR head display device described in fig. 3 or fig. 4 can automatically switch the interactive mode of the MR head display device 301 to the MR interactive mode under the control of the service device 302, without manual switching by a user, which is fast and efficient, and in the MR interactive mode, the user can accurately identify other people in the same scene through the MR head display device 301, so that the safety of the user when using the MR head display device 301 is improved, and more realistic, more stereoscopic, and more safe diversified interactive experience is brought to the user.
It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be implemented by instructions associated with a program, which may be stored in a computer-readable storage medium, including Read-only memory (ROM), Random Access Memory (RAM), programmable Read-only memory (PROM), erasable programmable Read-only memory (EPROM), One-time programmable Read-only memory (OTPROM), Electrically erasable rewritable Read-only memory (EEPROM), compact disc Read-only memory (CD-ROM) or other optical disc storage, magnetic disc storage, tape storage, or any other computer-readable medium capable of carrying or storing data.
The method and the system for implementing multi-user interaction based on the MR head display device disclosed by the embodiments of the present invention are described in detail above, and a specific example is applied in the text to explain the principle and the implementation of the present invention, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. An interactive mode switching control method of an MR head display device, wherein the MR is mediated reality, the method is characterized by comprising the following steps:
the MR head display equipment locates the current geographical position of the MR head display equipment in a default interaction mode, and sends an interaction condition acquisition request comprising the current geographical position to service equipment, wherein the default interaction mode is a VR mode or an AR mode;
the service equipment detects whether at least one other MR head display equipment in a moving state exists in the current geographic position according to the interactive condition acquisition request, and returns an interactive condition acquisition response aiming at the interactive condition acquisition request to the MR head display equipment sending the interactive condition acquisition request when detecting that the at least one other MR head display equipment exists, wherein the interactive condition acquisition response comprises a mode switching instruction;
the MR head display equipment which sends the interactive condition acquisition request receives the interactive condition acquisition response, and switches the interactive mode of the MR head display equipment which sends the interactive condition acquisition request from the default interactive mode to the MR interactive mode according to the mode switching instruction which is included in the interactive condition acquisition response, wherein the MR interactive mode is an interactive mode which outputs an entity scene in a real-time scene captured by the double cameras and a virtual scene matched with a background scene in the real-time scene.
2. The method for controlling switching of the interactive modes of the MR head display device according to claim 1, wherein after detecting the presence of the at least one other MR head display device and before the service device returns an interactive situation acquisition response to the interactive situation acquisition request to the MR head display device that sent the interactive situation acquisition request, the method further comprises:
the service equipment determines a first three-dimensional coordinate of the MR head display equipment sending the interactive condition acquisition request in the current geographical position and a second three-dimensional coordinate of each other MR head display equipment in the current geographical position, and determines a distance value from the MR head display equipment sending the interactive condition acquisition request to each other MR head display equipment according to the first three-dimensional coordinate and each second three-dimensional coordinate;
the service equipment judges whether a target distance value smaller than or equal to a preset distance threshold exists in the distance values from the MR head display equipment sending the interactive condition acquisition request to each other MR head display equipment, and when the target distance value is judged to exist, the service equipment triggers and executes the operation of returning an interactive condition acquisition response aiming at the interactive condition acquisition request to the MR head display equipment sending the interactive condition acquisition request.
3. The method for controlling the switching of the interactive mode of the MR head display device according to claim 2, wherein the method further comprises:
the service equipment determines a target MR head display equipment corresponding to the target distance value from the at least one other MR head display equipment and acquires the moving direction of the target MR head display equipment;
the service equipment judges whether the moving direction is close to the MR head display equipment sending the interactive condition acquisition request, and when the moving direction is judged to be close to the MR head display equipment sending the interactive condition acquisition request, the service equipment sends an equipment identifier of the target MR head display equipment to the MR head display equipment sending the interactive condition acquisition request;
the MR head display equipment which sends the interactive condition acquisition request receives the equipment identification sent by the service equipment, and establishes interactive connection with the target MR head display equipment in the MR interactive mode according to the equipment identification.
4. The method according to claim 3, wherein after determining that the moving direction is a direction close to the MR head display device that sends the interactive situation acquisition request, and before the service device sends the device identifier of the target MR head display device to the MR head display device that sends the interactive situation acquisition request, the method further comprises:
and the service equipment determines the interactive attribute of the target MR head display equipment, judges whether the interactive attribute indicates that the target MR head display equipment allows the interactive connection to be established with the target MR head display equipment, and triggers and executes the operation of sending the equipment identifier of the target MR head display equipment to the MR head display equipment which sends the interactive condition acquisition request when the interactive attribute indicates that the target MR head display equipment allows the interactive connection to be established with the target MR head display equipment.
5. The method according to claim 4, wherein after determining that the interaction attribute indicates that the target MR head display device allows to establish an interactive connection with the target MR head display device, and before the service device sends the device identifier of the target MR head display device to the MR head display device that sends the interaction condition acquisition request, the method further comprises:
the service equipment acquires the current interaction mode of the target MR head display equipment, judges whether the current interaction mode is the MR interaction mode or not, and triggers and executes the operation of sending the equipment identification of the target MR head display equipment to the MR head display equipment which sends the interaction condition acquisition request when the current interaction mode is judged to be the MR interaction mode.
6. An interactive mode switching control system of a MR head display device, wherein MR is mediated reality, the system comprises the MR head display device and a service device, the MR head display device comprises a positioning unit, a first communication unit and a switching unit, the service device comprises a second communication unit, a detection unit and a third communication unit, wherein:
the positioning unit is used for positioning the current geographic position of the mobile terminal in a default interaction mode, wherein the default interaction mode is a VR mode or an AR mode;
the first communication unit is used for sending an interaction condition acquisition request comprising the current geographic position to service equipment;
the second communication unit is used for receiving the interactive situation acquisition request sent by the first communication unit;
the detection unit is used for detecting whether at least one other MR head display device in a moving state exists in the current geographic position according to the interaction condition acquisition request;
the third communication unit is configured to, when the detection unit detects that the at least one other MR head display device exists, return an interaction condition acquisition response to the interaction condition acquisition request to the MR head display device that sends the interaction condition acquisition request, where the interaction condition acquisition response includes a mode switching instruction;
the first communication unit is further configured to receive the interaction condition acquisition response;
the switching unit is used for switching the interaction mode of the MR head display equipment which sends the interaction condition acquisition request from the default interaction mode to an MR interaction mode, wherein the MR interaction mode is an interaction mode of outputting an entity scene in a real-time scene captured by the double cameras and a virtual scene matched with a background scene in the real-time scene.
7. The interactive mode switching control system of the MR head display device according to claim 6, wherein the service device further comprises a determination unit and a judgment unit, wherein:
the determining unit is configured to determine, after the detecting unit detects that the at least one other MR head display device exists and before the third communication unit returns an interaction acquisition response for the interaction acquisition request to the MR head display device that sends the interaction acquisition request, a first three-dimensional coordinate of the MR head display device that sends the interaction acquisition request in the current geographic location and a second three-dimensional coordinate of each of the other MR head display devices in the current geographic location, and determine, according to the first three-dimensional coordinate and each of the second three-dimensional coordinates, a distance value from the MR head display device that sends the interaction acquisition request to each of the other MR head display devices;
the judgment unit is used for judging whether a target distance value smaller than or equal to a preset distance threshold exists in the distance values from the MR head display equipment sending the interaction condition acquisition request to each other MR head display equipment;
the third communication unit is specifically configured to, when the detection unit detects that the at least one other MR head display device exists and the determination unit determines that the target distance value exists, return an interaction condition acquisition response to the interaction condition acquisition request to the MR head display device that sends the interaction condition acquisition request.
8. The interactive mode switching control system of the MR head display device according to claim 7, wherein the determining unit is further configured to determine a target MR head display device corresponding to the target distance value from the at least one other MR head display device;
the service device further comprises an acquisition unit and a fourth communication unit, wherein:
the acquisition unit is used for acquiring the moving direction of the target MR head display equipment;
the judging unit is further configured to judge whether the moving direction is a direction close to the MR head display device that sends the interaction condition acquisition request;
the fourth communication unit is configured to send the device identifier of the target MR head display device to the MR head display device that sent the interaction condition acquisition request when the determination unit determines that the moving direction is a direction close to the MR head display device that sent the interaction condition acquisition request;
the first communication unit is further configured to receive the device identifier sent by the serving device;
the MR head display device that sends the interactive situation acquisition request further includes an interaction unit, wherein:
and the interaction unit is used for establishing interactive connection with the target MR head display equipment in the MR interaction mode according to the equipment identification.
9. The interactive mode switching control system of the MR head display device according to claim 8, wherein the determining unit is further configured to determine the interactive attribute of the target MR head display device after the determining unit determines that the moving direction is a direction close to the MR head display device that sends the interactive situation acquisition request and before the fourth communication unit sends the device identifier of the target MR head display device to the MR head display device that sends the interactive situation acquisition request;
the judging unit is further configured to judge whether the interaction attribute indicates that the target MR head display device allows an interactive connection to be established therewith;
the fourth communication unit is specifically configured to send the device identifier of the target MR head display device to the MR head display device that sends the interaction condition acquisition request when the determination unit determines that the moving direction is a direction close to the MR head display device that sends the interaction condition acquisition request and determines that the interaction attribute indicates that the target MR head display device allows the interactive connection to be established therewith.
10. The system according to claim 9, wherein the obtaining unit is further configured to obtain a current interaction mode of the target MR head display device after the determining unit determines that the interaction attribute indicates that the target MR head display device allows to establish an interaction connection with the target MR head display device and before the fourth communication unit sends the device identifier of the target MR head display device to the MR head display device that sends the interaction condition obtaining request;
the judging unit is further configured to judge whether the current interaction mode is the MR interaction mode;
the fourth communication unit is specifically configured to send the device identifier of the target MR head display device to the MR head display device that sent the interaction condition acquisition request when the determination unit determines that the moving direction is a direction close to the MR head display device that sent the interaction condition acquisition request, determines that the interaction attribute indicates that the target MR head display device allows an interactive connection to be established therewith, and determines that the current interaction mode is the MR interaction mode.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710781260.0A CN107577344B (en) | 2017-09-01 | 2017-09-01 | Interactive mode switching control method and system of MR head display equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710781260.0A CN107577344B (en) | 2017-09-01 | 2017-09-01 | Interactive mode switching control method and system of MR head display equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107577344A CN107577344A (en) | 2018-01-12 |
| CN107577344B true CN107577344B (en) | 2020-04-28 |
Family
ID=61031345
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710781260.0A Active CN107577344B (en) | 2017-09-01 | 2017-09-01 | Interactive mode switching control method and system of MR head display equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107577344B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114612635B (en) * | 2022-02-28 | 2022-10-25 | 北京行者无疆科技有限公司 | Method and device capable of switching between augmented reality mode and virtual reality mode |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5845211B2 (en) * | 2013-06-24 | 2016-01-20 | キヤノン株式会社 | Image processing apparatus and image processing method |
| US9924143B2 (en) * | 2014-09-23 | 2018-03-20 | Intel Corporation | Wearable mediated reality system and method |
| JP6598617B2 (en) * | 2015-09-17 | 2019-10-30 | キヤノン株式会社 | Information processing apparatus, information processing method, and program |
| CA3011637A1 (en) * | 2016-01-19 | 2017-07-27 | Magic Leap, Inc. | Eye image collection, selection, and combination |
-
2017
- 2017-09-01 CN CN201710781260.0A patent/CN107577344B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN107577344A (en) | 2018-01-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110176077B (en) | Augmented reality photographing method and device and computer storage medium | |
| US11089266B2 (en) | Communication processing method, terminal, and storage medium | |
| CN108269307B (en) | Augmented reality interaction method and equipment | |
| KR102191354B1 (en) | Virtual tool allocation method, server, client and storage media | |
| US9345967B2 (en) | Method, device, and system for interacting with a virtual character in smart terminal | |
| KR101811487B1 (en) | Method and apparatus for prompting based on smart glasses | |
| WO2020253685A1 (en) | Perspective switching control method and apparatus, electronic device and readable storage medium | |
| US9728011B2 (en) | System and method for implementing augmented reality via three-dimensional painting | |
| US9392248B2 (en) | Dynamic POV composite 3D video system | |
| CN111897507B (en) | Screen projection method and device, second terminal and storage medium | |
| US20120105447A1 (en) | Augmented reality-based device control apparatus and method using local wireless communication | |
| CN106730815B (en) | Somatosensory interaction method and system easy to realize | |
| CN110472099B (en) | Interactive video generation method and device and storage medium | |
| CN107562189B (en) | Space positioning method based on binocular camera and service equipment | |
| CN111131735B (en) | Video recording method, video playing method, video recording device, video playing device and computer storage medium | |
| CN109561333B (en) | Video playing method and device, storage medium and computer equipment | |
| CN108134945B (en) | AR service processing method, AR service processing device and terminal | |
| CN102402460A (en) | Switching method and device for user interface of AR (Augmented Reality) software based on smart mobile device | |
| CN109788359B (en) | Video data processing method and related device | |
| US11553009B2 (en) | Information processing device, information processing method, and computer program for switching between communications performed in real space and virtual space | |
| CN110875944B (en) | Communication connection method, device, terminal equipment and wireless communication system | |
| CN107577344B (en) | Interactive mode switching control method and system of MR head display equipment | |
| CN111225287A (en) | Bullet screen processing method and device, electronic equipment and storage medium | |
| CN108171801A (en) | A kind of method, apparatus and terminal device for realizing augmented reality | |
| CN107688392B (en) | Method and system for controlling MR head display equipment to display virtual scene |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |