CN113961082A - System and method for synchronizing proprietary virtual content in AR/MR technology - Google Patents

System and method for synchronizing proprietary virtual content in AR/MR technology Download PDF

Info

Publication number
CN113961082A
CN113961082A CN202111565818.4A CN202111565818A CN113961082A CN 113961082 A CN113961082 A CN 113961082A CN 202111565818 A CN202111565818 A CN 202111565818A CN 113961082 A CN113961082 A CN 113961082A
Authority
CN
China
Prior art keywords
virtual content
type
client
exclusive virtual
exclusive
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111565818.4A
Other languages
Chinese (zh)
Other versions
CN113961082B (en
Inventor
李晔
王纯祥
于胜琪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Weifang Vision Software Technology Co ltd
Original Assignee
Weifang Vision Software Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Weifang Vision Software Technology Co ltd filed Critical Weifang Vision Software Technology Co ltd
Priority to CN202111565818.4A priority Critical patent/CN113961082B/en
Publication of CN113961082A publication Critical patent/CN113961082A/en
Application granted granted Critical
Publication of CN113961082B publication Critical patent/CN113961082B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention relates to the technical field of AR/MR space calculation, in particular to a system and a method for synchronizing exclusive virtual content in AR/MR technology, wherein the system comprises a server program and N client programs, the client programs actively create or start the exclusive virtual content of class A, and N-1 exclusive virtual contents of class B corresponding to the exclusive virtual content of class A; the B-type exclusive virtual content is exclusive virtual content which is passively generated; the server program synchronizes the A-type exclusive virtual content to the other N-1 client programs respectively. The synchronization method comprises the following steps: a user creates A-type exclusive virtual content in a client program used by the user, N-1 IDs of B-type exclusive virtual content are generated through a server program and are respectively sent to other clients, and the other clients generate corresponding B-type exclusive virtual content. The system and the synchronization method can effectively manage the exclusive virtual content, cooperate with the operation and improve the user experience.

Description

System and method for synchronizing proprietary virtual content in AR/MR technology
Technical Field
The invention relates to the technical field of AR/MR space calculation, in particular to a system and a method for synchronizing exclusive virtual content in AR/MR technology.
Background
With the continuous development of the AR/MR technology, the requirement for multi-person interaction becomes more and more, and how to reduce communication obstacles in multi-person interaction and improve the user experience is the development direction of the AR/MR technology in the future.
Unlike traditional screen space interactions, interactions built in three-dimensional space break through the limitations of the screen plane, which can yield many things such as: the problems of vision, coordinates and the like in the space influence the communication of people in the AR/MR.
The exclusive virtual content in the AR/MR technology refers to a virtual content which has an important interactive relationship and an observation relationship with a user and has only an unimportant observation relationship with other interactors. The existing multi-user interactive system in the AR/MR technology generally has two modes:
first, the exclusive virtual content between users is not synchronized, and only the user can see his own operation. The disadvantages of this method are: when a user operates the dedicated virtual content, no other user knows what operation the user is performing.
For example, in a multi-user interactive system of AR/MR technology, three clients are interacting with multiple people, where one client opens a spatial menu, which is his proprietary virtual content. Only the user of the client can see the space menu and operate the space menu; the users of the other two clients cannot see the space menu and cannot operate the space menu. I.e. the users of the other two clients do not know what the user of the other client is doing and how to do. Similarly, the three clients open own exclusive virtual content for operation, and although the clients can independently operate, the clients do not know what and how to operate each other.
Secondly, all clients use the same virtual content, and are not exclusive to a certain person, and all clients can operate; who uses it, the space menu appears in the vicinity of who. The disadvantages of this method are: a plurality of clients operate the same space menu, which causes congestion, is difficult to work cooperatively and is easy to cause misoperation; and the requirement of confidentiality can not be met when the confidentiality is needed.
How to synchronize and manage the exclusive virtual content in the AR/MR technology is a technical problem that limits the development of the AR/MR technology, and is a technical problem that needs to be solved urgently by those skilled in the art.
Disclosure of Invention
Aiming at the defects, the invention provides a system and a method for synchronizing exclusive virtual content in AR/MR technology, which can synchronize the exclusive virtual content of a certain client in an AR/MR multi-user interactive system to other clients, effectively manage and collaborate the exclusive virtual content; communication obstacles in multi-user interaction are reduced, and user experience is improved.
In order to solve the above problems, the technical scheme adopted by the invention is as follows:
a system for synchronizing exclusive virtual content in AR/MR technology comprises a server program and N client programs, wherein N is more than or equal to 2; each client program can interact with the server program; the client program actively creates or starts the A-type exclusive virtual content and N-1B-type exclusive virtual contents corresponding to the A-type exclusive virtual content; the class B proprietary virtual content is passively generated proprietary virtual content; the server program sends the IDs of the N-1B-type exclusive virtual contents to other N-1 client programs respectively, so that the other N-1 client programs generate a B-type exclusive virtual content, and users of the N-1 client programs can synchronously observe the A-type exclusive virtual contents of the client programs through the B-type exclusive virtual contents.
Preferably, the type a-specific virtual content moves along with a body part or a visual angle of a user of the client, and the type B-specific virtual content passively synchronizes a position of the type a-specific virtual content.
Preferably, the N client programs are respectively installed in devices used by each user, and the devices are mobile phones, tablets or smart glasses.
Preferably, the server program is installed in the server or installed in the same device as a client program.
Preferably, each of the dedicated class a virtual contents and each of the dedicated class B virtual contents have a unique ID corresponding thereto; each ID number is associated with the kind of the dedicated virtual content and also with the associated client ID, and the ID number of the B-type dedicated virtual content is associated with the ID number of the A-type dedicated virtual content, which is recorded in the server program and the client program.
Preferably, the coordinates of the class a dedicated virtual content of the client program change, the client program sends the ID of the class a dedicated virtual content and the changed coordinates to the server program, the server program sends the information to other clients, and the client synchronizes the corresponding class B dedicated virtual content after receiving the information.
Preferably, the type a dedicated virtual content is a spatial menu.
The synchronization method for synchronizing the exclusive virtual content in the AR/MR technology comprises the following steps:
s1, the user creates A-type exclusive virtual content in the client program used by the user and informs the server program that the A-type exclusive virtual content is created, and meanwhile, the client program sends the position of the A-type exclusive virtual content to the server program;
s2, the server program generates 1A-type exclusive virtual content ID according to the A-type exclusive virtual content and sends the A-type exclusive virtual content ID back to the client of the A-type exclusive virtual content, generates N-1B-type exclusive virtual content ID and sends the B-type exclusive virtual content ID to N-1 clients respectively, the clients generate B-type exclusive virtual content, and the server synchronizes the position of the A-type exclusive virtual content to other N-1 client programs respectively; that is, a B-type dedicated virtual content corresponding to the A-type dedicated virtual content is generated in the other N-1 client programs, and the B-type dedicated virtual content synchronizes the location of the A-type dedicated virtual content.
Preferably, the method further comprises the following steps: and S3, when the coordinate of the A-type exclusive virtual content changes, the corresponding client program will notify the server program, and the server program will notify other clients, so that the positions of the B-type exclusive virtual content and the A-type exclusive virtual content are synchronized.
Preferably, when a plurality of users create respective a-class specific virtual contents in their respective client programs and notify the server program that they created the a-class specific virtual contents, the server program marks and distinguishes each a-class specific virtual content according to the difference in ID of each client program.
By adopting the technical scheme, compared with the prior art, the invention has the following advantages:
1. the visual perception makes the clients participating in the interaction know what the other party operates and what the current intention is, so that the cooperation is convenient.
2. The control right is accurately distinguished in the program logic, the content in the client of the active interactive party and the content in the client of the passive observer are strictly isolated, and the disorder in the program logic is avoided.
3. The method can limit interaction to avoid misoperation, space interaction often leads to misoperation due to complicated content, A, B two types of exclusive virtual content can avoid misoperation, for example, A type of exclusive virtual content can interact, B type of exclusive virtual content only has the same appearance effect as A type but is completely inoperable, so that misoperation of own exclusive content by other users can be completely avoided. The system and the method for synchronizing the exclusive virtual content in the AR/MR technology can synchronize the exclusive virtual content of the A class of a certain client in the AR/MR multi-user interactive system to other clients through the exclusive virtual content of the B class, and effectively manage and cooperate the exclusive virtual content; communication obstacles in multi-user interaction are reduced, and user experience is improved.
The present invention will be described in detail below with reference to the accompanying drawings and examples.
Drawings
FIG. 1 is a block diagram of an embodiment of a system for synchronizing proprietary virtual content in AR/MR technology according to the present invention;
FIG. 2 is a first diagram illustrating a usage status of a system for synchronizing proprietary virtual content in AR/MR technology according to the present invention;
FIG. 3 is a schematic diagram of the effect seen in the second user perspective of FIG. 2;
FIG. 4 is a schematic view of the effect seen from the third user perspective in FIG. 2;
FIG. 5 is a diagram of a second usage state of the system for synchronizing proprietary virtual content in AR/MR technology according to the present invention;
FIG. 6 is a schematic diagram of the effect seen in the first user perspective of FIG. 5;
FIG. 7 is a schematic illustration of the effect seen in the second user perspective of FIG. 5;
FIG. 8 is a schematic view of the effect seen in the third user perspective of FIG. 5;
FIG. 9 is a schematic diagram illustrating a second embodiment of a system for synchronizing dedicated virtual content in AR/MR according to the present invention;
FIG. 10 is a schematic diagram illustrating a third embodiment of a system for synchronizing dedicated virtual content in AR/MR technology according to the present invention;
wherein: 1-server, 2-first client, 3-second client, 4-third client, 5-first user, 6-second user, 7-third user, 8-fourth client, 9-cloud server, 10-first class a space menu, 11-first class B space menu, 12-second class B space menu, 13-second class a space menu, 14-third class B space menu, 15-fourth class B space menu.
Detailed Description
Example one
As shown in FIG. 1, a system for synchronizing dedicated virtual content in AR/MR technology comprises a server program and N client programs, wherein N is greater than or equal to 2; each client program can interact with the server program; the client program actively creates or starts the A-type exclusive virtual content and N-1B-type exclusive virtual contents corresponding to the A-type exclusive virtual content; the class B proprietary virtual content is passively generated proprietary virtual content. The server program sends the IDs of the N-1B-type exclusive virtual contents to other N-1 client programs respectively, so that the other N-1 client programs generate a B-type exclusive virtual content, and users of the N-1 client programs can synchronously observe the A-type exclusive virtual contents of the client programs through the B-type exclusive virtual contents. The type A specific virtual content can move along with a certain part or visual angle of the body of the user of the client, and the type B specific virtual content can passively synchronize the position of the type A specific virtual content. Therefore, the users of N-1 client programs can synchronously observe the control and operation of the client program on the A-type specific virtual content of the client program through the B-type specific virtual content in the respective client programs. And collaborative operation and effective communication are realized in multi-user interaction, and user experience is improved.
The N client programs are respectively installed in the using equipment of each user, and the equipment is a mobile phone, a tablet or intelligent glasses. The server program is installed in a hardware server, a cloud server, or various devices installed in a local area network, for example, the server program is installed in the same device installed with a certain client program.
Each type A specific virtual content and each type B specific virtual content have an ID corresponding thereto, and the ID is recorded in the server program and the client program. The coordinates of the A-type exclusive virtual content of the client program change, the client program can send the corresponding ID and the changed coordinates to the server program, the server program can send the information to other clients, and the client synchronizes the corresponding B-type exclusive virtual content according to the coordinate change of the A-type exclusive virtual content after receiving the information.
The synchronization method for synchronizing the exclusive virtual content in the AR/MR technology comprises the following steps:
s1, the user creates A-type exclusive virtual content in the client program used by the user and informs the server program that the A-type exclusive virtual content is created, and meanwhile, the client program sends the position of the A-type exclusive virtual content to the server program;
s2, the server program will generate 1A-type exclusive virtual content ID and N-1B-type exclusive virtual content ID according to the A-type exclusive virtual content, and send 1A-type exclusive virtual content ID to the corresponding client, and then send N-1B-type exclusive virtual content ID and its position to other N-1 client programs respectively; that is, a B-type dedicated virtual content corresponding to the A-type dedicated virtual content is generated in the other N-1 client programs, and the B-type dedicated virtual content synchronizes the location of the A-type dedicated virtual content.
S3, when the coordinates of the type a dedicated virtual content change, the corresponding client program will notify the server program, and the server program will notify other clients to synchronize the positions of the type B dedicated virtual content and the type a dedicated virtual content.
When a plurality of users create respective A-type exclusive virtual contents in client programs used by the users respectively and inform a server program that the A-type exclusive virtual contents are created, the server program marks and distinguishes each A-type exclusive virtual content according to different IDs of each client program.
In this embodiment, a detailed description will be given by taking an example in which a system for synchronizing exclusive virtual content in AR/MR technology includes a server program and three client programs, and the exclusive virtual content of one client program is shared by two other client programs. As shown in fig. 1 and 2, the server program is installed in the server 1, the first client program is installed in the first client 2, the user is the first user 5, and the first client 2 is the smart glasses. The second client program is installed in the second client 3, the user of which is the second user 6, and the second client 3 is smart glasses. The third client program is installed in the third client 4, the user of which is the third user 7, and the third client 4 is a tablet. The A-type exclusive virtual content is a space menu.
In the present system and method, dedicated virtual content is defined in groups. For example, a group of dedicated virtual contents is defined by a type a dedicated virtual content and a corresponding type B dedicated virtual content in a first client program used by the first user 5. Certainly, the dedicated class a virtual content and the dedicated class B virtual content in the client corresponding to other users are also defined as a set of dedicated virtual contents. There is no direct association between the proprietary virtual content of each group. Each set of dedicated virtual content includes a class A dedicated virtual content and N-1 class B dedicated content. In this embodiment, each set of dedicated virtual content includes one a-class dedicated virtual content and two B-class dedicated virtual contents. In the system and method, the types of dedicated virtual contents are defined in the form of seeds, and each dedicated virtual content has a prefabricated body. When the A-type and B-type exclusive virtual contents are generated, the A-type and B-type exclusive virtual contents are generated in a prefabricated body. Each proprietary virtual content has a base ID. For example, there is a spatial menu with an underlying ID X, whose a-specific virtual content is controllable after being generated, and whose B-specific virtual content is restricted to be uncontrollable when being generated, and they have the same appearance but different functions. The type a exclusive virtual content is to be controlled by the corresponding client, while the type B exclusive virtual content cannot be controlled by the client, and only the visual effect of the identifier a appears.
Each client program has a base ID, and each dedicated virtual content has a base ID, which are recorded in both the server program and the client program. When the client program creates the A-type exclusive virtual content, the server program is informed, and the server program generates a unique ID related to the two IDs to the client program according to a preset rule on the basis of the ID of the client and the basic ID of the exclusive virtual content.
Meanwhile, the server program generates a related B-type exclusive virtual content ID corresponding to the A-type exclusive virtual content ID according to a preset rule, and notifies other client programs, and the other client programs can passively generate B-type exclusive virtual content corresponding to the A-type exclusive virtual content.
The A-type exclusive virtual content checks whether the coordinates of the A-type exclusive virtual content change at regular intervals, if so, the ID of the A-type exclusive virtual content and the changed coordinates are sent to a server program, and the server program sends data to other client programs. When other client programs receive the ID of the A-type exclusive virtual content, the corresponding B-type exclusive virtual content can be found, and synchronization is carried out according to the changed coordinates.
When the exclusive virtual content of the A class is hidden or destroyed, the server program is also informed, and the server program informs other client programs to hide or destroy the corresponding exclusive virtual content of the B class.
Through the system, the user can also select whether to synchronize the A-type specific virtual content to other users and receive the A-type specific virtual content synchronized by other users.
Specifically, when the first user 5 lifts the left hand, a first a-class spatial menu 10 moving along with the hand is generated at the left hand position, and the first a-class spatial menu 10 is a type-a specific virtual content of the first client program corresponding to the first user 5. The ID of the first client program is M, and the basic ID of the dedicated virtual content first class A space menu 10 is X. The first client program informs the server program that a first class A space menu 10 is to be generated, and the server program generates a class A specific virtual content ID for the first client program according to the basic ID of the first client program. For example, the class a-specific virtual content is given a generated ID of mxA001, and the first client program is notified.
The ID of the second client is N, the ID of the third client is F, and the server program respectively generates two IDs for two B-type exclusive virtual contents corresponding to the A-type exclusive virtual contents on the basis of m: nxB001 and fxB001, and notifies the second client program and the third client program. The second client program generates a B-type exclusive virtual content after receiving the server notification: the first class B space menu 11 has an ID of nxB 001. The third client program will also generate a B-type exclusive virtual content after receiving the server notification: the second class B space menu 12 has an ID of fxB 001.
After the first client program receives the notification, the ID of the first class a space menu 10 it generates is mxA001, and the coordinates of mxA001 are sent to the server program, and then sent by the server program to the second client program and the third client program. After receiving the notification, the second client program and the third client program synchronize the received coordinates and synchronization content of the first class a space menu 10 to the corresponding two class B space menus: a first class B space menu 11 and a second class B space menu 12. As shown in FIG. 3, second user 6 of the second client program thus sees the left hand of first user 5 showing the appearance of first class B space menu 11. As shown in fig. 4, the third user 7 of the third client program will see that the left hand of the first user 5 appears to be the second class B space menu 12. The contents of the first class B space menu 11 and the second class B space menu 12 have the same visual effect as the first class A space menu 10; the position of the first class B spatial menu 11 and the position of the second class B spatial menu 12 are synchronized with the position of the first class a spatial menu 10.
The above-mentioned class a-specific virtual content: first class a spatial menu 10, ID mxA001, class B specific virtual content: the first class B space menu 11 with ID nxB001 and the second class B space menu 12 with ID fxB001 are the same set of dedicated virtual content corresponding to the first client program.
Similarly, as shown in FIG. 5, when the second user 6 with ID N lifts his left hand, a second class A space menu 13 is generated in his left hand position and follows the hand movement, to which the server assigns a unique ID such as nxA 002. The server program will assign a class B-specific virtual content to the first client program with ID M: the third class B space menu 14, ID mxB 002. The server program distributes a B-type exclusive virtual content to a third client program with the ID of F: the fourth class B space menu 15, ID fxB 002. The above-mentioned class a-specific virtual content: the second class A space menu 13, ID is nxA 002; class B proprietary virtual content: the third B-space menu 14, ID address mxB002, and the fourth B-space menu 15, ID fxB002 are the same set of dedicated virtual content corresponding to the second client program.
At this time, as shown in fig. 6, the first user 5 can see the first a-type space menu 10 in the left-hand position of himself, and can also see the third B-type space menu 14 in the left-hand position of the second user 6. As shown in fig. 7, the second user 6 can see his second class a space menu 13 and the first class B space menu 11 on the left hand side of the first user 5. As shown in fig. 8, the third user 7 can see the second B-space menu 12 on the left hand of the first user 5, and can also see the fourth B-space menu 15 on the left hand of the second user 6.
Of course, by the above system and method, the third user 7 can also synchronize its own dedicated virtual content to the first user 5 and the second user 6, and the principle is the same, which is not described herein again.
Example two
As shown in fig. 9, the difference between the present embodiment and the first embodiment is that the system for synchronizing dedicated virtual content in the AR/MR technology includes four client programs. In contrast to the first embodiment, the newly added fourth client program is installed in the fourth client 8, and the fourth client 8 is a mobile phone. The server program is installed in the cloud server 9.
EXAMPLE III
As shown in fig. 10, the present embodiment is different from the second embodiment in that in the system for synchronizing dedicated virtual content in the AR/MR technology, the server program and the second client program are installed in the device of the third client 4.
In the system for synchronizing dedicated virtual contents in the AR/MR technology of the present invention, when a plurality of users are interacting with each other, the dedicated virtual contents corresponding to a first user, such as a space menu, can be used. The B-type exclusive virtual content corresponding to the A-type exclusive virtual content is shared with other users, so that the B-type exclusive virtual content corresponding to the A-type exclusive virtual content appears in client programs corresponding to the other users, and the other users can know what operation is carried out by a first user through the B-type exclusive virtual content appearing in the client programs, and communication obstacles in multi-user interaction are reduced.
Furthermore, the permission of the exclusive virtual content of the B class can be limited or opened, for example, a certain user can operate and issue an instruction to the exclusive virtual content of the B class through a client, so that multi-user interaction is realized. Or a certain user is limited not to view the exclusive virtual content of the class B, or a password is required to be input to view the exclusive virtual content of the class B for security.
In summary, the system and the synchronization method for synchronizing the dedicated virtual content in the AR/MR technology of the present invention can synchronize the dedicated virtual content of a client in the AR/MR multi-user interactive system to other clients, and effectively manage and cooperate the dedicated virtual content; communication obstacles in multi-user interaction are reduced, and user experience is improved.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that changes may be made in the embodiments and/or equivalents thereof without departing from the spirit and scope of the invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (10)

  1. The system for synchronizing the exclusive virtual content in the AR/MR technology comprises a server program and N client programs, wherein N is more than or equal to 2; each client program can interact with the server program; the method is characterized in that: the client program actively creates or starts the A-type exclusive virtual content and N-1B-type exclusive virtual contents corresponding to the A-type exclusive virtual content; the class B proprietary virtual content is passively generated proprietary virtual content; the server program sends the IDs of the N-1B-type exclusive virtual contents to other N-1 client programs respectively, so that the other N-1 client programs generate a B-type exclusive virtual content, and users of the N-1 client programs can synchronously observe the A-type exclusive virtual contents of the client programs through the B-type exclusive virtual contents.
  2. 2. System for synchronizing proprietary virtual content in AR/MR technology according to claim 1, characterized in that: the type A exclusive virtual content can move along with a certain part or visual angle of the body of the user of the client, and the type B exclusive virtual content can passively synchronize the position of the type A exclusive virtual content.
  3. 3. System for synchronizing proprietary virtual content in AR/MR technology according to claim 1, characterized in that: the N client programs are respectively installed in the using equipment of each user, and the equipment is a mobile phone, a tablet or intelligent glasses.
  4. 4. A system for synchronizing proprietary virtual content in AR/MR technology according to claim 3, characterized by: the server program is installed in the server or installed in the same device with a client program.
  5. 5. A system for synchronizing proprietary virtual content in AR/MR technology according to claim 3, characterized by: each type A exclusive virtual content and each type B exclusive virtual content have a corresponding unique ID; each ID number is associated with the kind of the dedicated virtual content and also with the associated client ID, and the ID number of the B-type dedicated virtual content is associated with the ID number of the A-type dedicated virtual content, which is recorded in the server program and the client program.
  6. 6. System for synchronizing proprietary virtual content in AR/MR technology according to claim 1, characterized in that: the coordinates of the A-type exclusive virtual content of the client program change, the client program sends the ID and the changed coordinates of the A-type exclusive virtual content to the server program, the server program sends the information to other clients, and the client synchronizes the corresponding B-type exclusive virtual content after receiving the information.
  7. 7. System for synchronizing proprietary virtual content in AR/MR technology according to claim 6, characterized in that: the A-type exclusive virtual content is a space menu.
  8. Synchronization method for synchronizing dedicated virtual content in AR/MR technology, characterized in that it comprises the following steps:
    s1, the user creates A-type exclusive virtual content in the client program used by the user and informs the server program that the A-type exclusive virtual content is created, and meanwhile, the client program sends the position of the A-type exclusive virtual content to the server program;
    s2, the server program generates an A-type exclusive virtual content ID according to the A-type exclusive virtual content and sends the A-type exclusive virtual content ID back to the client of the A-type exclusive virtual content, generates N-1B-type exclusive virtual content IDs and sends the B-type exclusive virtual content IDs to N-1 clients respectively, the clients generate B-type exclusive virtual content, and the server synchronizes the position of the A-type exclusive virtual content to other N-1 client programs respectively; that is, a B-type dedicated virtual content corresponding to the A-type dedicated virtual content is generated in the other N-1 client programs, and the B-type dedicated virtual content synchronizes the location of the A-type dedicated virtual content.
  9. 9. The method for synchronizing proprietary virtual content in AR/MR technology according to claim 8, characterized by the further steps of:
    and S3, when the coordinate of the A-type exclusive virtual content changes, the corresponding client program will notify the server program, and the server program will notify other clients, so that the positions of the B-type exclusive virtual content and the A-type exclusive virtual content are synchronized.
  10. 10. The method for synchronizing proprietary virtual content in AR/MR technology according to claim 8, characterized in that: when a plurality of users create respective A-type exclusive virtual contents in client programs used by the users respectively and inform a server program that the A-type exclusive virtual contents are created, the server program marks and distinguishes each A-type exclusive virtual content according to different IDs of each client program.
CN202111565818.4A 2021-12-21 2021-12-21 System and method for synchronizing proprietary virtual content in AR/MR technology Active CN113961082B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111565818.4A CN113961082B (en) 2021-12-21 2021-12-21 System and method for synchronizing proprietary virtual content in AR/MR technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111565818.4A CN113961082B (en) 2021-12-21 2021-12-21 System and method for synchronizing proprietary virtual content in AR/MR technology

Publications (2)

Publication Number Publication Date
CN113961082A true CN113961082A (en) 2022-01-21
CN113961082B CN113961082B (en) 2022-10-18

Family

ID=79473415

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111565818.4A Active CN113961082B (en) 2021-12-21 2021-12-21 System and method for synchronizing proprietary virtual content in AR/MR technology

Country Status (1)

Country Link
CN (1) CN113961082B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180174363A1 (en) * 2016-12-16 2018-06-21 Lenovo (Singapore) Pte. Ltd. Systems and methods for presenting indication(s) of whether virtual object presented at first device is also presented at second device
CN108919951A (en) * 2018-06-28 2018-11-30 联想(北京)有限公司 A kind of information interacting method and device
CN110520820A (en) * 2017-06-06 2019-11-29 麦克赛尔株式会社 Mixed reality display system and mixed reality display terminal
CN110647237A (en) * 2018-06-27 2020-01-03 脸谱科技有限责任公司 Gesture-based content sharing in an artificial reality environment
CN111427453A (en) * 2020-03-30 2020-07-17 上海盛翔信息科技有限公司 Method for multi-person collaborative interaction and perception in medical virtual reality training scene
CN112534394A (en) * 2018-06-19 2021-03-19 交互数字Ce专利控股公司 Sharing virtual content in mixed reality scenes

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180174363A1 (en) * 2016-12-16 2018-06-21 Lenovo (Singapore) Pte. Ltd. Systems and methods for presenting indication(s) of whether virtual object presented at first device is also presented at second device
CN110520820A (en) * 2017-06-06 2019-11-29 麦克赛尔株式会社 Mixed reality display system and mixed reality display terminal
US20200241647A1 (en) * 2017-06-06 2020-07-30 Maxell, Ltd. Mixed reality display system and mixed reality display terminal
CN112534394A (en) * 2018-06-19 2021-03-19 交互数字Ce专利控股公司 Sharing virtual content in mixed reality scenes
CN110647237A (en) * 2018-06-27 2020-01-03 脸谱科技有限责任公司 Gesture-based content sharing in an artificial reality environment
CN108919951A (en) * 2018-06-28 2018-11-30 联想(北京)有限公司 A kind of information interacting method and device
CN111427453A (en) * 2020-03-30 2020-07-17 上海盛翔信息科技有限公司 Method for multi-person collaborative interaction and perception in medical virtual reality training scene

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
AULTMAN,ANDREW: "Design Heuristics for Mobile Augmented Reality Game User Interfaces", 《EXTENDED ABSTRACTS OF THE 2018 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS》 *
姚远: "增强现实应用技术研究", 《中国博士学位论文全文数据库 (信息科技辑)》 *
阚阔等: "基于分布式虚拟现实的连铸多人协作系统", 《物联网技术》 *

Also Published As

Publication number Publication date
CN113961082B (en) 2022-10-18

Similar Documents

Publication Publication Date Title
US20170237789A1 (en) Apparatuses, methods and systems for sharing virtual elements
US9749367B1 (en) Virtualization of physical spaces for online meetings
US8949159B2 (en) System and method for automatic merging of real and virtual environments
US20180356885A1 (en) Systems and methods for directing attention of a user to virtual content that is displayable on a user device operated by the user
CN103580881A (en) Virtual meeting establishing method and device
EP3907682A1 (en) Digital workspace sharing over one or more display clients and authorization protocols for collaboration systems
US11609682B2 (en) Methods and systems for providing a communication interface to operate in 2D and 3D modes
Li Augmented Reality for remote education
WO2013016165A1 (en) Communicating between a virtual area and a physical space
WO2023014900A1 (en) Video conferencing systems featuring multiple spatial interaction modes
KR20220096381A (en) Method for Creating a Cooperating VR-AR Space with Synchronizing Objects and Interactions
US20230362217A1 (en) Digital workspace sharing over one or more display clients in proximity of a main client
CN114549744A (en) Method for constructing virtual three-dimensional conference scene, server and AR (augmented reality) equipment
CN117616748A (en) Video conference system with multiple spatial interaction modes
CN113961082B (en) System and method for synchronizing proprietary virtual content in AR/MR technology
EP1038396B1 (en) Conference facility
KR20220158044A (en) Devices and methods for providing augmented reality interactions
CN104769539B (en) Graphic user interface, method and corresponding storage medium
KR102073010B1 (en) Method and system for pairing mobile terminal and augmented reality display device, and method and system for synchronizing coordinate system between multiple augmented reality display devices
Cohen et al. Requirements and design considerations for a fully immersive robotic telepresence system
US20220286311A1 (en) Scalable Extended Reality Video Conferencing
WO2016053311A1 (en) Artifact projection
Vertegaal et al. Look who's talking: the GAZE groupware system
JPH02245865A (en) Synergetic intelligent work backup system
CN208207732U (en) A kind of mixed reality experiencing system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant