WO2020258938A1 - 锚点共享方法及装置、系统、电子设备和存储介质 - Google Patents
锚点共享方法及装置、系统、电子设备和存储介质 Download PDFInfo
- Publication number
- WO2020258938A1 WO2020258938A1 PCT/CN2020/080481 CN2020080481W WO2020258938A1 WO 2020258938 A1 WO2020258938 A1 WO 2020258938A1 CN 2020080481 W CN2020080481 W CN 2020080481W WO 2020258938 A1 WO2020258938 A1 WO 2020258938A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- anchor point
- shared
- anchor
- information
- identity
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 144
- 238000003860 storage Methods 0.000 title claims abstract description 33
- 230000009466 transformation Effects 0.000 claims description 22
- 238000004590 computer program Methods 0.000 claims description 19
- 238000000605 extraction Methods 0.000 claims description 16
- 238000006243 chemical reaction Methods 0.000 claims description 9
- 230000008569 process Effects 0.000 abstract description 54
- 230000003190 augmentative effect Effects 0.000 abstract description 11
- 238000010586 diagram Methods 0.000 description 26
- 238000012545 processing Methods 0.000 description 22
- 238000005516 engineering process Methods 0.000 description 15
- 238000004891 communication Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 11
- 230000003993 interaction Effects 0.000 description 9
- 238000004458 analytical method Methods 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 6
- 230000009471 action Effects 0.000 description 5
- 238000004422 calculation algorithm Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 239000002699 waste material Substances 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 2
- 238000004140 cleaning Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000001902 propagating effect Effects 0.000 description 2
- 230000002829 reductive effect Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 238000004873 anchoring Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
- G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/131—Protocols for games, networked simulations or virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/52—Network services specially adapted for the location of the user terminal
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/0823—Network architectures or network communication protocols for network security for authentication of entities using certificates
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
Definitions
- the present disclosure relates to the field of augmented reality technology, and in particular to an anchor sharing method and device, system, electronic equipment and storage medium.
- Augmented Reality can combine real world information with virtual world information, and display virtual visual information in real world images through devices. How to allow multiple users to see the same virtual world and real world on their respective screens is critical to augmented reality technology.
- the present disclosure proposes a technical solution for anchor point sharing.
- an anchor point sharing method including: a server receives an anchor point sharing request sent by a terminal, the anchor point sharing request includes the current scene scanned by the terminal and the acquired anchor to be shared The identity of the point; the server determines the shared location information of the anchor point to be shared in the current scene according to the anchor point sharing request; the server feeds back the shared location information to the terminal.
- the anchor point can be fully shared between different terminals or different time periods, so that the multi-person sharing, single-person multi-period sharing, or multi-person multi-period sharing of AR scenes can be achieved, thereby greatly Improve the unity and sharing of AR technology.
- the method before the server receives the anchor point sharing request sent by the terminal, the method further includes: the server obtains the anchor point information of the anchor point to be shared; and the server generates the anchor point information according to the anchor point information.
- the identity of the anchor is shared, and the anchor information and the identity are saved.
- the identification and anchor point information are stored in the server, so that the server can directly determine the shared location information of the anchor point to be shared in the current scene based on the data stored in the server, without reading the corresponding anchor point information from the main terminal, thereby effectively improving The efficiency of the anchor sharing process.
- the server generates the identity of the anchor to be shared according to the anchor information, and saves the anchor information and the identity, and further includes: saving the anchor When the time between the point information and the identity identifier exceeds the time threshold, the server deletes the anchor point information and the identity identifier.
- the anchor point information of the anchor point to be shared includes: first feature information of the anchor point scene in which the anchor point to be shared is located, and the anchor point to be shared is at the anchor point Original location information in the scene.
- the anchor point information of the anchor point to be shared that includes the first feature information and the original position information
- the environment information of the anchor point scene where the anchor point to be shared is located and the position relationship between the anchor point to be shared and the anchor point scene can be effectively determined Therefore, it is convenient to effectively locate the shared position information of the anchor point to be shared in the current scene based on the comparison result of the first feature information and the current scene in combination with the original position information in the subsequent steps.
- the anchor point sharing request includes: the second feature information of the current scene, the identity of the anchor point to be shared, and an anchor point sharing request message.
- the server Through the anchor sharing request including the second feature information, the identity identifier, and the anchor sharing request message, it is convenient for the server to determine the anchor to be shared requested by the slave terminal according to the identity while receiving the anchor sharing request message sent by the slave terminal.
- the identity of the point while directly acquiring the second characteristic information to facilitate subsequent determination of the shared location information directly in the server based on the second characteristic information, thereby reducing multiple interaction processes with the slave terminal and improving the efficiency of the anchor point sharing process .
- the server determining the sharing location information of the anchor point to be shared in the current scene according to the anchor point sharing request includes: the server separately according to the anchor point sharing request Obtain the identity of the anchor to be shared and the second characteristic information of the current scene; the server reads the anchor information of the anchor to be shared according to the identity; the server according to the second characteristic information and The anchor point information determines the shared location information of the anchor point to be shared in the current scene.
- the server can easily determine the anchor point to be shared in the current scene by reading the data without multiple interactions with the terminal based on the internally stored data and the received anchor sharing request. In order to complete the sharing of AR scenes with high efficiency and high accuracy.
- the server determining the shared location information of the anchor point to be shared in the current scene according to the second feature information and the anchor point information includes: the server according to the Anchor point information, the first feature information of the anchor point scene where the anchor point to be shared is located and the original position information of the anchor point to be shared in the anchor point scene are obtained; the server compares the first feature information with Perform feature matching on the second feature information to obtain the position transformation relationship between the current scene and the anchor scene; the server performs position transformation on the original position information according to the position transformation relationship to obtain the waiting The shared location information of the shared anchor point in the current scene.
- the position transformation relationship between the current scene and the anchor point scene is obtained, and then based on this position transformation relationship and the original position information, the anchor point to be shared is obtained through the position transformation.
- Shared location information in the scene this process has a small amount of calculation and a convenient calculation method. While ensuring the accuracy of the shared location information for determining the anchor point to be shared, the calculation speed of this process is greatly reduced, thereby improving the anchor point sharing process Speed and efficiency.
- an anchor sharing method including: a terminal obtains the identity of an anchor to be shared; and the terminal sends an anchor sharing request to the server according to the current scenario and the identity, and the anchor
- the point sharing request is used to instruct the server to determine the shared location information of the anchor point to be shared in the current scene; the terminal receives the shared location information fed back by the server.
- the terminal only needs to obtain the identity of the current scene and the target anchor point, and then can obtain the shared location information of the anchor point to be shared in the current scene by communicating with the server, and then realize the sharing of the AR scene.
- the sharing method is simple and efficient, suitable for general promotion.
- the terminal acquiring the identity of the anchor to be shared includes: the terminal acquires shared information; the terminal obtains the identity of the anchor to be shared according to the correspondence between the shared information and the identity Logo.
- the identity of the anchor to be shared can be obtained more conveniently, without a complicated analysis process, and the identity can be obtained indirectly through shared information, which can reduce the risk of identity leakage and ensure security while ensuring Improve the efficiency of anchor sharing.
- the terminal sends an anchor sharing request to the server according to the current scene and the identity, including: the terminal scans the current scene and obtains an image of the current scene; the terminal responds to the image of the current scene Performing feature extraction to obtain the second feature information; the terminal sends the second feature information, the identity identifier, and the anchor point sharing request message together as the anchor point sharing request to the server.
- the terminal can directly transmit the data required by the server to the server while requesting the server to complete the anchor point sharing, without cumbersome interaction process, and improve the efficiency of anchor point sharing.
- an anchor sharing method which includes: a terminal obtains the identity of the anchor to be shared; the terminal sends an anchor sharing request to the server according to the current scenario and the identity; The anchor point sharing request determines the shared location information of the anchor point to be shared in the current scene; the terminal receives the shared location information fed back by the server.
- the anchor point to be shared can be positioned in the current scene through the server according to the identity of the anchor point to be shared, so that different terminals can share the virtual world in the same real scene and realize the sharing of augmented reality technology.
- an anchor point sharing device which is applied to a server and includes: an anchor point sharing request receiving module, configured to receive an anchor point sharing request sent by a terminal, the anchor point sharing request It includes the current scene scanned by the terminal and the acquired identity of the anchor point to be shared; the shared location information determination module is configured to determine the position of the anchor point to be shared in the current scene according to the anchor point sharing request Shared location information; a feedback module for feeding back the shared location information to the terminal.
- the anchor point sharing request receiving module before the anchor point sharing request receiving module, it further includes an identity generation module, and the identity generation module is configured to: obtain the anchor point information of the anchor point to be shared; The anchor point information generates the identity of the anchor to be shared, and saves the anchor information and the identity.
- the identity generation module is further configured to: when the time for storing the anchor point information and the identity identifier exceeds a time threshold, the server deletes the anchor point information and the identity identifier .
- the anchor point information of the anchor point to be shared includes: first feature information of the anchor point scene in which the anchor point to be shared is located, and the anchor point to be shared is at the anchor point Original location information in the scene.
- the anchor point sharing request includes: the second feature information of the current scene, the identity of the anchor point to be shared, and an anchor point sharing request message.
- the shared location information determining module is configured to: obtain the identity of the anchor to be shared and the second feature information of the current scene according to the anchor sharing request; The identity identifier reads the anchor point information of the anchor point to be shared; and determines the shared location information of the anchor point to be shared in the current scene according to the second characteristic information and the anchor point information.
- the shared location information determining module is further configured to: according to the anchor point information, obtain the first feature information of the anchor point scene where the anchor point to be shared is located and the first feature information of the anchor point to be shared The original position information of the anchor point in the anchor point scene; performing feature matching between the first feature information and the second feature information to obtain the position transformation relationship between the current scene and the anchor point scene; According to the position conversion relationship, perform position conversion on the original position information to obtain shared position information of the anchor point to be shared in the current scene.
- an anchor point sharing device which is applied to a terminal and includes: an identity identification acquisition module for acquiring the identity identification of an anchor to be shared; an anchor sharing request sending module for use According to the current scene and the identity, an anchor point sharing request is sent to the server, where the anchor point sharing request is used to instruct the server to determine the shared location information of the anchor point to be shared in the current scene; and the shared location
- the information receiving module is used to receive shared location information fed back by the server.
- the identity acquisition module is used to: acquire shared information; obtain the identity of the anchor to be shared according to the correspondence between the shared information and the identity.
- the anchor point sharing request sending module is configured to: scan the current scene to obtain an image of the current scene; perform feature extraction on the image of the current scene to obtain the second feature information;
- the second feature information, the identity identifier, and the anchor point sharing request message are collectively used as the anchor point sharing request and sent to the server.
- an anchor point sharing system including: the first anchor point sharing device as described in the third aspect; the second anchor point sharing device as described in the fourth aspect; wherein The first anchor point sharing device and the second anchor point sharing device interact through an anchor point sharing request.
- an electronic device including:
- a memory for storing processor executable instructions
- the processor is configured to execute the method of the first aspect described above.
- an electronic device including:
- a memory for storing processor executable instructions
- the processor is configured to execute the method of the second aspect described above.
- a computer-readable storage medium having computer program instructions stored thereon, and when the computer program instructions are executed by a processor, the method of the first aspect described above is implemented.
- a computer-readable storage medium having computer program instructions stored thereon, and when the computer program instructions are executed by a processor, the method of the second aspect described above is implemented.
- a computer program including computer readable code, when the computer readable code is executed in an electronic device, a processor in the electronic device executes for realizing any of the above The method described.
- the identity of the anchor to be shared is obtained through the terminal, and the anchor sharing request is sent to the server according to the current scenario and the identity.
- the server determines that the anchor to be shared is in the current scene according to the anchor sharing request And feed back the shared location information to the terminal.
- the anchor point to be shared can be positioned in the current scene through the server according to the identity of the anchor point to be shared, so that different terminals can share the virtual world in the same real scene and realize the sharing of augmented reality technology.
- Fig. 1 shows a flowchart of an anchor sharing method according to an embodiment of the present disclosure.
- Fig. 2 shows a flowchart of an anchor point sharing method according to an embodiment of the present disclosure.
- Fig. 3 shows a flowchart of an anchor point sharing method according to an embodiment of the present disclosure.
- Fig. 4 shows a schematic diagram of a coordinate system of an anchor point scene according to an embodiment of the present disclosure.
- Fig. 5 shows a schematic diagram of a coordinate system of a current scene according to an embodiment of the present disclosure.
- Fig. 6 shows a flowchart of an anchor point sharing method according to an embodiment of the present disclosure.
- Fig. 7 shows a flowchart of an anchor point sharing method according to an embodiment of the present disclosure.
- Fig. 8 shows a schematic diagram of an application example according to the present disclosure.
- Fig. 9 shows a schematic diagram of an application example according to the present disclosure.
- Fig. 10 shows a block diagram of an anchor point sharing device according to an embodiment of the present disclosure.
- Fig. 11 shows a block diagram of an anchor sharing device according to an embodiment of the present disclosure.
- Fig. 12 shows a block diagram of an anchor point sharing system according to an embodiment of the present disclosure.
- Fig. 13 shows a block diagram of an electronic device according to an embodiment of the present disclosure.
- Fig. 14 shows a block diagram of an electronic device according to an embodiment of the present disclosure.
- Fig. 1 shows a flowchart of an anchor sharing method according to an embodiment of the present disclosure.
- the method can be applied to a server.
- the specific type, model, and implementation of the server are not limited, and can be flexibly selected according to actual conditions.
- the anchor point sharing method may include:
- Step S11 The server receives an anchor point sharing request sent by the terminal, where the anchor point sharing request includes the current scene scanned by the terminal and the acquired identity of the anchor point to be shared.
- Step S12 The server determines the sharing location information of the anchor point to be shared in the current scene according to the anchor point sharing request.
- Step S13 the server feeds back the shared location information to the terminal.
- the anchor point to be shared may be generated by a method of generating anchor points after scanning the anchor point scene where the anchor point is located by a certain terminal device.
- the terminal that scans the anchor scene may be referred to as the master terminal, and the master terminal serves as the terminal device.
- the specific implementation manner is not limited, and can be flexibly determined according to actual conditions.
- the main terminal can be a user equipment (UE, User Equipment), mobile device, user terminal, terminal, cellular phone, cordless phone, personal digital assistant (PDA, Personal Digital Assistant), handheld device, Computing equipment, in-vehicle equipment, wearable devices, etc.
- the specific implementation method of anchor point generation is also not limited.
- the anchor points to be shared can be generated by extracting features from the results of the main terminal scanning the anchor point scene, and performing anchor point prediction based on the neural network. Since the method of anchor point generation is not limited, the number of generated anchor points to be shared is also not limited. It can be one or multiple, depending on the actual situation of the anchor point scene and the specific method of anchor point generation. Be flexible.
- the terminal that sends the anchor point sharing request to the server may be referred to as a slave terminal, and the slave terminal is used as a terminal device.
- the specific implementation manner thereof is also not limited, and will not be repeated here.
- the number of slave terminals is also not limited, and may be one or multiple. In an example, the number of slave terminals may be one.
- the server can realize the sharing of the anchor point to be shared between the master terminal and the slave terminal by receiving the anchor point sharing request sent by the slave terminal.
- the number of slave terminals can be multiple, and the specific number is not limited here. It can be flexibly selected according to the actual situation.
- the server can receive anchor sharing requests sent by multiple slave terminals to realize the sharing
- the anchor point is shared between the master terminal and multiple slave terminals.
- the slave terminal can be a different device from the master terminal, or the same device.
- the anchor point sharing between different terminal devices can be realized.
- multiple terminal devices can use the anchor point sharing method proposed in the above disclosed embodiment.
- a single terminal device can be implemented to share anchor points between different periods of time. For example, it can be a certain terminal device.
- the anchor point sharing method realizes multi-period sharing of an AR scene.
- the number of slave terminals can be multiple.
- One of the slave terminals and the master terminal is the same device, and the remaining slave terminals and the master terminal are different devices.
- multiple terminals can be used for multiple periods of an AR scenario. Sharing, for example, may be that multiple terminal devices use the anchor sharing method proposed in the above disclosed embodiment to realize multi-period sharing of a certain AR scene by multiple terminals.
- the anchor sharing request received by the server can be flexibly determined according to the actual situation. It has been proposed in step S11 that the anchor sharing request includes the current scene scanned by the terminal and the acquired identity of the anchor to be shared. Therefore, in the embodiments of the present disclosure, although the presentation form of the anchor sharing request is flexible, the anchor sharing request should effectively reflect the geographic information of the current scene and be related to the identity of the anchor to be shared.
- the anchor point sharing request may include: the second feature information of the current scene, the identity of the anchor point to be shared, and the anchor point sharing request message.
- the second feature information of the current scene is mainly used to reflect the geographic information of the current scene, and its specific expression form and acquisition method are not limited, and can be flexibly selected according to the actual situation. In a possible implementation manner, it can be acquired by the slave terminal scanning the current scene and performing feature extraction.
- the expression of the identity of the anchor to be shared is also not limited. Any form that can be used to indicate the identity of the anchor to be shared can be used as the expression of the identity.
- the anchor to be shared The expression form of the identity can be the anchor id of the anchor to be shared.
- the specific content and expression form of the anchor point sharing request message are also not limited. Any request that can be expressed to the server for anchor point sharing can be used as the expression form of the anchor point sharing request message.
- the server Through the anchor sharing request including the second feature information, the identity identifier, and the anchor sharing request message, it is convenient for the server to determine the anchor to be shared requested by the slave terminal according to the identity while receiving the anchor sharing request message sent by the slave terminal.
- the identity of the point while directly acquiring the second characteristic information to facilitate subsequent determination of the shared location information directly in the server based on the second characteristic information, thereby reducing multiple interaction processes with the slave terminal and improving the efficiency of the anchor point sharing process .
- the shared location information of the anchor point to be shared in the current scene finally determined by the server its expression is also not limited, any expression that can indicate the location of the anchor point to be shared in the current scene can be used as the realization of shared location information form.
- the position of the anchor point to be shared in the current scene can be indicated by coordinate information.
- the anchor point sharing method proposed in the embodiment of the present disclosure receives an anchor point sharing request sent by a terminal through a server, determines the shared location information of the anchor point to be shared in the current scene according to the anchor point sharing request, and sends the shared location information to Terminal, through this process, based on the operation of the server, the anchor point can be fully shared between different terminals or different time periods, so as to realize multi-person sharing, single-person multi-period sharing, or multi-person multi-period sharing of AR scenarios , Thereby greatly improving the unity and sharing of AR technology.
- step S10 may be further included.
- FIG. 2 shows a flowchart of an anchor point sharing method according to an embodiment of the present disclosure, as shown in FIG.
- step S10 may include:
- Step S101 The server obtains anchor point information of the anchor point to be shared.
- Step S102 The server generates the identity of the anchor to be shared according to the anchor information, and saves the anchor information and the identity.
- the implementation manner of step S101 is not limited, that is, the manner in which the server obtains the anchor point information of the anchor to be shared is not limited.
- the anchor information of the anchor to be shared can be actively uploaded to the server by the main terminal; in a possible implementation, the anchor information of the anchor to be shared can also be actively sent to the server by the server. Obtained by the master terminal. It should be noted that in the embodiments of the present disclosure, no matter how the server obtains the anchor information of the anchor to be shared, the process of generating the anchor information of the anchor to be shared is completed inside the main terminal, and the server The anchor point information is only used for receiving and storing.
- the server obtains the anchor point information of the anchor point to be shared, and generates the identity of the anchor point to be shared based on the anchor point information, and saves the anchor point information and the identity identifier.
- the identity and anchor information are stored in the server, so that the server can directly
- the shared location information of the anchor point to be shared in the current scene is determined based on the data stored in the server, and there is no need to read the corresponding anchor point information from the main terminal, thereby effectively improving the efficiency of the anchor point sharing process.
- the anchor point information of the anchor point to be shared is not limited to its specific content.
- the anchor point information of the anchor point to be shared may include: the first anchor point scene of the anchor point to be shared Feature information, and the original location information of the anchor point to be shared in the anchor point scene.
- the original position information of the anchor point to be shared in the anchor point scene is used to indicate the position relationship between the anchor point to be shared and the anchor point scene.
- the specific expression form is the same as the shared position information, which is not used in the embodiment of the present disclosure. Due to limitations, in one example, the original location information can also be expressed in the form of coordinate information.
- the original position information of the anchor point to be shared in the anchor point scene is not limited in its generation method and form of expression.
- the original position information can be natural when the anchor point to be shared is generated. What is obtained is that after the master terminal scans the anchor point scene, when the master terminal generates the anchor point to be shared, it also generates the original position information of the anchor point to be shared in the anchor point scene.
- the first feature information of the anchor point scene where the anchor point to be shared is located are also not limited.
- the first feature information may include instant positioning and map construction ( Related map information in the SLAM (simultaneous localization and mapping) algorithm. This map information can be used as the reference coordinate system of the anchor point scene where the anchor point to be shared is located and the reference surrounding environment, and used in the subsequent step S12 to realize the shared location information Of ok.
- the first feature information may be obtained by the master terminal by scanning the anchor point scene and performing feature extraction on the scanning result.
- the expression form of the first characteristic information is also not limited.
- the first characteristic information may be acquired and stored by the server in the form of continuous frames.
- the anchor point information of the anchor point to be shared that includes the first feature information and the original position information
- the environment information of the anchor point scene where the anchor point to be shared is located and the position relationship between the anchor point to be shared and the anchor point scene can be effectively determined Therefore, it is convenient to effectively locate the shared position information of the anchor point to be shared in the current scene based on the comparison result of the first feature information and the current scene in combination with the original position information in the subsequent step S12.
- step S102 may further include:
- the server When the time for storing the anchor point information and the identity mark exceeds the time threshold, the server deletes the anchor point information and the identity mark.
- the above disclosed embodiments have proposed that once the identity of the anchor to be shared is generated, it can represent that the anchor to be shared corresponding to the identity can be shared.
- the anchor point information and identity of the anchor point to be shared can be stored in the server. Because the anchor point to be shared may be immediacy, that is, the shared anchor point may only be used for a certain period of time. For the server If all anchor points to be shared are permanently stored inside the server, it may cause a waste of resources, and at the same time may reduce the storage space of the server and reduce the operating efficiency of the server. Therefore, in order to reduce the waste of resources, you can delete the anchor information and the identity stored in the server when the time for storing the anchor information and the identity tag exceeds the time threshold.
- the specific time threshold setting can be flexibly selected according to the actual situation.
- the time threshold can be set to 168 hours, that is, starting from the moment the identity of the anchor to be shared is generated, within 168 hours, the anchor to be shared can be After being shared, after 168 hours, the identity and anchor information of the anchor to be shared will be deleted from the server, that is, the anchor to be shared can no longer be shared.
- step S12 may also be different, so the implementation of step S12 is not unique.
- FIG. 3 shows a flowchart of an anchor point sharing method according to an embodiment of the present disclosure. As shown in the figure, in a possible implementation manner, step S12 may include:
- step S121 the server obtains the identity of the anchor to be shared and the second feature information of the current scene respectively according to the anchor sharing request.
- Step S122 The server reads the anchor point information of the anchor point to be shared according to the identity identifier.
- Step S123 The server determines the sharing location information of the anchor point to be shared in the current scene according to the second feature information and the anchor point information.
- the anchor point sharing request may include the identity of the anchor point to be shared, the second feature information of the current scene, and the anchor point sharing request message. Therefore, the server may follow the anchor point
- the point sharing request obtains the identity identifier and the second characteristic information. After the server obtains the identity identifier, according to the above disclosed embodiments, it can be known that the identity identifier and its corresponding anchor point information can be stored in the server. Therefore, the server can be based on the anchor point.
- the identity identifier in the sharing request determines the anchor point information corresponding to the anchor point to be shared, and then based on the anchor point information and the second characteristic information, based on step S123, the shared location information of the anchor point to be shared in the current scene can be determined.
- the server can easily determine the anchor point to be shared in the current scene by reading the data without multiple interactions with the terminal based on the internally stored data and the received anchor sharing request. In order to complete the sharing of AR scenes with high efficiency and high accuracy.
- step S123 may include:
- the server obtains the first feature information of the anchor point scene where the anchor point to be shared is located and the original position information of the anchor point to be shared in the anchor point scene.
- the server performs feature matching between the first feature information and the second feature information to obtain the position transformation relationship between the current scene and the anchor scene.
- the server performs position conversion on the original position information according to the position conversion relationship to obtain the shared position information of the anchor point to be shared in the current scene.
- the anchor point information may include first feature information and original position information, where it can be seen from the above disclosed embodiments that the first feature information can represent the anchor point
- the original position information can reflect the position of the anchor point to be shared in the anchor point scene.
- the second feature information can also characterize the situation of the current scene. Therefore, in a possible implementation, the The first feature information and the second feature information are feature-matched to obtain the position transformation relationship between the current scene and the anchor point scene. In this way, after the position transformation relationship between the current scene and the anchor point scene is determined, the original position information Substituting into this transformation relationship, the shared location information of the anchor point to be shared in the current scene can be obtained.
- the feature matching process can be flexibly determined according to the actual expression of the first feature information and the second feature information.
- the feature matching process can be the registration of the coordinate system between the master terminal and the slave terminal device. That is, the first feature information uploaded by the master terminal to the server.
- the representation form of the feature information can be map information, and the second feature information uploaded to the server by the slave terminal is registered with the coordinate system of the master and slave terminals, thereby The transformation relationship of the coordinate system between the anchor scene corresponding to the master terminal and the current scene corresponding to the slave terminal can be calculated.
- FIG. 4 shows a schematic diagram of the coordinate system of the anchor scene according to an embodiment of the present disclosure.
- the origin of the coordinate system anchor scene may be referred to as O H
- a is the anchor to be shared
- the origin of the current scene coordinate system may be referred to is O R
- the position transformation relationship between the current scene and the anchor point scene is obtained, and then based on this position transformation relationship and the original position information, the anchor point to be shared is obtained through the position transformation.
- Shared location information in the scene this process has a small amount of calculation and a convenient calculation method. While ensuring the accuracy of the shared location information for determining the anchor point to be shared, the calculation speed of this process is greatly reduced, thereby improving the anchor point sharing process Speed and efficiency.
- FIG. 6 shows a flowchart of an anchor point sharing method according to an embodiment of the present disclosure.
- the method can be applied to a terminal device. Further, the method can be applied to the slave terminal proposed in the above disclosed embodiment.
- the slave terminal The number and implementation manners of, are not limited, and reference may be made to the above disclosed embodiments, which will not be repeated here.
- the anchor point sharing method may include:
- Step S21 The terminal obtains the identity of the anchor to be shared.
- Step S22 The terminal sends an anchor point sharing request to the server according to the current scene and the identity.
- the anchor point sharing request is used to instruct the server to determine the shared location information of the anchor point to be shared in the current scene.
- Step S23 The terminal receives the shared location information fed back by the server.
- the identity of the anchor to be shared obtained by the terminal is consistent with the identity proposed in the previous disclosed embodiments, and will not be repeated here; at the same time, the anchor sharing request sent by the terminal to the server is the same as The anchor point sharing request received by the server proposed in the foregoing disclosed embodiments is the same, and will not be repeated here; the terminal receiving the shared location information fed back by the server is the same as the shared location information fed back to the terminal by the server in the foregoing disclosed embodiments Consistent, it will not be described in detail here.
- the terminal obtains the identity of the anchor to be shared, and sends an anchor sharing request to the server according to the current scene and identity, and then receives the shared location information fed back by the server.
- the terminal only needs to obtain the current scene and the target anchor.
- the identity of the point can be used to obtain the shared location information of the anchor point to be shared in the current scene by communicating with the server, and then realize the sharing of the AR scene.
- the sharing method is simple and efficient, and is suitable for general promotion.
- step S21 is not limited, that is, the manner in which the terminal obtains the identity of the anchor to be shared is not limited.
- the subject of implementing step S21 in the embodiment of the present disclosure may be the slave terminal, and the identity of the anchor to be shared is based on the communication between the master terminal and the server in a possible implementation. It is generated by the information exchange and stored in the server. In a possible implementation, the server can return the generated identity of the anchor to be shared to the main terminal.
- the master terminal and the slave terminal may be the same device or different devices. Therefore, how the slave terminal obtains the identity of the anchor to be shared is not limited in the embodiment of the present disclosure. Any manner that enables the slave terminal to obtain the identity identifier can be used as an implementation manner of the embodiments of the present disclosure.
- step S21 may include:
- the terminal obtains the shared information.
- the terminal obtains the identity of the anchor to be shared according to the correspondence between the shared information and the identity.
- the form of expression of shared information is not limited, and any form of information that can be mapped to an identity and can be shared in a shared form can be used as a way to realize shared information.
- the corresponding relationship between the shared information and the identity can be flexibly set according to actual conditions, and is not limited to the following disclosed embodiments.
- the form of the shared information can be the room number set during the AR scene sharing process, that is, the room number is bound to the identity identifier.
- the terminal can obtain the shared room number After entering the room, the ID corresponding to the room number is automatically obtained.
- the form of the shared information can be the user identity in the AR scenario sharing process, that is, the user identity is bound with the identity identifier.
- the terminal may obtain the shared user identity after obtaining the shared user identity. , Automatically obtain the identity that is bound to the user identity.
- the expression of the shared information can be directly the identity identifier, that is, the identity identifier itself can be used as the content of the shared information and be acquired by the terminal.
- the manner in which the terminal obtains shared information is also not limited, and can be flexibly selected according to the actual situation.
- the terminal is a slave terminal and may not be the same device as the master terminal.
- the slave terminal may obtain shared information in Obtain the shared information shared by the master terminal; in an example, the terminal, as a slave terminal, may be the same device as the master terminal.
- the method for the slave terminal to obtain the shared information may be to directly read the shared information from the master terminal.
- the terminal obtains the identity of the anchor to be shared by obtaining the shared information and according to the corresponding relationship between the shared information and the identity.
- the identity of the anchor to be shared can be obtained more conveniently without complicated analysis.
- the identity can be obtained indirectly through shared information, which can reduce the risk of identity leakage and improve the efficiency of anchor sharing while ensuring security.
- step S22 is also not limited, that is, the terminal according to the current scenario and the identity identifier ,
- the specific implementation process of sending the anchor sharing request to the server is not limited.
- step S22 may include:
- the terminal scans the current scene and obtains an image of the current scene.
- the terminal performs feature extraction on the image of the current scene to obtain second feature information.
- the terminal sends the second feature information, identity identifier, and anchor point sharing request message together as an anchor point sharing request to the server.
- the second feature information is consistent with the second feature information of the current scene included in the anchor point sharing request, and will not be repeated here.
- the second feature information may The second feature information is obtained by scanning the current scene and performing feature extraction on the results obtained from the scan.
- the specific feature extraction process and method are not limited in the embodiments of the present disclosure, and any relevant information that can be extracted into the current scene Feature information, which can determine the physical environment features of the current scene, can be used as a feature extraction implementation method.
- a trained feature extraction neural network can be used to extract the physical environment feature information of the current scene.
- SIFT Scale-invariant Feature Transform
- the terminal obtains the image of the current scene by scanning the current scene, and extracts the features of the image of the current scene. After obtaining the second feature information, it packs the second feature information, the nearby teacher and the anchor point sharing request message as the anchor point sharing The request is sent to the server, so that the terminal can directly transmit the data required by the server to the server while requesting the server to complete the anchor sharing, without cumbersome interaction process, and improving the efficiency of anchor sharing.
- FIG. 7 shows a flowchart of an anchor point sharing method according to an embodiment of the present disclosure.
- the method can be applied to a system composed of a terminal device and a server.
- the implementation of the terminal and the server is the same as in the above disclosed embodiment. This will not be repeated here.
- the anchor point sharing method may include:
- Step S31 The terminal obtains the identity of the anchor to be shared.
- Step S32 The terminal sends an anchor point sharing request to the server according to the current scene and the identity.
- Step S33 The server determines the sharing location information of the anchor point to be shared in the current scene according to the anchor point sharing request.
- Step S34 The terminal receives the shared location information fed back by the server.
- step S31 is the same as that of step S21
- the implementation of step S32 is the same as that of step S22
- the implementation of step S33 is the same as that of step S13
- the implementation of step S34 is the same as that of step S23.
- the methods are the same, so I won't repeat them here.
- the anchor point to be shared can be positioned in the current scene through the server according to the identity of the anchor point to be shared, so that different terminals can share the virtual world in the same real scene and realize the sharing of augmented reality technology.
- Augmented reality technology is a technology that can combine real world information and virtual world information, and display virtual visual information in real world images through devices.
- most of the current augmented reality is a stand-alone version. What is displayed on the screen is a combination of their own virtual world and real world information. It is impossible for multiple users to see the same virtual world and real world on their respective screens. No interactive AR experience.
- FIGS 8-9 show schematic diagrams of an application example according to the present disclosure.
- an embodiment of the present disclosure proposes an anchor point sharing method, which can be integrated into a software development kit (SDK, Inside the Software Development Kit, it is realized through the cooperation between the terminal and the server.
- SDK software development kit
- the process of implementing the anchor sharing method based on SDK may be:
- the specific authentication process may be adding the Key/Secret applied from the developer website To obtain the permission to call cloud services.
- User A creates an AR scene through the main terminal, and creates an anchor point in the scene (the anchor point is located on a marker in the real scene) as the anchor point to be shared, and hosts the anchor point to be shared to the cloud server , Obtain the corresponding anchor id as the identity of the anchor to be shared.
- the application layer manages the acquired anchor id by itself, and shares the shared information with related users after binding to the shared information.
- this process can be completed using cloud services.
- User B creates an AR scene against the same real scene, uses the anchor id bound to the shared information to perform an anchor resolve operation in the cloud server to obtain the anchor to be shared, and the anchor to be shared
- the position of the point relative to the real scene is the same as when the user A is placed.
- Figure 8 shows the implementation process of hosting the anchor point to be shared to the cloud server
- Figure 9 shows the implementation process of anchor resolution of the anchor point to be shared in the cloud server, as can be seen from the figure
- the process of hosting and parsing is consistent in the data transmission process, but the transmitted data flow is different.
- the anchor point to be shared is hosted on the cloud server
- the main realization is the analysis and storage of the data, and the analysis on the cloud server to be shared
- the cloud server will call the matching algorithm to achieve.
- the specific process for the cloud server to host the anchor point to be shared can be as follows: the main terminal transmits data to the cloud server.
- the data includes the location information of the anchor point to be shared in the anchor point scene, the relevant map information in the SLAM algorithm, etc.
- the map information is used as The reference coordinate system and the surrounding environment are used for subsequent analysis of the anchor point to be shared.
- the data transmitted by the main terminal will be saved in the cloud server and become the cloud anchor point and assigned a cloud anchor id, which will be returned The main terminal.
- Anchor hosting is instant. From the time the cloud anchor number is obtained to 168 hours thereafter, the anchor can be resolved. After 168 hours, the related information of the anchor will be deleted.
- the process of analyzing the anchor point to be shared by the cloud server can be as follows: the slave terminal is responsible for sending an analysis request to the cloud server to register the cloud anchor point to the local coordinate system in the current slave terminal, and the request packet contains the image extracted from the current slave terminal Feature information and the number of the cloud anchor point to be resolved.
- the cloud server will perform feature matching between the feature information uploaded by the slave terminal and the map information uploaded by the master terminal.
- the matching process includes the registration of the master-slave terminal coordinate system, calculates the transformation relationship of the AR scene coordinate system in the master-slave terminal, and compares this The transformation result is applied to the cloud anchor point, and the slave terminal receives the coordinate information of the cloud anchor point in the AR scene of the slave terminal.
- the above method can be applied to the sharing process of a multi-person AR scene, that is, a user through a terminal device, the cloud server hosts one or more anchor points to be shared, and the remaining users can use their respective terminal devices , Scan the respective current scenes, and analyze the anchor points on the cloud server to obtain the position of the anchor point to be shared in the respective terminal device, so as to realize that in multiple terminals, the anchor points are displayed at the same position in the real world. Realize multi-person AR interaction.
- the above method can also be applied to the sharing process of single-person multi-period AR scenarios, that is, a user hosts one or more anchor points to be shared on the cloud server through a certain terminal device, so that the anchor point and the anchor point are stored on the cloud server Scenes. After a period of time, the user can also scan the anchor point scene through the terminal device, and open the anchor point scene in the server through anchor point analysis, and obtain the anchor point to be shared in the same position as the previously saved anchor point scene. And perform the required operations.
- the above method can also be applied to the sharing process of multi-person and multi-period AR scenes, that is, combining the above two application methods, multiple people save the AR scene, and next time the AR scene is opened through anchor analysis, the same scene will be presented. Subject to time constraints.
- the writing order of the steps does not mean a strict execution order but constitutes any limitation on the implementation process.
- the specific execution order of each step should be based on its function and possibility.
- the inner logic is determined.
- Fig. 10 shows a block diagram of an anchor sharing device according to an embodiment of the present disclosure.
- the anchor sharing device may be a server or other equipment.
- the anchor point sharing device 40 may include: an anchor point sharing request receiving module 41, configured to receive an anchor point sharing request sent by the terminal, and the anchor point sharing request includes the current scene scanned by the terminal and the obtained waiting The identity of the shared anchor point; the shared location information determining module 42 is used to determine the shared location information of the anchor point to be shared in the current scene according to the anchor point sharing request; the feedback module 43 is used to feed back the shared location information to the terminal .
- the anchor sharing request receiving module before the anchor sharing request receiving module, it further includes an identity generating module, and the identity generating module is used to: obtain the anchor information of the anchor to be shared; and generate the anchor to be shared according to the anchor information Point’s identity, save anchor point information and identity.
- the identity generation module is further configured to: when the time for storing the anchor point information and the identity mark exceeds the time threshold, the server deletes the anchor point information and the identity mark.
- the anchor point information of the anchor point to be shared includes: the first feature information of the anchor point scene where the anchor point to be shared is located, and the original position information of the anchor point to be shared in the anchor point scene .
- the anchor point sharing request includes: the second feature information of the current scene, the identity of the anchor point to be shared, and the anchor point sharing request message.
- the shared location information determination module is used to: obtain the identity of the anchor to be shared and the second feature information of the current scene according to the anchor sharing request; and read the anchor to be shared according to the identity.
- the shared location information determination module is further used to: according to the anchor point information, obtain the first feature information of the anchor point scene where the anchor point to be shared is located and the position of the anchor point to be shared in the anchor point scene.
- Original location information; the first feature information and the second feature information are feature-matched to obtain the position transformation relationship between the current scene and the anchor scene; according to the position transformation relationship, the original position information is transformed to obtain the anchor point to be shared Shared location information in the current scene.
- Fig. 11 shows a block diagram of an anchor sharing device according to an embodiment of the present disclosure.
- the anchor sharing device may be a terminal device or the like.
- the anchor point sharing device 50 may include: an identity identification acquisition module 51, which is used to acquire the identity identification of the anchor point to be shared; and an anchor point sharing request sending module 52, which is used to according to the current scene and identification Send an anchor point sharing request to the server, where the anchor point sharing request is used to instruct the server to determine the shared location information of the anchor to be shared in the current scene; the shared location information receiving module 53 is used to receive shared location information fed back by the server.
- the identity acquisition module is used to: obtain shared information; and obtain the identity of the anchor to be shared according to the correspondence between the shared information and the identity.
- the anchor point sharing request sending module is used to: scan the current scene to obtain an image of the current scene; perform feature extraction on the image of the current scene to obtain the second feature information; combine the second feature information and identity
- the identifier and the anchor point sharing request message, together as an anchor point sharing request, are sent to the server.
- FIG. 12 shows a block diagram of an anchor point sharing system according to an embodiment of the present disclosure.
- the anchor point sharing system 60 may include: the first anchor point sharing device 40 as described in the foregoing disclosed embodiments; the second anchor point sharing device 50 as described in the foregoing disclosed embodiments; wherein , The first anchor point sharing device and the second anchor point sharing device interact through an anchor point sharing request.
- the embodiments of the present disclosure also provide a computer-readable storage medium on which computer program instructions are stored, and the computer program instructions implement the foregoing method when executed by a processor.
- the computer-readable storage medium may be a non-volatile computer-readable storage medium.
- An embodiment of the present disclosure also provides an electronic device, including: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured as the above method.
- the electronic device can be provided as a terminal, server or other form of device.
- FIG. 13 is a block diagram of an electronic device 800 according to an embodiment of the present disclosure.
- the electronic device 800 may be a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and other terminals.
- the electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, and a sensor component 814 , And communication component 816.
- the processing component 802 generally controls the overall operations of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations.
- the processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the foregoing method.
- the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components.
- the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.
- the memory 804 is configured to store various types of data to support operations in the electronic device 800. Examples of these data include instructions for any application or method operated on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc.
- the memory 804 can be implemented by any type of volatile or nonvolatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic Disk or Optical Disk.
- SRAM static random access memory
- EEPROM electrically erasable programmable read-only memory
- EPROM erasable Programmable Read Only Memory
- PROM Programmable Read Only Memory
- ROM Read Only Memory
- Magnetic Memory Flash Memory
- Magnetic Disk Magnetic Disk or Optical Disk.
- the power supply component 806 provides power for various components of the electronic device 800.
- the power supply component 806 may include a power management system, one or more power supplies, and other components associated with the generation, management, and distribution of power for the electronic device 800.
- the multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user.
- the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user.
- the touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation.
- the multimedia component 808 includes a front camera and/or a rear camera. When the electronic device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
- the audio component 810 is configured to output and/or input audio signals.
- the audio component 810 includes a microphone (MIC).
- the microphone is configured to receive external audio signals.
- the received audio signal may be further stored in the memory 804 or transmitted via the communication component 816.
- the audio component 810 further includes a speaker for outputting audio signals.
- the I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module.
- the peripheral interface module may be a keyboard, a click wheel, a button, and the like. These buttons may include but are not limited to: home button, volume button, start button, and lock button.
- the sensor component 814 includes one or more sensors for providing the electronic device 800 with various aspects of state evaluation.
- the sensor component 814 can detect the on/off status of the electronic device 800 and the relative positioning of the components.
- the component is the display and the keypad of the electronic device 800.
- the sensor component 814 can also detect the electronic device 800 or the electronic device 800.
- the position of the component changes, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration/deceleration of the electronic device 800, and the temperature change of the electronic device 800.
- the sensor component 814 may include a proximity sensor configured to detect the presence of nearby objects when there is no physical contact.
- the sensor component 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
- the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.
- the communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices.
- the electronic device 800 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof.
- the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel.
- the communication component 816 further includes a near field communication (NFC) module to facilitate short-range communication.
- the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
- RFID radio frequency identification
- IrDA infrared data association
- UWB ultra-wideband
- Bluetooth Bluetooth
- the electronic device 800 can be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field A programmable gate array (FPGA), controller, microcontroller, microprocessor, or other electronic components are implemented to implement the above methods.
- ASIC application specific integrated circuits
- DSP digital signal processors
- DSPD digital signal processing devices
- PLD programmable logic devices
- FPGA field A programmable gate array
- controller microcontroller, microprocessor, or other electronic components are implemented to implement the above methods.
- a non-volatile computer-readable storage medium such as the memory 804 including computer program instructions, which can be executed by the processor 820 of the electronic device 800 to complete the foregoing method.
- FIG. 14 is a block diagram of an electronic device 1900 according to an embodiment of the present disclosure.
- the electronic device 1900 may be provided as a server. 14
- the electronic device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by a memory 1932 for storing instructions executable by the processing component 1922, such as application programs.
- the application program stored in the memory 1932 may include one or more modules each corresponding to a set of instructions.
- the processing component 1922 is configured to execute instructions to perform the above-described methods.
- the electronic device 1900 may also include a power supply component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input output (I/O) interface 1958 .
- the electronic device 1900 can operate based on an operating system stored in the memory 1932, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM or the like.
- a non-volatile computer-readable storage medium such as the memory 1932 including computer program instructions, which can be executed by the processing component 1922 of the electronic device 1900 to complete the foregoing method.
- the present disclosure may be a system, method, and/or computer program product.
- the computer program product may include a computer-readable storage medium loaded with computer-readable program instructions for enabling a processor to implement various aspects of the present disclosure.
- the computer-readable storage medium may be a tangible device that can hold and store instructions used by the instruction execution device.
- the computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing.
- Computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) Or flash memory), static random access memory (SRAM), portable compact disk read-only memory (CD-ROM), digital versatile disk (DVD), memory stick, floppy disk, mechanical encoding device, such as a printer with instructions stored thereon
- RAM random access memory
- ROM read-only memory
- EPROM erasable programmable read-only memory
- flash memory flash memory
- SRAM static random access memory
- CD-ROM compact disk read-only memory
- DVD digital versatile disk
- memory stick floppy disk
- mechanical encoding device such as a printer with instructions stored thereon
- the computer-readable storage medium used herein is not interpreted as a transient signal itself, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (for example, light pulses through fiber optic cables), or through wires Transmission of electrical signals.
- the computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to various computing/processing devices, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and/or a wireless network.
- the network may include copper transmission cables, optical fiber transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers.
- the network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network, and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing/processing device .
- the computer program instructions used to perform the operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, status setting data, or in one or more programming languages.
- Source code or object code written in any combination, the programming language includes object-oriented programming languages such as Smalltalk, C++, etc., and conventional procedural programming languages such as "C" language or similar programming languages.
- Computer-readable program instructions can be executed entirely on the user's computer, partly on the user's computer, executed as a stand-alone software package, partly on the user's computer and partly executed on a remote computer, or entirely on the remote computer or server carried out.
- the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to access connection).
- LAN local area network
- WAN wide area network
- an electronic circuit such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), can be customized by using the status information of the computer-readable program instructions.
- the computer-readable program instructions are executed to realize various aspects of the present disclosure.
- These computer-readable program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine such that when these instructions are executed by the processor of the computer or other programmable data processing device , A device that implements the functions/actions specified in one or more blocks in the flowchart and/or block diagram is produced. It is also possible to store these computer-readable program instructions in a computer-readable storage medium. These instructions make computers, programmable data processing apparatuses, and/or other devices work in a specific manner, so that the computer-readable medium storing instructions includes An article of manufacture, which includes instructions for implementing various aspects of the functions/actions specified in one or more blocks in the flowchart and/or block diagram.
- each block in the flowchart or block diagram may represent a module, program segment, or part of an instruction, and the module, program segment, or part of an instruction contains one or more functions for implementing the specified logical function.
- Executable instructions may also occur in a different order from the order marked in the drawings. For example, two consecutive blocks can actually be executed in parallel, or they can sometimes be executed in the reverse order, depending on the functions involved.
- each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart can be implemented by a dedicated hardware-based system that performs the specified functions or actions Or it can be realized by a combination of dedicated hardware and computer instructions.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Human Computer Interaction (AREA)
- Telephonic Communication Services (AREA)
- Information Transfer Between Computers (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
- Studio Devices (AREA)
Abstract
Description
Claims (27)
- 一种锚点共享方法,其特征在于,包括:服务器接收终端发送的锚点共享请求,所述锚点共享请求包括所述终端扫描得到的当前场景以及获取的待共享锚点的身份标识;服务器根据所述锚点共享请求,确定所述待共享锚点在所述当前场景中的共享位置信息;服务器向所述终端反馈所述共享位置信息。
- 根据权利要求1所述的方法,其特征在于,所述服务器接收终端发送的锚点共享请求之前,还包括:服务器获取所述待共享锚点的锚点信息;服务器根据所述锚点信息,生成所述待共享锚点的身份标识,保存所述锚点信息和所述身份标识。
- 根据权利要求2所述的方法,其特征在于,所述服务器根据所述锚点信息,生成所述待共享锚点的身份标识,保存所述锚点信息和所述身份标识,还包括:在保存所述锚点信息和所述身份标识的时间超过时间阈值时,服务器删除所述锚点信息和所述身份标识。
- 根据权利要求2或3所述的方法,其特征在于,所述待共享锚点的锚点信息包括:所述待共享锚点所在的锚点场景的第一特征信息,以及所述待共享锚点在所述锚点场景中的原始位置信息。
- 根据权利要求1至4中任意一项所述的方法,其特征在于,所述锚点共享请求包括:所述当前场景的第二特征信息、所述待共享锚点的身份标识和锚点共享请求消息。
- 根据权利要求1至5中任意一项所述的方法,其特征在于,所述服务器根据所述锚点共享请求,确定所述待共享锚点在所述当前场景中的共享位置信息,包括:服务器根据所述锚点共享请求,分别得到所述待共享锚点的身份标识和所述当前场景的第二特征信息;服务器根据所述身份标识,读取所述待共享锚点的锚点信息;服务器根据所述第二特征信息和所述锚点信息,确定所述待共享锚点在所述当前场景中的共享位置信息。
- 根据权利要求6所述的方法,其特征在于,所述服务器根据所述第二特征信息和所述锚点信息,确定所述待共享锚点在所述当前场景中的共享位置信息,包括:服务器根据所述锚点信息,分别得到所述待共享锚点所在的锚点场景的第一特征信息和所述待共享锚点在所述锚点场景中的原始位置信息;服务器将所述第一特征信息与所述第二特征信息进行特征匹配,得到所述当前场景与所述锚点场景之间的位置变换关系;服务器根据所述位置变换关系,对所述原始位置信息进行位置变换,得到所述待共享锚点在所述当前场景中的共享位置信息。
- 一种锚点共享方法,其特征在于,包括:终端获取待共享锚点的身份标识;终端根据当前场景和所述身份标识,向服务器发送锚点共享请求,所述锚点共享请求用于指示所述服务器确定所述待共享锚点在所述当前场景中的共享位置信息;终端接收服务器反馈的共享位置信息。
- 根据权利要求8所述的方法,其特征在于,所述终端获取待共享锚点的身份标识,包括:终端获取共享信息;终端根据所述共享信息与身份标识之间的对应关系,得到待共享锚点的身份标识。
- 根据权利要求8或9所述的方法,其特征在于,所述终端根据当前场景和所述身份标识,向服务器发送锚点共享请求,包括:终端扫描当前场景,获取当前场景的图像;终端对所述当前场景的图像进行特征提取,得到所述第二特征信息;终端将所述第二特征信息、所述身份标识和所述锚点共享请求消息,共同作为所述锚点共享请求,发送至服务器。
- 一种锚点共享方法,其特征在于,包括:终端获取待共享锚点的身份标识;终端根据当前场景和所述身份标识,向服务器发送锚点共享请求;服务器根据所述锚点共享请求,确定所述待共享锚点在当前场景中的共享位置信息;终端接收所述服务器反馈的所述共享位置信息。
- 一种锚点共享装置,其特征在于,所述装置应用于服务器,包括:锚点共享请求接收模块,用于接收终端发送的锚点共享请求,所述锚点共享请求包括所述终端扫描得到的当前场景以及获取的待共享锚点的身份标识;共享位置信息确定模块,用于根据所述锚点共享请求,确定所述待共享锚点在所述当前场景中的共享位置信息;反馈模块,用于向所述终端反馈所述共享位置信息。
- 根据权利要求12所述的装置,其特征在于,所述锚点共享请求接收模块之前,还包括身份标识生成模块,所述身份标识生成模块用于:获取所述待共享锚点的锚点信息;根据所述锚点信息,生成所述待共享锚点的身份标识,保存所述锚点信息和所述身份标识。
- 根据权利要求13所述的装置,其特征在于,所述身份标识生成模块进一步用于:在保存所述锚点信息和所述身份标识的时间超过时间阈值时,服务器删除所述锚点信息和所述身份标识。
- 根据权利要求13或14所述的装置,其特征在于,所述待共享锚点的锚点信息包括:所述待共享锚点所在的锚点场景的第一特征信息,以及所述待共享锚点在所述锚点场景中的原始位置信息。
- 根据权利要求12至15中任意一项所述的装置,其特征在于,所述锚点共享请求包括:所述当前场景的第二特征信息、所述待共享锚点的身份标识和锚点共享请求消息。
- 根据权利要求12至16中任意一项所述的装置,其特征在于,所述共享位置信息确定模块用于:根据所述锚点共享请求,分别得到所述待共享锚点的身份标识和所述当前场景的第二特征信息;根据所述身份标识,读取所述待共享锚点的锚点信息;根据所述第二特征信息和所述锚点信息,确定所述待共享锚点在所述当前场景中的共享位置信息。
- 根据权利要求17所述的装置,其特征在于,所述共享位置信息确定模块进一步用于:根据所述锚点信息,分别得到所述待共享锚点所在的锚点场景的第一特征信息和所述待共享锚点在所述锚点场景中的原始位置信息;将所述第一特征信息与所述第二特征信息进行特征匹配,得到所述当前场景与所述锚点场景之间的位置变换关系;根据所述位置变换关系,对所述原始位置信息进行位置变换,得到所述待共享锚点在所述当前场景中的共享位置信息。
- 一种锚点共享装置,其特征在于,所述装置应用于终端,包括:身份标识获取模块,用于获取待共享锚点的身份标识;锚点共享请求发送模块,用于根据当前场景和所述身份标识,向服务器发送锚点共享请求,所述锚点共享请求用于指示所述服务器确定所述待共享锚点在所述当前场景中的共享位置信息;共享位置信息接收模块,用于接收服务器反馈的共享位置信息。
- 根据权利要求19所述的装置,其特征在于,所述身份标识获取模块用于:获取共享信息;根据所述共享信息与身份标识之间的对应关系,得到待共享锚点的身份标识。
- 根据权利要求19或20所述的装置,其特征在于,所述锚点共享请求发送模块用于:扫描当前场景,获取当前场景的图像;对所述当前场景的图像进行特征提取,得到所述第二特征信息;将所述第二特征信息、所述身份标识和所述锚点共享请求消息,共同作为所述锚点共享请求,发送至服务器。
- 一种锚点共享系统,其特征在于,包括:如权利要求12至18中任意一项所述的第一锚点共享装置;如权利要求19至21中任意一项所述的第二锚点共享装置;其中,所述第一锚点共享装置与所述第二锚点共享装置通过锚点共享请求进行交互。
- 一种电子设备,其特征在于,包括:处理器;用于存储处理器可执行指令的存储器;其中,所述处理器被配置为调用所述存储器存储的指令,以执行权利要求1至7中任意一项所述的方法。
- 一种电子设备,其特征在于,包括:处理器;用于存储处理器可执行指令的存储器;其中,所述处理器被配置为调用所述存储器存储的指令,以执行权利要求8至10中任意一项所述的方法。
- 一种计算机可读存储介质,其上存储有计算机程序指令,其特征在于,所述计算机程序指令被处理器执行时实现权利要求1至7中任意一项所述的方法。
- 一种计算机可读存储介质,其上存储有计算机程序指令,其特征在于,所述计算机程序指令被处理器执行时实现权利要求8至10中任意一项所述的方法。
- 一种计算机程序,包括计算机可读代码,其特征在于,当所述计算机可读代码在电子设备中运行时,所述电子设备中的处理器执行用于实现如权利要求1-11中的任一项所述的方法。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2021549776A JP7245350B2 (ja) | 2019-06-26 | 2020-03-20 | アンカー共有方法及び装置、システム、電子機器並びに記憶媒体 |
SG11202109292SA SG11202109292SA (en) | 2019-06-26 | 2020-03-20 | Method, apparatus and system for anchor sharing, electronic device and storage medium |
US17/407,214 US20210383580A1 (en) | 2019-06-26 | 2021-08-20 | Method, apparatus and system for anchor sharing, electronic device and storage medium |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910562547.3A CN112153083B (zh) | 2019-06-26 | 2019-06-26 | 锚点共享方法及装置、系统、电子设备和存储介质 |
CN201910562547.3 | 2019-06-26 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/407,214 Continuation US20210383580A1 (en) | 2019-06-26 | 2021-08-20 | Method, apparatus and system for anchor sharing, electronic device and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020258938A1 true WO2020258938A1 (zh) | 2020-12-30 |
Family
ID=73869895
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/080481 WO2020258938A1 (zh) | 2019-06-26 | 2020-03-20 | 锚点共享方法及装置、系统、电子设备和存储介质 |
Country Status (6)
Country | Link |
---|---|
US (1) | US20210383580A1 (zh) |
JP (1) | JP7245350B2 (zh) |
CN (1) | CN112153083B (zh) |
SG (1) | SG11202109292SA (zh) |
TW (1) | TWI767225B (zh) |
WO (1) | WO2020258938A1 (zh) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102505537B1 (ko) * | 2021-09-28 | 2023-03-03 | 성균관대학교산학협력단 | Ar 공유 시스템 |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103460256A (zh) * | 2011-03-29 | 2013-12-18 | 高通股份有限公司 | 在扩增现实系统中将虚拟图像锚定到真实世界表面 |
US20140354685A1 (en) * | 2013-06-03 | 2014-12-04 | Gavin Lazarow | Mixed reality data collaboration |
US20140375688A1 (en) * | 2013-06-25 | 2014-12-25 | William Gibbens Redmann | Multiuser augmented reality system |
CN107741886A (zh) * | 2017-10-11 | 2018-02-27 | 江苏电力信息技术有限公司 | 一种基于增强现实技术多人互动的方法 |
CN107850779A (zh) * | 2015-06-24 | 2018-03-27 | 微软技术许可有限责任公司 | 虚拟位置定位锚 |
US20180190023A1 (en) * | 2016-12-30 | 2018-07-05 | Glen J. Anderson | Dynamic, local augmented reality landmarks |
US20180285052A1 (en) * | 2017-03-30 | 2018-10-04 | Microsoft Technology Licensing, Llc | Sharing neighboring map data across devices |
US20180321894A1 (en) * | 2017-05-04 | 2018-11-08 | Microsoft Technology Licensing, Llc | Virtual content displayed with shared anchor |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20190088030A1 (en) * | 2017-09-20 | 2019-03-21 | Microsoft Technology Licensing, Llc | Rendering virtual objects based on location data and image data |
US10685456B2 (en) * | 2017-10-12 | 2020-06-16 | Microsoft Technology Licensing, Llc | Peer to peer remote localization for devices |
-
2019
- 2019-06-26 CN CN201910562547.3A patent/CN112153083B/zh active Active
-
2020
- 2020-03-20 SG SG11202109292SA patent/SG11202109292SA/en unknown
- 2020-03-20 WO PCT/CN2020/080481 patent/WO2020258938A1/zh active Application Filing
- 2020-03-20 JP JP2021549776A patent/JP7245350B2/ja active Active
- 2020-04-30 TW TW109114595A patent/TWI767225B/zh active
-
2021
- 2021-08-20 US US17/407,214 patent/US20210383580A1/en not_active Abandoned
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103460256A (zh) * | 2011-03-29 | 2013-12-18 | 高通股份有限公司 | 在扩增现实系统中将虚拟图像锚定到真实世界表面 |
US20140354685A1 (en) * | 2013-06-03 | 2014-12-04 | Gavin Lazarow | Mixed reality data collaboration |
US20140375688A1 (en) * | 2013-06-25 | 2014-12-25 | William Gibbens Redmann | Multiuser augmented reality system |
CN107850779A (zh) * | 2015-06-24 | 2018-03-27 | 微软技术许可有限责任公司 | 虚拟位置定位锚 |
US20180190023A1 (en) * | 2016-12-30 | 2018-07-05 | Glen J. Anderson | Dynamic, local augmented reality landmarks |
US20180285052A1 (en) * | 2017-03-30 | 2018-10-04 | Microsoft Technology Licensing, Llc | Sharing neighboring map data across devices |
US20180321894A1 (en) * | 2017-05-04 | 2018-11-08 | Microsoft Technology Licensing, Llc | Virtual content displayed with shared anchor |
CN107741886A (zh) * | 2017-10-11 | 2018-02-27 | 江苏电力信息技术有限公司 | 一种基于增强现实技术多人互动的方法 |
Also Published As
Publication number | Publication date |
---|---|
CN112153083A (zh) | 2020-12-29 |
CN112153083B (zh) | 2022-07-19 |
US20210383580A1 (en) | 2021-12-09 |
TWI767225B (zh) | 2022-06-11 |
SG11202109292SA (en) | 2021-09-29 |
JP2022522283A (ja) | 2022-04-15 |
TW202103497A (zh) | 2021-01-16 |
JP7245350B2 (ja) | 2023-03-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2022043741A1 (zh) | 网络训练、行人重识别方法及装置、存储介质、计算机程序 | |
WO2022134382A1 (zh) | 图像分割方法及装置、电子设备和存储介质、计算机程序 | |
US10608988B2 (en) | Method and apparatus for bluetooth-based identity recognition | |
WO2017045309A1 (zh) | 设备控制方法、装置和终端设备 | |
US10630735B2 (en) | Communication terminal, communication system, communication method, and recording medium | |
US10298881B2 (en) | Communication terminal, communication system, communication method, and recording medium | |
US10102505B2 (en) | Server-implemented method, terminal-implemented method and device for acquiring business card information | |
WO2022188305A1 (zh) | 信息展示方法及装置、电子设备、存储介质及计算机程序 | |
TWI767217B (zh) | 坐標系對齊的方法及裝置、電子設備和計算機可讀存儲介質 | |
EP3264774B1 (en) | Live broadcasting method and device for live broadcasting | |
US10091010B2 (en) | Communication terminal, communication system, communication method, and recording medium | |
US20150282233A1 (en) | Communication management system, communication management method, and recording medium storing communication management program | |
US9723486B2 (en) | Method and apparatus for accessing network | |
US20180144546A1 (en) | Method, device and terminal for processing live shows | |
KR20220024302A (ko) | 블록체인과 해쉬 암호화 기술을 기반으로 한 영상 인증 시스템 및 그 방법 | |
KR20210000957A (ko) | 블록체인과 해쉬 암호화 기술을 기반으로 한 영상 인증 시스템 및 그 방법 | |
CN110619097A (zh) | 二维码生成方法、装置、电子设备及存储介质 | |
WO2020258938A1 (zh) | 锚点共享方法及装置、系统、电子设备和存储介质 | |
CN112616053B (zh) | 直播视频的转码方法、装置及电子设备 | |
CN106447747B (zh) | 图像处理方法及装置 | |
CN111526380A (zh) | 视频处理方法、装置、服务器、电子设备及存储介质 | |
CN110673732A (zh) | 场景共享方法及装置、系统、电子设备和存储介质 | |
CN106375744B (zh) | 信息投影方法及装置 | |
WO2022151687A1 (zh) | 合影图像生成方法、装置、设备、存储介质、计算机程序及产品 | |
CN106126104B (zh) | 键盘模拟方法和装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20833051 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2021549776 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20833051 Country of ref document: EP Kind code of ref document: A1 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20833051 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 12/05/2023) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20833051 Country of ref document: EP Kind code of ref document: A1 |