CN115426335A - Information interaction method, device, equipment and system - Google Patents
Information interaction method, device, equipment and system Download PDFInfo
- Publication number
- CN115426335A CN115426335A CN202110521431.2A CN202110521431A CN115426335A CN 115426335 A CN115426335 A CN 115426335A CN 202110521431 A CN202110521431 A CN 202110521431A CN 115426335 A CN115426335 A CN 115426335A
- Authority
- CN
- China
- Prior art keywords
- terminal
- resource
- resource platform
- media channel
- resources
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 69
- 230000003993 interaction Effects 0.000 title claims abstract description 51
- 230000003190 augmentative effect Effects 0.000 claims abstract description 43
- 230000005540 biological transmission Effects 0.000 claims abstract description 28
- 238000012545 processing Methods 0.000 claims description 42
- 230000004044 response Effects 0.000 claims description 39
- 238000004422 calculation algorithm Methods 0.000 claims description 26
- 230000008569 process Effects 0.000 claims description 11
- 238000004364 calculation method Methods 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 description 19
- 230000000694 effects Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000011664 signaling Effects 0.000 description 4
- 238000012795 verification Methods 0.000 description 4
- 238000013475 authorization Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 238000000354 decomposition reaction Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 230000006798 recombination Effects 0.000 description 2
- 238000005215 recombination Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1069—Session establishment or de-establishment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/0807—Network architectures or network communication protocols for network security for authentication of entities using tickets, e.g. Kerberos
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Multimedia (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The invention provides an information interaction method, an information interaction device, information interaction equipment and an information interaction system, wherein the information interaction method on the Augmented Reality (AR) resource platform side comprises the following steps: establishing session connection with an augmented reality AR terminal supporting a universal interface through the universal interface; allocating AR resources to the AR terminal through the session connection; when determining that the AR terminal is allowed to use the AR resources, establishing media channel connection with the AR terminal; and carrying out data transmission with the AR terminal through the media channel connection. The scheme of the invention enables the AR terminal to fully utilize the computing power and data resources of the AR resource platform, expand the AR application function and improve the performance of the AR terminal.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a method, an apparatus, a device, and a system for information interaction.
Background
Currently, augmented Reality (AR) applications are typically implemented by terminals such as AR glasses, including obtaining AR material from local storage or sensors; and calculating the AR materials, extracting key information, responding to the key information, displaying the contents such as the view field superposition and the like. With the construction of 5G infrastructure, the wireless network has the advantages of high speed, high bandwidth and low time delay.
In the conventional AR application processing method, some local calculation tasks are scheduled to a server side on a network side for execution, so that the server side can provide resources to provide service capability for an AR terminal.
By adopting the traditional AR application processing method, the AR resource function of the server side is single; and the interface is closed, the service cannot be provided for the AR terminal of the third party, and the expansibility is poor.
Disclosure of Invention
The invention aims to provide an information interaction method, device, equipment and system. The AR terminal can fully utilize the computing power and data resources of the cloud resource platform, expand the AR application function and improve the performance of the AR terminal.
In order to solve the technical problems, the technical scheme of the invention is as follows:
an information interaction method is applied to an Augmented Reality (AR) resource platform, and comprises the following steps:
establishing session connection with an augmented reality AR terminal supporting a universal interface through the universal interface;
allocating AR resources to the AR terminal through the session connection;
when determining that the AR terminal is allowed to use the AR resources, establishing media channel connection with the AR terminal;
and carrying out data transmission with the AR terminal through the media channel connection.
Optionally, establishing a session connection with the augmented reality AR terminal includes:
receiving a session connection establishment request sent by the AR terminal;
and feeding back a session connection establishment response message to the AR terminal according to the session connection establishment request, wherein the session connection establishment response message carries the information for agreeing to the establishment of the session connection and the session identification.
Optionally, allocating AR resources to the AR terminal through the session connection includes:
receiving a resource request message sent by the AR terminal;
and according to the resource request message, allocating AR resources for the AR terminal, and sending an allocation result to the AR terminal, wherein the allocation result comprises a session identifier, a resource identifier of the AR resources allocated for the AR terminal, a challenge word and a challenge algorithm.
Optionally, when determining that the AR terminal is allowed to use the AR resource, establishing a media channel connection with the AR terminal includes:
carrying out authentication and authentication on the AR terminal;
after the authentication passes, determining that the AR terminal is allowed to use the AR resources;
and when determining that the AR terminal is allowed to use the AR resources, establishing media channel connection with the AR terminal.
Optionally, performing authentication and verification on the AR terminal, including:
receiving an authentication request sent by the AR terminal, wherein the authentication request carries terminal information of the AR terminal and a first token, and the first token is obtained by the AR terminal through calculation according to a challenge word and a challenge algorithm sent by the AR resource platform and a secret key of the AR terminal;
calculating to obtain a second token according to the challenge word, the challenge algorithm and the key;
and if the second token is the same as the first token, feeding back an authentication passing response to the AR terminal.
Optionally, establishing a media channel connection with the AR terminal includes:
receiving a media channel connection request sent by the AR terminal;
according to the media channel connection request, initializing AR resources and establishing a port connected with the media channel, and feeding back an asynchronous event message to the AR terminal;
and after receiving the response message of the asynchronous event message sent by the AR terminal, establishing media channel connection with the AR terminal.
Optionally, the data transmission with the AR terminal through the media channel connection includes:
receiving data sent by the AR terminal through the media channel connection;
processing the data according to the asynchronous event message to obtain a processing result;
and feeding back the processing result to the AR terminal through the media channel connection.
The embodiment of the invention also provides an information interaction method, which is applied to an augmented reality AR terminal supporting a general interface, and comprises the following steps:
establishing session connection with an Augmented Reality (AR) resource platform through a general interface;
obtaining AR resources allocated to the AR terminal through the session connection;
when determining that the AR resources are allowed to be used, establishing media channel connection with the AR resource platform;
and carrying out data transmission with the AR resource platform through the media channel connection.
Optionally, establishing a session connection with the augmented reality AR resource platform includes:
sending a session connection establishment request to the AR resource platform;
and receiving a session connection establishment response fed back by the AR resource platform, wherein the session connection establishment response carries the information for agreeing to the establishment of the session connection and a session identifier.
Optionally, allocating AR resources to the AR terminal through the session connection includes:
sending a resource request message to the AR resource platform;
and receiving an allocation result obtained by the AR resource platform allocating AR resources to the AR terminal according to the resource request message, wherein the allocation result comprises a session identifier, a resource identifier of the AR resources allocated to the AR terminal, a challenge word and a challenge algorithm.
Optionally, when determining that the AR terminal is allowed to use the AR resource, establishing a media channel connection with the AR terminal includes:
performing authentication and authentication with the AR resource platform;
after the authentication passes, determining that the AR resources are allowed to be used;
and when determining that the AR resources are allowed to be used, establishing media channel connection with the AR resource platform.
Optionally, performing authentication interactively with the AR resource platform, including:
calculating to obtain a first token according to the challenge word and the challenge algorithm sent by the AR resource platform and the key of the AR terminal;
sending an authentication request to the AR resource platform, wherein the authentication request carries terminal information of the AR terminal and a first token;
and after the AR resource platform passes the authentication of the terminal information and the token, the fed-back authentication passing response is received.
Optionally, establishing a media channel connection with the AR resource platform includes:
sending a media channel connection request to the AR resource platform;
receiving an asynchronous event message fed back to the AR terminal after the AR resource platform initializes the AR resource and establishes a port connected with the media channel according to the media channel connection request;
and sending a response message of the asynchronous event message to the AR resource platform, and establishing media channel connection with the AR resource platform.
Optionally, the data transmission is performed through the media channel connection, including:
data sent to the AR resource platform through the media channel connection;
and receiving a processing result which is fed back by the AR resource platform to process the data according to the asynchronous event message.
The embodiment of the invention also provides an information interaction method, which comprises the following steps:
the AR resource platform establishes session connection with an augmented reality AR terminal supporting a universal interface through the universal interface;
the AR resource platform allocates AR resources for the AR terminal through the session connection;
the AR resource platform establishes media channel connection with the AR terminal when determining that the AR terminal is allowed to use the AR resources;
and the AR resource platform is connected with the AR terminal through the media channel and carries out data transmission.
The embodiment of the invention also provides an information interaction device, which is applied to an Augmented Reality (AR) resource platform, and the device comprises:
the receiving and sending module is used for establishing session connection with an augmented reality AR terminal supporting a universal interface through the universal interface;
the processing module is used for distributing AR resources for the AR terminal through the session connection;
the receiving and sending module is also used for establishing media channel connection with the AR terminal when the AR terminal is allowed to use the AR resources; and carrying out data transmission with the AR terminal through the media channel connection.
The embodiment of the invention also provides an augmented reality AR resource platform which comprises the information interaction device.
The embodiment of the invention also provides an information interaction device, which is applied to an augmented reality AR terminal supporting a universal interface, and comprises the following components:
the receiving and sending module is used for establishing session connection with the augmented reality AR resource platform through the universal interface;
the processing module is used for obtaining AR resources distributed to the AR terminal through the session connection;
the receiving and sending module is also used for establishing media channel connection with the AR resource platform when determining that the AR resource is allowed to be used; and carrying out data transmission with the AR resource platform through the media channel connection.
An embodiment of the present invention further provides an augmented reality AR terminal, including: the information interaction device is described above.
The embodiment of the present invention further provides an information interaction system, including: the AR resource platform;
the AR resource platform establishes session connection with the AR terminal supporting the universal interface through the universal interface;
the AR resource platform allocates AR resources for the AR terminal through the session connection;
the AR resource platform establishes media channel connection with the AR terminal when determining that the AR terminal is allowed to use the AR resource;
and the AR resource platform is connected with the AR terminal through the media channel and carries out data transmission.
An embodiment of the present invention further provides a processing device, including: a processor, a memory storing a computer program which, when executed by the processor, performs the method as described above.
Embodiments of the present invention also provide a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the method as described above.
The scheme of the invention at least comprises the following beneficial effects:
establishing session connection with an augmented reality AR terminal supporting a universal interface through the universal interface through an AR resource platform; allocating AR resources to the AR terminal through the session connection; when determining that the AR terminal is allowed to use the AR resources, establishing media channel connection with the AR terminal; and carrying out data transmission with the AR terminal through the media channel connection. The standard of the universal interface between the AR cloud resource platform and the AR terminal is unified, and the standard interface is provided for the AR terminal, so that the AR terminal can fully utilize the computing capability and data resources of the cloud resource platform, expand the AR application function and improve the performance of the AR terminal.
Drawings
Fig. 1 is a schematic flowchart of an information interaction method on an AR resource platform side according to an embodiment of the present invention;
fig. 2 is a schematic flow diagram of interaction between an AR terminal and an AR resource platform according to an embodiment of the present invention;
fig. 3 is another schematic flow chart of the interaction between the AR terminal and the AR resource platform according to the embodiment of the present invention;
FIG. 4 is a schematic block diagram of an information interaction apparatus on the AR resource platform side according to an embodiment of the present invention;
FIG. 5 is a block diagram of an embodiment of an AR resource platform;
fig. 6 is a schematic diagram of a specific implementation example of interaction between an AR terminal and an AR resource platform according to an embodiment of the present invention;
fig. 7 is a flowchart illustrating an information interaction method at an AR terminal according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
As shown in fig. 1, an embodiment of the present invention provides an information interaction method applied to an augmented reality AR resource platform, where the method includes:
and step 14, performing data transmission with the AR terminal through the media channel connection.
In the embodiment of the invention, the universal interface standard between the AR resource platform and the AR terminal is carried by a websocket communication mode, the data format conforms to the json specification, and the data is encrypted by a ssl (secure socket layer) certificate. Establishing session connection with an augmented reality AR terminal through an AR resource platform; allocating AR resources to the AR terminal through the session connection; when determining that the AR terminal is allowed to use the AR resources, establishing media channel connection with the AR terminal; and carrying out data transmission with the AR terminal through the media channel connection. The AR cloud resource platform and the AR terminal universal interface standard are unified and provided for the AR terminal in a standard interface mode, so that the AR terminal can fully utilize the computing capability and data resources of the cloud resource platform, the AR application function is expanded, and the AR terminal performance is improved.
In an alternative embodiment of the present invention, step 11 may include:
step 111, receiving a session connection establishment request sent by the AR terminal;
and 112, feeding back a session connection establishment response to the AR terminal according to the session connection establishment request, where the session connection establishment response carries information agreeing to session connection establishment and a session identifier.
As shown in fig. 2, when implemented specifically, the step 11 may include:
n1: after the AR terminal is powered on, a create request needs to be sent to the AR resource platform to establish a session. Wherein the parameter value "create" represents a request to establish a communication session, and the parameter "transaction" identifies a request and a response, which are randomly generated by the terminal;
n2: and the AR resource platform synchronously replies a response to the AR terminal. The parameter "result" identifies whether the AR resource platform agrees to establish a session with the AR terminal, for example, the value of "result" is success, which indicates agreement to establish a session with the AR terminal. The parameter "transaction" is consistent with the request parameter for the AR terminal to check. The parameter "data" carries the session ID, which is generated by the AR resource platform, and the ID needs to be added to all subsequent signaling of the session.
In an alternative embodiment of the present invention, step 12 may include:
step 121, receiving a resource request message sent by the AR terminal;
and step 122, according to the resource request message, allocating the AR resources to the AR terminal, and sending an allocation result to the AR terminal, where the allocation result includes the session identifier, the resource identifier of the AR resources allocated to the AR terminal, the challenge word, and the challenge algorithm.
As shown in fig. 2, when implemented specifically, the step 12 may include:
n3: after the session is established, the AR terminal needs to initiate a resource request message according to the service scenario. Where the parameter value "attach" represents a resource engine request and the parameter "resource" identifies which type of AR resource is requested. The parameter values are defined by "{ manufacturer } { type } { resource name } { version }", for example, cmcc. The request parameters need to carry the session ID fed back by the upper AR resource platform and a new transaction ID generated by the AR terminal.
N4: and the AR resource platform allocates the AR resources for the terminal and synchronously replies the allocation result to the AR terminal. The parameter "result" identifies whether the AR resource platform agrees to establish a session with the AR terminal, and when the response resource in the AR resource platform is insufficient, failure information is fed back to the AR terminal. The parameter "transaction" is consistent with the request parameter for the AR terminal to check. The parameter "session _ ID" carries the session ID. The parameter "ID" carries the resource ID newly generated by the AR resource platform, and is generated by the AR resource platform, and the resource ID needs to be added to all the request signaling for the resource of the subsequent session. The parameters "nonce" and "algorithm" carry the challenge word and the challenge algorithm for the AR terminal to operate token.
In an alternative embodiment of the present invention, step 13 may include:
step 131, performing authentication and authorization on the AR terminal;
step 132, after the authentication passes, determining that the AR terminal is allowed to use the AR resources;
step 133, establishing a media channel connection with the AR terminal when it is determined that the AR terminal is allowed to use the AR resource.
Optionally, performing authentication and verification on the AR terminal, including:
receiving an authentication request sent by the AR terminal, wherein the authentication request carries terminal information of the AR terminal and a first token, and the token is obtained by the AR terminal through calculation according to a challenge word and a challenge algorithm sent by the AR resource platform and a local secret key of the AR terminal;
calculating to obtain a second token according to the challenge word, the challenge algorithm and the key;
and if the second token is the same as the first token, feeding back an authentication passing response to the AR terminal.
As shown in fig. 2, when the authentication and authorization is specifically implemented, the step of performing the authentication and authorization on the AR terminal may include:
n5: the AR terminal calculates a token (token) by combining the local key according to the challenge word and the challenge algorithm, and sends the user name and the token as authentication request parameters to the AR resource platform. Wherein the value of the parameter "request" is "register".
N6: and the AR resource platform calculates the token through the same operation method, if the token calculated by the AR resource platform is consistent with the AR terminal, the AR terminal is considered to be effective, the applied resource is allowed to be used, and otherwise, the resource is released and the connection with the terminal is interrupted. When the AR terminal is allowed to use the resource, the AR resource platform informs the AR terminal through a synchronous response message carrying the 'registered' information.
N7: and after the AR terminal obtains the authentication passing response, the AR terminal starts to establish media connection with the AR resource platform. The AR terminal sends a 'join' request and request parameters thereof to the AR resource platform. Taking the face recognition resource as an example, the request parameters include width, height, frame rate fps, minimum code rate minbr, initial code rate initbr and maximum code rate maxbr.
In an optional embodiment of the present invention, in step 133, establishing a media channel connection for the AR terminal includes:
step 1331, receiving a media channel connection request sent by the AR terminal;
step 1332, according to the media channel connection request, performing AR resource initialization and port establishment of media channel connection, and feeding back an asynchronous event message to the AR terminal;
step 1333, after receiving the response message of the asynchronous event message sent by the AR terminal, establishing a media channel connection with the AR terminal.
As shown in fig. 3, when implemented specifically, step 133 may include:
n8: and the AR resource platform gives a synchronous response ack, and the identifier receives the request and performs resource initialization and media port establishment work.
N9: the AR resource platform completes the resource initialization and the media port establishment work and feeds back the asynchronous event message to the AR terminal. Wherein the value "event" of the parameter "oper" identifies the message as an asynchronous event. "resourcedata" carries notification content, including an event type "sdp" identified by the parameter "event" and its related parameters "type" and "sdp". The Sdp protocol is a session description protocol used for the AR resource platform and the AR terminal to establish a media session. Here the AR resource platform offer an sdp to the AR terminal.
N10: after receiving the sdp information from the AR resource platform, the AR terminal generates local response sdp information, and feeds the sdp information at the terminal side back to the AR resource platform through an 'accept' request. Sdp information is carried by the parameters "type" and "sdp".
N11: and the AR resource platform receives the sdp information of the terminal side and then processes the sdp information, so that the media channel connection between the AR resource platform and the AR terminal is established. And then, the AR terminal encodes and transmits the locally acquired video to the AR resource platform, and the related resources prepared by the AR resource platform are processed and identified.
N12: and after the AR resource platform identifies the face information, the identification result is sent to the AR terminal through the asynchronous event message. The recognition result is carried by the sub-element "data" of "resource data". The membership of the recognition result may differ depending on the AR engine. Taking the face recognition AR engine as an example, the recognition result includes the total width "of the image, the total height" of the image, one or more pieces of face information, and the like.
In an alternative embodiment of the present invention, step 14 may include:
step 141, receiving data sent by the AR terminal through the media channel connection;
step 142, processing the data according to the asynchronous event message to obtain a processing result;
and step 143, feeding back the processing result to the AR terminal through the media channel connection.
In this embodiment, the data sent by the AR terminal may be: audio stream data, video stream data, or data of other files or related information besides audio stream data, video stream data.
The following describes specific implementations of the above embodiments with reference to fig. 4, 5, and 6:
as shown in fig. 4, an embodiment of the present invention further provides an information interaction apparatus 40 applied to an augmented reality AR resource platform, where the apparatus 40 includes:
a transceiver module 41, configured to establish a session connection with an augmented reality AR terminal supporting a universal interface through the universal interface;
a processing module 42, configured to allocate AR resources to the AR terminal through the session connection;
the transceiver module 41 is further configured to establish a media channel connection with the AR terminal when determining that the AR terminal is allowed to use the AR resource; and carrying out data transmission with the AR terminal through the media channel connection.
Optionally, establishing a session connection with an augmented reality AR terminal supporting the universal interface through the universal interface includes:
receiving a session connection establishment request sent by the AR terminal;
and feeding back a session connection establishment response message to the AR terminal according to the session connection establishment request, wherein the session connection establishment response message carries information for agreeing to the establishment of the session connection and a session identifier.
Optionally, allocating AR resources for the AR terminal through the session connection includes:
receiving a resource request message sent by the AR terminal;
and distributing AR resources for the AR terminal according to the resource request message, and sending a distribution result to the AR terminal, wherein the distribution result comprises a session identifier, a resource identifier of the AR resources distributed for the AR terminal, a challenge word and a challenge algorithm.
Optionally, when determining that the AR terminal is allowed to use the AR resource, establishing a media channel connection with the AR terminal includes:
carrying out authentication certification on the AR terminal;
after the authentication passes, determining that the AR terminal is allowed to use the AR resources;
and when determining that the AR terminal is allowed to use the AR resources, establishing media channel connection with the AR terminal.
Optionally, performing authentication and verification on the AR terminal, including:
receiving an authentication request sent by the AR terminal, wherein the authentication request carries terminal information of the AR terminal and a first token, and the first token is obtained by the AR terminal through calculation according to a challenge word and a challenge algorithm sent by the AR resource platform and a secret key of the AR terminal;
calculating to obtain a second token according to the challenge word, the challenge algorithm and the key;
and if the second token is the same as the first token, feeding back an authentication passing response to the AR terminal.
Optionally, establishing a media channel connection with the AR terminal includes:
receiving a media channel connection request sent by the AR terminal;
according to the media channel connection request, initializing AR resources and establishing a port connected with the media channel, and feeding back an asynchronous event message to the AR terminal;
and after receiving the response message of the asynchronous event message sent by the AR terminal, establishing media channel connection with the AR terminal.
Optionally, the data transmission with the AR terminal through the media channel connection includes:
receiving data sent by the AR terminal through the media channel connection;
processing the data according to the asynchronous event message to obtain a processing result;
and feeding back the processing result to the AR terminal through the media channel connection.
As shown in fig. 5, an embodiment of the present invention further provides an augmented reality AR resource platform, including the information interaction apparatus as described above.
Specifically, the transceiver module may be implemented by at least one of a communication access module, a request distribution module, a voice bus, a video bus, and other data buses;
the processing module may include: the request is realized by at least one of a sub-terminal management authentication module, a resource management module, a voice processing engine, a video processing engine and other data processing engines;
the AR terminal communicates with the AR resource platform through the N interface; the modules in the AR resource platform can be realized through a P interface.
Wherein, the communication access module: it is responsible for providing an IP communication interface and two communication ports, namely a control signaling monitoring port and a media data communication port. The control signaling monitoring port is a fixed TCP port, the media data communication port is established by negotiation between the AR resource platform and the AR terminal session each time, and the media communication port needs to be closed and released after the session is finished. The port provided by the communication access module can work on IPv4 and IPv6, and can run in a Data Plane Development Kit (DPDK) mode in order to increase data throughput.
The request distribution module: and the terminal is responsible for receiving an AR terminal request from the communication access module and completing session _ id and transaction session management described in the communication protocol part. The message can be routed to a designated AR resource library according to a 'resource' request string carried by the AR terminal request.
The terminal authentication management module: and finishing the authentication management of the terminal, including storing account password information of the AR terminal, generating a work key challenge word for each communication, calculating the work key through a specified algorithm, and finishing a verification process.
A resource management module: and managing the AR resource libraries, determining the resource use condition of each resource library, and keeping the heartbeat with the resource libraries to determine the health state of the resource libraries. When the AR terminal requests a certain AR resource, the module determines whether the AR resource platform has the resource and whether the resource is idle. After the AR resource completes the processing of the media, the processing result is delivered to the resource management module to be issued to the AR terminal.
Voice bus: and the terminal is responsible for establishing a voice media channel with the AR terminal, receiving and decoding the voice from the AR terminal, and distributing the decoded PCM voice data to a required resource library for further processing. In addition, if the resource library needs to send the audio to the AR terminal, the audio is also transmitted through the audio bus.
A speech processing engine: a set of resource pools for processing speech, including but not limited to: a speech recognition engine (ASR), a text-to-speech engine (TTS), an outbound telephony engine, etc.
Video bus: and the terminal is responsible for establishing a video media channel with the AR terminal, receiving and decoding the video from the AR terminal, and distributing the decoded image data to a required resource library for further processing. In addition, if the resource library needs to send the video to the AR terminal, the video is also transmitted by the encoding through the video bus.
A video processing engine: a library of processing video images, including but not limited to: an image recognition (face, license plate, certificate, two-dimensional code, etc.) engine, an image tracking engine, a panoramic image processing engine, a 3D image processing engine, an image optimization engine, a visual computing algorithm engine, a spatial localization engine, etc.
Data bus: and the terminal is responsible for establishing a data channel with the AR terminal, receiving and decoding data from the AR terminal, and distributing the analyzed data information to a required resource library for further processing. In addition, if the resource library needs to send the data stream to the AR terminal, the data stream is also encoded and transmitted through the data bus. Data transmitted by the data bus is FBX, model data in an OBJ format, synchronous positioning and modeling (SLAM) data and the like.
Other data processing engines: a series of engines that process AR data and material, including but not limited to: digital twin engines, digital modeling engines, virtual content engines, etc., where others may include any data other than audio, video.
As shown in fig. 6, one achievable flow includes:
p1: after receiving the attach request of the AR terminal, the communication access module forwards the attach request to the request distribution module.
P2: the request distribution module forwards the attach request to the resource management module.
P3: the resource management module confirms resources to the resource library, and the resource library reserves corresponding resources.
P4: and the resource base feeds back the resource reservation condition to the resource management module.
P5, P6: and the resource management module informs the result to the AR terminal through the request distribution module and the communication access module.
P7, P8: the AR terminal initiates an authentication request to be routed to the terminal authentication management module.
P9, P10: and the terminal authentication management module authenticates the authority of the AR terminal for using the resource and feeds back the authority to the AR terminal after the authority passes.
P11, P12, P13: the AR terminal initiates a media channel connection establishment request, the request distribution module sends the request to the video bus, and the video bus establishes a media port and feeds the media port back to the request distribution module.
P14, P15: the request distribution module initiates a request for initializing the AR resources to the video bus, and the video bus creates an AR resource instance through the AR resource library.
P16, P17: the AR resource platform feeds back the media port information to the AR terminal, and the AR terminal also feeds back the media port information to the AR resource platform through the accept request.
P18: media port information fed back by the AR terminal is routed to the video bus through the request distribution module, and the video bus and the AR terminal establish a unidirectional uplink video stream.
P19: and the AR terminal compresses and encodes the video stream and then sends the video stream to the media port of the video bus, and the video bus decodes and forwards the video stream to the AR resource library.
P20, P21, P22: after the face recognition engine of the AR resource library recognizes the face, the face data are fed back to the AR terminal through the resource management, request distribution module and the communication access module, and the face data are locally synthesized by the AR terminal and displayed for a user.
The embodiment of the invention provides a set of universal protocol and an implementation mode of the AR resource platform, can be used for operators to establish the AR resource platform as a reference, is favorable for integrating abundant network, data and technical resources of the operators, and provides standardized and easily accessed service for a plurality of AR terminal manufacturers. The technical threshold of AR terminal manufacturers is reduced, service innovation of AR industry can be effectively facilitated, and AR service development cycle can be reduced.
As shown in fig. 7, an embodiment of the present invention further provides an information interaction method, which is applied to an augmented reality AR terminal supporting a universal interface, where the method includes:
and step 74, performing data transmission with the AR resource platform through the media channel connection.
Optionally, establishing a session connection with the AR resource platform includes:
sending a session connection establishment request to the AR resource platform;
and receiving a session connection establishment response fed back by the AR resource platform, wherein the session connection establishment response carries the information for agreeing to the establishment of the session connection and a session identifier.
Optionally, allocating AR resources to the AR terminal through the session connection includes:
sending a resource request message to the AR resource platform;
and receiving an allocation result obtained by the AR resource platform allocating the AR resources to the AR terminal according to the resource request message, wherein the allocation result comprises a session identifier, a resource identifier of the AR resources allocated to the AR terminal, a challenge word and a challenge algorithm.
Optionally, when determining that the AR terminal is allowed to use the AR resource, establishing a media channel connection with the AR terminal includes:
performing authentication and certification with the AR resource platform in an interactive manner;
after the authentication passes, determining that the AR resources are allowed to be used;
and when determining that the AR resources are allowed to be used, establishing media channel connection with the AR resource platform.
Optionally, performing authentication with the AR resource platform interactively, includes:
calculating to obtain a first token according to the challenge word and the challenge algorithm sent by the AR resource platform and the key of the AR terminal;
sending an authentication request to the AR resource platform, wherein the authentication request carries terminal information of the AR terminal and a first token;
and after the AR resource platform passes the authentication of the terminal information and the token, the fed-back authentication passing response is received.
Optionally, establishing a media channel connection with the AR resource platform includes:
sending a media channel connection request to the AR resource platform;
receiving an asynchronous event message fed back to the AR terminal after the AR resource platform initializes the AR resource and establishes a port connected with the media channel according to the media channel connection request;
and sending a response message of the asynchronous event message to the AR resource platform, and establishing media channel connection with the AR resource platform.
Optionally, the data transmission is performed through the media channel connection, including:
data sent to the AR resource platform through the media channel connection;
and receiving a processing result which is fed back by the AR resource platform to process the data according to the asynchronous event message.
It should be noted that the apparatus is an AR terminal side method corresponding to the AR resource platform side method shown in fig. 1, and all the implementation manners in the above method embodiment are applicable to the AR terminal side method, and the same technical effects can be achieved.
The embodiment of the invention also provides an information interaction device, which is applied to an Augmented Reality (AR) terminal, and the device comprises:
the receiving and sending module is used for establishing session connection with the augmented reality AR resource platform through the universal interface;
the processing module is used for obtaining AR resources distributed to the AR terminal through the session connection;
the receiving and sending module is also used for establishing media channel connection with the AR resource platform when determining that the AR resource is allowed to be used; and carrying out data transmission with the AR resource platform through the media channel connection.
Optionally, establishing a session connection with the AR resource platform includes:
sending a session connection establishment request to the AR resource platform;
and receiving a session connection establishment response fed back by the AR resource platform, wherein the session connection establishment response carries the information agreeing to the establishment of the session connection and a session identifier.
Optionally, allocating AR resources to the AR terminal through the session connection includes:
sending a resource request message to the AR resource platform;
and receiving an allocation result obtained by the AR resource platform allocating the AR resources to the AR terminal according to the resource request message, wherein the allocation result comprises a session identifier, a resource identifier of the AR resources allocated to the AR terminal, a challenge word and a challenge algorithm.
Optionally, when determining that the AR terminal is allowed to use the AR resource, establishing a media channel connection with the AR terminal includes:
performing authentication and certification with the AR resource platform in an interactive manner;
after the authentication passes, determining that the AR resources are allowed to be used;
and when determining that the AR resources are allowed to be used, establishing media channel connection with the AR resource platform.
Optionally, performing authentication with the AR resource platform interactively, includes:
calculating to obtain a first token according to the challenge word and the challenge algorithm sent by the AR resource platform and the key of the AR terminal;
sending an authentication request to the AR resource platform, wherein the authentication request carries terminal information of an AR terminal and a first token;
and after the AR resource platform passes the authentication of the terminal information and the token, the fed-back authentication passing response is received.
Optionally, establishing a media channel connection with the AR resource platform includes:
sending a media channel connection request to the AR resource platform;
receiving an asynchronous event message fed back to the AR terminal after the AR resource platform initializes the AR resource and establishes a port connected with the media channel according to the media channel connection request;
and sending a response message of the asynchronous event message to the AR resource platform, and establishing media channel connection with the AR resource platform.
Optionally, the data transmission is performed through the media channel connection, including:
data sent to the AR resource platform through the media channel connection;
and receiving a processing result which is fed back by the AR resource platform to process the data according to the asynchronous event message.
It should be noted that the apparatus is an apparatus corresponding to the method shown in fig. 7, and all the implementations in the above method embodiment are applicable to the embodiment of the apparatus, and the same technical effects can be achieved.
An embodiment of the present invention further provides an augmented reality AR terminal, including: the information interaction device is described above.
The embodiment of the invention also provides an information interaction method, which comprises the following steps:
the AR resource platform establishes session connection with an augmented reality AR terminal supporting a universal interface through the universal interface;
the AR resource platform allocates AR resources for the AR terminal through the session connection;
the AR resource platform establishes media channel connection with the AR terminal when determining that the AR terminal is allowed to use the AR resources;
and the AR resource platform is connected with the AR terminal through the media channel and carries out data transmission.
All the implementation manners in the above method embodiment are applicable to this embodiment, and the same technical effect can be achieved.
The embodiment of the present invention further provides an information interaction system, including: the AR resource platform;
the AR resource platform interacts with an augmented reality AR terminal and establishes session connection with the AR terminal;
the AR resource platform is connected with the AR terminal through the session, interacts with the AR terminal and distributes AR resources for the AR terminal;
the AR resource platform establishes media channel connection with the AR terminal when determining that the AR terminal is allowed to use the AR resources;
and the AR resource platform is connected with the AR terminal through the media channel and carries out data transmission.
It should be noted that all the implementation manners of the AR terminal and the AR resource platform are applicable to the embodiment of the system, and the same technical effect can be achieved.
An embodiment of the present invention further provides a processing device, including: a processor, a memory storing a computer program which, when executed by the processor, performs the method as described above. All the implementation manners in the above method embodiment are applicable to this embodiment, and the same technical effect can be achieved.
Embodiments of the present invention also provide a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the method as described above. All the implementation manners in the above method embodiment are applicable to this embodiment, and the same technical effect can be achieved.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the technical solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It can be clearly understood by those skilled in the art that, for convenience and simplicity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
Furthermore, it is to be noted that in the device and method of the invention, it is obvious that the individual components or steps can be decomposed and/or recombined. These decompositions and/or recombinations are to be regarded as equivalents of the present invention. Also, the steps of performing the series of processes described above may naturally be performed chronologically in the order described, but need not necessarily be performed chronologically, and some steps may be performed in parallel or independently of each other. It will be understood by those skilled in the art that all or any of the steps or elements of the method and apparatus of the present invention may be implemented in any computing device (including processors, storage media, etc.) or network of computing devices, in hardware, firmware, software, or any combination thereof, which can be implemented by those skilled in the art using their basic programming skills after reading the description of the present invention.
The object of the invention is thus also achieved by a program or a set of programs running on any computing device. The computing device may be a general purpose device as is well known. The object of the invention is thus also achieved solely by providing a program product comprising program code for implementing the method or the apparatus. That is, such a program product also constitutes the present invention, and a storage medium storing such a program product also constitutes the present invention. It is to be understood that the storage medium may be any known storage medium or any storage medium developed in the future. It is further noted that in the apparatus and method of the present invention, it is apparent that each component or step can be decomposed and/or recombined. These decompositions and/or recombinations are to be considered as equivalents of the present invention. Also, the steps of executing the series of processes described above may naturally be executed chronologically in the order described, but need not necessarily be executed chronologically. Some steps may be performed in parallel or independently of each other.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (22)
1. An information interaction method is applied to an Augmented Reality (AR) resource platform, and comprises the following steps:
establishing session connection with an augmented reality AR terminal supporting a universal interface through the universal interface;
allocating AR resources to the AR terminal through the session connection;
when determining that the AR terminal is allowed to use the AR resources, establishing media channel connection with the AR terminal;
and carrying out data transmission with the AR terminal through the media channel connection.
2. The information interaction method according to claim 1, wherein establishing a session connection with an Augmented Reality (AR) terminal comprises:
receiving a session connection establishment request sent by the AR terminal;
and feeding back a session connection establishment response message to the AR terminal according to the session connection establishment request, wherein the session connection establishment response message carries the information for agreeing to the establishment of the session connection and the session identification.
3. The information interaction method of claim 1, wherein allocating AR resources for the AR terminal through the session connection comprises:
receiving a resource request message sent by the AR terminal;
and according to the resource request message, allocating AR resources for the AR terminal, and sending an allocation result to the AR terminal, wherein the allocation result comprises a session identifier, a resource identifier of the AR resources allocated for the AR terminal, a challenge word and a challenge algorithm.
4. The information interaction method of claim 1, wherein when determining that the AR terminal is allowed to use the AR resource, establishing a media channel connection with the AR terminal comprises:
carrying out authentication and authentication on the AR terminal;
after the authentication passes, determining that the AR terminal is allowed to use the AR resources;
and when determining that the AR terminal is allowed to use the AR resources, establishing media channel connection with the AR terminal.
5. The information interaction method of claim 4, wherein authenticating the AR terminal comprises:
receiving an authentication request sent by the AR terminal, wherein the authentication request carries terminal information of the AR terminal and a first token, and the first token is obtained by the AR terminal through calculation according to a challenge word and a challenge algorithm sent by the AR resource platform and a secret key of the AR terminal;
calculating to obtain a second token according to the challenge word, the challenge algorithm and the key;
and if the second token is the same as the first token, feeding back an authentication passing response to the AR terminal.
6. The information interaction method of claim 5, wherein establishing a media channel connection with the AR terminal comprises:
receiving a media channel connection request sent by the AR terminal;
according to the media channel connection request, initializing AR resources and establishing a port connected with the media channel, and feeding back an asynchronous event message to the AR terminal;
and after receiving the response message of the asynchronous event message sent by the AR terminal, establishing media channel connection with the AR terminal.
7. The information interaction method of claim 6, wherein the data transmission with the AR terminal through the media channel connection comprises:
receiving data sent by the AR terminal through the media channel connection;
processing the data according to the asynchronous event message to obtain a processing result;
and feeding back the processing result to the AR terminal through the media channel connection.
8. An information interaction method is applied to an Augmented Reality (AR) terminal supporting a universal interface, and comprises the following steps:
establishing session connection with an Augmented Reality (AR) resource platform through a general interface;
obtaining AR resources allocated to the AR terminal through the session connection;
when determining that the AR resources are allowed to be used, establishing media channel connection with the AR resource platform;
and carrying out data transmission with the AR resource platform through the media channel connection.
9. The information interaction method according to claim 8, wherein establishing a session connection with an Augmented Reality (AR) resource platform comprises:
sending a session connection establishment request to the AR resource platform;
and receiving a session connection establishment response fed back by the AR resource platform, wherein the session connection establishment response carries the information for agreeing to the establishment of the session connection and a session identifier.
10. The information interaction method of claim 8, wherein allocating AR resources for the AR terminal through the session connection comprises:
sending a resource request message to the AR resource platform;
and receiving an allocation result obtained by the AR resource platform allocating AR resources to the AR terminal according to the resource request message, wherein the allocation result comprises a session identifier, a resource identifier of the AR resources allocated to the AR terminal, a challenge word and a challenge algorithm.
11. The information interaction method of claim 8, wherein when determining that the AR terminal is allowed to use the AR resource, establishing a media channel connection with the AR terminal comprises:
performing authentication and authentication with the AR resource platform;
after the authentication passes, determining that the AR resources are allowed to be used;
and when determining that the AR resources are allowed to be used, establishing media channel connection with the AR resource platform.
12. The information interaction method of claim 11, wherein interacting with the AR resource platform to perform authentication comprises:
calculating to obtain a first token according to the challenge word and the challenge algorithm sent by the AR resource platform and the key of the AR terminal;
sending an authentication request to the AR resource platform, wherein the authentication request carries terminal information of the AR terminal and a first token;
and after the AR resource platform passes the authentication of the terminal information and the token, the fed-back authentication passing response is received.
13. The information interaction method of claim 8, wherein establishing a media channel connection with the AR resource platform comprises:
sending a media channel connection request to the AR resource platform;
receiving an asynchronous event message fed back to the AR terminal after the AR resource platform initializes the AR resource and establishes a port connected with the media channel according to the media channel connection request;
and sending a response message of the asynchronous event message to the AR resource platform, and establishing media channel connection with the AR resource platform.
14. The information interaction method of claim 13, wherein the data transmission via the media channel connection comprises:
data sent to the AR resource platform through the media channel connection;
and receiving a processing result which is fed back by the AR resource platform to process the data according to the asynchronous event message.
15. An information interaction method, comprising:
the AR resource platform establishes session connection with an augmented reality AR terminal supporting a universal interface through the universal interface;
the AR resource platform allocates AR resources for the AR terminal through the session connection;
the AR resource platform establishes media channel connection with the AR terminal when determining that the AR terminal is allowed to use the AR resources;
and the AR resource platform is connected with the AR terminal through the media channel and carries out data transmission.
16. An information interaction device, applied to an Augmented Reality (AR) resource platform, the device comprising:
the receiving and sending module is used for establishing session connection with an augmented reality AR terminal supporting a universal interface through the universal interface;
the processing module is used for distributing AR resources for the AR terminal through the session connection;
the receiving and sending module is also used for establishing media channel connection with the AR terminal when the AR terminal is allowed to use the AR resources; and carrying out data transmission with the AR terminal through the media channel connection.
17. An Augmented Reality (AR) resource platform comprising the information interaction device of claim 16.
18. An information interaction device, which is applied to an Augmented Reality (AR) terminal supporting a universal interface, the device comprising:
the receiving and sending module is used for establishing session connection with the AR resource platform through the universal interface;
the processing module is used for obtaining AR resources distributed to the AR terminal through the session connection;
the receiving and sending module is also used for establishing media channel connection with the AR resource platform when determining that the AR resource is allowed to be used; and carrying out data transmission with the AR resource platform through the media channel connection.
19. An Augmented Reality (AR) terminal, comprising: the information interaction device of claim 18.
20. An information interaction system, comprising: the AR resource platform;
the AR resource platform establishes session connection with the AR terminal supporting the universal interface through the universal interface;
the AR resource platform allocates AR resources for the AR terminal through the session connection;
the AR resource platform establishes media channel connection with the AR terminal when determining that the AR terminal is allowed to use the AR resources;
and the AR resource platform is connected with the AR terminal through the media channel and carries out data transmission.
21. A processing device, comprising: a processor, a memory storing a computer program which, when executed by the processor, performs the method of any of claims 1 to 7 or the method of any of claims 8 to 14 or the method of claim 15.
22. A computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the method of any of claims 1 to 7 or the method of any of claims 8 to 14 or the method of claim 15.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110521431.2A CN115426335B (en) | 2021-05-13 | 2021-05-13 | Information interaction method, device, equipment and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110521431.2A CN115426335B (en) | 2021-05-13 | 2021-05-13 | Information interaction method, device, equipment and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115426335A true CN115426335A (en) | 2022-12-02 |
| CN115426335B CN115426335B (en) | 2023-10-27 |
Family
ID=84195469
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110521431.2A Active CN115426335B (en) | 2021-05-13 | 2021-05-13 | Information interaction method, device, equipment and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115426335B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1809037A (en) * | 2005-01-19 | 2006-07-26 | 华为技术有限公司 | Method of implementing end-to-end information interaction |
| CN101273607A (en) * | 2005-08-26 | 2008-09-24 | 松下电器产业株式会社 | Establishment of media sessions with media adaptation |
| CN102082960A (en) * | 2010-10-29 | 2011-06-01 | 广东星海数字家庭产业技术研究院有限公司 | Interactive value added business platform system and method for digital television |
| CN102136933A (en) * | 2010-09-30 | 2011-07-27 | 华为技术有限公司 | Equipment management method, middleware and machine communication platform, equipment and system |
| CN105809591A (en) * | 2015-02-26 | 2016-07-27 | 上海三泽信息技术有限公司 | Method for realizing computer-aided teaching via virtual reality and software research and development technologies |
| US20200259763A1 (en) * | 2020-04-27 | 2020-08-13 | Intel Corporation | Intelligent resource selection for received content |
| CN112214338A (en) * | 2020-11-05 | 2021-01-12 | 北京科东电力控制系统有限责任公司 | Internet of things cloud platform based on flexible deployment of micro-services |
-
2021
- 2021-05-13 CN CN202110521431.2A patent/CN115426335B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1809037A (en) * | 2005-01-19 | 2006-07-26 | 华为技术有限公司 | Method of implementing end-to-end information interaction |
| CN101273607A (en) * | 2005-08-26 | 2008-09-24 | 松下电器产业株式会社 | Establishment of media sessions with media adaptation |
| CN102136933A (en) * | 2010-09-30 | 2011-07-27 | 华为技术有限公司 | Equipment management method, middleware and machine communication platform, equipment and system |
| CN102082960A (en) * | 2010-10-29 | 2011-06-01 | 广东星海数字家庭产业技术研究院有限公司 | Interactive value added business platform system and method for digital television |
| CN105809591A (en) * | 2015-02-26 | 2016-07-27 | 上海三泽信息技术有限公司 | Method for realizing computer-aided teaching via virtual reality and software research and development technologies |
| US20200259763A1 (en) * | 2020-04-27 | 2020-08-13 | Intel Corporation | Intelligent resource selection for received content |
| CN112214338A (en) * | 2020-11-05 | 2021-01-12 | 北京科东电力控制系统有限责任公司 | Internet of things cloud platform based on flexible deployment of micro-services |
Non-Patent Citations (1)
| Title |
|---|
| 李腾飞: ""增强现实虚实交互技术的研究与实现"", 《中国优秀硕士学位论文全文数据库 (基础科学辑)》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115426335B (en) | 2023-10-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10924783B2 (en) | Video coding method, system and server | |
| CN108449633B (en) | Set top box cloud system based on NFV and service implementation method | |
| US10194180B2 (en) | Systems and methods for transmitting video data over a network | |
| CN109309866B (en) | Image processing method and device, and storage medium | |
| CN113079175A (en) | Authorization system and method based on oauth2 protocol enhancement | |
| RU99125838A (en) | DEVICE AND METHOD FOR INDIVIDUALIZING CHIP CARD | |
| CN109587142B (en) | Data security access module and equipment for service flow | |
| WO2015172477A1 (en) | Method and system for multimedia sharing between cloud terminal and mobile terminal, and cloud terminal | |
| CN113489805B (en) | Butt joint method, device, equipment and storage medium of cloud desktop system | |
| KR20130026609A (en) | Apparatus and method for providing multimedia cloud service associated with social network service in multimedia cloud system | |
| WO2016155495A1 (en) | Data exchange method, apparatus and device | |
| CN104079624A (en) | Message access layer framework based on service and implementing method thereof | |
| CN110798651A (en) | Video conference method, device, equipment and storage medium | |
| CN113691516A (en) | Streaming media data transmission method and device, electronic equipment and storage medium | |
| CN112511892B (en) | Screen sharing method, device, server and storage medium | |
| CN116521634B (en) | Method, system, electronic equipment and storage medium for processing call ticket data service | |
| CN103220347A (en) | CRP (compression reflection protocol) cloud interaction method | |
| CN115134638A (en) | Video stream processing method and device based on cloud service | |
| CN115426335B (en) | Information interaction method, device, equipment and system | |
| CN109450887B (en) | Data transmission method, device and system | |
| CN107770219A (en) | A kind of sharing method, gateway server and the system of form window | |
| US10231004B2 (en) | Network recording service | |
| US9071596B2 (en) | Securely establishing a communication channel between a switch and a network-based application using a unique identifier for the network-based application | |
| CN114389868A (en) | Method, system and device for distributing cloud resources and storage medium | |
| WO2014015795A1 (en) | Method and device for providing communication connection for multiple candidate applications in mobile device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |