WO2013029390A1

WO2013029390A1 - Augmented reality information transmission method and mobile augmented reality server

Info

Publication number: WO2013029390A1
Application number: PCT/CN2012/075305
Authority: WO
Inventors: 黄成�
Original assignee: 中兴通讯股份有限公司
Priority date: 2011-08-26
Filing date: 2012-05-10
Publication date: 2013-03-07
Also published as: CN102958009A; CN102958009B

Abstract

The present invention provides an augmented reality information transmission method and a mobile augmented reality server. The method comprises: a mobile augmented reality server receiving a subscription request or unsubscription request from a mobile augmented reality client and about a notification of an augmented reality content and/or an augmented reality target (S102); the mobile augmented reality server managing a push configuration of the augmented reality content and/or the augmented reality target, designated by a user, in the request (S104); and the mobile augmented reality server initiating a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the push configuration (S106). The present invention enables an augmented reality terminal to in time obtain augmented reality information about which the augmented reality terminal is concerned.

Description

TECHNICAL FIELD The present invention relates to the field of communications, and in particular to a method for transmitting augmented reality information and a mobile augmented reality server. BACKGROUND With the maturity and development of smart terminals and mobile internet technologies, Augmented Reality (AR) technology, which was once limited to the laboratory, has begun to enter the public's field of vision, and a large number of images based on image recognition and terminal positioning technologies are based. Internet/mobile Internet AR applications are beginning to emerge, called Mobile Augmented Reality (Mobile AR) applications, which have attracted much attention from the industry and become a hot research topic. The research and application of mobile augmented reality technology, the application of virtual augmented reality information to the real world, changing the way users observe the surrounding world. The traditional text-based WEB page browsing query mode is changed to camera-based shooting, capturing hotspots. And browse the new mode of enhanced information in real time.

Mobile AR users can use the mobile terminal (such as: smart phone) to get the augmented reality service experience while shooting the surrounding scenes: The augmented reality application (AR Application) running on the terminal captures the augmented reality target deployed by the AR service provider based on the user's current location. (AR Target), for example, related to geographic location-related points of interest (POI), and based on user selection to obtain augmented reality content (AR Content), including: text, pictures, voice, video, and ultimately combined with user terminal geographic fingerprint information (such as: latitude and longitude , orientation, etc.), the acquired augmented reality content and the surrounding real-time shooting of the terminal camera are displayed on the screen to obtain an unusual augmented reality service experience. The augmented reality target search and the augmented reality content acquisition process in the traditional augmented reality implementation scheme are generally initiated by the system according to the request of the augmented reality user terminal, and may be referred to as a PULL mode or a single request-response mode. The business trigger mode realizes a single, instant association between real physical world information (user location, shooting real scene, etc.) and virtual augmented reality content (text, audio and video), which can meet the needs of most application scenarios. However, in the actual application of augmented reality services, some users tend to pay close attention to the augmented reality targets and their enhanced content deployed nearby (and the user's location is constantly changing). If the traditional PULL mode is used to provide such services, the user must have multiple times. Repeatedly sending requests (searching for augmented reality targets based on the latest location) is not only cumbersome but also causes repeated downloads of the same information. On the other hand, if the user’s focus on the augmented reality goal is Mobility (such as people or vehicles) or corresponding enhancements change. In traditional mode, even if they are very close, if the user does not realize it and does not initiate the request, the system will not provide any prompts, so the relevant information may be missed. . SUMMARY OF THE INVENTION The present invention is directed to a method for transmitting augmented reality information and a mobile augmented reality server to solve the problem in the prior art that the augmented reality information of the user's attention cannot be obtained in time. According to an aspect of the present invention, a method for transmitting augmented reality information is provided, including: a mobile augmented reality server receiving a subscription request or an unsubscribing request for an augmented reality content and/or an augmented reality target notification from a mobile augmented reality client; The mobile augmented reality server manages the push settings of the augmented reality content and/or the augmented reality target specified by the user in the request; the mobile augmented reality server initiates a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the push setting. Preferably, the step of moving the augmented reality content and/or the push setting of the augmented reality target specified by the user in the mobile augmented reality server management request comprises: the mobile augmented reality server creating or updating the user-specified augmented reality content according to the received subscription request and/or Push settings of the augmented reality target; or, the mobile augmented reality server deletes the push settings of the user-specified augmented reality content and/or the augmented reality target according to the received unsubscribe request or after the subscription expires. Preferably, the push setting of the augmented reality content and/or the augmented reality target comprises at least one of: augmented reality content and/or a trigger condition of the augmented reality target push; and a filtering criterion of the augmented reality content and/or the augmented reality target push . Preferably, the triggering condition of the augmented reality content and/or the augmented reality target push comprises at least one of: augmented reality content and/or a push interval of the augmented reality target; an augmented reality user context; a deployed state of the augmented reality target. Preferably, the push interval comprises: daily or weekly. Preferably, the augmented reality user context comprises: a user location or a user presentation state. Preferably, the deployment state of the augmented reality target comprises: a distance between the augmented reality target and the augmented reality user, or an augmented reality content change related to the augmented reality target. Preferably, the filtering criteria of the augmented reality content and/or the augmented reality target push comprises at least one of: augmented reality user preferences; augmented reality target attributes. Preferably, the augmented reality target attribute comprises at least one of the following: a category of the augmented reality target, a type of the augmented reality target, and a feature of the augmented reality target. Preferably, the step of the mobile augmented reality server initiating the push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the push setting comprises: the mobile augmented reality server determining whether the trigger condition in the push setting is satisfied; if satisfied, The mobile augmented reality server then initiates a push request for the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the filtering criteria in the push settings. Preferably, the step of determining, by the mobile augmented reality server, whether the trigger condition in the push setting is met comprises: moving the augmented reality server to determine whether the push interval in the trigger condition is reached, and if yes, determining that the trigger condition is met; or moving the augmented reality server Obtaining an augmented reality user context in the trigger condition, and determining whether the user location in the augmented reality user context is located in the specified area, or determining whether the user presence status in the augmented reality user context allows to receive the push information, if the user location is in the designated area or the user The presentation state allows to receive the push information, and then determines that the trigger condition is met; or, the mobile augmented reality server acquires the deployment state of the augmented reality target in the trigger condition, and determines whether the distance between the augmented reality target and the augmented reality user reaches a predetermined threshold, or It is judged whether the augmented reality content related to the augmented reality target changes, and if the distance reaches a predetermined threshold or the augmented reality content changes, it is judged that the trigger condition is satisfied. Preferably, the step of the mobile augmented reality server initiating a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the filtering criterion in the push setting comprises: the mobile augmented reality server requesting and acquiring the augmented reality content according to the filtering criterion And/or an augmented reality target; the mobile augmented reality server transmits the acquired augmented reality content and/or augmented reality target to the mobile augmented reality client through the underlying push mechanism. Preferably, the push setting of the augmented reality content and/or the augmented reality target comprises at least one of the following augmented reality content and/or augmented reality target push criteria: augmented reality target category; user location information; augmented reality business condition; augmented reality Content and/or augmented reality target filtering criteria. Preferably, the augmented reality service condition comprises at least one of the following: a timer or a service event. Preferably, the augmented reality content and/or the augmented reality target filtering criteria comprise at least one of: an augmented reality user preference or an augmented reality target attribute. According to another aspect of the present invention, a mobile augmented reality server is provided comprising: an augmented reality content target subscription management function entity configured to receive a subscription request for augmented reality content and/or augmented reality target notification from a mobile augmented reality client Or cancel the subscription request; manage the push settings of the augmented reality content and/or the augmented reality target specified by the user in the request; initiate a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the push setting. Preferably, the augmented reality content target subscription management function entity comprises: a first unit, configured to receive a subscription request or an unsubscribe request for the augmented reality content and/or the augmented reality target notification from the mobile augmented reality client; A push setting for managing augmented reality content and/or an augmented reality target specified by the user in the request; a third unit, configured to initiate a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the push setting. Preferably, the second unit comprises: a first processing module, configured to create or update a push setting of the augmented reality content and/or the augmented reality target specified by the user according to the received subscription request; or, the second processing module is configured to receive Unsubscribe requests or remove push settings for user-specified augmented reality content and/or augmented reality targets after the subscription expires. Preferably, the third unit comprises: a determining module, configured to determine whether the trigger condition in the push setting is met; the initiating module, configured to initiate the augmented reality content to the mobile augmented reality client according to the filtering criterion in the push setting when the trigger condition is met And/or push requests for augmented reality targets. Preferably, the determining module is configured to determine whether the trigger condition in the push setting is satisfied by: determining whether the push interval in the trigger condition is reached, and if yes, determining that the trigger condition is met; or acquiring the augmented reality user in the trigger condition Context, and determining whether the user location in the context of the augmented reality user is located in the designated area, or determining whether the user presence status in the context of the augmented reality user is allowed to receive the push information, and if the user location is in the designated area or the user presentation state allows to receive the push information, Determining that the trigger condition is met; or obtaining a deployment state of the augmented reality target in the trigger condition, and determining whether the distance between the augmented reality target and the augmented reality user reaches a predetermined threshold, or determining whether the augmented reality content related to the augmented reality target occurs The change, if the distance reaches a predetermined threshold or the augmented reality content changes, it is judged that the trigger condition is satisfied. Preferably, the initiating module is configured to initiate a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client by: requesting and acquiring the augmented reality content and/or the augmented reality target according to the filtering criterion; Augmented reality content and/or augmented reality targets are sent to the mobile augmented reality client via the underlying push mechanism. In the present invention, the transmission of the augmented reality information is implemented by the subscription push mechanism, and the following technical problems are solved: 1) when the augmented reality target/content is searched based on the request-response mode of the mobile augmented reality terminal (mobile augmented reality client), The request must be repeated multiple times, resulting in cumbersome user operations, low execution efficiency, and augmented reality information downloading; 2) when augmented reality target/content is searched based on the mobile augmented reality client request-response method, The lack of an active request to send a prompt, resulting in the inability to timely obtain the augmented reality information of the user's attention. Continuously gaining nearby enhanced information through a subscription-push mechanism, improving business execution Rate, even if the augmented reality target moves, or the augmented reality content changes, the mobile augmented reality client can obtain the augmented reality information of interest in time. BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are set to illustrate,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, In the drawings: FIG. 1 is a preferred flowchart of a method for transmitting augmented reality information according to an embodiment of the present invention; FIG. 2 is a preferred structural diagram of a mobile augmented reality server according to an embodiment of the present invention; A preferred schematic diagram of an augmented reality implementation system according to an embodiment of the present invention; FIG. 4 is another preferred flowchart of a method for transmitting augmented reality information according to an embodiment of the present invention; FIG. 5 is an augmented reality according to an embodiment of the present invention. Still another preferred flow chart of the method of transmitting information; FIG. 6 is still another preferred flow chart of a method of transmitting augmented reality information according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict. Embodiment 1 FIG. 1 is a preferred flowchart of a method for transmitting augmented reality information according to an embodiment of the present invention, which includes the following steps:

S102. The mobile augmented reality server receives a subscription request or a cancellation request for the augmented reality content and/or the augmented reality target notification from the mobile augmented reality client. Preferably, the subscription request is used to subscribe to the augmented reality content that is available and/or Or a notification of an augmented reality target, the above unsubscribing request for unsubscribing to notifications about augmentable reality content and/or augmented reality goals that are available;

S104. Push settings of the augmented reality content and/or the augmented reality target specified by the user in the mobile augmented reality server management request; S106. The mobile augmented reality server initiates a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the push setting. In the above preferred embodiment, the transmission of the augmented reality information is implemented by the subscription push mechanism, and the following technical problems are solved: 1) searching for the augmented reality target/content based on the mobile augmented reality terminal (mobile augmented reality client) request-response method When there is a need to repeatedly send a request, the user operation is cumbersome, the execution efficiency is not high, and the augmented reality information is repeatedly downloaded. 2) Searching for the augmented reality target/content based on the mobile augmented reality client request-response method At the time, there is a lack of an active request to send a prompt, resulting in the inability to timely acquire the augmented reality information of the user's attention. Through the subscription-push mechanism to continuously obtain nearby enhanced information, the efficiency of business execution is improved, and even if the augmented reality target moves or the augmented reality content changes, the mobile augmented reality client can timely acquire the augmented reality information of interest. According to the foregoing embodiment, in order to facilitate response to the subscription request and facilitate and accurately push the augmented reality information, and improve the efficiency and accuracy of the processing, the present invention moves to the mobile augmented reality client according to the push setting on the mobile augmented reality server side. A push request to initiate augmented reality content and/or augmented reality goals. Further, the present invention provides a preferred scheme for managing push settings to enable creation, update, and deletion of push settings based on subscription requests and/or unsubscribe requests. Specifically, the step of moving the augmented reality content and/or the push setting of the augmented reality target specified by the user in the augmented reality server management request comprises: the mobile augmented reality server creates or updates the user-specified augmented reality content according to the received subscription request and/or Or push settings of the augmented reality target; or, the mobile augmented reality server deletes the push settings of the user-specified augmented reality content and/or the augmented reality target according to the received unsubscribe request or after the subscription expires. In the preferred embodiment described above, flexible control of subscriptions and unsubscriptions can be achieved by creating, updating, and deleting user-specified push settings to meet different demand scenarios. Based on various preferred embodiments of the present invention, preferably, the push setting of the augmented reality content and/or the augmented reality target comprises at least one of the following augmented reality content and/or augmented reality target push criteria: augmented reality Target category; user location information; augmented reality business conditions; augmented reality content and/or augmented reality target filtering criteria. On the basis of various preferred embodiments of the present invention, preferably, the augmented reality service condition includes at least one of the following: a timer or a service event. Based on various preferred embodiments of the present invention, preferably, the augmented reality content and/or the augmented reality target filtering criterion includes at least one of the following: an augmented reality user preference or an augmented reality target attribute. Based on various preferred embodiments of the present invention, preferably, the push setting of the augmented reality content and/or the augmented reality target includes at least one of: augmented reality content and/or a trigger condition of the augmented reality target push; and, enhancement Filtering criteria for realistic content and/or augmented reality target push. Based on various preferred embodiments of the present invention, preferably, the trigger condition of the augmented reality content and/or the augmented reality target push includes at least one of: augmented reality content and/or push interval of the augmented reality target; augmented reality user Context; the deployment state of the augmented reality target. Preferably, the push interval comprises: daily or weekly. Preferably, the augmented reality user context comprises: a user location and/or a user presentation state. Preferably, the deployment state of the augmented reality target comprises: a distance between the augmented reality target and the augmented reality user and/or augmented reality content change related to the augmented reality target. Of course, the content included in the above trigger condition is only an example, and the present invention is not limited thereto. Based on various preferred embodiments of the present invention, preferably, the filtering criteria of the augmented reality content and/or the augmented reality target push include at least one of: augmented reality user preference; augmented reality target attribute. Preferably, the augmented reality target attribute comprises at least one of the following: a category of the augmented reality target, a type of the augmented reality target, and a feature of the augmented reality target. Of course, the content included in the above filtering criteria is only an example, and the present invention is not limited thereto. Based on various preferred embodiments of the present invention, the present invention provides a preferred push request initiation scheme. Specifically, the step of the mobile augmented reality server initiating a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the push setting comprises: the mobile augmented reality server determining whether the trigger condition in the push setting is satisfied; Then, the mobile augmented reality server initiates a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the filtering criteria in the push setting. Based on the various preferred embodiments of the present invention, the present invention further provides a preferred solution for determining whether the trigger condition is met, so as to ensure that the latest augmented reality information is pushed to the mobile augmented reality client in time. Specifically, the step of the mobile augmented reality server determining whether the trigger condition in the push setting is satisfied includes:

1) the mobile augmented reality server determines whether the push interval in the trigger condition is reached, and if yes, determines that the trigger condition is met; or

2) The mobile augmented reality server acquires the augmented reality user context in the trigger condition, and determines whether the user location in the augmented reality user context is located in the designated area, or determines whether the user presence status in the augmented reality user context allows to receive the push information, if the user If the location is in the designated area or the user presentation state allows to receive the push information, it is determined that the trigger condition is met; or 3) the mobile augmented reality server acquires the deployment state of the augmented reality target in the trigger condition, and determines whether the distance between the augmented reality target and the augmented reality user reaches a predetermined threshold, or determines whether the augmented reality content related to the augmented reality target changes. If the distance reaches a predetermined threshold or the augmented reality content changes, it is determined that the trigger condition is satisfied. Based on various preferred embodiments of the present invention, the present invention also provides a preferred push request initiation scheme. Specifically, the step of the mobile augmented reality server initiating a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the filtering criterion in the push setting comprises: the mobile augmented reality server requests and acquires the augmented reality according to the filtering criterion Content and/or augmented reality goals; the mobile augmented reality server sends the acquired augmented reality content and/or augmented reality objects to the mobile augmented reality client via the underlying push mechanism. Embodiment 2 FIG. 2 is a preferred structural diagram of a mobile augmented reality server according to an embodiment of the present invention. The mobile augmented reality server shown in FIG. 2 includes: an augmented reality content/target subscription management function entity 200 configured to receive a subscription request or an unsubscribe request for augmented reality content and/or augmented reality target notification from a mobile augmented reality client; Managing push settings of the augmented reality content and/or augmented reality target specified by the user in the request; initiating a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the push setting. Preferably, the subscription request is for subscribing to a notification about the augmentable reality content and/or the augmented reality target that is available for unsubscribing to the notification about the augmentable reality content and/or the augmented reality target that is available. Preferably, the augmented reality content/target subscription management function entity 200 may include the following components to implement the above solution: The receiving unit 202 (or the first unit) is configured to receive the augmented reality content and/or from the mobile augmented reality client. a subscription request or a cancellation request for the augmented reality target notification; the management unit 204 (or referred to as the second unit) is configured to manage the push settings of the augmented reality content and/or the augmented reality target specified by the user in the request; the initiating unit 206 (or Referred to as the third unit), it is set to initiate a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the push setting. In the above preferred embodiment, the transmission of the augmented reality information is implemented by the subscription push mechanism, and the following technical problems are solved: 1) searching for the augmented reality target/content based on the mobile augmented reality terminal (mobile augmented reality client) request-response method When there is a need to repeatedly send a request, the user operation is cumbersome, the execution efficiency is not high, and the augmented reality information is repeatedly downloaded. 2) Searching for the augmented reality target/content based on the mobile augmented reality client request-response method At the time, there is a lack of an active request to send a prompt, resulting in the inability to timely acquire the augmented reality information of the user's attention. Continuously gain access to nearby enhanced information through a subscription-push mechanism The efficiency of business execution, even if the augmented reality target moves, or the augmented reality content changes, enables the mobile augmented reality client to obtain the augmented reality information of interest in time. According to the foregoing embodiment, in order to facilitate response to the subscription request and facilitate and accurately push the augmented reality information, and improve the efficiency and accuracy of the processing, the present invention moves to the mobile augmented reality client according to the push setting on the mobile augmented reality server side. A push request to initiate augmented reality content and/or augmented reality goals. Further, the present invention provides a preferred scheme for managing push settings to enable creation, update, and deletion of push settings based on subscription requests and/or unsubscribe requests. Specifically, the management unit 204 includes: a first processing module 2041, configured to create or update a push setting of the augmented reality content and/or the augmented reality target specified by the user according to the received subscription request; or, the second processing module 2042, setting The push settings for the received unsubscribe request or the user-specified augmented reality content and/or augmented reality target are deleted after the subscription expires. Based on various preferred embodiments of the present invention, preferably, the push setting of the augmented reality content and/or the augmented reality target comprises at least one of the following augmented reality content and/or augmented reality target push criteria: augmented reality Target category; user location information; augmented reality business conditions; augmented reality content and/or augmented reality target filtering criteria. On the basis of various preferred embodiments of the present invention, preferably, the augmented reality service condition includes at least one of the following: a timer or a service event. Based on various preferred embodiments of the present invention, preferably, the augmented reality content and/or the augmented reality target filtering criterion includes at least one of the following: an augmented reality user preference or an augmented reality target attribute. Based on various preferred embodiments of the present invention, preferably, the push setting of the augmented reality content and/or the augmented reality target includes at least one of: augmented reality content and/or a trigger condition of the augmented reality target push; and, enhancement Filtering criteria for realistic content and/or augmented reality target push. Based on various preferred embodiments of the present invention, preferably, the trigger condition of the augmented reality content and/or the augmented reality target push includes at least one of: augmented reality content and/or push interval of the augmented reality target; augmented reality user Context; the deployment state of the augmented reality target. Preferably, the push interval comprises: daily or weekly. Preferably, the augmented reality user context comprises: a user location and/or a user presentation state. Preferably, the deployment state of the augmented reality target comprises: a distance between the augmented reality target and the augmented reality user and/or augmented reality content change related to the augmented reality target. Of course, the content included in the above trigger condition is only an example, and the present invention is not limited thereto. Based on various preferred embodiments of the present invention, preferably, the filtering criteria of the augmented reality content and/or the augmented reality target push include at least one of: augmented reality user preference; augmented reality target attribute. Preferably, the augmented reality target attribute comprises at least one of the following: a category of the augmented reality target, a type of the augmented reality target, and a feature of the augmented reality target. Of course, the content included in the above filtering criteria is only an example, and the present invention is not limited thereto. Based on various preferred embodiments of the present invention, the present invention provides a preferred push request initiation scheme. Specifically, the initiating unit 206 includes: a determining module 2061, configured to determine whether the trigger condition in the push setting is met; the initiating module 2062, configured to initiate to the mobile augmented reality client according to the filtering criterion in the push setting when the trigger condition is met Push requests for augmented reality content and/or augmented reality goals. Based on the various preferred embodiments of the present invention, the present invention further provides a preferred solution for determining whether the trigger condition is met, so as to ensure that the latest augmented reality information is pushed to the mobile augmented reality client in time. Specifically, the determining module 2061 is configured to determine whether the trigger condition in the push setting is satisfied by the following steps:

1) determining whether the push interval in the trigger condition is reached, and if so, determining that the trigger condition is met; or

2) obtaining an augmented reality user context in the trigger condition, and determining whether the user location in the augmented reality user context is located in the specified area, or determining whether the user presence status in the augmented reality user context allows to receive the push information, if the user location is in the designated area Or the user presentation state allows to receive the push information, and then determines that the trigger condition is met; or

3) obtaining a deployment state of the augmented reality target in the trigger condition, and determining whether the distance between the augmented reality target and the augmented reality user reaches a predetermined threshold, or determining whether the augmented reality content related to the augmented reality target changes, if the distance reaches a predetermined time When the threshold or the augmented reality content changes, it is judged that the trigger condition is satisfied. Based on various preferred embodiments of the present invention, the present invention also provides a preferred push request initiation scheme. Specifically, the initiating module 2062 is configured to initiate a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client by: requesting and acquiring the augmented reality content and/or the augmented reality target according to the filtering criterion; The acquired augmented reality content and/or augmented reality target is sent to the mobile augmented reality client through the underlying push mechanism. Embodiment 3 As shown in FIG. 3, a schematic diagram of a mobile augmented reality system in the present invention includes: an augmented reality terminal 302, a mobile augmented reality client 304, and a mobile augmented reality server 306. The augmented reality terminal 302 is a mobile intelligent terminal used by the user, and has a terminal side capability component required for implementing the mobile augmented reality service; The real client 304 is configured to request the mobile augmented reality server 306 to acquire the augmented reality target/content according to the user's request; the mobile augmented reality server 306 is a network side deployment function entity, and is responsible for searching for the augmented reality target according to the request, selecting and acquiring the augmented reality The content, the augmented reality target and/or the augmented reality content is delivered to the mobile augmented reality client 304. The terminal capability component 3022 is responsible for collecting and displaying information required for the mobile augmented reality service, and includes: a camera, which is used to capture real-time information of the physical world around the user (Camera View). You can also use a camera with video memory to cache the captured live view information in real time. Display screen, presenting the camera to the user to capture the real scene information in the augmented reality content rendering (AR View, Augmented Reality View) Global Positioning System (GPS) module, GPS module and GPS satellite Communication, providing terminal location information (such as latitude and longitude information) in real time. , compass, sensor, used to collect the status of the user terminal, including: camera orientation, angle with the ground; radio frequency identification (RARARio Frequency Identification, referred to as RFID) reader, QR code scanner, image recognition | J, computer Visual processing and other modules to achieve augmented reality target feature scanning, input and extraction. The augmented reality application 3024 provides a terminal-side application implemented by the mobile augmented reality service. By accessing the underlying support capability of the augmented reality service provided by the mobile augmented reality client 304, different forms of augmented reality service experience, such as augmented reality, are provided. Multimedia advertising applications, augmented reality navigation apps, augmented reality gaming apps, and more. The mobile augmented reality client 304, the mobile augmented reality service system terminal side functional entity, accesses the real-time status of the augmented reality terminal 302 collected by the terminal capability component 3022 (such as GPS, compass, sensor, etc.), requests the mobile augmented reality server 306 to acquire the augmented reality Target and/or augmented reality content, and control the fusion of acquired augmented reality content with the camera's live view. The mobile augmented reality client 304 returns the requested information to the augmented reality application, and provides support capabilities such as user interaction support, augmented reality measurement reporting, and the like. The mobile augmented reality server 306 is a functional entity on the network side of the mobile augmented reality service system, and is responsible for providing augmented reality target search and augmented reality content selection according to the request of the mobile augmented reality client 304 and the augmented reality personalization and context setting. Services such as acquisition, augmented reality target and/or augmented reality content delivery, mainly include the following functional entities: augmented reality content/target selection function 3061, requested in the mobile augmented reality server 306 according to the received mobile augmented reality client 304, or Augmented reality goals, augmented reality content delivery related push requests, search for augmented reality goals, selection and acquisition of augmented reality content. The augmented reality content/target subscription function 3062 is responsible for augmented reality content and/or augmented reality target subscription management functions in the mobile augmented reality server 306, and mainly includes: 1) managing the mobile augmented reality client augmented reality content/target subscription request, canceling the subscription request;

2) managing augmented reality content/target push settings associated with the request, including: creating or updating augmented reality content/target push settings according to a user subscription request, and deleting the augmented reality content according to the user's subscription request or expiring the subscription/ Target push settings. Preferably, the push setting includes at least: an augmented reality content/target push filter criterion, and an augmented reality content/target push trigger condition. Preferably, information related to the trigger condition in the augmented reality content/target push setting is collected, such as: user location, presence status, time interval, augmented reality target position, etc., and determines whether the trigger condition is met. Preferably, the requested augmented reality content/target is requested according to a filtering criterion in the augmented reality content/target push setting, such as: category, feature, type, and the like. Augmented Reality Personalization and Contextual Functions 3063, The Mobile Augmented Reality Server 306 is responsible for managing user personalized preferences and user context, including:

1) The setting and management of user personalized preferences, including at least: a) augmented reality target search preferences, such as: search radius, search category, augmented reality target features; b) augmented reality content acquisition preferences, such as: augmented reality content features, etc. c) Augmented reality target and/or augmented reality content push setting, for example: Pre-set the user context (user position, terminal status) in the push condition, and preset the push time in the push condition.

2) Collection and use of user context. The user context refers to the current state information of the user and its user terminal, including: a) the current state of the user, such as: user geographic location, user presence information; b) augmented reality terminal 302 state, such as: screen size, remaining power, storage space Wait. The augmented reality content/target management function 3064 is responsible for the storage and management of the augmented reality target deployment and the augmented reality content release related information in the mobile augmented reality server 306, which mainly includes:

1) Augmented reality target deployment information management, including at least: augmented reality target identification, augmented reality target type, classification, description, related augmented reality content identification, and other augmented reality goals; 2) Associated augmented reality content publishing information management, including at least: augmented reality content identification, related augmented reality target identifier, augmented reality content publishing status, augmented reality content deployment rule, and augmented reality content access address, access control policy, etc.;

3) Augmented Reality Content Cache Policy Management; 4) Augmented Reality Content Local Cache Management. The augmented reality content/target delivery function 3065, in the mobile augmented reality server 306, is responsible for delivering the following information to the mobile augmented reality client 304:

1) Augmented reality goals and / or augmented reality content;

2) Augmented reality goals and/or references to augmented reality content; 3) Unable to obtain indications of augmented reality goals and/or augmented reality content. Augmented Reality Content / Target Delivery Features The 3065 delivers augmented reality and/or augmented reality content delivery services in the following ways:

1) PULL mode: The augmented reality content/target delivery function 3065 delivers augmented reality objects and/or augmented reality content in response to a request from the mobile augmented reality client 3024; 2) PUSH mode: augmented reality content/target delivery function 3065 active push Augmented reality targets and/or augmented reality content to the mobile augmented reality client 304. Based on the augmented reality implementation system shown in FIG. 3, the present invention also provides a method for transmitting augmented reality information. As shown in FIG. 4, the transmission method specifically includes the following steps: Step S402: A mobile augmented reality server receives an augmented reality content and/or an augmented reality target subscription request, where the request may be a request from a mobile augmented reality client, or may be The request sent by the third-party out-of-band mechanism; Step S404, the mobile augmented reality server manages the augmented reality content and/or the augmented reality target push setting associated with the subscription request, including: creating or updating the augmented reality content target according to the user subscription request Push settings, and augmented reality content/target push settings are removed based on the user's subscription request or as the subscription period expires. The push setting includes at least: an augmented reality content/target push filter criterion, and an augmented reality content/target push trigger condition; step S406, the mobile augmented reality server collects the state information related to the trigger condition in the augmented reality content/target push setting, For example: user terminal location, augmented reality target location, timer time, etc., and determine whether the trigger condition related settings are met. If yes, step S408 is performed. Otherwise, no processing is performed, and the mobile augmented reality server may perform the above step of determining whether the trigger condition related setting is satisfied at intervals. Step S408: The mobile augmented reality server acquires the subscribed augmented reality content/target according to the augmented reality content/target filtering standard in the augmented reality content/target push setting, such as: category, feature, and the like. The mobile augmented reality server pushes the acquired augmented reality content/target to the mobile augmented reality client through an underlying push mechanism. Embodiment 4 Based on the augmented reality implementation system shown in FIG. 3, the present invention also provides a method for transmitting augmented reality information. As shown in FIG. 5, the mobile augmented reality server 306 in the preferred embodiment receives the subscription request of the mobile augmented reality client 304, and searches and acquires a flowchart of the nearby augmented reality content/target according to the location change of the user terminal, specifically including the following. Steps: Steps 1-4 (Fl, PI, F2-F4), according to the user operation instruction or the augmented reality application business logic, the mobile augmented reality client sends the augmented reality content/target subscription request to the mobile augmented reality server, requesting to receive the user terminal. Augmented reality content/targets are available near the location. Upon request, the augmented reality content/target subscription functionality in the mobile augmented reality server creates associated augmented reality content/target push settings, including: augmented reality content/target push filtering criteria, augmented reality content/target push triggering conditions, and the like. In this example, it is assumed that the filtering criteria is an augmented reality target type, such as: "restaurant", the trigger condition is that the user terminal location enters a specific area, such as: "commercial pedestrian street." The augmented reality content/target subscription function sends a trigger condition related information subscription request in the subscription push setting to the augmented reality personalization and context function in the mobile augmented reality server, in this case, the subscription user terminal location changes. Step 5-8 (F5-F8), supporting the service server, for example: positioning the server, obtaining the location information of the user terminal, and sending the location change information of the user terminal to the mobile augmented reality server. The augmented reality personalization and context function sends a trigger condition (user terminal location) status change notification to the augmented reality content/target subscription function according to the subscription request. Without loss of generality, the mobile augmented reality server may also receive user terminal location change information by other means, including: the mobile augmented reality client sends the terminal location to the mobile augmented reality server; Step 9-12 (P2, F9-F11, P3, F12), the augmented reality content/target subscription function determines whether the augmented reality content/target push trigger condition is satisfied according to the user terminal location information. In this example, assuming that the user has entered the preset push trigger area, the augmented reality content/target subscription function transmits an augmented reality content/target acquisition request to the augmented reality content/target selection function in the mobile augmented reality server according to the filtering criteria in the push setting. The latter requests the augmented reality content/target management function to search for augmented reality targets, select and acquire related augmented reality content according to the user terminal location and filtering criteria. In this step, the mobile augmented reality server may need to request the augmented reality content publisher, that is, the augmented reality content server, to acquire the actual content of the augmented reality content. Step 13-18 (P4, F13-F18), via the augmented reality content/target delivery function, the mobile augmented reality server pushes the acquired augmented reality content/object directly to the user terminal based on the underlying push mechanism (such as OMA PUSH), or first The augmented reality content/target push notification is sent, and then the augmented reality content/target actual content is requested by the mobile augmented reality client. Step 19-22 (P5, F19, P6, F20-F22), after a period of time, according to the user operation instruction or the augmented reality application business logic, the mobile augmented reality client sends the augmented reality content/target unsubscribe request to the mobile augmented reality server. , Augmented Reality Content/Goals can be obtained by no longer subscribing to the location of the user terminal. Upon request, the augmented reality content/target subscription function in the mobile augmented reality server deletes the associated augmented reality content/target push settings, while requesting the augmented reality personalization and context function cancellation trigger condition status subscription notification. Embodiment 5 Based on the augmented reality implementation system shown in FIG. 3, the present invention also provides a method for transmitting augmented reality information. As shown in FIG. 6, the mobile augmented reality server 306 receives the mobile augmented reality client 304 subscription request, identifies the augmented reality target to be subscribed, and obtains a flowchart corresponding to the augmented reality content according to the target location change, which specifically includes the following steps: 1-5 (F1-F3, PI, F4-F5), according to the user operation instruction or the augmented reality application business logic, the mobile augmented reality client collects an augmented reality target image or image feature description, and sends the augmented reality content/target subscription request. To the mobile augmented reality server, request to subscribe to the augmented reality content/target corresponding to the image frame. The augmented reality content/target subscription function in the mobile augmented reality server transmits an augmented reality target recognition request to the augmented reality content/target selection function, requesting to identify the augmented reality target to be subscribed. Augmented reality content / The target selection function requests the augmented reality content/target management function to perform augmented reality target matching based on the image frame or image feature description. Step 6-8 (P2, F6-F8), the augmented reality content/target subscription function creates related augmented reality content/target push settings based on the subscription request and the matching augmented reality target, including: Augmented Reality Content/Target Push Filtering Standard , augmented reality content/target push trigger conditions, etc. In this example, it is assumed that the filtering criteria is the relevant augmented reality content media type, such as: "video", the trigger condition is that the augmented reality target enters a region close to the user, for example: "within 100 meters". The augmented reality content/target subscription function sends a trigger condition related information subscription request in the subscription push setting to the augmented reality personalization and context function in the mobile augmented reality server, in this case, subscribes to the identified augmented reality target location change. Step 9-12 (F9-F12), support the service server, for example: locate the server, obtain the augmented reality target location, and send the augmented reality target location information to the mobile augmented reality server. The augmented reality personalization and context function sends a trigger condition (augmented reality target location) change notification to the augmented reality content/target subscription function according to the subscription request. Step 13-16 (P3, F13-F15, P4, F16), the augmented reality content/target subscription function determines whether the augmented reality content/target push trigger condition is satisfied according to the user terminal location and the augmented reality target location information. In this example, it is assumed that the augmented reality target has entered a region close to the user terminal, and the augmented reality content/target subscription function transmits an augmented reality content acquisition request to the augmented reality content/target selection function in the mobile augmented reality server according to the filtering criteria in the push setting, According to the augmented reality target identification and filtering criteria, the augmented reality content/target management function is selected and related augmented reality content is obtained. In this step, the mobile augmented reality server may need to request the augmented reality content publisher, that is, the augmented reality content server, to acquire the actual content of the augmented reality content. Step 17-22 (P5, F17-F22), via the augmented reality content/target delivery function, the mobile augmented reality server pushes the acquired augmented reality content/object directly to the user terminal based on an underlying push mechanism (such as OMA PUSH), or first The augmented reality content/target push notification is sent, and then the augmented reality content/target actual content is requested by the mobile augmented reality client. Step 23-26 (P6, F23, P7, F24-F26), after a period of time, according to the user operation instruction or the augmented reality application business logic, the mobile augmented reality client sends the augmented reality content/target unsubscribe request to the mobile augmented reality server. , no longer subscribe to the augmented reality target corresponding to augmented reality content. Move enhancement based on request The Real Server Augmented Reality Content/Target Subscription feature deletes the associated augmented reality content/target push settings while requesting augmented reality personalization and context function cancellation trigger condition status subscription notifications. Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general-purpose computing device, which can be concentrated on a single computing device or distributed over a network composed of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device so that they may be stored in the storage device by the computing device, or they may be separately fabricated into individual integrated circuit modules, or Multiple modules or steps are made into a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software. The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims

A method for transmitting mobile augmented reality information, comprising:

The mobile augmented reality server receives a subscription request or an unsubscribe request for the augmented reality content and/or the augmented reality target notification from the mobile augmented reality client;

The mobile augmented reality server manages push settings of augmented reality content and/or augmented reality objects specified by the user in the request;

The mobile augmented reality server issues a push request for the augmented reality content and/or the augmented reality target to the mobile augmented reality client in accordance with the push setting.

2. The method according to claim 1, wherein the step of the mobile augmented reality server managing the push settings of the augmented reality content and/or the augmented reality target specified by the user in the request comprises:

The mobile augmented reality server creates or updates a push setting of the user-specified augmented reality content and/or an augmented reality target according to the received subscription request; or

The mobile augmented reality server deletes the push settings of the user-specified augmented reality content and/or augmented reality target according to the received unsubscribe request or after the subscription expires.

The method according to claim 1 or 2, wherein the push setting of the augmented reality content and/or the augmented reality target comprises at least one of the following:

Trigger conditions for augmented reality content and/or augmented reality target push; and,

Filtering criteria for augmented reality content and/or augmented reality target push.

4. The method according to claim 3, wherein the trigger condition of the augmented reality content and/or the augmented reality target push comprises at least one of the following:

Push interval for augmented reality content and/or augmented reality goals;

Augmented reality user context;

The deployment state of the augmented reality target.

5. The method according to claim 4, wherein the pushing interval comprises: daily or weekly.

6. The method of claim 4, wherein the augmented reality user context comprises: a user location or a user presentation state. The method according to claim 4, wherein the deployment state of the augmented reality target comprises: a distance between the augmented reality target and an augmented reality user, or an augmented reality content change related to the augmented reality target.

8. The method according to claim 3, wherein the filtering criteria of the augmented reality content and/or augmented reality target push comprises at least one of the following:

Augmented reality user preferences;

Augmented reality target attributes.

9. The method of claim 8, wherein the augmented reality target attribute comprises at least one of: a category of an augmented reality object, a type of augmented reality object, and a feature of the augmented reality object.

10. The method according to claim 1, wherein the step of the mobile augmented reality server initiating a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the push setting comprises:

Determining, by the mobile augmented reality server, whether a trigger condition in the push setting is satisfied; if satisfied, the mobile augmented reality server initiates augmented reality content to the mobile augmented reality client according to a filtering criterion in the push setting / or push requests for augmented reality targets.

The method according to claim 10, wherein the step of determining, by the mobile augmented reality server, whether the trigger condition in the push setting is satisfied comprises:

Determining, by the mobile augmented reality server, whether a push interval in the trigger condition is reached, and if it reaches |J, determining that the trigger condition is met; or

Obtaining, by the mobile augmented reality server, an augmented reality user context in the trigger condition, and determining whether a user location in the augmented reality user context is located in a specified area, or determining whether a user presence status in the augmented reality user context is allowed Receiving the push information, if the user location is located in the designated area or the user presentation state is allowed to receive the push information, determining that the trigger condition is met; or

Obtaining, by the mobile augmented reality server, a deployment state of the augmented reality target in the trigger condition, and determining whether a distance between the augmented reality target and the augmented reality user reaches a predetermined threshold, or determining an enhancement related to the augmented reality target Whether the actual content changes, if the distance reaches the predetermined threshold or the augmented reality content changes, it is determined that the trigger condition is satisfied.

12. The method according to claim 10, wherein the mobile augmented reality server initiates a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to a filtering criterion in the push setting. The steps include:

The mobile augmented reality server requests and acquires augmented reality content and/or an augmented reality target according to the filtering criteria;

The mobile augmented reality server transmits the acquired augmented reality content and/or augmented reality target to the mobile augmented reality client via an underlying push mechanism.

13. The method according to claim 1 or 2, wherein the push setting of the augmented reality content and/or the augmented reality object comprises at least an augmented reality target category of augmented reality content and/or augmented reality target push criteria ;

User location information;

Augmented reality business conditions;

Augmented reality content and/or augmented reality target filtering criteria.

14. The method of claim 13, wherein the augmented reality service condition comprises at least one of: a timer or a business event.

15. The method of claim 13, wherein the augmented reality content and/or augmented reality target filtering criteria comprises at least one of: an augmented reality user preference or an augmented reality target attribute.

16. A mobile augmented reality server, comprising:

An augmented reality content target subscription management function entity configured to receive a subscription request or an unsubscribe request for augmented reality content and/or augmented reality target notification from a mobile augmented reality client; managing user-specified augmented reality content in the request and/or Or a push setting of the augmented reality target; launching a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the push setting.

17. The mobile augmented reality server of claim 16, wherein the augmented reality content target subscription management function entity comprises:

a first unit, configured to receive a subscription request or an unsubscribe request for the augmented reality content and/or the augmented reality target notification from the mobile augmented reality client; a second unit configured to manage push settings of augmented reality content and/or augmented reality targets specified by the user in the request;

And a third unit, configured to initiate a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the push setting.

The mobile augmented reality server according to claim 17, wherein the second unit comprises: a first processing module, configured to create or update the user-specified augmented reality content according to the received subscription request and/or Or push settings for augmented reality targets; or,

The second processing module is configured to receive the unsubscribe request or delete the push settings of the user-specified augmented reality content and/or augmented reality target after the subscription expires.

The mobile augmented reality server according to claim 17, wherein the third unit comprises: a determining module, configured to determine whether a trigger condition in the push setting is satisfied; and an initiating module configured to satisfy the trigger The condition initiates a push request of the augmented reality content and/or the augmented reality target to the mobile augmented reality client according to the filtering criteria in the push setting.

20. The mobile augmented reality server of claim 19, wherein the determining module is configured to determine whether the trigger condition in the push setting is satisfied by the following steps:

Determining whether the push interval in the trigger condition is reached, and if so, determining that the trigger condition is met; or

Obtaining an augmented reality user context in the trigger condition, and determining whether a user location in the augmented reality user context is located in a specified area, or determining whether a user presence status in the augmented reality user context is allowed to receive push information, if Determining that the trigger condition is met when the user location is located in the designated area or the user presentation state is allowed to receive the push information; or acquiring a deployment state of the augmented reality target in the trigger condition, and determining the augmented reality Whether the distance between the target and the augmented reality user reaches a predetermined threshold, or whether the augmented reality content related to the augmented reality target changes, and if the distance reaches the predetermined threshold or the augmented reality content changes, determining The trigger condition is met.

21. The mobile augmented reality server of claim 19, wherein the initiating module is configured to initiate a push request for augmented reality content and/or an augmented reality target to the mobile augmented reality client by the following steps:

Requesting and obtaining augmented reality content and/or augmented reality goals in accordance with the filtering criteria; The acquired augmented reality content and/or augmented reality target is sent to the mobile augmented reality client through an underlying push mechanism.