WO2012174865A1 - 实现移动增强现实业务的系统及方法、终端及服务器 - Google Patents

实现移动增强现实业务的系统及方法、终端及服务器 Download PDF

Info

Publication number
WO2012174865A1
WO2012174865A1 PCT/CN2012/070613 CN2012070613W WO2012174865A1 WO 2012174865 A1 WO2012174865 A1 WO 2012174865A1 CN 2012070613 W CN2012070613 W CN 2012070613W WO 2012174865 A1 WO2012174865 A1 WO 2012174865A1
Authority
WO
WIPO (PCT)
Prior art keywords
augmented reality
target
content
mobile
request
Prior art date
Application number
PCT/CN2012/070613
Other languages
English (en)
French (fr)
Inventor
黄成�
阿里加赞法尔
李伟华
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2012174865A1 publication Critical patent/WO2012174865A1/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality

Definitions

  • the present invention relates to a technology for implementing a mobile augmented reality service, and more particularly to a system and method for realizing a mobile augmented reality service, and a mobile augmented reality terminal and a mobile augmented reality server.
  • Background technique
  • AR Augmented Reality
  • Mobile AR Mobile Augmented Reality
  • the research and application of mobile augmented reality technology changes the way users observe the world around them.
  • the traditional text-based WEB page browsing query mode is transformed into camera-based shooting, capturing. Hotspots and real-time browsing of new modes of enhanced information.
  • Mobile AR users can use the mobile terminal, such as a smart phone, to obtain an augmented reality service experience while shooting surrounding scenes.
  • the augmented reality application (AR Application) running on the mobile terminal captures the AR service provider based on the current location of the user.
  • Deployed augmented reality targets (AR Targets) such as POI (Point of Interest), and based on user selection to obtain augmented reality content (AR Content), including text, images, voice, video, and ultimately combined with users
  • AR Targets such as POI (Point of Interest)
  • AR Content augmented reality content
  • the terminal geographic fingerprint information such as latitude and longitude, orientation, and the like, integrates the acquired augmented reality content with the surrounding real scene captured by the terminal camera on the screen to obtain an unusual augmented reality service experience.
  • the augmented reality technologies mainly include the following: AR target recognition technology, AR content acquisition technology, AR content display technology, etc.
  • AR applications developed by AR application developers for different AR service providers must be implemented using different technologies, which undoubtedly increases the difficulty of AR application development.
  • the AR user must choose to install different AR application running environments according to the AR service provider. This is very unfavorable for the user to replace the terminal. This is because the AR applications are not compatible with each other. Replacing the terminal requires reinstalling the operating environment of all AR applications, which undoubtedly greatly hinders the market penetration of AR applications.
  • the AR applications are not compatible with each other. Therefore, the AR application cannot be centralized for online sales, which greatly reduces the number of subscribers of the AR service provider.
  • the AR service provider not only needs to deploy the AR service server, but also needs to bear the design work of the AR content alone, which also increases the service operation cost of the AR service provider.
  • the main object of the present invention is to provide a system and method for realizing a mobile augmented reality service, and a mobile augmented reality terminal and a mobile augmented reality server, which can enhance the user experience.
  • a method for implementing a mobile augmented reality service comprising:
  • the mobile augmented reality server After receiving the augmented reality service request, acquires the parameter of the augmented reality service request, determines the augmented reality service request type, and enhances the requested mobile service. Real business is controlled.
  • the augmented reality service request includes at least one of the following requests:
  • Augmented reality target search request augmented reality content acquisition request, augmented reality measure reporting request, and augmented reality content management request.
  • the requested mobile augmented reality service is controlled as:
  • the mobile augmented reality server performs enhanced real target matching according to the target search parameter carried in the request, obtains the matched augmented reality target, and returns to the mobile augmented reality terminal.
  • the requested mobile augmented reality service is controlled as:
  • the requested mobile augmented reality service is controlled as:
  • the mobile augmented reality server performs an augmented reality target metadata search according to the measurement reporting parameter carried in the augmented reality measurement report request, and acquires the measurement report to notify the legal recipient address.
  • the requested mobile augmented reality service is controlled as:
  • the augmented reality content management authority corresponding to the management request is verified, and the target information of the corresponding augmented reality content is updated according to the augmented reality content of the augmented reality content server after the verification.
  • the mobile augmented reality server satisfies the set push setting condition
  • the corresponding augmented reality target and/or augmented reality content is acquired and sent to the mobile augmented reality terminal.
  • the setting push setting condition is:
  • the augmented reality target search parameter and the user service setting are in compliance with the third-party value-added service trigger condition.
  • a system for implementing a mobile augmented reality service including a mobile augmented reality terminal, a mobile augmented reality server, and an augmented reality content server, wherein
  • a mobile augmented reality terminal configured to send an augmented reality service request to the mobile augmented reality server; acquiring augmented reality content associated with the augmented reality target in the augmented reality content server, and according to the real-time status of the mobile augmented reality terminal Augmented reality content is merged with the real scene captured by the mobile augmented reality terminal and displayed;
  • a mobile augmented reality server configured to acquire the parameter of the augmented reality service request or the push request sent by the mobile augmented reality terminal, determine an augmented reality service request type, and control the requested mobile augmented reality service; and receive the enhancement
  • the augmented reality content management authority corresponding to the management request is verified, and the target information of the augmented reality content corresponding to the management request is updated after the verification;
  • the augmented reality content server is set to provide and provide Storage and management of augmented reality content associated with deployed augmented reality targets in a mobile augmented reality server.
  • the mobile augmented reality terminal includes a camera, a state acquiring unit, a communication unit, and a display unit, where
  • a camera configured to capture a real scene around the mobile augmented reality terminal in real time
  • a state acquiring unit configured to acquire current location information of the mobile augmented reality terminal
  • a camera height and orientation an angle with the ground
  • a communication unit configured to implement communication with the mobile augmented reality server, send an augmented reality service request to the mobile augmented reality server, and acquire augmented reality content associated with the augmented reality target in the augmented reality content server;
  • the display unit is configured to use the acquired augmented reality content to modify and render the augmented reality target in the real scene captured by the camera.
  • the augmented reality service request includes at least one of the following requests:
  • Augmented reality target search request augmented reality content acquisition request
  • augmented reality measure reporting request Augmented reality measure reporting request
  • the mobile augmented reality server performs augmented reality target matching according to the target search parameter carried in the request for the augmented reality target search request, obtains the matched enhanced real target, and returns to the mobile augmented reality terminal.
  • the mobile augmented reality server acquires the corresponding augmented reality content and the searched augmented reality target, and returns to the mobile augmented reality terminal.
  • the mobile augmented reality server triggers the third-party value-added service when the augmented reality target search parameter and the user service setting meet the trigger condition of the third-party value-added service, and returns the execution result.
  • the mobile augmented reality server obtains an augmented reality content access address according to the content acquisition parameter carried in the augmented reality content acquisition request, and obtains the augmented reality content and returns the same to the mobile augmented reality terminal.
  • the mobile augmented reality server performs an augmented reality target metadata search according to the measurement reporting parameter carried in the augmented reality measurement report request, and obtains the measurement report to notify the legal recipient address.
  • the mobile augmented reality server pushes the acquired augmented reality target and/or augmented reality content to the mobile augmented reality client for the push request.
  • a mobile augmented reality server including an augmented reality content/target delivery function, an augmented reality content/target selection function, and augmented reality content/target management function, wherein
  • the augmented reality content/target selection function is configured to search for an augmented reality target according to the received mobile augmented reality client's business request, and select and acquire the augmented reality content;
  • An augmented reality content/target delivery function configured to deliver an augmented reality target and/or augmented reality content to a mobile augmented reality client in response to a mobile augmented reality client's business request; or, actively initiate a request to push an augmented reality target and/or enhance Realistic content to the mobile augmented reality client;
  • the augmented reality content/target management function is configured to store and manage augmented reality target deployment information, augmented reality content distribution information, and augmented reality content caching strategies and locally cache augmented reality content according to augmented reality content management requests.
  • the augmented reality service request includes at least one of the following requests:
  • Augmented reality target search request augmented reality content acquisition request
  • augmented reality measure reporting request Augmented reality measure reporting request
  • the augmented reality content/target selection function searches for an augmented reality target according to the target search parameter carried in the request for the augmented reality target search request, and selects and acquires the augmented reality content.
  • the augmented reality content/target selection function acquires an augmented reality content access address according to the content acquisition parameter carried in the augmented reality content acquisition request for the augmented reality content acquisition request, and acquires the augmented reality content.
  • the augmented reality content/target selection function performs an augmented reality target metadata search according to the measure report parameter carried in the augmented reality measure report request, and acquires the measure report to notify the legal recipient address.
  • the augmented reality content/target management function after receiving the augmented reality content management request, performs verification of the augmented reality content management authority, and promotes the augmented reality after the verification is passed
  • the content/target management function update corresponds to the management request to augment the reality target information.
  • the augmented reality content/target management function transmits an augmented reality content publishing status and deployment rule change information according to the augmented reality content management request execution result.
  • a mobile augmented reality terminal including augmented reality content/target acquisition function, augmented reality content/target display function, and user/terminal data management function, wherein
  • An augmented reality content/target acquisition function for requesting acquisition of augmented reality content and/or augmented reality target from the mobile augmented reality server according to the request of the augmented reality application;
  • An augmented reality content/target display function for providing an augmented reality content display mechanism according to an augmented reality application request
  • User/terminal data management function for collecting and managing user augmented reality personalization and context related information.
  • the invention overcomes the problems of difficulty in application development, high cost of service deployment, and inconsistent user experience in the existing AR solution, and plays a good role in promoting the development of the AR market.
  • the mobile augmented reality system (server, client) of the present invention develops an open API for augmented reality applications, and provides underlying capabilities support for augmented reality services, including: target search, content acquisition, etc., thereby reducing the difficulty of augmented reality application development;
  • the augmented reality content server provides an augmented reality content publishing management interface, and reduces the augmented reality service deployment cost.
  • the mobile augmented reality service implementation method adapts to different types of augmented reality target recognition and augmented reality content acquisition, and has good scalability, in different Application scenarios provide users with a unified business experience.
  • FIG. 1 is a schematic structural diagram of a system for implementing a mobile augmented reality service according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of an augmented reality content/target selection function 222 according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of a structure of an augmented reality content/target management function 223 according to an embodiment of the present invention
  • 4 is a flowchart of a method for implementing a mobile augmented reality service according to an embodiment of the present invention
  • FIG. 5 is a flowchart of a method for implementing a mobile augmented reality service according to an application example of the present invention
  • FIG. 6 is a second embodiment of the present invention for implementing a mobile augmented reality service.
  • FIG. 7 is a flowchart of a method for implementing a mobile augmented reality service according to application example 3 of the present invention
  • FIG. 8 is a flowchart of a method for implementing a mobile augmented reality service according to application example 4 of the present invention
  • Example 5 is a flow chart of a method for implementing a mobile augmented reality service. detailed description
  • the system for implementing a mobile augmented reality service includes a mobile augmented reality terminal 200, a mobile augmented reality server 220, and augmented reality content.
  • the server 240 and the third party value-added application server 250 are used to optimize the mobile augmented reality service of the present invention.
  • the mobile augmented reality server 220, the augmented reality content server 230, the supporting service server 240, and the third-party value-added application server 250 are both network side network elements, and the mobile augmented reality terminal 200 realizes access to the network side server through a mobile network or the like, such as sending Related business request, obtaining the requested business content returned by the relevant server. It should be understood by those skilled in the art that the mobile augmented reality terminal 200 realizes access to the mobile network, and it is easy to implement communication with the above server and obtain related service content, and the above communication details are not repeatedly described in the present invention. In the following, a detailed description will be given of the functions implemented by the above network elements and how the interactions are implemented therebetween.
  • the mobile augmented reality terminal 200 the mobile terminal with the augmented reality service function used by the user, can provide the user with an augmented reality service experience in addition to providing basic communication functions. Also includes the following functional modules:
  • the terminal capability component 201 is responsible for collecting and displaying information required for the implementation of the mobile augmented reality service, including:
  • the camera is used to capture real-time information (Camera View) of the physical world around the user. You can also use a camera with video memory to cache the captured live view information in real time.
  • the display screen is provided for the user to view the augmented real content view (AR View, Augmented Reality View) under the augmented reality content modification rendering; the display screen is mainly used to display the augmented reality content server 230 according to the slave network side.
  • the acquired augmented reality content renders the corresponding augmented reality target and is presented to the user of the mobile augmented reality terminal 200. That is, the terminal capability component 201 needs to locate an augmented reality target to be specially displayed in the real scene information captured by the camera, and render the real target by using the corresponding augmented reality content of the acquired augmented reality target, and then display To the user.
  • GPS Global Positioning System
  • the GPS module communicates with GPS satellites to provide terminal location information (such as latitude and longitude information) in real time.
  • the compass and the sensor are used to collect the state of the user terminal, including: camera orientation, angle with the ground, etc.; here, the mobile augmented reality terminal 200 has these functional modules, mainly for implementing corresponding image processing on the augmented reality target. It is set, that is, the mobile augmented reality terminal 200 needs to locate the augmented reality target in the real scene information captured by the self camera to facilitate corresponding image processing.
  • Radio frequency identification (RFID) readers two-dimensional code scanners, image recognition, computer vision processing and other modules to achieve alternative augmented reality target features for scanning, input and extraction.
  • RFID Radio frequency identification
  • the augmented reality application 202 provides a terminal-side application implemented by the mobile augmented reality service.
  • the mobile augmented reality interface MobAR-1 of the present invention accesses the augmented reality service support capability provided by the mobile augmented reality client 210, and provides different forms on the basis.
  • Augmented reality business experience Such as augmented reality multimedia advertising applications, augmented reality navigation applications, augmented reality gaming applications, and the like.
  • the device management client based on the DM protocol, implements communication between the device management client and the device management server, and provides device management functions for the user mobile augmented reality terminal;
  • Extensible Markup Language (XML) document management client based on XML Configuration Access Protocol (XCAP), realizes communication between X Display Manager (XDM, X Display Manager) client and XDM server , providing user preferences and business settings management functions for user augmented reality services;
  • XML Extensible Markup Language
  • XCAP XML Configuration Access Protocol
  • the presentation client based on the Session Initiation Protocol (SIP), is used to communicate between the client and the presence server (included in the support service server 240), and provides a presence information publishing function for the user mobile augmented reality terminal;
  • SIP Session Initiation Protocol
  • the mobile augmented reality client 210 provides an augmented reality service capability client function entity, and is responsible for transmitting an augmented reality target search request to the augmented reality server 220, acquiring the augmented reality content associated with the augmented reality target in the augmented reality content server 230, and according to
  • the mobile augmented reality terminal 200 real-time state controls the fusion display of the augmented reality content and the terminal capability component 201 to capture the real scene of the camera.
  • the augmented reality content/target acquisition function is responsible for receiving the request of the augmented reality application 202 running on the mobile augmented reality terminal 200, contacting the mobile augmented reality server 220, requesting the search for the augmented reality target, and acquiring the related augmented reality content, including:
  • Augmented reality goals and/or augmented reality content References to augmented reality goals and/or augmented reality content;
  • the augmented reality content/target acquisition function can be as follows Ways to get augmented reality goals and / or augmented reality content:
  • Augmented Reality Content/Target Acquisition Function Proactively Requests Mobile Augmented Reality Server 220 to search for augmented reality targets, or to acquire augmented reality content;
  • the mobile augmented reality server 220 pushes an augmented reality target according to the user's augmented reality service setting, or augments the reality content to the augmented reality content/target acquisition function.
  • the augmented reality content/target display function is responsible for controlling the real-time status information of the user's mobile augmented reality terminal 200 collected by the terminal capability component 201, and controlling the augmented reality content acquired by the augmented reality content acquisition module and the camera shooting real scene to be displayed on the display screen. ;
  • User/terminal data management function which is responsible for managing mobile augmented reality users and terminal related information, including:
  • user context information such as: user location information, augmented reality terminal status information (such as: terminal power, storage status);
  • the mobile augmented reality server 220 is a functional entity deployed by the augmented reality service provider on the network side, and is responsible for implementing the augmented reality server-side business logic, and providing the user with the augmented reality service according to the user service subscription relationship and the preference setting, mainly including the following functional entities. :
  • Augmented reality content/target delivery function 221, responsible for user mobile augmented reality client enhancements The receipt and response of the real service request, transmitting the augmented reality target and/or the acquired augmented reality content found by the mobile augmented reality server to the user.
  • the augmented reality content/target delivery function 221 receives the user-side augmented reality service request message sent by the mobile augmented reality client 210 (the mobile augmented reality terminal 200), wherein the augmented reality service request message includes: an augmented reality target search request, augmented reality content Acquiring an augmented reality service class request message such as a request, an augmented reality measure report request, and forwarding the augmented reality content/target selection function 222; and receiving the augmented reality target and/or augmented reality content returned by the augmented reality content/target selection function 222, And returning the augmented reality target and/or the augmented reality content to the requesting party to move the augmented reality client in the augmented reality service request response; and simultaneously receiving the network side augmented reality service notification message sent by the external support service server 240, where The augmented reality service notification message includes: a user mobile augmented reality terminal location notification message, a user mobile augmented reality terminal presentation status notification message, a user candidate augmented reality target feature notification message, etc., and forwards the increase a real content/target selection function
  • the augmented reality content/target selection function 222 is responsible for extracting the request parameters carried in the received augmented reality service request message, determining the augmented reality service type, and performing corresponding mobile augmented reality service control. Whereas, for services that require access to augmented reality targets and/or augmented reality content, relevant user contexts and/or business preferences are determined, and corresponding augmented reality targets and/or augmented reality content are obtained or updated accordingly. And processing the augmented reality target and/or the augmented reality content obtained by the access according to the augmented reality service type corresponding processing flow; specifically, receiving the user-side augmented reality service request forwarded by the augmented reality content/target delivery function 221, and extracting the request message Determine the augmented reality service type by carrying the request parameters:
  • the target search parameter carried in the request is enhanced
  • the real content/target management function 223 sends an augmented reality target search request and returns the searched augmented reality target to the augmented reality content/target delivery function 221.
  • the augmented reality content/target selection function 222 determines, according to the user preference and the service setting, whether to acquire the augmented reality content corresponding to the target position of the augmented reality target and the user terminal position. For mobile augmented reality client caching. If so, the augmented reality content/target selection function 222 transmits an augmented reality content acquisition request to the augmented reality content server 230, acquires the corresponding augmented reality content, and returns the augmented reality content/target delivery function 221 along with the searched augmented reality object.
  • the augmented reality content/target selection function 222 sends a trigger notification to the corresponding third-party value-added application server 250 to obtain the third-party value-added application service content together with the search.
  • the augmented reality target returns to the augmented reality content/target delivery function 221 .
  • the augmented reality content access address is obtained according to the content acquisition parameter carried in the request, the augmented reality content acquisition request is sent to the corresponding augmented reality content server 230, and the acquired augmented reality content is returned to the augmented reality content/target delivery. Function 221.
  • the augmented reality target metadata search request is sent to the augmented reality content/target management function 203 according to the measure report parameter carried in the request, and the measure report is notified to the legal recipient address, and the corresponding augmented reality content server is sent to the corresponding augmented reality content server.
  • 230 sends an augmented reality measure report notification.
  • the network side augmented reality service notification message forwarded by the augmented reality content/target delivery function 221 is received, and whether the augmented reality target automatic discovery process is executed is determined according to the user service setting. If yes, extracting the augmented reality target search parameter (user mobile augmented reality terminal location, user mobile augmented reality terminal presentation state, candidate augmented reality target feature) in the notification message, and transmitting the augmented reality to the augmented reality content/target management function 203
  • the target search request returns the searched augmented reality target to the augmented reality content/target delivery function 221.
  • the augmented reality content/target management function 223 is responsible for storing and managing the augmented reality target information. After receiving the augmented reality content management request sent by the augmented reality content server 230, the augmented reality content management authority control verification is performed.
  • the augmented reality content management request includes: an augmented reality content and an augmented reality target association request, an augmented reality content status publishing request, an augmented reality content deployment rule setting request, and an augmented reality measurement subscription request.
  • the augmented reality content/target management function 223 After receiving the augmented reality target search request sent by the augmented reality content/target selection function 222, the augmented reality content/target management function 223 queries the augmented reality target information storage according to the search condition and returns the search result; and, according to the augmented reality content management request As a result, the augmented reality content release status and the deployment rule change notification are sent to the augmented reality content/target selection function 222;
  • the augmented reality content server 230 provides augmented reality content associated with the published augmented reality target, such as the POI, in the mobile augmented reality server 220, including: text, image , audio, video and other multimedia information.
  • the mobile augmented reality system of the present invention further includes the following functional entities:
  • Supporting the service server 240 providing a server-side capability implementation for supporting the service required by the mobile augmented reality service, including the following functional entities:
  • a device management server which provides a terminal management service for the user mobile augmented reality terminal;
  • an XDM server stores the user augmented reality service preference and receives the mobile augmented reality server query;
  • a presence server transmitting, to the mobile augmented reality server, a presence information change notification related to the user's augmented reality business state;
  • the billing server receives the billing information reported by the mobile augmented reality server and provides a charging basis.
  • the third-party value-added application server 250 is configured to provide third-party value-added services for the augmented reality user, including the following functional entities:
  • Augmented reality advertising apps Augmented reality gaming apps, augmented reality social apps, and more.
  • the mobile augmented reality system of the present invention also relates to a communication interface between each functional entity, which is described in detail as follows:
  • the first interface (MobAR-1), which is an interface for mobile augmented reality clients to open to augmented reality applications, supports the following functions:
  • the augmented reality application implements the following functions through the MobAR-1 interface:
  • Accessing the augmented reality content provided by the mobile augmented reality client includes: acquiring augmented reality content based on location, or acquiring augmented reality content based on augmented reality target feature matching.
  • Access to other augmented reality business functions provided by the mobile augmented reality client including: enhanced reality target feature recognition, augmented reality target search and tracking, augmented reality content display, augmented reality content storage, and augmented reality measurement reporting.
  • the second interface is an interface that the mobile augmented reality server opens to the mobile augmented reality client, and supports the following functions:
  • the mobile augmented reality server implements the following functions through the MobAR-2 interface:
  • PULL augmented reality content acquisition request
  • the mobile augmented reality client receives an augmented reality measure report request of the mobile augmented reality client, and returning a response; notifying the mobile augmented reality client to delete some augmented reality content cached locally; the mobile augmented reality client implements the following functions through the MobAR-2 interface: requesting discovery of augmented reality Target, requesting augmented reality content, and requesting an augmented reality measure.
  • the third interface (MobAR-3):
  • the mobile augmented reality client is open to the mobile augmented reality server interface and supports the following functions:
  • the mobile augmented reality client implements a function through the MobAR-3 interface: receiving an augmented reality content (or target) (PUSH) delivered by the mobile augmented reality server;
  • PUSH augmented reality content
  • the mobile augmented reality server implements functions through the MobAR-3 interface: delivering (unicast) augmented reality content (or target) to the mobile augmented reality client; pushing (unicast) augmented reality content (or target) to get notifications to the mobile augmented reality client Broadcasting augmented reality content (or target) to a mobile augmented reality client;
  • the fourth interface is an interface that the mobile augmented reality server opens to the augmented reality content server, and supports the following functions:
  • the mobile augmented reality server implements a function through the MobAR-4 interface: receiving an augmented reality content management request sent by the augmented reality content server, where the augmented reality content management request comprises: augmented reality content and an augmented reality target association request, and augmented reality content status publishing request , augmented reality content deployment rule setting request, augmented reality measurement subscription request, etc.;
  • the augmented reality content server implements functionality through the MobAR-4 interface: Sending augmented reality content Manage requests to the mobile augmented reality server.
  • the augmented reality content/target selection function 222 includes the following processing unit: an augmented reality request processing unit 321 that is responsible for receiving enhancement.
  • the augmented reality service request forwarded by the real content/target delivery function 310, extracting the request parameter and determining the service type corresponding to the augmented reality request, and forwarding the augmented reality target search unit 322 or the augmented reality content obtaining unit 323 to process;
  • the augmented reality target search unit 322 is responsible for processing the augmented reality target search service request. Sending an enhanced real-target search request to the augmented reality content/target management function 330 according to the request carrying the target search parameter, and receiving the search result;
  • the augmented reality target search unit 322 transmits an augmented reality content acquisition request corresponding to the augmented reality target of the current location of the user to the augmented reality content acquisition unit 323;
  • the augmented reality content acquisition unit 323 is responsible for processing the augmented reality content acquisition service request. Sending an augmented reality content acquisition request to the augmented reality content server 400 according to the content acquisition parameter carried in the request, and receiving the returned content;
  • the augmented reality content filtering unit 324 is responsible for filtering the augmented reality target found by the augmented reality target search unit 322 according to the user context and/or the service preference, and the augmented reality content acquired by the augmented reality content acquiring unit, and returning the final result to the augmented reality content transmission.
  • the user context refers to status information related to the user and its use terminal, including: current location of the user, mobile augmented reality terminal capability (screen size, terminal power, storage space, media playback capability, etc.).
  • the user context is usually dynamically updated, and can be reported to the mobile augmented reality server through an augmented reality service request, or by requesting other external supporting function entities, such as by requesting an Open Mobile Architecture (OMA) DPE.
  • OMA Open Mobile Architecture
  • the user service preference refers to the service setting information related to the user using the augmented reality service, including: augmented reality target search range radius, augmented reality content filtering rule, augmented reality content active transmission trigger condition, and the like.
  • User service preferences can be stored on the mobile augmented reality server or by requesting other external storage entities, such as by requesting the OMA Shared Preference XDMS.
  • FIG. 3 is a schematic structural diagram of augmented reality content/target management function 223 according to an embodiment of the present invention.
  • the augmented reality content/target management function 223 includes the following processing unit: an augmented reality target information storage unit 331 that is responsible for storage enhancement.
  • the realistic target information receives the query request of the augmented reality content/target selection function 222.
  • Support different types of augmented reality goals including: points of interest (POI), people, buildings, natural scenery (mountain, rivers, etc.).
  • the stored augmented reality target information includes:
  • Augmented reality target attributes including: geographic location, name, identity, category, metadata (creation time, author, visibility) of the augmented reality target, and the relationship between the augmented reality goals;
  • associated augmented reality content attributes including: augmented reality content name, logo, format, size, release time, publisher, access address, etc.;
  • Associated augmented reality content deployment rules including: augmented reality content deployment start time, deployment period, based on the association between the same augmented reality target set by the user and different augmented reality content, the same augmented reality target based on time setting and different Correlation between augmented reality content, access control rules for additional augmented reality content, etc.;
  • an augmented reality target measurement access control list comprising: an augmented reality target measure reporting the legal recipient identifier;
  • the augmented reality content/target pushing unit 332 is responsible for receiving the augmented reality content management request sent by the augmented reality content server 400, performing the access authority control verification, and verifying the validity of the request.
  • the management request type is identified, and the augmented reality target information storage is updated according to the augmented reality content management object information carried in the request.
  • the specific example application is used to describe the system for implementing the mobile augmented reality service and the corresponding network element of the present invention, and how to implement the mobile augmented reality service by implementing interaction between the network elements.
  • FIG. 4 is a flowchart of a method for implementing a mobile augmented reality service according to an embodiment of the present invention. As shown in FIG. 4, the method for implementing a mobile augmented reality service according to the present invention includes the following steps:
  • Step S100 The mobile augmented reality server receives the augmented reality service request message.
  • the enhanced real business request includes an augmented reality target request request, an augmented reality content acquisition request, an augmented reality measurement report request, an augmented reality content management request, and the like.
  • Step S110 The mobile augmented reality server carries the message according to the augmented reality service request message.
  • the request parameters determine the type of service and perform corresponding mobile augmented reality server-side service control. Wherein, for services that need to access the augmented reality target and/or augmented reality content, relevant user contexts and/or business preferences are determined, and corresponding augmented reality targets and/or augmented reality content are obtained or updated accordingly.
  • FIG. 5 is a flowchart of a method for implementing a mobile augmented reality service according to an application example of the present invention. As shown in FIG. 5, this example is a flowchart for implementing a mobile augmented reality client requesting to discover an augmented reality target and acquiring corresponding augmented reality content. PULL mode; The method of implementing the mobile augmented reality service in this example includes the following steps:
  • Step F1 The user activates the augmented reality application on the mobile augmented reality terminal, and the augmented reality application requests the mobile augmented reality client to find the augmented reality target that can be acquired;
  • Step F2 The mobile augmented reality client collects the terminal context (latitude and longitude information) and/or the candidate augmented reality target feature (RFID identification, image feature code) by the mobile augmented reality terminal capability component, generates an augmented reality target search parameter, and moves to the mobile device.
  • the augmented reality server sends an augmented reality target search request;
  • Step F3 the augmented reality content/target delivery function in the mobile augmented reality server forwards the request to the augmented reality content/target selection function;
  • Step F4 the augmented reality content/target selection function extracts the augmented reality target search parameter (user terminal location parameter, candidate augmented reality target feature parameter) in the request, and sends an augmented reality to the augmented reality content/target management function according to the method.
  • Target search request user terminal location parameter, candidate augmented reality target feature parameter
  • Step F5 the augmented reality content/target management function retrieves the augmented reality target storage according to the target search parameter, and returns the matched augmented reality target metadata set;
  • Steps F6 to F7 if the augmented reality target search parameter is the user terminal location information, the augmented reality content/target selection function determines, according to the user preference and the service setting, whether the acquired augmented reality target is closer to the target location than the user terminal location. Corresponding augmented reality Capacity for mobile augmented reality client caching. If the augmented reality target search parameter is not the user terminal location information, the augmented reality content/target selection function sends an augmented reality content acquisition request to the augmented reality content server to obtain the corresponding augmented reality content;
  • Step F8 the augmented reality content/target selection function filters the acquired augmented reality target (or target and content) according to the user preference and the context, and obtains an augmented reality target (or target and content) that conforms to the user preference and the current state of the user terminal, and Returning to the augmented reality content/target delivery function;
  • Step F9 the augmented reality content/target delivery function returns a response to the mobile augmented reality client, carrying the acquired augmented reality target (or target and content);
  • Step F10 The mobile augmented reality client returns the discovered augmented reality target metadata to the augmented reality application, including: augmented reality target identifier, name, description, and the like.
  • the mobile augmented reality client will also cache augmented reality content acquired simultaneously.
  • the augmented reality application displays an augmented reality label corresponding to the discovered augmented reality target on the terminal screen according to its own business logic;
  • Step F11 according to the user selection operation, the augmented reality application requests the mobile augmented reality client to acquire the augmented reality content corresponding to an augmented reality target;
  • Step F12 The mobile augmented reality client generates an augmented reality content acquisition parameter according to the selected augmented reality target, and sends an augmented reality content acquisition request to the mobile augmented reality server;
  • Step F13 The augmented reality content/target delivery function in the mobile augmented reality server forwards the request to the augmented reality content/target selection function.
  • the augmented reality content/target selection function extracts the augmented reality content acquisition parameter in the request, and obtains an augmented reality content access address corresponding to the selected augmented reality target, and if the augmented reality content acquisition parameter is an associated augmented reality target identifier, the augmented reality
  • the content/target selection function will request the augmented reality content/target management function to query the corresponding augmented reality content access address;
  • Steps F14 to F15 the augmented reality content/target selection function transmits an augmented reality content acquisition request to the augmented reality content server providing the content according to the access address, and acquires the enhancement.
  • Realistic actual content
  • Step F16 the augmented reality content/target selection function filters the acquired augmented reality content according to the user preference and the context, obtains augmented reality content that conforms to the user preference and the current state of the user terminal, and returns the augmented reality content/target delivery function;
  • Step F17 the augmented reality content/target delivery function returns a response to the mobile augmented reality client, and carries the acquired augmented reality content;
  • Step F18 The mobile augmented reality client returns the acquired augmented reality actual content to the augmented reality application.
  • the augmented reality application displays the content on the terminal screen according to its own business logic.
  • FIG. 6 is a flowchart of a method for implementing a mobile augmented reality service according to application example 2 of the present invention. As shown in FIG. 6 , this example is a flowchart for implementing a mobile augmented reality server to actively discover an augmented reality target and transmit corresponding augmented reality content, which is a PUSH. Mode;
  • the method for implementing the mobile augmented reality service in this example includes the following steps:
  • the mobile augmented reality server receives the external mobile service server related to the user mobile augmented reality terminal service notification message, for example, the user location change information sent by the location based service (LBS) (enter a certain location area) And presenting a user terminal presentation status (opening the camera shooting function) sent by the service server (Presence Server), or an optional augmented reality target feature calculated according to the user moving the augmented reality terminal captured image sent by the third-party graphic image recognition server;
  • LBS location based service
  • Presence Server presenting a user terminal presentation status (opening the camera shooting function) sent by the service server (Presence Server), or an optional augmented reality target feature calculated according to the user moving the augmented reality terminal captured image sent by the third-party graphic image recognition server
  • Step F3 the augmented reality content/target delivery function in the mobile augmented reality server forwards the notification message to the augmented reality content/target selection function;
  • Step F4 the augmented reality content/target selection function determines whether to execute the augmented reality target automatic discovery process according to the user augmented reality service setting. If yes, extracting the augmented reality target search parameter (user terminal location parameter, candidate augmented reality target feature parameter) in the notification message, and sending an augmented reality target search request to the augmented reality content/target management function according to the method;
  • Step F5 the augmented reality content/target management function retrieves the augmented reality according to the target search parameter
  • the target stores, and returns a matching set of augmented reality target metadata
  • Steps F6 to F7 if the augmented reality target search parameter is the user terminal location information, the augmented reality content/target selection function determines, according to the user preference and the service setting, whether the acquired augmented reality target is closer to the target location than the user terminal location. Corresponding augmented reality content for mobile augmented reality client caching. If the augmented reality target search parameter is not the user terminal location information, the augmented reality content/target selection function sends an augmented reality content acquisition request to the augmented reality content server to obtain the corresponding augmented reality content;
  • Step F8 the augmented reality content/target selection function filters the acquired augmented reality target (or target and content) according to the user preference and the context, and obtains an augmented reality target (or target and content) that conforms to the user preference and the current state of the user terminal, and Returning to the augmented reality content/target delivery function; step F9 to step F10, the augmented reality content/target delivery function delivers the acquired augmented reality target (or target and content) to the mobile augmented reality client;
  • the mobile augmented reality client provides the augmented reality target metadata to the augmented reality application, including: augmented reality target identifier, name, description and the like.
  • the mobile augmented reality client will also cache augmented reality content acquired at the same time.
  • the augmented reality application displays an augmented reality label corresponding to the discovered augmented reality target on the augmented reality terminal screen according to its own business logic;
  • Steps F13 to F20 are completely the same as steps F11 to F18 of FIG. 4, and are not described herein again.
  • FIG. 7 is a flowchart of a method for implementing a mobile augmented reality service according to application example 3 of the present invention. As shown in FIG. 7, this example is a flowchart for implementing an augmented reality content server to manage augmented reality content, and the method for implementing the mobile augmented reality service in this example Includes the following steps:
  • the corresponding management object information including: an augmented reality target identifier "AR Target ID”, an augmented reality content identifier "AR Content ID”, and a current augmented reality content release status "Available” or "Unavailable”;
  • Step F2 the augmented reality content/target management function performs augmented reality content server access right control, and determines whether the related augmented reality content management authority is available. If the verification is performed, the augmented reality content/target management function triggers the augmented reality content publishing unit to update the augmented reality target information corresponding to the request management object in the augmented reality target information storage, that is, establish the augmented reality target and the enhancement in the request.
  • Step F3 to step F4 the mobile augmented reality server returns an enhanced real content management request response to the augmented reality content server;
  • the publishing status, and the corresponding management object information include: an augmented reality target identifier "AR Target ID”, an augmented reality content identifier "AR Content ID”, and a current augmented reality content publishing status "Available” or "Unavailable”;
  • Step F6 the augmented reality content/target management function performs augmented reality content server access right control, and determines whether the related augmented reality content management authority is available. If the verification is performed, the augmented reality content/target management function triggers the augmented reality content publishing unit to update the augmented reality target information corresponding to the request management object in the augmented reality target information storage, that is, update the augmented reality content release status in the request. ;
  • Step F7 to step F8 the mobile augmented reality server returns an enhanced real content management request response to the augmented reality content server;
  • Steps F9 to F10 the augmented reality content/target management function sends an augmented reality content release state change notification to the augmented reality content/target selection function, where the related augmented reality is carried Target identifier, augmented reality content identifier, current release status of augmented reality content, access address, etc.;
  • Step F11 the augmented reality content/target selection function moves the augmented reality client to the relevant user via the augmented reality transmission function according to the user context and/or service preference Send augmented reality content release status change notification.
  • the notification may be sent to the mobile augmented reality client that has found the corresponding augmented reality target, or may be sent to the mobile augmented reality client that has acquired the related augmented reality content, where the notification carries the corresponding augmented reality target identifier and the augmented reality content identifier. , the current release status of the augmented reality content, the access address, and the like.
  • the mobile augmented reality client performs the corresponding augmented reality service control process according to the received notification, including:
  • the augmented reality content publishing status becomes unavailable, or the prompt information is displayed in the augmented reality target display tag, or the locally cached augmented reality content is deleted;
  • augmented reality content associated with an augmented reality goal changes, or displays a hint in the Enhanced Reality Targets tab, or requests a change to the augmented reality valley,
  • the object information includes: an augmented reality target identifier "AR Target ID”, an augmented reality content identifier "AR Content ID”, and a control rule related to augmented reality content deployment access, including at least: augmented reality content deployment start time "Start time” and The deployment period "duration” is based on the association between the same augmented reality target set by the user and different augmented reality content "association based on user", the association between the same augmented reality target based on time setting and different augmented reality content "association based” On time” , access control rules for additional augmented reality content 1 J "Access control to premium content”;
  • Step F13 the augmented reality content/target management function performs augmented reality content server access Permission control, to determine whether there is related Augmented Reality content management authority. If the verification is performed, the augmented reality content/target management function triggers the augmented reality content publishing unit to update the augmented reality target information corresponding to the request management object in the augmented reality target information storage, that is, establish the augmented reality content deployment rule in the request. ;
  • Step F14 to step F15 the mobile augmented reality server returns an augmented reality content management request response to the augmented reality content server;
  • Steps F16 to F17 the augmented reality content/target management function sends an augmented reality content deployment rule change notification to the augmented reality content/target selection function, where the related augmented reality target identifier, the augmented reality content identifier, the augmented reality content deployment rule, and the like are carried;
  • Step F18 The augmented reality content/target selection function sends an augmented reality content release status change notification to the related user mobile augmented reality client via the augmented reality transmission function according to the user context and/or the service preference.
  • the mobile augmented reality client performs a corresponding augmented reality service control process based on the received notification.
  • Step F19 The augmented reality content server sends an augmented reality content management request to the mobile augmented reality server, where the request carries the augmented reality content management request type: , indicating that the user wants to subscribe or unsubscribe to the augmented reality target and the augmented reality content measurement report notification, and the corresponding management object information, including: augmented reality target identifier "AR Target ID”, augmented reality content identifier "AR Content ID”, and subscription period"Duration";
  • Step F20 the augmented reality content/target management function performs augmented reality content server access authority control, and determines whether the related augmented reality content management authority is available. If the verification is performed, the augmented reality content/target management function triggers the augmented reality content publishing unit to update the augmented reality target information corresponding to the request management object in the augmented reality target information storage, that is, adding or deleting the augmented reality target and the augmented reality content. Measure the reported object;
  • Step F21 to step F22 the mobile augmented reality server returns to the augmented reality content server Augmented Reality Content Management Request Response.
  • FIG. 8 is a flowchart of a method for implementing a mobile augmented reality service according to an application example of the present invention. As shown in FIG. 8 , this example is a flowchart for implementing an augmented reality application requesting an augmented reality measurement report. Includes the following steps:
  • Steps F1 to F2 the augmented reality application constructs and generates an augmented reality measure (AR Metrics) according to the feedback information of the augmented reality service process, including: an augmented reality tag selected by the user, and a user augmented reality content access history, for example: Access time, augmented reality target location, corresponding augmented reality content identification, etc.
  • the augmented reality application reports the augmented reality measure to the mobile augmented reality client;
  • Step F3 to step F4 the mobile augmented reality client sends a request for augmented reality measurement report to the mobile augmented reality server;
  • Step F5 to step F6 the augmented reality content/target delivery function in the mobile augmented reality server forwards the request to the augmented reality content/target selection function according to the request type;
  • Steps F7 to F8 the augmented reality content/target selection function extracts the augmented reality measure reporting parameter (related augmented reality target identifier) in the request, and sends an augmented reality target metadata search to the augmented reality content/target management function according to the method.
  • Step F9 to step F10 the augmented reality content/target selection function filters the augmented reality measure notification recipient address that does not meet the user preference and the service setting, and sends the augmented reality measure notification to the legal augmented reality content server.
  • FIG. 9 is a flowchart of a method for implementing a mobile augmented reality service according to Embodiment 5 of the present invention. As shown in FIG. 9 , this example is a flowchart for implementing a third-party value-added application service, and the method for implementing the mobile augmented reality service includes the following steps. :
  • a third-party value-added application service provider is provided through a mobile augmented reality service
  • Business cooperation agreements can provide additional value-added application services for mobile augmented reality users, including: multimedia advertising, public safety guidelines, social networking services, etc.
  • Step F1 to step F7 refer to the corresponding F1 to step F7 in the embodiment of FIG. 4;
  • the augmented reality content/target selection function determines whether to additionally provide a third-party value-added application according to the augmented reality target search parameter and the user service setting, and the judgment condition includes: the user's augmented reality target search parameter (such as the user's geographic location information, Whether the augmented reality target feature, etc., meets the third-party value-added application trigger condition, and whether the user augmented reality service setting allows the mobile augmented reality server to automatically trigger the third-party value-added application.
  • the user's augmented reality target search parameter such as the user's geographic location information, Whether the augmented reality target feature, etc., meets the third-party value-added application trigger condition, and whether the user augmented reality service setting allows the mobile augmented reality server to automatically trigger the third-party value-added application.
  • the augmented reality content/target selection function sends a trigger notification to the corresponding third-party value-added application server, carrying the augmented reality target search parameter and/or the user identifier;
  • the third-party value-added application server selects and executes the corresponding business logic according to the augmented reality target search parameter and/or the user identifier carried in the trigger notification, such as selecting an advertisement content that matches the current location of the user, or searching for social interaction related to the user.
  • the third-party value-added application server returns the obtained third-party value-added application content or content identifier to the mobile enhanced real-time server;
  • Steps F12 to F13 if the third-party value-added application server returns the content identifier, the augmented reality content/target selection function sends a third-party value-added application content acquisition request to the augmented reality content server or other content storage entity according to the identifier, and obtains the corresponding content;
  • Step F14 the augmented reality content/target selection function filters the acquired augmented reality target (content) and the third-party value-added application content according to the user preference and the context, and returns the augmented reality content/target delivery function;
  • Step F15 the augmented reality content/target delivery function returns a response to the mobile augmented reality client, carries the acquired augmented reality target (content, optional), and the third-party value-added application content;
  • Step F16 the mobile augmented reality client enhances Realistic application returns the augmented reality that has been discovered Target and third-party value-added application content, and displayed on the augmented reality terminal screen.

Abstract

本发明公开了一种实现移动增强现实业务的方法,包括:接收到增强现实业务请求后,移动增强现实服务器获取所述增强现实业务请求的参数,确定所述增强现实业务请求类型,对所请求的移动增强现实业务进行控制。本发明还公开了一种实现移动增强现实业务的系统,移动增强现实服务器以及移动增强现实终端。发明中移动增强现实业务实现方法适应不同类型的增强现实目标识别、增强现实内容获取,具有良好的可扩展性,在不同应用场景为用户提供统一的业务体验。

Description

实现移动增强现实业务的系统及方法、 终端及服务器 技术领域
本发明涉及实现移动增强现实业务的技术, 尤其涉及一种实现移动增 强现实业务的系统及方法, 以及, 移动增强现实终端、 移动增强现实服务 器。 背景技术
随着智能终端、 移动互联网技术的成熟与发展, 曾经局限于实验室的 增强现实 (AR, Augmented Reality )技术开始走进大众视野, 一大批以图 像识别、 终端定位技术为基础的互联网 /移动互联网 AR应用开始涌现, 称 为移动增强现实 (Mobile AR )应用, 这引起了业界较大关注, 逐渐成为技 术研究的热点。
移动增强现实技术的研究与应用, 将虚拟的增强现实信息应用到真实 世界, 改变了用户观察周围世界的方式一一由传统的基于文本输入的 WEB 页面浏览查询模式, 转变为基于摄像头拍摄, 捕获热点并实时浏览增强信 息的全新模式。
Mobile AR用户利用移动终端如智能手机等在拍摄周围景物的同时可 以得到增强现实业务体验, 主要存在以下业务场景: 移动终端上运行的增 强现实应用 ( AR Application )基于用户当前位置捕获 AR业务提供商部署 的增强现实目标(AR Target ), 如与地理位置相关兴趣点 (POI, Point of Interest ), 并根据用户选择获取增强现实内容(AR Content ), 包括文字、 图 片、 语音、 视频, 最终结合用户终端地理指纹信息如经纬度、 朝向等, 将 获取的增强现实内容与终端摄像头实时拍摄的周围实景在屏幕融合显示, 获取不同寻常的增强现实业务体验。 当前市场增强现实解决方案中, 不同的增强现实业务提供商各自独立 开发 AR应用, 不同 AR应用是基于不同的增强现实技术实现的, 目前的增 强现实技术主要包括以下几种: AR 目标识别技术、 AR 内容获取技术 、 AR内容展示技术等。 如此以来, AR应用开发者为不同 AR业务提供商开 发的 AR应用必须使用不同技术实现, 这无疑增加了 AR应用开发难度。 AR用户必须根据所订购 AR业务提供商的不同而选择安装不同 AR应用运 行环境, 这非常不利于用户对终端的更换, 这是因为, AR业务提供商各自 发布的 AR应用互不兼容, 用户一旦更换终端, 就需要重新安装所有 AR应 用的运行环境, 这无疑极大地阻碍了 AR应用的市场普及。
在现有增强现实解决方案中,由于 AR业务提供商各自发布的 AR应用 互不兼容, 因此 AR应用也就无法集中上线销售, 这会大大减少 AR业务提 供商的签约用户群体。另夕卜, AR业务提供商不仅需要部署 AR业务服务器, 还需要独自承担 AR内容的设计工作,这也增加了 AR业务提供商的业务运 营成本。
综上所知, 传统 AR业务提供商根据各自实现技术开展各自 AR业务, 其结果是不仅割裂了 AR应用市场, 还对广大 AR用户造成了极大的不便, 目前这已成为阻碍 AR业务市场发展的一个重要因素。 发明内容
有鉴于此, 本发明的主要目的在于提供一种实现移动增强现实业务的 系统及方法, 以及, 移动增强现实终端、 移动增强现实服务器, 能强化用 户体验效果。
为达到上述目的, 本发明的技术方案是这样实现的:
一种实现移动增强现实业务的方法, 包括:
接收到增强现实业务请求后, 移动增强现实服务器获取所述增强现实 业务请求的参数, 确定所述增强现实业务请求类型, 对所请求的移动增强 现实业务进行控制。
优选地, 所述增强现实业务请求包括以下请求的至少一种:
增强现实目标搜索请求、 增强现实内容获取请求、 增强现实测度上报 请求和增强现实内容管理请求。
优选地, 所述增强现实业务请求为增强现实目标搜索请求时, 对所请 求的移动增强现实业务进行控制, 为:
所述移动增强现实服务器根据请求中携带的目标搜索参数进行增强现 实目标匹配, 获取匹配到的增强现实目标, 并返回给所述移动增强现实终 端。
优选地, 所述增强现实业务请求为增强现实内容获取请求时, 对所请 求的移动增强现实业务进行控制, 为:
所述移动增强现实服务器根据增强现实内容获取请求中携带的内容获 取参数获取增强现实内容访问地址, 获取增强现实内容并返回给所述移动 增强现实终端。
优选地, 所述增强现实业务请求为增强现实测度上报请求时, 对所请 求的移动增强现实业务进行控制, 为:
所述移动增强现实服务器根据增强现实测度上报请求中携带的测度上 报参数进行增强现实目标元数据搜索, 获取测度上报通知合法接收方地址。
优选地, 所述增强现实业务请求为增强现实内容管理请求时, 对所请 求的移动增强现实业务进行控制, 为:
对管理请求对应的增强现实内容管理权限进行验证, 验证通过后根据 增强现实内容服务器的增强现实内容对相应增强现实内容的目标信息进行 更新。
优选地, 所述移动增强现实服务器在满足设定推送设置条件时, 获取 对应的增强现实目标和 /或增强现实内容, 并发送给移动增强现实终端。 优选地, 所述设定推送设置条件为:
根据用户偏好及业务设置确定获取发现增强现实目标中与移动增强现 实终端位置比较接近的目标所对应的增强现实内容;
或者, 设定时刻到来;
或者, 移动增强现实终端进入设定区域;
或者, 在增强现实目标搜索参数及用户业务设置符合第三方增值业务 触发条件。
一种实现移动增强现实业务的系统, 包括移动增强现实终端、 移动增 强现实服务器和增强现实内容服务器, 其中,
移动增强现实终端, 设置为向所述移动增强现实服务器发送增强现实 业务请求; 获取增强现实内容服务器中与增强现实目标相关联的增强现实 内容, 并根据所述移动增强现实终端实时状态将所述增强现实内容与所述 移动增强现实终端拍摄的实景融合并展示;
移动增强现实服务器, 设置为获取所述接收移动增强现实终端发送的 增强现实业务请求或推送请求的参数, 确定增强现实业务请求类型, 对所 请求的移动增强现实业务进行控制; 以及, 接收到增强现实内容服务器发 送的增强现实内容管理请求后, 对管理请求对应的增强现实内容管理权限 进行验证, 验证通过后更新管理请求对应的增强现实内容的目标信息; 增强现实内容服务器, 设置为提供与所述移动增强现实服务器中已部 署的增强现实目标相关联的增强现实内容的存储与管理。
优选地, 所述移动增强现实终端包括摄像头、 状态获取单元、 通信单 元和展示单元, 其中,
摄像头, 设置为实时拍摄所述移动增强现实终端周围的实景; 状态获取单元, 设置为获取所述移动增强现实终端的当前位置信息; 摄像头与地面高度、 朝向、 与地面夹角信息; 通信单元, 设置为实现与所述移动增强现实服务器的通信, 向所述移 动增强现实服务器发送增强现实业务请求, 并获取增强现实内容服务器中 与增强现实目标相关联的增强现实内容;
展示单元, 设置为利用所获取的增强现实内容, 修饰渲染所述摄像头 拍摄的实景中的增强现实目标, 并展示。
优选地, 所述增强现实业务请求包括以下请求的至少一种:
增强现实目标搜索请求、 增强现实内容获取请求、 增强现实测度上报 请求。
优选地, 所述移动增强现实服务器对于增强现实目标搜索请求, 根据 请求中携带的目标搜索参数进行增强现实目标匹配, 获取匹配到的增强现 实目标, 并返回给所述移动增强现实终端。
优选地, 所述移动增强现实服务器在增强现实目标搜索参数是用户位 置信息时, 获取对应增强现实内容及搜索到的增强现实目标, 返回给所述 移动增强现实终端。
优选地, 所述移动增强现实服务器在增强现实目标搜索参数及用户业 务设置符合第三方增值业务触发条件时, 触发第三方增值业务, 并返回执 行结果。
优选地, 所述移动增强现实服务器对于增强现实内容获取请求, 根据 增强现实内容获取请求中携带的内容获取参数获取增强现实内容访问地 址, 获取增强现实内容并返回给所述移动增强现实终端。
优选地, 所述移动增强现实服务器对于增强现实测度上报请求, 根据 增强现实测度上报请求中携带的测度上报参数进行增强现实目标元数据搜 索, 获取测度上报通知合法接收方地址。
优选地, 所述移动增强现实服务器对于推送请求, 向移动增强现实客 户端推送所获取的增强现实目标和 /或增强现实内容。 一种移动增强现实服务器, 包括增强现实内容 /目标递送功能、 增强现 实内容 /目标选择功能和增强现实内容 /目标管理功能, 其中,
增强现实内容 /目标选择功能, 设置为根据接收的移动增强现实客户端 的业务请求, 搜索增强现实目标, 选择并获取增强现实内容;
增强现实内容 /目标递送功能, 设置为通过响应移动增强现实客户端的 业务请求, 递送增强现实目标和 /或增强现实内容至移动增强现实客户端; 或者, 主动发起请求推送增强现实目标和 /或增强现实内容至移动增强现实 客户端;
增强现实内容 /目标管理功能, 设置为根据增强现实内容管理请求, 存 储并管理增强现实目标部署信息, 增强现实内容发布信息, 以及增强现实 内容緩存策略及本地緩存增强现实内容。
优选地, 所述增强现实业务请求包括以下请求的至少一种:
增强现实目标搜索请求、 增强现实内容获取请求、 增强现实测度上报 请求。
优选地,所述增强现实内容 /目标选择功能对于增强现实目标搜索请求, 根据请求中携带的目标搜索参数搜索增强现实目标, 选择并获取增强现实 内容。
优选地,所述增强现实内容 /目标选择功能对于增强现实内容获取请求, 根据增强现实内容获取请求中携带的内容获取参数获取增强现实内容访问 地址, 获取增强现实内容。
优选地,所述增强现实内容 /目标选择功能对于增强现实测度上报请求, 根据增强现实测度上报请求中携带的测度上报参数进行增强现实目标元数 据搜索, 获取测度上报通知合法接收方地址。
优选地, 所述增强现实内容 /目标管理功能接收到增强现实内容管理请 求后, 进行增强现实内容管理权限的验证, 并在验证通过后促使增强现实 内容 /目标管理功能更新与管理请求相对应增强现实目标信息。
优选地, 所述增强现实内容 /目标管理功能根据增强现实内容管理请求 执行结果发送增强现实内容发布状态、 部署规则变化信息。
一种移动增强现实终端, 包括增强现实内容 /目标获取功能、 增强现实 内容 /目标展示功能和用户 /终端数据管理功能, 其中,
增强现实内容 /目标获取功能, 用于根据增强现实应用的请求, 向移动 增强现实服务器请求获取增强现实内容和 /或增强现实目标;
增强现实内容 /目标展示功能, 用于根据增强现实应用请求, 提供增强 现实内容显示机制;
用户 /终端数据管理功能, 用于收集并管理用户增强现实个性化及上下 文相关信息。
本发明克服了现有 AR解决方案中应用开发难度大, 业务部署成本高, 以及用户体验不一致的问题,对 AR市场的发展起到良好的推动作用。本发 明移动增强现实系统(服务器、 客户端)为增强现实应用开发开放 API, 提 供增强现实业务底层能力支撑, 包括: 目标搜索、 内容获取等, 从而降低 增强现实应用开发难度; 移动增强现实服务器为增强现实内容服务器提供 增强现实内容发布管理接口, 降低增强现实业务部署成本; 本发明中移动 增强现实业务实现方法适应不同类型的增强现实目标识别、 增强现实内容 获取, 具有良好的可扩展性, 在不同应用场景为用户提供统一的业务体验。 附图说明
图 1为本发明实施例实现移动增强现实业务的系统的组成结构示意图; 图 2为本发明实施例增强现实内容 /目标选择功能 222的组成结构示意 图;
图 3为本发明实施例增强现实内容 /目标管理功能 223的组成结构示意 图; 图 4为本发明实施例实现移动增强现实业务的方法的流程图; 图 5为本发明应用例一实现移动增强现实业务的方法的流程图; 图 6为本发明应用例二实现移动增强现实业务的方法的流程图; 图 7为本发明应用例三实现移动增强现实业务的方法的流程图; 图 8为本发明应用例四实现移动增强现实业务的方法的流程图; 图 9为本发明应用例五实现移动增强现实业务的方法的流程图。 具体实施方式
为使本发明的目的、 技术方案和优点更加清楚明白, 以下举实施例并 参照附图, 对本发明进一步详细说明。
图 1为本发明实施例实现移动增强现实业务的系统的组成结构示意图, 如图 1 所示, 本发明实现移动增强现实业务的系统包括移动增强现实终端 200、 移动增强现实服务器 220、 增强现实内容服务器 230、 支撑业务服务 器 240和第三方增值应用服务器 250; 其中, 移动增强现实终端 200、 移动 增强现实服务器 220、增强现实内容服务器 230是实现本发明移动增强现实 业务的基本核心网元, 支撑业务服务器 240和第三方增值应用服务器 250 用于优化本发明的移动增强现实业务。移动增强现实服务器 220、增强现实 内容服务器 230、支撑业务服务器 240和第三方增值应用服务器 250均为网 络侧网元, 移动增强现实终端 200通过移动网络等实现对上述网络侧服务 器的访问, 如发送相关业务请求, 获取相关服务器返回的所请求的业务内 容。 本领域技术人员应当理解, 移动增强现实终端 200 实现对移动网络的 访问, 实现与上述服务器的通信并获取相关业务内容是容易实现的, 本发 明不再赘述上述的通信细节。 以下, 对上述各网元所实现的功能以及其之 间是如何实现交互的, 进行详细描述。
移动增强现实终端 200, 用户使用的具备增强现实业务功能的移动终 端, 除了提供基本的通信功能以外, 还可以为用户提供增强现实业务体验, 还包括以下功能模块:
终端能力部件 201 , 负责移动增强现实业务实现所需信息的采集与展 示, 包括:
摄像头, 用来实时拍摄用户周围物理世界的实景信息(Camera View )。 也可以使用具备显存功能的摄像头, 以实时緩存拍摄到的实景信息。
显示屏幕, 为用户呈现摄像头拍摄实景信息在增强现实内容修饰渲染 下的增强现实内容视图 (AR View, Augmented Reality View ); 具体的, 显 示屏幕主要用于展示根据从网络侧的增强现实内容服务器 230获取的增强 现实内容对对应的增强现实目标进行渲染,并展示给移动增强现实终端 200 的用户。 也就是说, 终端能力部件 201 需要在摄像头所拍摄的实景信息中 定位出待进行特别显示的增强现实目标, 利用所获取的增强现实目标的对 应的增强现实内容对该现实目标进行渲染, 然后展示给用户。
全球卫星定位系统(GPS, Global Positioning System )模块、 指南针、 传感器等, 其中 GPS模块与 GPS卫星通讯, 实时提供终端位置信息(如经 纬度信息)。 指南针、 传感器, 用来采集用户终端状态, 包括: 摄像头朝向、 与地面夹角等; 这里, 移动增强现实终端 200之所以具备这些功能模块, 主要是为实现对增强现实目标进行相应的图像处理而设置的, 也就是说, 需要移动增强现实终端 200在自身摄像头所拍摄的实景信息中定位出增强 现实目标, 以方便对其进行相应的图像处理。
射频识别(RFID, Radio Frequency Identification )阅读器、 二维码扫描 器、 图像识别、 计算机视觉处理等模块, 实现备选增强现实目标特征进行 扫描、 输入与提取等。
增强现实应用 202,提供移动增强现实业务实现的终端侧应用程序,通 过本发明移动增强现实接口 MobAR-1访问移动增强现实客户端 210提供的 增强现实业务支撑能力, 在此基础上提供不同形式的增强现实业务体验, 如增强现实多媒体广告应用、 增强现实导航应用、 增强现实游戏应用等。 支撑业务客户端 203 ,提供移动增强现实业务实现所需支撑业务的客户 端 能力实现, 包括:
设备管理客户端, 基于 DM协议, 实现设备管理客户端与设备管理服 务器之间的通信, 为用户移动增强现实终端提供设备管理功能;
可扩展标记语言 (XML, Extensible Markup Language )文档管理客户 端, 基于 XML配置访问协议(XCAP, XML Configuration Access Protocol ) 实现 X显示管理器( XDM, X Display Manager )客户端与 XDM服务器之 间的通信, 为用户增强现实业务提供用户偏好和业务设置管理功能;
呈现客户端, 基于会话初始协议( SIP, Session Initiation Protocol ), 用 于呈现客户端与呈现服务器(包含于支撑业务服务器 240中)之间的通信, 为用户移动增强现实终端提供呈现信息发布功能;
移动增强现实客户端 210,提供增强现实业务能力客户端功能实体, 负 责向增强现实服务器 220发送增强现实目标搜索请求, 获取增强现实内容 服务器 230 中与增强现实目标相关联的增强现实内容, 并根据移动增强现 实终端 200实时状态控制增强现实内容与终端能力部件 201摄像头拍摄实 景的融合展示。 包括以下功能模块:
增强现实内容 /目标获取功能, 负责接收运行在移动增强现实终端 200 上增强现实应用 202的请求,联系移动增强现实服务器 220,请求搜索增强 现实目标, 并获取相关增强现实内容, 具体包括:
1 )接收增强现实应用 202发送增强现实目标搜索请求, 或者增强现实 内容获取请求;
2 )向移动增强现实服务器 220请求获取, 或者接收移动增强现实服务 器 220推送, 下列信息:
增强现实目标和 /或增强现实内容; 增强现实目标和 /或增强现实内容的引用;
3 )緩存来自移动增强现实服务器 220的增强现实目标或者增强现实内 谷,
4 )管理(譬如: 更新、 删除)緩存的增强现实目标或者增强现实内容; 5 )返回所请求的增强现实目标或者增强现实内容至增强现实应用 202; 增强现实内容 /目标获取功能可以通过下述方式获取增强现实目标和 / 或增强现实内容:
PULL模式: 增强现实内容 /目标获取功能主动请求移动增强现实服务 器 220搜索增强现实目标, 或者获取增强现实内容;
PUSH模式:移动增强现实服务器 220根据用户增强现实业务设置推送 增强现实目标, 或者增强现实内容至增强现实内容 /目标获取功能。
增强现实内容 /目标展示功能, 负责根据终端能力部件 201采集的用户 移动增强现实终端 200 实时状态信息, 控制所述增强现实内容获取模块获 取到的增强现实内容与摄像头拍摄实景在显示屏幕上融合显示;
用户 /终端数据管理功能, 负责管理移动增强现实用户、终端相关信息, 包括:
1 )设置并管理用户个性化偏好, 譬如: 增强现实目标和 /或增强现实内 容获取偏好、 增强现实目标和 /或增强现实内容展示偏好;
2 )收集并处理用户上下文信息, 譬如: 用户位置信息、 增强现实终端 状态信息(譬如: 终端电量、 存储状态);
3 )管理增强现实目标或者增强现实内容緩存。
移动增强现实服务器 220,是增强现实业务提供商部署在网络侧的功能 实体, 负责实现增强现实服务器端业务逻辑, 根据用户业务订购关系以及 偏好设置, 为用户提供增强现实服务, 主要包括以下功能实体:
增强现实内容 /目标递送功能 221 , 负责用户移动增强现实客户端增强 现实业务请求的接收与应答, 为用户传输移动增强现实服务器发现的增强 现实目标和 /或获取的增强现实内容。
增强现实内容 /目标递送功能 221接收移动增强现实客户端 210 (移动 增强现实终端 200 )发送的用户侧增强现实业务请求消息, 其中, 增强现实 业务请求消息包括: 增强现实目标搜索请求、 增强现实内容获取请求、 增 强现实测度上报请求等增强现实业务类请求消息, 并转发增强现实内容 /目 标选择功能 222; 以及, 接收增强现实内容 /目标选择功能 222返回的增强 现实目标和 /或增强现实内容, 并在增强现实业务请求应答中将所述增强现 实目标和 /或增强现实内容返回至请求方移动增强现实客户端; 同时, 还接 收外部支撑业务服务器 240发送的网络侧增强现实业务通知消息, 其中, 增强现实业务通知消息包括: 用户移动增强现实终端位置通知消息、 用户 移动增强现实终端呈现状态通知消息、 用户备选增强现实目标特征通知消 息等, 并转发增强现实内容 /目标选择功能 222; 以及, 接收增强现实内容 / 目标选择功能 222返回的增强现实目标和 /或增强现实内容, 并根据返回响 应中携带增强现实用户标识, 将所述增强现实目标和 /或增强现实内容递送 至与该用户对应的移动增强现实客户端。
增强现实内容 /目标选择功能 222, 负责提取所接收增强现实业务请求 消息中携带的请求参数, 确定增强现实业务类型, 并进行相应的移动增强 现实业务控制。 其中, 对于需要访问增强现实目标和 /或增强现实内容的业 务, 确定相关用户上下文和 /或业务偏好, 据此获取或更新对应增强现实目 标和 /或增强现实内容。 并根据增强现实业务类型对应处理流程处理所述访 问得到的增强现实目标和 /或增强现实内容; 具体的, 接收增强现实内容 / 目标递送功能 221 转发的用户侧增强现实业务请求, 提取该请求消息中携 带的请求参数, 确定增强现实业务类型:
对于增强现实目标搜索请求, 根据请求中携带的目标搜索参数向增强 现实内容 /目标管理功能 223发送增强现实目标搜索请求, 并将搜索的增强 现实目标返回增强现实内容 /目标递送功能 221。
如果增强现实目标搜索参数是用户位置信息, 则增强现实内容 /目标选 择功能 222根据用户偏好及业务设置判断是否同时获取所发现增强现实目 标中与用户终端位置比较接近目标所对应的增强现实内容, 以供移动增强 现实客户端緩存。 若是, 则增强现实内容 /目标选择功能 222向增强现实内 容服务器 230发送增强现实内容获取请求, 获取对应增强现实内容并连同 搜索到的增强现实目标返回增强现实内容 /目标递送功能 221。
如果增强现实目标搜索参数及用户业务设置符合第三方增值应用触发 条件,则增强现实内容 /目标选择功能 222向对应第三方增值应用服务器 250 发送触发通知, 获取第三方增值应用服务内容并连同搜索的增强现实目标 返回增强现实内容 /目标递送功能 221。
对于增强现实内容获取请求 , 根据请求中携带的内容获取参数得到增 强现实内容访问地址, 向对应增强现实内容服务器 230发送增强现实内容 获取请求, 并将获取的增强现实内容返回增强现实内容 /目标递送功能 221。
对于增强现实测度上报请求, 根据请求中携带的测度上报参数向增强 现实内容 /目标管理功能 203发送增强现实目标元数据搜索请求, 获取测度 上报通知合法接收方地址, 并向对应的增强现实内容服务器 230发送增强 现实测度上报通知。
接收增强现实内容 /目标递送功能 221转发的网络侧增强现实业务通知 消息, 根据用户业务设置判断是否执行增强现实目标自动发现流程。 若是, 则提取所述通知消息中增强现实目标搜索参数(用户移动增强现实终端位 置、 用户移动增强现实终端呈现状态、 备选增强现实目标特征), 向增强现 实内容 /目标管理功能 203发送增强现实目标搜索请求, 并将搜索的增强现 实目标返回增强现实内容 /目标递送功能 221。 增强现实内容 /目标管理功能 223 , 负责增强现实目标信息的存储和管 理。 接收到增强现实内容服务器 230发送的增强现实内容管理请求后, 执 行增强现实内容管理权限控制验证。 若通过验证, 更新与管理请求相对应 增强现实目标信息存储。 所述增强现实内容管理请求包括: 增强现实内容 与增强现实目标关联请求, 增强现实内容状态发布请求, 增强现实内容部 署规则设置请求, 以及增强现实测度订阅请求。
增强现实内容 /目标管理功能 223 接收到增强现实内容 /目标选择功能 222发送的增强现实目标搜索请求后,根据搜索条件查询增强现实目标信息 存储并返回搜索结果; 以及, 根据增强现实内容管理请求执行结果向增强 现实内容 /目标选择功能 222发送增强现实内容发布状态、 部署规则变化通 知;
增强现实内容服务器 230 ,增强现实内容提供商部署在网络侧的功能实 体,提供与移动增强现实服务器 220中已发布增强现实目标,如兴趣点 POI, 相关联的增强现实内容, 包括: 文字、 图像、 音频、 视频等多媒体信息。
为更好地实现移动增强现实业务, 本发明的移动增强现实系统还包括 以下功能实体:
支撑业务服务器 240,提供移动增强现实业务实现所需支撑业务的服务 器端能力实现, 包括以下功能实体:
设备管理服务器, 为用户移动增强现实终端提供终端管理服务; XDM服务器,存储用户增强现实业务偏好并接收移动增强现实服务器 查询;
呈现服务器, 向移动增强现实服务器发送与用户增强现实业务状态相 关的呈现信息变化通知;
计费服务器, 接收移动增强现实服务器上报的计费信息并提供收费依 据。 第三方增值应用服务器 250,设置为为增强现实用户提供第三方增值服 务, 包括以下功能实体:
增强现实广告应用、 增强现实游戏应用、 增强现实社交应用等。
另外, 本发明的移动增强现实系统还涉及了一些各功能实体之间的通 信接口, 进行详细描述, 具体如下:
第一接口 (MobAR-1 ), 是移动增强现实客户端开放给增强现实应用的 接口, 支持下述功能:
增强现实应用通过 MobAR-1接口实现下述功能:
访问移动增强现实客户端提供的增强现实内容, 包括: 基于位置获取 增强现实内容, 或者, 基于增强现实目标特征匹配获取增强现实内容。
访问移动增强现实客户端提供的其他增强现实业务功能, 包括: 增强 现实目标特征识别, 增强现实目标搜索与跟踪, 增强现实内容展示, 增强 现实内容存储以及增强现实测度上报等。
第二接口 (MobAR-2 ), 是移动增强现实服务器开放给移动增强现实客 户端的接口, 支持下述功能:
移动增强现实服务器通过 MobAR-2接口实现下述功能:
接收移动增强现实客户端的增强现实目标搜索请求, 并返回响应; 接收移动增强现实客户端的增强现实内容获取请求(PULL ), 并返回 响应;
接收移动增强现实客户端的增强现实测度上报请求, 并返回响应; 通知移动增强现实客户端删除本地緩存的一些增强现实内容; 移动增强现实客户端通过 MobAR-2接口实现下述功能: 请求发现增强 现实目标, 请求获取增强现实内容, 以及请求上报增强现实测度。
第三接口 (MobAR-3 ): 移动增强现实客户端开放给移动增强现实服务 器的接口, 支持下述功能: 移动增强现实客户端通过 MobAR-3接口实现功能:接收移动增强现实 服务器递送的增强现实内容(或者目标)( PUSH );
移动增强现实服务器通过 MobAR-3接口实现功能: 递送(单播 )增强 现实内容(或目标) 至移动增强现实客户端; 推送(单播)增强现实内容 (或目标)获取通知至移动增强现实客户端; 广播增强现实内容(或者目 标) 至移动增强现实客户端;
第四接口 (MobAR-4 ), 是移动增强现实服务器开放给增强现实内容服 务器的接口, 支持下述功能:
移动增强现实服务器通过 MobAR-4接口实现功能:接收增强现实内容 服务器发送的增强现实内容管理请求, 其中, 增强现实内容管理请求包括: 增强现实内容与增强现实目标关联请求, 增强现实内容状态发布请求, 增 强现实内容部署规则设置请求, 增强现实测度订阅请求等;
增强现实内容服务器通过 MobAR-4接口实现功能: 发送增强现实内容 管理请求至移动增强现实服务器。
图 2为本发明实施例增强现实内容 /目标选择功能 222的组成结构示意 图, 如图 2所示, 增强现实内容 /目标选择功能 222包括下述处理单元: 增强现实请求处理单元 321 ,负责接收增强现实内容 /目标递送功能 310 转发的增强现实业务请求, 提取请求参数并确定增强现实请求对应的业务 类型, 转发增强现实目标搜索单元 322或者增强现实内容获取单元 323处 理;
增强现实目标搜索单元 322, 负责处理增强现实目标搜索业务请求。根 据请求中携带目标搜索参数向增强现实内容 /目标管理功能 330发送增强现 实目标搜索请求, 并接收搜索结果;
如果增强现实目标搜索参数是用户位置信息, 且用户偏好及业务设置 允许同时获取所发现增强现实目标中与用户终端位置比较接近目标所对应 增强现实内容,则增强现实目标搜索单元 322向增强现实内容获取单元 323 发送与用户当前位置接近增强现实目标对应增强现实内容获取请求;
增强现实内容获取单元 323 , 负责处理增强现实内容获取业务请求。根 据请求中携带的内容获取参数向增强现实内容服务器 400发送增强现实内 容获取请求, 并接收返回内容;
增强现实内容过滤单元 324, 负责根据用户上下文和 /或业务偏好过滤 增强现实目标搜索单元 322发现的增强现实目标, 以及增强现实内容获取 单元获取的增强现实内容, 并将最终结果返回增强现实内容传输单元 321 ; 用户上下文及偏好 340, 代表增强现实内容 /目标选择功能 222获取的 增强现实业务使用过程中用户相关信息。
用户上下文是指与用户及其使用终端相关状态信息, 包括: 用户当前 位置、 移动增强现实终端能力 (屏幕尺寸、 终端电量、 存储空间、 媒体播 放能力等)。 用户上下文通常动态更新, 可以通过增强现实业务请求上报移 动增强现实服务器, 也可以通过请求其他外部支撑功能实体获取, 如通过 请求开放式移动体系结构 (OMA, Open Mobile Architecture ) DPE获取。
用户业务偏好是指是指与用户使用增强现实业务相关业务设置信息, 包括: 增强现实目标搜索范围半径、 增强现实内容过滤规则、 增强现实内 容主动传输触发条件等。 用户业务偏好可以存储在移动增强现实服务器, 也可以通过请求其他外部存储实体获取, 如通过请求 OMA Shared Preference XDMS获取。
图 3为本发明实施例增强现实内容 /目标管理功能 223的组成结构示意 图, 如图 3所示, 增强现实内容 /目标管理功能 223包括以下处理单元: 增强现实目标信息存储单元 331 , 负责存储增强现实目标信息,接收增 强现实内容 /目标选择功能 222的查询请求。支持不同类型的增强现实目标, 包括: 兴趣点 (POI )、 人、 建筑物、 自然景物 (山川、 河流)等。 所存储的增强现实目标信息包括:
1 )增强现实目标属性, 包括: 增强现实目标的地理位置、 名称、 标识、 类别、 元数据(创建时间、 作者、 是否可见), 以及增强现实目标之间关系 等;
2 )相关联增强现实内容属性, 包括: 增强现实内容的名称、 标识、 格 式、 尺寸、 发布时间、 发布者、 访问地址等;
3 )相关联增强现实内容部署规则, 包括: 增强现实内容部署开始时间、 部署周期, 基于用户设置的相同增强现实目标与不同增强现实内容之间的 关联, 基于时间设置的相同增强现实目标与不同增强现实内容之间的关联, 针对额外增强现实内容的访问控制规则等;
4 )增强现实目标测度访问控制列表, 包括: 增强现实目标测度上报通 知的合法接收者标识;
增强现实内容 /目标推送单元 332, 负责接收增强现实内容服务器 400 发送的增强现实内容管理请求, 执行访问权限控制验证, 验证请求的合法 性。 识别管理请求类型, 并根据请求中携带的增强现实内容管理对象信息 更新增强现实目标信息存储。
以下通过具体的示例应用, 对本发明的实现移动增强现实业务的系统 及其相应网元, 以及各网元之间如何实现交互而实现移动增强现实业务的, 进行详细的描述。
图 4为本发明实施例实现移动增强现实业务的方法的流程图, 如图 4 所示, 本发明实现移动增强现实业务的方法包括以下步驟:
步驟 S100, 移动增强现实服务器接收增强现实业务请求消息。 所述增 强现实业务请求包括增强现实目标发现请求、 增强现实内容获取请求、 增 强现实测度上报请求、 增强现实内容管理请求等增强现实业务类请求消息。
步驟 S110, 移动增强现实服务器根据所述增强现实业务请求消息携带 的请求参数确定业务类型并进行相应的移动增强现实服务器端业务控制。 其中, 对于需要访问增强现实目标和 /或增强现实内容的业务, 确定相关用 户上下文和 /或业务偏好, 据此获取或更新对应增强现实目标和 /或增强现实 内容。
以下通过具体示例, 进一步阐明本发明技术方案的实质。
图 5为本发明应用例一实现移动增强现实业务的方法的流程图,如图 5 所示, 本示例是实现移动增强现实客户端请求发现增强现实目标并获取相 应增强现实内容的流程图, 为 PULL模式; 本示例实现移动增强现实业务 的方法包括以下步驟:
步驟 F1 , 用户启动移动增强现实终端上的增强现实应用, 增强现实应 用请求移动增强现实客户端发现可获取的增强现实目标;
步驟 F2, 移动增强现实客户端通过移动增强现实终端能力部件采集终 端上下文(经纬度信息 )和 /或备选增强现实目标特征( RFID标识、 图像特 征码), 生成增强现实目标搜索参数, 并向移动增强现实服务器发送增强现 实目标搜索请求;
步驟 F3 ,移动增强现实服务器中增强现实内容 /目标递送功能将该请求 转发增强现实内容 /目标选择功能;
步驟 F4, 增强现实内容 /目标选择功能提取所述请求中的增强现实目标 搜索参数 (用户终端位置参数、 备选增强现实目标特征参数), 并据此向增 强现实内容 /目标管理功能发送增强现实目标搜索请求;
步驟 F5 ,增强现实内容 /目标管理功能根据目标搜索参数检索增强现实 目标存储, 并返回匹配到的增强现实目标元数据集合;
步驟 F6至步驟 F7, 如果增强现实目标搜索参数是用户终端位置信息, 则增强现实内容 /目标选择功能根据用户偏好及业务设置判断是否同时获取 所发现增强现实目标中与用户终端位置比较接近目标所对应的增强现实内 容, 以供移动增强现实客户端緩存。 如果增强现实目标搜索参数不是用户 终端位置信息, 则增强现实内容 /目标选择功能向增强现实内容服务器发送 增强现实内容获取请求, 获取对应增强现实内容;
步驟 F8, 增强现实内容 /目标选择功能根据用户偏好及上下文过滤所获 取的增强现实目标(或目标及内容), 得到符合用户偏好及用户终端当前状 态的增强现实目标(或目标及内容), 并返回增强现实内容 /目标递送功能; 步驟 F9, 增强现实内容 /目标递送功能向移动增强现实客户端返回应 答, 携带所获取的增强现实目标(或目标及内容);
步驟 F10,移动增强现实客户端向增强现实应用返回已发现的增强现实 目标元数据, 包括: 增强现实目标标识、 名称、 描述等信息。 此外, 移动 增强现实客户端还将緩存同时获取的增强现实内容。 增强现实应用则根据 自身业务逻辑在终端屏幕上展示与已发现增强现实目标对应的增强现实标 签;
步驟 F11 ,根据用户选择操作,增强现实应用请求移动增强现实客户端 获取与某个增强现实目标对应的增强现实内容;
步驟 F12,移动增强现实客户端根据所选择增强现实目标生成增强现实 内容获取参数, 向移动增强现实服务器发送增强现实内容获取请求;
步驟 F13 , 移动增强现实服务器中增强现实内容 /目标递送功能将该请 求转发增强现实内容 /目标选择功能。增强现实内容 /目标选择功能提取所述 请求中增强现实内容获取参数, 得到与所选择增强现实目标对应的增强现 实内容访问地址, 若增强现实内容获取参数为相关联增强现实目标标识, 则增强现实内容 /目标选择功能将请求增强现实内容 /目标管理功能查询对 应增强现实内容访问地址;
步驟 F14至步驟 F15, 增强现实内容 /目标选择功能根据访问地址向提 供该内容的增强现实内容服务器发送增强现实内容获取请求, 并获取增强 现实实际内容;
步驟 F16, 增强现实内容 /目标选择功能根据用户偏好及上下文过滤所 获取的增强现实内容, 得到符合用户偏好及用户终端当前状态的增强现实 内容, 并返回增强现实内容 /目标递送功能;
步驟 F17, 增强现实内容 /目标递送功能向移动增强现实客户端返回应 答, 携带所获取的增强现实内容;
步驟 F18,移动增强现实客户端向增强现实应用返回已获取的增强现实 实际内容。 增强现实应用则根据自身业务逻辑在终端屏幕上展示该内容。
图 6为本发明应用例二实现移动增强现实业务的方法的流程图,如图 6 所示, 本示例是实现移动增强现实服务器主动发现增强现实目标并传输相 应增强现实内容的流程图, 为 PUSH模式; 本示例实现移动增强现实业务 的方法包括以下步驟:
步驟 F1至步驟 F2,移动增强现实服务器接收外部支撑业务服务器有关 用户移动增强现实终端业务通知消息, 譬如基于位置服务(LBS, Location Based Service ) Server发送的用户位置变化信息(进入某一位置区域), 以 及呈现业务服务器( Presence Server )发送的用户终端呈现状态 (打开摄像 头拍摄功能), 或者第三方图形图像识别服务器发送的根据用户移动增强现 实终端拍摄图像计算分析出的备选增强现实目标特征;
步驟 F3 , 移动增强现实服务器中增强现实内容 /目标递送功能将该通知 消息转发增强现实内容 /目标选择功能;
步驟 F4,增强现实内容 /目标选择功能根据用户增强现实业务设置判断 是否执行增强现实目标自动发现流程。 若是, 则提取所述通知消息中增强 现实目标搜索参数(用户终端位置参数、 备选增强现实目标特征参数), 并 据此向增强现实内容 /目标管理功能发送增强现实目标搜索请求;
步驟 F5 ,增强现实内容 /目标管理功能根据目标搜索参数检索增强现实 目标存储, 并返回匹配到的增强现实目标元数据集合;
步驟 F6至步驟 F7, 如果增强现实目标搜索参数是用户终端位置信息, 则增强现实内容 /目标选择功能根据用户偏好及业务设置判断是否同时获取 所发现增强现实目标中与用户终端位置比较接近目标所对应的增强现实内 容, 以供移动增强现实客户端緩存。 如果增强现实目标搜索参数不是用户 终端位置信息, 则增强现实内容 /目标选择功能向增强现实内容服务器发送 增强现实内容获取请求, 获取对应增强现实内容;
步驟 F8, 增强现实内容 /目标选择功能根据用户偏好及上下文过滤所获 取的增强现实目标(或目标及内容), 得到符合用户偏好及用户终端当前状 态的增强现实目标(或目标及内容), 并返回增强现实内容 /目标递送功能; 步驟 F9至步驟 F10,增强现实内容 /目标递送功能向移动增强现实客户 端递送所获取的增强现实目标(或目标及内容);
步驟 F11至步驟 F12,移动增强现实客户端向增强现实应用提供已发现 的增强现实目标元数据, 包括: 增强现实目标标识、 名称、 描述等信息。 此外, 移动增强现实客户端还将緩存同时获取的增强现实内容。 增强现实 应用则根据自身业务逻辑在增强现实终端屏幕上展示与已发现增强现实目 标对应的增强现实标签;
步驟 F13至步驟 F20, 与图 4的步驟 F11至步驟 F18完全相同, 这里 不再赘述。
图 7为本发明应用例三实现移动增强现实业务的方法的流程图,如图 7 所示, 本示例是实现增强现实内容服务器管理增强现实内容的流程图, 本 示例实现移动增强现实业务的方法包括以下步驟:
步驟 F1 , 增强现实内容服务器发送增强现实内容管理请求至移动增强 现实服务器, 所述请求携带增强现实内容管理请求类型字段: "Type=Association" , 表示希望建立增强现实目标与增强现实内容之间联 系, 以及相应管理对象信息, 包括: 增强现实目标标识 "AR Target ID" , 增强现实内容标识 " AR Content ID" , 以及当前增强现实内容发布状态 "Available" 或 "Unavailable";
步驟 F2, 增强现实内容 /目标管理功能执行增强现实内容服务器访问权 限控制, 判断是否具备相关增强现实内容管理权限。 若通过验证, 则增强 现实内容 /目标管理功能触发增强现实内容发布单元更新增强现实目标信息 存储中与所述请求管理对象相对应的增强现实目标信息, 即建立所述请求 中增强现实目标与增强现实内容之间的联系;
步驟 F3至步驟 F4,移动增强现实服务器向增强现实内容服务器返回增 强现实内容管理请求应答;
步驟 F5 , 增强现实内容服务器发送增强现实内容管理请求至移动增强 现实服务器, 所述请求携带增强现实内容管理请求类型字段: "Type=Publication" ,表示请求更新与增强现实目标相联系的增强现实内容 发布状态, 以及相应管理对象信息, 包括: 增强现实目标标识 "AR Target ID" , 增强现实内容标识 "AR Content ID" , 以及当前增强现实内容发布状 态 "Available" 或 "Unavailable";
步驟 F6, 增强现实内容 /目标管理功能执行增强现实内容服务器访问权 限控制, 判断是否具备相关增强现实内容管理权限。 若通过验证, 则增强 现实内容 /目标管理功能触发增强现实内容发布单元更新增强现实目标信息 存储中与所述请求管理对象相对应的增强现实目标信息, 即更新所述请求 中增强现实内容发布状态;
步驟 F7至步驟 F8,移动增强现实服务器向增强现实内容服务器返回增 强现实内容管理请求应答;
步驟 F9至步驟 F10, 增强现实内容 /目标管理功能向增强现实内容 /目 标选择功能发送增强现实内容发布状态变化通知, 其中携带相关增强现实 目标标识、 增强现实内容标识、 增强现实内容当前发布状态、 访问地址等; 步驟 F11 , 增强现实内容 /目标选择功能根据用户上下文和 /或业务偏好 经由增强现实传输功能向相关用户移动增强现实客户端发送增强现实内容 发布状态变化通知。 可以向已经发现对应增强现实目标的移动增强现实客 户端发送通知, 也可能向已经获取相关增强现实内容的移动增强现实客户 端发送通知, 所述通知中携带对应增强现实目标标识、 增强现实内容标识、 增强现实内容当前发布状态、 访问地址等。
移动增强现实客户端根据接收到的通知执行相应增强现实业务控制流 程, 包括:
如果增强现实内容发布状态变为不可用, 或者在增强现实目标展示标 签中显示提示信息, 或者删除本地緩存的增强现实内容;
如果与某个增强现实目标相关联的增强现实内容发生改变, 或者在增 强现实目标展示标签中显示提示信息, 或者请求获取变化后的增强现实内 谷,
步驟 F12,增强现实内容服务器发送增强现实内容管理请求至移动增强 现实服务器, 所述请求携带增强现实内容管理请求类型字段: "Type=Deployment" , 表示希望设置增强现实内容的部署规则, 以及相应 管理对象信息, 包括: 增强现实目标标识 "AR Target ID" , 增强现实内容 标识 "AR Content ID" , 以及与增强现实内容部署访问相关控制规则, 至少 包括: 增强现实内容部署开始时间 "Start time" 及部署周期 "duration" , 基 于用户设置的同一增强现实目标与不同增强现实内容之间的关联 "association based on user" ,基于时间设置的同一增强现实目标与不同增强 现实内容之间的关联 "association based on time" ,针对额外增强现实内容的 访问控制规贝1 J "Access control to premium content";
步驟 F13 , 增强现实内容 /目标管理功能执行增强现实内容服务器访问 权限控制, 判断是否具备相关增强现实内容管理权限。 若通过验证, 则增 强现实内容 /目标管理功能触发增强现实内容发布单元更新增强现实目标信 息存储中与所述请求管理对象相对应的增强现实目标信息, 即建立所述请 求中增强现实内容部署规则;
步驟 F14至步驟 F15,移动增强现实服务器向增强现实内容服务器返回 增强现实内容管理请求应答;
步驟 F16至步驟 F17, 增强现实内容 /目标管理功能向增强现实内容 /目 标选择功能发送增强现实内容部署规则变化通知, 其中携带相关增强现实 目标标识、 增强现实内容标识、 增强现实内容部署规则等;
步驟 F18, 增强现实内容 /目标选择功能根据用户上下文和 /或业务偏好 经由增强现实传输功能向相关用户移动增强现实客户端发送增强现实内容 发布状态变化通知。 移动增强现实客户端根据接收到的通知执行相应增强 现实业务控制流程。
步驟 F19,增强现实内容服务器发送增强现实内容管理请求至移动增强 现实服务器, 所述请求携带增强现实 内 容管理请求类型 :
Figure imgf000027_0001
, 表示希望订阅或者取消订阅 增强现实目标及增强现实内容测度上报通知, 以及相应管理对象信息, 包 括:增强现实目标标识 "AR Target ID",增强现实内容标识 "AR Content ID" , 以及订阅周期 "duration" ;
步驟 F20, 增强现实内容 /目标管理功能执行增强现实内容服务器访问 权限控制, 判断是否具备相关增强现实内容管理权限。 若通过验证, 则增 强现实内容 /目标管理功能触发增强现实内容发布单元更新增强现实目标信 息存储中与所述请求管理对象相对应的增强现实目标信息, 即增加或删除 增强现实目标及增强现实内容测度上报通知对象;
步驟 F21至步驟 F22,移动增强现实服务器向增强现实内容服务器返回 增强现实内容管理请求应答。
图 8为本发明应用例四实现移动增强现实业务的方法的流程图,如图 8 所示, 本示例是实现增强现实应用请求增强现实测度上报的流程图, 本示 例实现移动增强现实业务的方法包括以下步驟:
步驟 F1至步驟 F2,增强现实应用根据用户使用增强现实业务过程的反 馈信息, 构造生成增强现实测度(AR Metrics ), 包括: 用户所选择操作的 增强现实标签, 用户增强现实内容访问历史, 譬如: 访问时间、 增强现实 目标位置、 对应增强现实内容标识等。 增强现实应用上报所述增强现实测 度至移动增强现实客户端;
步驟 F3至步驟 F4,移动增强现实客户端向移动增强现实服务器发送增 强现实测度上报请求;
步驟 F5至步驟 F6, 移动增强现实服务器中增强现实内容 /目标递送功 能根据请求类型将该请求转发增强现实内容 /目标选择功能;
步驟 F7至步驟 F8, 增强现实内容 /目标选择功能提取所述请求中的增 强现实测度上报参数(相关增强现实目标标识), 并据此向增强现实内容 / 目标管理功能发送增强现实目标元数据搜索请求, 获取针对所述上报增强 现实测度订阅通知合法接收方地址, 即增强现实测度中涉及的增强现实内 容发布方增强现实内容服务器地址;
步驟 F9至步驟 F10 ,增强现实内容 /目标选择功能过滤不符合用户偏好 及业务设置的增强现实测度通知接收方地址, 向合法增强现实内容服务器 发送所述增强现实测度通知。
图 9为本发明应用例五实现移动增强现实业务的方法的流程图,如图 9 所示, 本示例是实现第三方增值应用服务的流程图, 本示例实现移动增强 现实业务的方法包括以下步驟:
本发明中, 第三方增值应用服务提供商通过与移动增强现实服务提供 商达成合作协议可以为移动增强现实用户提供额外增值应用服务, 包括: 多媒体广告, 公共安全指南, 社交网络服务等。
步驟 F1至步驟 F7, 参照图 4实施例中对应的 F1至步驟 F7;
步驟 F8至步驟 F9, 增强现实内容 /目标选择功能根据增强现实目标搜 索参数及用户业务设置判断是否额外提供第三方增值应用, 判断条件包括: 用户的增强现实目标搜索参数(如用户地理位置信息、 备选增强现实目标 特征等)是否符合该第三方增值应用触发条件, 并且用户增强现实业务设 置是否允许移动增强现实服务器自动触发第三方增值应用。
若判断需要触发第三方增值应用, 则增强现实内容 /目标选择功能向对 应第三方增值应用服务器发送触发通知, 携带增强现实目标搜索参数和 /或 用户标识;
步驟 F10至步驟 F11 ,第三方增值应用服务器根据触发通知中携带的增 强现实目标搜索参数和 /或用户标识选择执行相应业务逻辑, 如选择符合用 户当前位置的广告内容, 或者搜索与用户相关的社交网络信息。 第三方增 值应用服务器将获取的第三方增值应用内容或者内容标识返回移动增强现 实服务器;
步驟 F12至步驟 F13,如果第三方增值应用服务器返回内容标识,则增 强现实内容 /目标选择功能根据该标识向增强现实内容服务器或者其他内容 存储实体发送第三方增值应用内容获取请求, 获取相应内容;
步驟 F14, 增强现实内容 /目标选择功能根据用户偏好及上下文过滤所 获取的增强现实目标(内容) 以及第三方增值应用内容, 并返回增强现实 内容 /目标递送功能;
步驟 F15, 增强现实内容 /目标递送功能向移动增强现实客户端返回应 答, 携带所获取的增强现实目标(内容, 可选), 以及第三方增值应用内容; 步驟 F16,移动增强现实客户端向增强现实应用返回已发现的增强现实 目标以及第三方增值应用内容, 并在增强现实终端屏幕上展示。
以上所述, 仅为本发明的较佳实施例而已, 并非用于限定本发明的保 护范围。

Claims

权利要求书
1、 一种实现移动增强现实业务的方法, 其中, 所述方法包括: 接收到增强现实业务请求后, 移动增强现实服务器获取所述增强现实 业务请求的参数, 确定所述增强现实业务请求类型, 对所请求的移动增强 现实业务进行控制。
2、 根据权利要求 1所述的方法, 其中, 所述增强现实业务请求包括以 下请求的至少一种:
增强现实目标搜索请求、 增强现实内容获取请求、 增强现实测度上报 请求和增强现实内容管理请求。
3、 根据权利要求 1所述的方法, 其中, 所述增强现实业务请求为增强 现实目标搜索请求时, 对所请求的移动增强现实业务进行控制, 为:
所述移动增强现实服务器根据请求中携带的目标搜索参数进行增强现 实目标匹配, 获取匹配到的增强现实目标, 并返回给所述移动增强现实终 端。
4、 根据权利要求 1所述的方法, 其中, 所述增强现实业务请求为增强 现实内容获取请求时, 对所请求的移动增强现实业务进行控制, 为:
所述移动增强现实服务器根据增强现实内容获取请求中携带的内容获 取参数获取增强现实内容访问地址, 获取增强现实内容并返回给所述移动 增强现实终端。
5、 根据权利要求 1所述的方法, 其中, 所述增强现实业务请求为增强 现实测度上报请求时, 对所请求的移动增强现实业务进行控制, 为:
所述移动增强现实服务器根据增强现实测度上报请求中携带的测度上 报参数进行增强现实目标元数据搜索, 获取测度上报通知合法接收方地址。
6、 根据权利要求 1所述的方法, 其中, 所述增强现实业务请求为增强 现实内容管理请求时, 对所请求的移动增强现实业务进行控制, 为: 对管理请求对应的增强现实内容管理权限进行验证, 验证通过后根据 增强现实内容服务器的增强现实内容对相应增强现实内容的目标信息进行 更新。
7、 根据权利要求 1所述的方法, 其中, 所述移动增强现实服务器在满 足设定推送设置条件时, 获取对应的增强现实目标和 /或增强现实内容, 并 发送给移动增强现实终端。
8、 根据权利要求 7所述的方法, 其中, 所述设定推送设置条件为: 根据用户偏好及业务设置确定获取发现增强现实目标中与移动增强现 实终端位置比较接近的目标所对应的增强现实内容;
或者, 设定时刻到来;
或者, 移动增强现实终端进入设定区域;
或者, 在增强现实目标搜索参数及用户业务设置符合第三方增值业务 触发条件。
9、 一种实现移动增强现实业务的系统, 其中, 所述系统包括移动增强 现实终端、 移动增强现实服务器和增强现实内容服务器, 其中,
移动增强现实终端, 设置为向所述移动增强现实服务器发送增强现实 业务请求; 获取增强现实内容服务器中与增强现实目标相关联的增强现实 内容, 并根据所述移动增强现实终端实时状态将所述增强现实内容与所述 移动增强现实终端拍摄的实景融合并展示;
移动增强现实服务器, 设置为获取所述接收移动增强现实终端发送的 增强现实业务请求或推送请求的参数, 确定增强现实业务请求类型, 对所 请求的移动增强现实业务进行控制; 以及, 接收到增强现实内容服务器发 送的增强现实内容管理请求后, 对管理请求对应的增强现实内容管理权限 进行验证, 验证通过后更新管理请求对应的增强现实内容的目标信息; 增强现实内容服务器, 设置为提供与所述移动增强现实服务器中已部 署的增强现实目标相关联的增强现实内容的存储与管理。
10、 根据权利要求 9所述的系统, 其中, 所述移动增强现实终端包括 摄像头、 状态获取单元、 通信单元和展示单元, 其中,
摄像头, 设置为实时拍摄所述移动增强现实终端周围的实景; 状态获取单元, 设置为获取所述移动增强现实终端的当前位置信息; 摄像头与地面高度、 朝向、 与地面夹角信息;
通信单元, 设置为实现与所述移动增强现实服务器的通信, 向所述移 动增强现实服务器发送增强现实业务请求, 并获取增强现实内容服务器中 与增强现实目标相关联的增强现实内容;
展示单元, 设置为利用所获取的增强现实内容, 修饰渲染所述摄像头 拍摄的实景中的增强现实目标, 并展示。
11、 根据权利要求 9所述的系统, 其中, 所述增强现实业务请求包括 以下请求的至少一种:
增强现实目标搜索请求、 增强现实内容获取请求、 增强现实测度上报 请求。
12、 根据权利要求 11所述的系统, 其中, 所述移动增强现实服务器对 于增强现实目标搜索请求, 根据请求中携带的目标搜索参数进行增强现实 目标匹配, 获取匹配到的增强现实目标, 并返回给所述移动增强现实终端。
13、 根据权利要求 12所述的系统, 其中, 所述移动增强现实服务器在 增强现实目标搜索参数是用户位置信息时, 获取对应增强现实内容及搜索 到的增强现实目标, 返回给所述移动增强现实终端。
14、 根据权利要求 12所述的系统, 其中, 所述移动增强现实服务器在 增强现实目标搜索参数及用户业务设置符合第三方增值业务触发条件时, 触发第三方增值业务, 并返回执行结果。
15、 根据权利要求 12所述的系统, 其中, 所述移动增强现实服务器对 于增强现实内容获取请求, 根据增强现实内容获取请求中携带的内容获取 参数获取增强现实内容访问地址, 获取增强现实内容并返回给所述移动增 强现实终端。
16、 根据权利要求 12所述的系统, 其中, 所述移动增强现实服务器对 于增强现实测度上报请求, 根据增强现实测度上报请求中携带的测度上报 参数进行增强现实目标元数据搜索, 获取测度上报通知合法接收方地址。
17、 根据权利要求 12所述的系统, 其中, 所述移动增强现实服务器对 于推送请求, 向移动增强现实客户端推送所获取的增强现实目标和 /或增强 现实内容。
18、 一种移动增强现实服务器, 其中, 所述移动增强现实服务器包括 增强现实内容 /目标递送功能、增强现实内容 /目标选择功能和增强现实内容 /目标管理功能, 其中,
增强现实内容 /目标选择功能, 设置为根据接收的移动增强现实客户端 的业务请求, 搜索增强现实目标, 选择并获取增强现实内容;
增强现实内容 /目标递送功能, 设置为通过响应移动增强现实客户端的 业务请求, 递送增强现实目标和 /或增强现实内容至移动增强现实客户端; 或者, 主动发起请求推送增强现实目标和 /或增强现实内容至移动增强现实 客户端;
增强现实内容 /目标管理功能, 设置为根据增强现实内容管理请求, 存 储并管理增强现实目标部署信息, 增强现实内容发布信息, 以及增强现实 内容緩存策略及本地緩存增强现实内容。
19、 根据权利要求 18所述的移动增强现实服务器, 其中, 所述增强现 实业务请求包括以下请求的至少一种:
增强现实目标搜索请求、 增强现实内容获取请求、 增强现实测度上报 请求。
20、 根据权利要求 19所述的移动增强现实服务器, 其中,
所述增强现实内容 /目标选择功能对于增强现实目标搜索请求, 根据请 求中携带的目标搜索参数搜索增强现实目标, 选择并获取增强现实内容。
21、 根据权利要求 19所述的移动增强现实服务器, 其中, 所述增强现 实内容 /目标选择功能对于增强现实内容获取请求, 根据增强现实内容获取 请求中携带的内容获取参数获取增强现实内容访问地址, 获取增强现实内 谷。
22、 根据权利要求 19所述的移动增强现实服务器, 其中,
所述增强现实内容 /目标选择功能对于增强现实测度上报请求, 根据增 强现实测度上报请求中携带的测度上报参数进行增强现实目标元数据搜 索, 获取测度上报通知合法接收方地址。
23、 根据权利要求 19所述的移动增强现实服务器, 其中, 所述增强现 实内容 /目标管理功能接收到增强现实内容管理请求后, 进行增强现实内容 管理权限的验证, 并在验证通过后促使增强现实内容 /目标管理功能更新与 管理请求相对应增强现实目标信息。
24、 根据权利要求 19或 23所述的移动增强现实服务器, 其中, 所述 增强现实内容 /目标管理功能根据增强现实内容管理请求执行结果发送增强 现实内容发布状态、 部署规则变化信息。
25、 一种移动增强现实终端, 其中, 所述移动增强现实终端包括增强 现实内容 /目标获取功能、增强现实内容 /目标展示功能和用户 /终端数据管理 功能, 其中,
增强现实内容 /目标获取功能, 用于根据增强现实应用的请求, 向移动 增强现实服务器请求获取增强现实内容和 /或增强现实目标;
增强现实内容 /目标展示功能, 用于根据增强现实应用请求, 提供增强 现实内容显示机制;
用户 /终端数据管理功能, 用于收集并管理用户增强现实个性化及上下 文相关信息。
PCT/CN2012/070613 2011-06-24 2012-01-19 实现移动增强现实业务的系统及方法、终端及服务器 WO2012174865A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201110173562.2 2011-06-24
CN201110173562.2A CN102843347B (zh) 2011-06-24 2011-06-24 实现移动增强现实业务的系统及方法、终端及服务器

Publications (1)

Publication Number Publication Date
WO2012174865A1 true WO2012174865A1 (zh) 2012-12-27

Family

ID=47370410

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/070613 WO2012174865A1 (zh) 2011-06-24 2012-01-19 实现移动增强现实业务的系统及方法、终端及服务器

Country Status (2)

Country Link
CN (1) CN102843347B (zh)
WO (1) WO2012174865A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103488525A (zh) * 2012-06-08 2014-01-01 诺基亚公司 确定与情景相关的用户偏好
US11157762B2 (en) 2019-06-18 2021-10-26 At&T Intellectual Property I, L.P. Surrogate metadata aggregation for dynamic content assembly

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103561382B (zh) * 2013-10-22 2017-08-04 华为终端有限公司 一种移动终端的消息呈现方法及移动终端
CN103606310B (zh) * 2013-10-29 2016-01-13 中兴通讯股份有限公司 教学方法及系统
RU2606874C1 (ru) * 2015-12-02 2017-01-10 Виталий Витальевич Аверьянов Способ управления устройством формирования среды дополненной реальности
CN106445154A (zh) * 2016-09-29 2017-02-22 宇龙计算机通信科技(深圳)有限公司 一种提供ar内容的方法、装置、ar设备及服务器
TWI642002B (zh) 2017-04-14 2018-11-21 李雨暹 適地性空間物件可視範圍管理方法與系統
CN108983971A (zh) * 2018-06-29 2018-12-11 北京小米智能科技有限公司 基于增强现实的标记方法及装置
CN110147288A (zh) * 2019-05-13 2019-08-20 浙江商汤科技开发有限公司 信息交互方法及装置、电子设备和存储介质
CA3198439A1 (en) * 2020-11-05 2022-05-12 Computer Generated Solutions, Inc. Systems and methods for integrating and using augmented reality technologies
CN113421356B (zh) * 2021-07-01 2023-05-12 北京华信傲天网络技术有限公司 一种对复杂环境中设备的巡检系统和方法
CN115914716A (zh) * 2021-09-30 2023-04-04 中兴通讯股份有限公司 图像显示方法及装置、存储介质及电子装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060002610A1 (en) * 2004-07-02 2006-01-05 Hartti Suomela Initiation of actions with compressed action language representations
CN101605313A (zh) * 2009-06-26 2009-12-16 华为技术有限公司 业务处理方法及系统、呼叫会话控制功能实体设备和应用服务器
CN101971618A (zh) * 2008-03-14 2011-02-09 阿尔卡特朗讯 实现移动终端的丰富视频的方法
US20110115816A1 (en) * 2009-11-16 2011-05-19 Alliance For Sustainable Energy, Llc. Augmented reality building operations tool

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3467017B2 (ja) * 2000-11-30 2003-11-17 キヤノン株式会社 位置姿勢の決定方法及び装置並びに記憶媒体
CN101924992B (zh) * 2010-07-30 2013-11-20 中国电信股份有限公司 通过移动终端获取景物资讯的方法、系统和设备

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060002610A1 (en) * 2004-07-02 2006-01-05 Hartti Suomela Initiation of actions with compressed action language representations
CN101971618A (zh) * 2008-03-14 2011-02-09 阿尔卡特朗讯 实现移动终端的丰富视频的方法
CN101605313A (zh) * 2009-06-26 2009-12-16 华为技术有限公司 业务处理方法及系统、呼叫会话控制功能实体设备和应用服务器
US20110115816A1 (en) * 2009-11-16 2011-05-19 Alliance For Sustainable Energy, Llc. Augmented reality building operations tool

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103488525A (zh) * 2012-06-08 2014-01-01 诺基亚公司 确定与情景相关的用户偏好
US11157762B2 (en) 2019-06-18 2021-10-26 At&T Intellectual Property I, L.P. Surrogate metadata aggregation for dynamic content assembly
US11907285B2 (en) 2019-06-18 2024-02-20 AT&T Intellect al Property I, L.P. Surrogate metadata aggregation for dynamic content assembly

Also Published As

Publication number Publication date
CN102843347B (zh) 2017-10-31
CN102843347A (zh) 2012-12-26

Similar Documents

Publication Publication Date Title
WO2012174865A1 (zh) 实现移动增强现实业务的系统及方法、终端及服务器
WO2012174974A1 (zh) 实现移动增强现实业务的方法及系统、终端及服务器
AU2012223882B2 (en) Method and apparatus for sharing media based on social network in communication system
KR101720940B1 (ko) 메신저 채팅창을 통한 실시간 영상 공유 장치, 방법 및 컴퓨터 판독 가능한 기록 매체
US20070214180A1 (en) Social network application for processing image or video data from wireless devices of users and methods of operation
US8560955B2 (en) System and method for bridging communication services between virtual worlds and the real world
US20150281208A1 (en) System and method for posting content to network sites
EP3809349A1 (en) Method of displaying user interface on device, and device
US20120041982A1 (en) Method and system for associating co-presence information with a media item
JP2015505384A (ja) 画像アノテーション方法およびシステム
EP2750438B1 (en) Method for accessing augmented reality user context
CN103155477A (zh) 分布式计算环境中的数据同步
EP2689340A2 (en) Sharing content among multiple devices
WO2013029390A1 (zh) 增强现实信息的传输方法和移动增强现实服务器
CN116057964A (zh) 使用朋友列表版本的位置共享
CN116057916A (zh) 使用不同速率受限链路的位置共享
CN111680238B (zh) 信息分享方法、装置和存储介质
KR20180004433A (ko) 응용 프로그램을 활용한 영상 콘텐츠 공유 시스템 및 이를 이용한 커뮤니케이션 방법
KR101693738B1 (ko) 모바일 sns를 이용한 위치기반의 민원 공유 서비스 시스템 및 방법
KR101134883B1 (ko) 오픈형 poi를 등록하는 시스템 및 방법
CN106791912A (zh) 一种海报图片匹配方法及系统
JP2006065650A (ja) 情報提供方法およびシステム、プログラムおよび記録媒体
KR102121371B1 (ko) 생활영상정보 실시간 공유 방법
US20160005230A1 (en) Server Controlled Augmented Reality
WO2013189218A1 (zh) 增强现实内容的获取方法和移动增强现实服务器及客户端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12802940

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12802940

Country of ref document: EP

Kind code of ref document: A1