WO2018018698A1 - 一种增强现实ar的信息处理方法、装置及系统 - Google Patents

一种增强现实ar的信息处理方法、装置及系统 Download PDF

Info

Publication number
WO2018018698A1
WO2018018698A1 PCT/CN2016/097148 CN2016097148W WO2018018698A1 WO 2018018698 A1 WO2018018698 A1 WO 2018018698A1 CN 2016097148 W CN2016097148 W CN 2016097148W WO 2018018698 A1 WO2018018698 A1 WO 2018018698A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
terminal
server
update
target object
Prior art date
Application number
PCT/CN2016/097148
Other languages
English (en)
French (fr)
Inventor
田永胜
路雄博
秦严
Original Assignee
宇龙计算机通信科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 宇龙计算机通信科技(深圳)有限公司 filed Critical 宇龙计算机通信科技(深圳)有限公司
Publication of WO2018018698A1 publication Critical patent/WO2018018698A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/445—Program loading or initiating
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00—Arrangements for software engineering
    • G06F8/60—Software deployment
    • G06F8/65—Updates

Definitions

  • the present invention relates to the field of electronic technologies, and in particular, to an information processing method, apparatus, and system for augmented reality AR.
  • Augmented Reality is a technology that calculates the position and angle of camera images in real time and adds corresponding images, videos, and 3D models.
  • the goal of this technology is to put the virtual world on the screen. The real world and interact.
  • CPUs Central Processing Units
  • the real world is constantly developing dynamically: the driving of vehicles, the replacement of brand stores, etc., will cause the model generated by data acquisition to be outdated or invalid in an instant.
  • This situation is more prominent in AR applications in mobile terminals.
  • the minimum consumption of a store is XX yuan
  • the 666 bus will pass 4 minutes.
  • the minimum consumption of the store may vary according to the season or the holiday, and the geographic location of the bus will also change due to the operation of the bus.
  • the AR information provided on the AR server can still be associated with the store. It is consistent with the actual AR information of the bus. When it is inconsistent, it is very likely to mislead the user and have adverse consequences. Therefore, in a rapidly changing dynamic environment, how to ensure the timeliness of the AR information acquired in the AR application of the terminal device is an urgent problem to be solved.
  • the technical problem to be solved by the embodiments of the present invention is to provide an information processing method, device, and system for augmented reality AR, which can solve the problem that the terminal device cannot obtain the AR information with high timeliness in the prior art.
  • an embodiment of the present invention provides an information processing method for an augmented reality AR, which may include: an AR server receives an AR request for a target object sent by a first terminal; and the AR server sends the location to the first terminal. a first AR information of the target object; the AR server receives AR update information of the target object sent by the first terminal; and the AR server updates the first AR information to the first information according to the AR update information
  • the second AR information wherein the AR update information is information generated when the first terminal compares the first AR information and the target scan information, and the target scan information is scanned and obtained by the first terminal.
  • the AR related information of the target object may include: an AR server receives an AR request for a target object sent by a first terminal; and the AR server sends the location to the first terminal. a first AR information of the target object; the AR server receives AR update information of the target object sent by the first terminal; and the AR server updates the first AR information to the first information according to the AR update information
  • the second AR information wherein the AR update information is
  • the method further includes: the AR server: The second AR information is sent to the first terminal.
  • the AR server updates the first AR information to the second AR information according to the AR update information, including: the AR server: the first The part of the AR information that is inconsistent with the target scan information is replaced with the AR update information, and the second AR information is generated; or the AR server re-acquires the AR information of the target object according to the AR update information, and generates a second The AR information is replaced with the first AR information.
  • the method further includes: the AR server is configured according to The AR request acquires the current geographic location of the first terminal, and pushes, to the first terminal, AR information of at least one push object within a preset geographic range corresponding to the geographic location.
  • the method before the pushing the AR information of the at least one push object in the preset geographic range corresponding to the geographic location, the method includes: The AR server receives AR information of the at least one push object sent by the second terminal.
  • an embodiment of the present invention provides an information processing method for an augmented reality AR, which may include: a first terminal sends an AR request for a target object to an AR server; and the first terminal receives a location sent by the AR server. a first AR information of the target object; the first terminal compares the first AR information with the target scan information, and when there is an inconsistency in the comparison, generates AR update information, where the target scan information is Determining, by the first terminal, the AR related information of the target object that is obtained by the first terminal; the first terminal sending the AR update information to the AR server, where the AR update information is used by the AR server according to the AR update Information updates the first AR information to a second AR information.
  • the target scan information is that the first terminal scans through a camera, and is subjected to image processing, feature extraction, and calculation of the target object obtained by combining preset rules. AR related information.
  • the method further includes: receiving, by the first terminal, the second AR information.
  • the AR request includes the first terminal current
  • the method further includes: the first terminal receiving, by the AR server, AR information of at least one push object within a preset geographic range corresponding to the geographic location that is pushed by the AR server.
  • an embodiment of the present invention provides an information processing apparatus for an augmented reality AR, which may include: a first receiving module, configured to receive an AR request for a target object sent by a first terminal; and a first sending module, configured to Transmitting, to the first terminal, first AR information of the target object; the second receiving module is configured to receive AR update information of the target object sent by the first terminal; and an update module, configured to be according to the AR
  • the update information is updated to the second AR information, where the AR update information is information generated when the first terminal compares that the first AR information and the target scan information are inconsistent,
  • the target scan information is AR related information of the target object scanned and obtained by the first terminal.
  • the apparatus further includes: a second sending module, configured to send the second AR information to the first terminal.
  • the updating module is specifically configured to: replace, in the first AR information, a portion that is inconsistent with the target scan information with the AR update information, and generate a And second retrieving the AR information of the target object according to the AR update information, generating second AR information, and replacing the first AR information.
  • the apparatus further includes: an acquiring module, configured to Acquiring, according to the AR request, the current geographic location of the first terminal; the pushing module is configured to push, to the first terminal, AR information of at least one push object within a preset geographic range corresponding to the geographic location.
  • the apparatus further includes: a third receiving module, configured to receive the AR of the at least one push object sent by the second terminal information.
  • an embodiment of the present invention provides an information processing apparatus for augmented reality AR, which may include: a request sending module, configured to send an AR request for a target object to an AR server; and a first information receiving module configured to receive Determining, by the AR server, the first AR information of the target object that is sent by the AR server, and the generating module, configured to compare the first AR information with the target scan information, and generate an AR update information when the comparison is inconsistent, where
  • the target scan information is AR related information of the target object scanned and obtained by the first terminal;
  • the information sending module is configured to send the AR update information to the AR server, where the AR update information is used for the
  • the AR server updates the first AR information to the second AR information according to the AR update information.
  • the target scan information is that the first terminal scans through a camera, and is subjected to image processing, feature extraction, and calculation of the target object obtained by combining preset rules. AR related information.
  • the apparatus further includes: a second information receiving module, configured to receive the second AR information sent by the AR server.
  • the AR request includes the first terminal current
  • the device further includes: a third information receiving module, configured to receive the AR information of the at least one push object within the preset geographic range corresponding to the geographic location that is pushed by the AR server.
  • an embodiment of the present invention provides an information processing system for an augmented reality AR, which may include: an AR server and a terminal device, where the AR server is the augmented reality AR according to any one of the third aspects.
  • the information processing device is the information processing device of the augmented reality AR according to any one of the fourth aspect.
  • an embodiment of the present invention provides an AR server, including: a memory storing executable program code; a processor coupled to the memory; the processor invoking the executable stored in the memory
  • the program code performs some or all of the steps described in any of the methods of the first aspect of the embodiments of the present invention.
  • an embodiment of the present invention provides a terminal device, including: storing an executable program a memory coupled to the memory; the processor invoking the executable program code stored in the memory to perform some or all of the methods described in any of the second aspects of the embodiments of the present invention step.
  • the present invention provides a computer storage medium for storing computer software instructions for an augmented reality AR information processing apparatus provided by a third aspect of the embodiments of the present invention, including a program designed to execute the above aspects .
  • the present invention provides a computer storage medium for storing computer software instructions for an information processing apparatus of an augmented reality AR provided by a fourth aspect of the embodiments of the present invention, including a program designed to execute the above aspects .
  • the AR server receives the AR request for the target object that is sent by the first terminal, and sends the first AR information of the target object to the first terminal, where the AR server receives the location sent by the first terminal. Determining the AR update information of the target object, and updating the first AR information to the second AR information according to the AR update information, where the AR update information is that the first terminal compares the first AR information
  • the information generated when there is an inconsistency with the target scan information, and the target scan information is AR related information of the target object scanned and obtained by the first terminal.
  • the AR server prompts the AR server to update or re-acquire the update according to the latest AR information provided by the terminal device, so that
  • the AR information with high accuracy and timeliness can be obtained, and the problem that the terminal device cannot obtain the AR information with high timeliness in the prior art is solved, and the AR is improved. Timeliness and accuracy of AR information interaction between the server and the terminal device.
  • FIG. 1 is a network architecture diagram of an augmented reality AR according to an embodiment of the present invention.
  • FIG. 2 is a schematic flowchart of an information processing method of an augmented reality AR according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of an information processing apparatus for an augmented reality AR according to an embodiment of the present invention
  • FIG. 4 is a schematic structural diagram of another information processing apparatus for augmented reality AR according to an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of another information processing apparatus for augmented reality AR according to an embodiment of the present disclosure
  • FIG. 6 is a schematic structural diagram of another information processing apparatus for augmented reality AR according to an embodiment of the present disclosure.
  • FIG. 7 is a schematic structural diagram of another information processing apparatus for augmented reality AR according to an embodiment of the present disclosure.
  • FIG. 8 is a schematic structural diagram of an AR server according to an embodiment of the present disclosure.
  • FIG. 9 is a schematic structural diagram of a terminal device according to an embodiment of the present disclosure.
  • FIG. 10 is a schematic structural diagram of another terminal device according to an embodiment of the present invention.
  • references to "an embodiment” herein mean that a particular feature, structure, or characteristic described in connection with the embodiments can be included in at least one embodiment of the invention.
  • the appearances of the phrases in various places in the specification are not necessarily referring to the same embodiments, and are not exclusive or alternative embodiments that are mutually exclusive.
  • Those skilled in the art understand, explicitly and implicitly, that the embodiments described herein may be The combination of the examples.
  • a terminal device also called a User Equipment (UE) is a device that provides voice and/or data connectivity to a user, for example, a handheld device with a wireless connection function, an in-vehicle device, and the like.
  • Common terminal devices include, for example, mobile phones, tablets, laptops, PDAs, mobile Internet devices (MIDs), wearable devices, smart bracelets, pedometers, MP3 players (Moving Picture Experts Group Audio) Layer III, motion picture expert compresses standard audio layer 3), MP4 (Moving Picture Experts Group Audio Layer IV) player, personal digital assistant (PDA) and laptop portable Computer, etc.
  • Augmented Reality is a technology that increases the user's perception of the real world through the information provided by the computer system. It is an entity information (visual information) that is difficult to experience in a certain time and space within the real world. , sound, taste, touch, etc.), through the science and technology of intelligent terminals, simulation and then superimposition, the virtual information is applied to the real world, perceived by human senses, thereby achieving a sensory experience beyond reality, realizing the enhancement of reality It has three outstanding features: information integration of the real world and the virtual world; real-time interactivity; and the addition of positioning virtual objects in the three-dimensional scale space.
  • Multiple means two or more. "and/or”, describing the association relationship of the associated objects, indicating that there may be three relationships, for example, A and/or B, which may indicate that there are three cases where A exists separately, A and B exist at the same time, and B exists separately.
  • the character "/" generally indicates that the contextual object is an "or" relationship.
  • FIG. 1 is a network architecture diagram of an augmented reality AR according to an embodiment of the present invention.
  • the network architecture of the embodiment of the present invention is an architecture for providing an AR service based on a client-server architecture, and may include an AR server, a terminal device (a terminal device supporting an AR application), where the terminal device passes the relevant The AR application requests the related AR service from the AR server, and the AR server sends the corresponding AR information stored in advance to the terminal device through a network (such as the Internet).
  • a network such as the Internet
  • the network architecture in FIG. 1 is only one of the preferred embodiments of the present invention.
  • the network architecture in the embodiment of the present invention includes, but is not limited to, the foregoing network architecture, as long as the enhancement in the present invention can be implemented.
  • the network architecture of the real AR information processing method belongs to the scope protected and covered by the present invention. Wai.
  • FIG. 2 is a schematic flowchart of an information processing method of an augmented reality AR according to an embodiment of the present invention.
  • an interaction between an AR server and a terminal device (first terminal) is performed in conjunction with FIG.
  • the information processing method of the augmented reality AR is described in detail, and the method includes the following steps S201 to S208.
  • Step S201 The first terminal sends an AR request for the target object to the AR server.
  • the first terminal is a terminal device that supports the AR application, and the first terminal sends an AR request for the target object to the AR server, indicating that the user using the first terminal needs to view the AR information of the target object through the first terminal.
  • the target object that the user needs to view may be a building, a store, a restaurant, various daily necessities, various types of food, and the like
  • the corresponding AR information may be the geographical location and name of the building, the store, the restaurant. , shape, type, construction age, internal structure, business hours and business scope, etc.
  • AR information of daily necessities can be its function, material, price, date of manufacture, age, internal structure, and related evaluation.
  • the AR information of the food may be the ingredients, the color, the taste, the mouthfeel, the nutritional value, the related evaluation, and the like, and the examples of the present invention are not enumerated here.
  • Step S202 The AR server receives the AR request for the target object sent by the first terminal.
  • the AR server receives the AR request for the target object sent by the first terminal in step S201.
  • the AR request may include a geographical location, a name, attribute information, or identification information of the target object, so that the AR server can accurately and uniquely determine the target object, thereby finding related AR information of the target object.
  • Step S203 The AR server sends the first AR information of the target object to the first terminal.
  • the AR server extracts the first AR information of the target object that is stored and collected in advance according to the AR request sent by the first terminal.
  • the first AR information may be uploaded to the service by manual collection, or may be sent to the server by using various types of sensors, which is not specifically limited by the present invention.
  • Step S204 The first terminal receives the first AR information of the target object that is sent by the AR server.
  • the first terminal receives the first AR information of the target object that is sent by the AR server in step S203.
  • Step S205 The first terminal compares the first AR information with the target scan information, and generates AR update information when there is an inconsistency in the comparison.
  • the target scan information is AR related information of the target object scanned and obtained by the first terminal; the first terminal may scan the target object by a camera or other sensor before, or simultaneously with, or after the AR request is initiated.
  • the related AR information of the target object can also be obtained by other information acquisition methods.
  • the first terminal compares the first AR information with the target scan information, and when there is an inconsistency in the comparison, the AR update information is generated.
  • the AR update information may be a trigger condition for prompting the AR server to specifically update which information and update information, or may be an AR server that needs to perform AR information update of the target object. That is, the AR server receives the AR update information, and may directly update according to the AR update information, or actively collect and replace the first AR information of the target object.
  • the method of active collection may be to send an information update prompt to the relevant staff member or the collection device, prompting the staff member or the related device that the current AR information of the target object has an error or has expired, and needs to be re-acquired or measured to ensure AR.
  • the accuracy and timeliness of the information may be to send an information update prompt to the relevant staff member or the collection device, prompting the staff member or the related device that the current AR information of the target object has an error or has expired, and needs to be re-acquired or measured to ensure AR.
  • the first terminal may be different from the first AR information and the target scan information, for example, the information type included in the first AR information and the target scan information. If the information is inconsistent, it may be regarded as inconsistency in the embodiment of the present invention; or, the information type in the target scan information is greater than the first AR information, or the information type in the target scan information is smaller than the first AR information. And the information that is not included in the first AR information is included in the target scan information, or the information included in the first AR information is inconsistent with the information in the first AR information, and may be regarded as an inconsistency in the embodiment of the present invention. This is not specifically limited.
  • the target scan information is AR related information of the target object that is obtained by the first terminal scanning by a camera and calculated by image processing, feature extraction, and combined with a preset rule.
  • the first terminal acquires a signature image of a restaurant through its own camera, and identifies AR related information such as a specific name and logo of the restaurant through steps of image processing, feature extraction, and the like.
  • Step S206 The first terminal sends the AR update information to the AR server.
  • the first terminal sends the AR update information generated by the first terminal to the AR server, so that the AR server performs the update of the AR information of the target object according to the AR update information, thereby providing the user with real-time highly accurate AR information.
  • the AR update information needs to be verified or the first terminal that sends the AR update information needs to be verified. Otherwise, there may be a malicious phenomenon of arbitrarily tampering with the AR information of the target object.
  • Step S207 The AR server receives the AR update of the target object sent by the first terminal. information.
  • the AR server receives the AR update information of the target object sent by the first terminal in step S206.
  • Step S208 The AR server updates the first AR information to the second AR information according to the AR update information.
  • the AR server updates the first AR information to the second AR information according to the AR update information. That is, the AR server considers that there is an error in the first AR information of the currently stored target object, or that the information has expired and is not time-sensitive, and the first AR information that is not time-sensitive needs to be updated to be second in timeliness. AR information.
  • the AR server replaces the part of the first AR information that is inconsistent with the target scan information with the AR update information, and generates second AR information. That is, only the inconsistencies are modified to replace and generate new AR information.
  • the AR server re-acquires the AR information of the target object according to the AR update information, generates second AR information, and replaces the first AR information. That is, the AR update information may be a condition for prompting or triggering the update, and does not include any information that needs to be updated. At this time, the AR server may actively re-collect, so as to update the AR information of the target object in time. It can be understood that if the AR update information includes specific information that needs to be updated, the AR server can still choose to re-collect itself to ensure the authenticity and authority of the updated AR information.
  • the AR server sends the second AR information to the first terminal, where the first terminal receives the second AR information sent by the AR server. That is, after the AR server is updated, the updated second AR information may be resent to the first terminal to ensure that the first terminal can obtain the complete AR information of the target object with timeliness. It can be understood that if the other terminal needs to obtain the AR information of the target object, the AR server can send the updated second AR information to the terminal. Therefore, the interaction process can be regarded as the power of the plurality of terminals. Help improve the dynamic update of AR information on the AR server.
  • the AR server acquires a current geographic location of the first terminal according to the AR request, and pushes, within the preset geographic range corresponding to the geographic location, the first terminal At least one AR information of the push object. That is, the AR server can learn the geographical location or other related information that the terminal is currently located according to the AR request sent by the first terminal, so as to find the geographical location.
  • the AR server receives the AR information of the at least one push object sent by the second terminal, that is, the content that the AR server pushes to the first terminal may be that the other terminal reports to the AR server in real time. As a result, the virtuous cycle of the entire information processing system can be improved.
  • the AR server will static model information according to the information scanned by the user 1. Sent to user 1, but the static model information sent is the information of Gome (this shop was originally Gome, now becomes Suning), then user 1 returns this error message to AR server, AR server Re-establish the model of this static store information (to Suning Appliance) and send the new model information to User 1.
  • the location of the user 1 is the street where the 666 bus passes. After the AR server obtains the geographic location of the user 1, the AR server needs to selectively push the AR information of the 666 to the user.
  • the application scenario divides the AR model into two parts: a static model and a dynamic model.
  • the static model is pre-captured and generated by the AR application provider, and the user dynamically loads in dynamic use, and the information software scans the identified place or object. And compared with the static model, if there is any inconsistency, upload it to the server for correction, the server records this information, and delivers the newly generated model to the user application; the dynamic model is completed by multiple application users.
  • Initialization establishment User 1 sends the dynamic object 1 information (object name, position, direction, etc.) in the scanned location to the server, the server establishes an initialization model, and if the user 2 appears in another location, the dynamic object 1 The server sends the model information of the object to the user 2. Therefore, the technical solution dynamically initializes the AR model during the dynamic use of the AR application to improve the user experience.
  • the server establishes an initialization model, and if the user 2 appears in another location, the dynamic object 1
  • the server sends the model information of the object to the user 2. Therefore, the technical solution dynamically initializes the AR model during the dynamic use of the AR application to improve the user experience.
  • the AR server receives the AR request for the target object that is sent by the first terminal, and sends the first AR information of the target object to the first terminal, where the AR server receives the location sent by the first terminal. Determining the AR update information of the target object, and updating the first AR information to the second AR information according to the AR update information, where the AR update information is that the first terminal compares the first AR information Information generated when there is an inconsistency with the target scan information, the target sweep The trace information is AR related information of the target object scanned and obtained by the first terminal.
  • the AR server prompts the AR server to update or re-acquire the update according to the latest AR information provided by the terminal device, so that
  • the AR information with high accuracy and timeliness can be obtained, and the problem that the terminal device cannot obtain the AR information with high timeliness in the prior art is solved, and the AR is improved. Timeliness and accuracy of AR information interaction between the server and the terminal device.
  • FIG. 3 is a schematic structural diagram of an information processing apparatus 10 of an augmented reality AR according to an embodiment of the present invention. 3. The structure of the information processing apparatus 10 of the augmented reality AR will be described in detail.
  • the device 10 may include: a first receiving module 101, a first sending module 102, a second receiving module 103, and an updating module 104, where
  • the first receiving module 101 is configured to receive an AR request for the target object sent by the first terminal;
  • the first sending module 102 is configured to send, to the first terminal, first AR information of the target object;
  • the second receiving module 103 is configured to receive AR update information of the target object sent by the first terminal;
  • the update module 104 is configured to update the first AR information to the second AR information according to the AR update information, where the AR update information is that the first terminal compares the first AR information with a target scan The information generated when the information is inconsistent, the target scan information is AR related information of the target object scanned and obtained by the first terminal.
  • FIG. 4 is a schematic structural diagram of another information processing apparatus 10 for augmented reality AR according to an embodiment of the present invention.
  • the apparatus 10 further includes:
  • the second sending module 105 is configured to send the second AR information to the first terminal.
  • update module 104 is specifically configured to:
  • the device 10 further includes: an obtaining module 106, which is set as a root Obtaining a current geographic location of the first terminal according to the AR request;
  • the pushing module 107 is configured to push, to the first terminal, AR information of at least one push object within a preset geographic range corresponding to the geographic location.
  • the device further includes:
  • the third receiving module 108 is configured to receive the AR information of the at least one push object sent by the second terminal.
  • the information processing apparatus 10 of the augmented reality AR is presented in the form of a module.
  • a “module” herein may refer to an application-specific integrated circuit (ASIC), a processor and memory that executes one or more software or firmware programs, integrated logic circuits, and/or other devices that provide the above functionality.
  • the update module 104 can be implemented by the processor 301 in the AR server shown in FIG. 8, and the first receiving module 101, the first sending module 102, and the second receiving module 103 can pass through the AR server shown in FIG.
  • the communication interface 303 is implemented.
  • FIG. 5 is a schematic structural diagram of an information processing apparatus of an augmented reality AR according to an embodiment of the present invention. 5. The structure of the device 20 is described in detail.
  • the device 20 may include: a request sending module 201, a first information receiving module 202, and a generating module 203 and an information sending module 204, wherein
  • the request sending module 201 is configured to send an AR request for the target object to the AR server;
  • the first information receiving module 202 is configured to receive first AR information of the target object sent by the AR server;
  • the generating module 203 is configured to compare the first AR information with the target scan information, and generate AR update information when the comparison is inconsistent, wherein the target scan information is scanned and obtained by the first terminal. AR related information of the target object;
  • the information sending module 204 is configured to send the AR update information to the AR server, where the AR update information is used by the AR server to update the first AR information to the second AR information according to the AR update information.
  • the target scan information is AR related information of the target object that is obtained by the first terminal scanning by a camera and calculated by image processing, feature extraction, and combined with a preset rule.
  • FIG. 6 is still another augmented reality AR provided by an embodiment of the present invention.
  • the schematic diagram of the structure of the information processing device 20, the device further includes:
  • the second information receiving module 205 is configured to receive the second AR information sent by the AR server.
  • the AR request includes a current geographic location of the first terminal; the device 20 further includes:
  • the third information receiving module 206 is configured to receive AR information of at least one push object within a preset geographic range corresponding to the geographic location that is pushed by the AR server.
  • the information processing apparatus 20 of the augmented reality AR is presented in the form of a module.
  • a “module” herein may refer to an application-specific integrated circuit (ASIC), a processor and memory that executes one or more software or firmware programs, integrated logic circuits, and/or other devices that provide the above functionality.
  • the generating module 203 can be implemented by the processor 401 of the terminal device 40 shown in FIG. 9, and the request sending module 201, the first information receiving module 202, and the information transmitting module 204 can communicate with the terminal device 40 shown in FIG. Interface 403 is implemented.
  • FIG. 7 is a schematic structural diagram of an information processing system of an augmented reality AR according to an embodiment of the present invention.
  • the system 00 includes an AR server 01 and a terminal device 02, where
  • the AR server 01 may include the information processing apparatus 10 of the augmented reality AR in the above-described embodiment of FIG. 5, and the terminal apparatus 02 may be the information processing apparatus 20 of the augmented reality AR in the above-described embodiment of FIG. It can be understood that the information processing system 00 of the augmented reality AR in the embodiment of the present invention may further include related base stations, base station controllers, routing devices, switching devices, and core network servers.
  • FIG. 8 is a schematic structural diagram of an AR server 30 according to an embodiment of the present invention.
  • the structure of the AR server 30 will be described in detail below with reference to FIG. .
  • the AR server 30 includes at least one processor 301, at least one memory 302, and at least one communication interface 303.
  • the processor 301, the memory 302, and the communication interface 303 are connected by the communication bus and complete communication with each other.
  • the processor 301 can be a general purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the above program.
  • CPU central processing unit
  • ASIC application-specific integrated circuit
  • the communication interface 303 is configured to communicate with other devices or communication networks, such as Ethernet, Radio Access Network (RAN), Wireless Local Area Networks (WLAN), and the like.
  • RAN Radio Access Network
  • WLAN Wireless Local Area Networks
  • the memory 302 can be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type that can store information and instructions.
  • the dynamic storage device can also be an Electrically Erasable Programmable Read-Only Memory (EEPROM), a Compact Disc Read-Only Memory (CD-ROM) or other optical disc storage, and a disc storage device. (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program code in the form of instructions or data structures and can be Any other media accessed, but not limited to this.
  • the memory can exist independently and be connected to the processor via a bus.
  • the memory can also be integrated with the processor.
  • the memory 302 is used to store application code that executes the above solution, and is controlled by the processor 301 for execution.
  • the processor 301 is configured to execute application code stored in the memory 302.
  • the code stored in the memory 302 may be executed by the processor 301 by the information processing method of the augmented reality AR of FIG. 1 to FIG. 2 performed by the AR server 30 provided above, such as receiving an AR request for the target object sent by the first terminal; Transmitting, by the first terminal, first AR information of the target object, receiving AR update information of the target object sent by the first terminal, and updating the first AR information to a second according to the AR update information
  • the AR information where the AR update information is information generated when the first terminal compares the first AR information and the target scan information, and the target scan information is scanned and obtained by the first terminal.
  • the AR related information of the target object is information generated when the first terminal compares the first AR information and the target scan information, and the target scan information is scanned and obtained by the first terminal.
  • FIG. 9 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
  • the structure of the terminal device 40 will be described in detail below with reference to FIG.
  • the terminal device 40 includes at least one processor 401, at least one memory 402, and at least one communication interface 403.
  • the processor 401, the memory 402, and the communication interface 403 are connected by the communication bus and complete communication with each other.
  • the processor 401 can be a general purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the above program.
  • CPU central processing unit
  • ASIC application-specific integrated circuit
  • the communication interface 403 is configured to communicate with other devices or communication networks, such as Ethernet, Radio Access Network (RAN), Wireless Local Area Networks (WLAN), and the like.
  • RAN Radio Access Network
  • WLAN Wireless Local Area Networks
  • the memory 402 can be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type that can store information and instructions.
  • the dynamic storage device can also be an Electrically Erasable Programmable Read-Only Memory (EEPROM), a Compact Disc Read-Only Memory (CD-ROM) or other optical disc storage, and a disc storage device. (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program code in the form of instructions or data structures and can be Any other media accessed, but not limited to this.
  • the memory can exist independently and be connected to the processor via a bus.
  • the memory can also be integrated with the processor.
  • the memory 402 is used to store application code that executes the above solution, and is controlled by the processor 401 for execution.
  • the processor 401 is configured to execute application code stored in the memory 402.
  • the code stored in the memory 402 may be executed by the processor 401 by the information processing method of the augmented reality AR of FIG. 1 to FIG. 2 performed by the terminal device 40 provided above, such as sending an AR request for the target object to the AR server; The first AR information of the target object sent by the AR server; comparing the first AR information with the target scan information, and when there is a discrepancy between the comparisons, generating AR update information, where the target scan information is Determining, by the first terminal, the AR related information of the target object, and sending the AR update information to the AR server, where the AR update information is used by the AR server according to the AR update information An AR message is updated to the second AR information.
  • FIG. 10 is a schematic structural diagram of another embodiment of a terminal device according to an embodiment of the present invention.
  • the terminal device 50 can be a smart mobile terminal (such as a mobile phone).
  • the terminal device 50 includes: a radio frequency (RF) circuit 501, a memory 502 storing one or more computer programs, an input device 503, and an output device 504.
  • RF radio frequency
  • the sensor 505 the audio circuit 506, the wireless fidelity (WiFi) module 507, the processor 508 including one or more processing cores, and the power source 503 and the like.
  • WiFi wireless fidelity
  • the terminal device structure shown in FIG. 10 does not constitute a limitation of the terminal device, and may include more or less components than those illustrated, or a combination of certain components, or different component arrangements. among them:
  • the RF circuit 501 can be used for transmitting and receiving information or during a call, receiving and transmitting signals, in particular, After receiving the downlink information of the base station, it is processed by one or more processors 508; in addition, data related to the uplink is transmitted to the base station.
  • the RF circuit 501 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a subscriber identity module (SIM) card, a transceiver, a coupler, a low noise amplifier ( English: low noise amplifier, LNA), duplexer, etc.
  • SIM subscriber identity module
  • the RF circuit 501 can also communicate with a network or other terminal device through wireless communication.
  • the wireless communication may use any communication standard or protocol, including but not limited to global system of mobile communication (GSM), general packet radio service (GPRS), code division. Code division multiple access (CDMA), wideband code division multiple access (WCDMA), long term evolution (LTE), e-mail, short message service (English) :short messaging service,SMS), etc.
  • GSM global system of mobile communication
  • GPRS general packet radio service
  • CDMA Code division multiple access
  • WCDMA wideband code division multiple access
  • LTE long term evolution
  • e-mail e-mail
  • SMS short message service
  • Memory 502 can be used to store computer programs and modules, and processor 508 executes various functional applications and data processing by running computer programs and modules stored in memory 502.
  • the memory 502 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to The data created by the use of the terminal device 50 (such as photographed photos, audio data, video data, etc.) and the like.
  • memory 502 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, memory 502 may also include a memory controller to provide access to memory 502 by processor 508 and input device 503.
  • Input device 503 can be used to receive input numeric or character information, as well as to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.
  • input device 503 can include touch-sensitive surface 5031 as well as other input devices 5032.
  • a touch-sensitive surface 5031 also referred to as a touch display panel or trackpad, can collect touch operations on or near the user (eg, the user uses a finger, stylus, etc., any suitable object or accessory on the touch-sensitive surface 5031 or The operation near the touch-sensitive surface 5031) and driving the corresponding connecting device according to a preset program.
  • the touch-sensitive surface 5031 can include two portions of a touch detection device and a touch controller.
  • the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information.
  • the processor 508 is provided and can receive commands from the processor 508 and execute them.
  • resistors can be used Various types, such as capacitive, infrared, and surface acoustic waves, implement a touch-sensitive surface 5031.
  • the input device 503 can also include other input devices 5032.
  • other input devices 5032 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.
  • Output device 504 can be used to display information entered by the user or information provided to the user and various graphical user interfaces of terminal device 50, which can be constructed from graphics, text, icons, video, and any combination thereof.
  • the output device 504 can include a display panel 5041.
  • the display panel 5041 can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
  • the touch-sensitive surface 5031 can cover the display panel 5041, and when the touch-sensitive surface 5031 detects a touch operation thereon or nearby, it is transmitted to the processor 508 to determine the type of the touch event, and then the processor 508 according to the touch event The type provides a corresponding visual output on display panel 5041.
  • touch-sensitive surface 5031 and display panel 5041 are implemented as two separate components to implement input and input functions, in some embodiments, touch-sensitive surface 5031 can be integrated with display panel 5041 for input. And output function.
  • Terminal device 50 may also include at least one type of sensor 505, such as a distance sensor, a light sensor, a motion sensor, and other sensors.
  • the distance sensor is configured to detect a distance between the screen of the terminal device and an object covering the terminal device
  • the light sensor is configured to detect an optical signal of an environment external to the terminal device.
  • the gravity acceleration sensor can detect the magnitude of acceleration in each direction (usually three axes), and the magnitude and direction of gravity can be detected at rest, which can be used to identify the attitude of the terminal device 50 (such as horizontal and vertical screen switching).
  • the terminal device 50 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, I will not repeat them here.
  • the audio circuit 506, the speaker 5061, and the microphone 5062 can provide an audio interface between the user and the terminal device 50.
  • the audio circuit 506 can transmit the converted electrical data of the received audio data to the speaker 5061, and convert it into a sound signal output by the speaker 5061.
  • the microphone 5062 converts the collected sound signal into an electrical signal, and the audio circuit 506 is used by the audio circuit 506. After receiving, it is converted into audio data, and then processed by the audio data output processor 508, transmitted to the device, for example, via the RF circuit 501, or the audio data is output to the memory 502 for further processing.
  • the audio circuit 506 may also include an earbud jack to provide communication of the peripheral earphones with the terminal device 50.
  • WiFi is a short-range wireless transmission technology
  • the terminal device 50 can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 507, which provides wireless broadband Internet access for users.
  • FIG. 3 shows the WiFi module 507, it can be understood that it does not belong to the essential configuration of the terminal device 50, and may be omitted as needed within the scope of not changing the essence of the invention.
  • Processor 508 is the control center of terminal device 50, which connects various portions of the entire terminal device 50 using various interfaces and lines, by running or executing computer programs and/or modules stored in memory 502, and for recalling stored in memory 502.
  • the data performs various functions and processing data of the terminal device 50, thereby performing overall monitoring of the terminal device 50.
  • the processor 508 may include one or more processing cores; preferably, the processor 508 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, and the like.
  • the modem processor primarily handles wireless communications. It will be appreciated that the above described modem processor may also not be integrated into the processor 508.
  • the terminal device 50 further includes a power source 503 (such as a battery) for supplying power to the respective components.
  • a power source 503 (such as a battery) for supplying power to the respective components.
  • the power source can be logically connected to the processor 508 through the power management system to manage functions such as charging, discharging, and power management through the power management system.
  • the power supply 503 can also include any one or more of a DC or AC power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
  • the terminal device 50 may further include a camera, a Bluetooth module, and the like, and details are not described herein again.
  • the output device 504 (or the input device 503) of the terminal device is a touch screen display
  • the terminal device 50 further includes a memory 502, a processor 508, and one or more computer programs, one or more of which The computer program is stored in the memory 502, and the program used by the processor 508 to call the information processing of the augmented reality AR stored in the memory 502 (non-volatile memory) performs the flow of each method step in the foregoing method embodiment, and is no longer Narration.
  • the embodiment of the present invention further provides a computer storage medium, wherein the computer storage medium may store a program, where the program includes some or all of the steps of the information processing method of any of the augmented reality ARs described in the foregoing method embodiments. .
  • the disclosed apparatus may be implemented in other ways.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical or otherwise.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present invention may contribute to the prior art or all or part of the technical solution may be embodied in the form of a software product stored in a memory. A number of instructions are included to cause a computer device (which may be a personal computer, server or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing memory includes: a U disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk, and the like, which can store program codes.
  • the memory may include: a flash disk, a read-only memory (English: Read-Only Memory, ROM for short), a random access memory (English: Random Access Memory, RAM for short), a magnetic disk or an optical disk.

Abstract

本发明实施例公开了一种增强现实AR的信息处理方法、装置及系统，其中的方法可包括：AR服务器接收第一终端发送的针对目标对象的AR请求；所述AR服务器向所述第一终端发送所述目标对象的第一AR信息；所述AR服务器接收所述第一终端发送的所述目标对象的AR更新信息；所述AR服务器根据所述AR更新信息将所述第一AR信息更新为第二AR信息，其中，所述AR更新信息为所述第一终端对比出所述第一AR信息和目标扫描信息存在不一致时生成的信息，所述目标扫描信息为所述第一终端扫描并获得的所述目标对象的AR相关信息。采用本发明可以解决现有技术中终端设备无法获得时效性较高的AR信息的问题。

Description

一种增强现实AR的信息处理方法、装置及系统
本申请要求于2016年7月29日提交中国专利局，申请号为201610616780.1、发明名称为“一种增强现实AR的信息处理方法、装置及系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及电子技术领域，尤其涉及一种增强现实AR的信息处理方法、装置及系统。
背景技术
增强现实技术(Augmented Reality，简称AR)，是一种实时地计算摄影机影像的位置及角度并加上相应图像、视频、3D模型的技术，这种技术的目标是在屏幕上把虚拟世界套在现实世界并进行互动。随着随身电子产品中CPU(中央处理单元)运算能力的提升，预期增强现实的用途将会越来越广。
然而，现实世界是不断动态发展的：车辆的行驶、品牌门店的更替等等，都会导致数据采集生成的模型瞬间过时或无效，这种情况在移动终端中的AR应用更显的突出。例如，当你使用智能手机的某款AR应用：扫描当前街道，在屏幕上会增强如下信息：某商店的最低消费是XX元，666路公交车还有4分钟会经过这里。然而，该商店的最低消费可能会根据季节或者节日的不同发生变化，而公交的地理位置也会因为公交的运行而发生变化，此时，AR服务器上所提供的AR信息是否还能与该商店和公交的实际AR信息保持一致，当不一致时则极有可能会误导用户，产生不良的后果。由此，在快速变化的动态环境中，如何保证终端设备的AR应用中获取的AR信息的时效性，是一个亟需优化解决的问题。
发明内容
本发明实施例所要解决的技术问题在于，提供一种增强现实AR的信息处理方法、装置及系统，可以解决现有技术中终端设备无法获得时效性较高的AR信息的问题。
第一方面，本发明实施例提供了一种增强现实AR的信息处理方法，可包括：AR服务器接收第一终端发送的针对目标对象的AR请求；所述AR服务器向所述第一终端发送所述目标对象的第一AR信息；所述AR服务器接收所述第一终端发送的所述目标对象的AR更新信息；所述AR服务器根据所述AR更新信息将所述第一AR信息更新为第二AR信息，其中，所述AR更新信息为所述第一终端对比出所述第一AR信息和目标扫描信息存在不一致时生成的信息，所述目标扫描信息为所述第一终端扫描并获得的所述目标对象的AR相关信息。
结合第一方面，在第一种可能的实现方式中，所述AR服务器根据所述AR更新信息将所述第一AR信息更新为第二AR信息之后，还包括：所述AR服务器将所述第二AR信息发送至所述第一终端。
结合第一方面，在第二种可能的实现方式中，所述AR服务器根据所述AR更新信息将所述第一AR信息更新为第二AR信息，包括：所述AR服务器将所述第一AR信息中与所述目标扫描信息不一致的部分替换为所述AR更新信息，生成第二AR信息；或者所述AR服务器根据所述AR更新信息重新采集所述目标对象的AR信息，生成第二AR信息并对所述第一AR信息进行替换。
结合第一方面或第一方面的第一种可能的实现方式或第一方面的第二种可能的实现方式，在第三种可能的实现方式中，所述方法还包括：所述AR服务器根据所述AR请求，获取所述第一终端当前的地理位置；向所述第一终端推送与所述地理位置对应的预设地理范围内的至少一个推送对象的AR信息。
结合第一方面的第三种可能的实现方式，在第四种可能的实现方式中，所述推送与所述地理位置对应的预设地理范围内的至少一个推送对象的AR信息之前，包括：所述AR服务器接收第二终端发送的所述至少一个推送对象的AR信息。
第二方面，本发明实施例提供了一种增强现实AR的信息处理方法，可包括：第一终端向AR服务器发送针对目标对象的AR请求；所述第一终端接收所述AR服务器发送的所述目标对象的第一AR信息；所述第一终端将所述第一AR信息与目标扫描信息进行对比，当比对出存在不一致时，生成AR更新信息，其中，所述目标扫描信息为所述第一终端扫描并获得的所述目标对象的AR相关信息；所述第一终端向所述AR服务器发送所述AR更新信息，所述AR更新信息用于所述AR服务器根据所述AR更新信息将所述第一AR信息更新为第二AR 信息。
结合第二方面，在第一种可能的实现方式中，所述目标扫描信息为所述第一终端通过摄像头扫描，且经过图像处理、特征提取并结合预设规则计算获得的所述目标对象的AR相关信息。
结合第二方面，在第二种可能的实现方式中，所述第一终端向所述AR服务器发送所述AR更新信息之后，还包括：所述第一终端接收所述AR服务器发送的第二AR信息。
结合第一方面或第一方面的第一种可能的实现方式或第一方面的第二种可能的实现方式，在第三种可能的实现方式中，所述AR请求包括所述第一终端当前的地理位置，所述方法还包括：所述第一终端接收所述AR服务器的推送的与所述地理位置对应的预设地理范围内的至少一个推送对象的AR信息。
第三方面，本发明实施例提供了一种增强现实AR的信息处理装置，可包括：第一接收模块，设置为接收第一终端发送的针对目标对象的AR请求；第一发送模块，设置为向所述第一终端发送所述目标对象的第一AR信息；第二接收模块，设置为接收所述第一终端发送的所述目标对象的AR更新信息；更新模块，设置为根据所述AR更新信息将所述第一AR信息更新为第二AR信息，其中，所述AR更新信息为所述第一终端对比出所述第一AR信息和目标扫描信息存在不一致时生成的信息，所述目标扫描信息为所述第一终端扫描并获得的所述目标对象的AR相关信息。
结合第三方面，在第一种可能的实现方式中，所述装置还包括：第二发送模块，设置为将所述第二AR信息发送至所述第一终端。
结合第三方面，在第二种可能的实现方式中，所述更新模块具体设置为：将所述第一AR信息中与所述目标扫描信息不一致的部分替换为所述AR更新信息，生成第二AR信息；或者根据所述AR更新信息重新采集所述目标对象的AR信息，生成第二AR信息并对所述第一AR信息进行替换。
结合第三方面或第三方面的第一种可能的实现方式或第三方面的第二种可能的实现方式，在第三种可能的实现方式中，所述装置还包括：获取模块，设置为根据所述AR请求，获取所述第一终端当前的地理位置；推送模块，设置为向所述第一终端推送与所述地理位置对应的预设地理范围内的至少一个推送对象的AR信息。
结合第三方面的第三种可能的实现方式，在第四种可能的实现方式中，所述装置还包括：第三接收模块，设置为接收第二终端发送的所述至少一个推送对象的AR信息。
第四方面，本发明实施例提供了一种增强现实AR的信息处理装置，可包括：请求发送模块，设置为向AR服务器发送针对目标对象的AR请求；第一信息接收模块，设置为接收所述AR服务器发送的所述目标对象的第一AR信息；生成模块，设置为将所述第一AR信息与目标扫描信息进行对比，当比对出存在不一致时，生成AR更新信息，其中，所述目标扫描信息为所述第一终端扫描并获得的所述目标对象的AR相关信息；信息发送模块，设置为向所述AR服务器发送所述AR更新信息，所述AR更新信息用于所述AR服务器根据所述AR更新信息将所述第一AR信息更新为第二AR信息。
结合第四方面，在第一种可能的实现方式中，所述目标扫描信息为所述第一终端通过摄像头扫描，且经过图像处理、特征提取并结合预设规则计算获得的所述目标对象的AR相关信息。
结合第四方面，在第二种可能的实现方式中，所述装置还包括：第二信息接收模块，设置为接收所述AR服务器发送的第二AR信息。
结合第四方面或第四方面的第一种可能的实现方式或第四方面的第二种可能的实现方式，在第三种可能的实现方式中，所述AR请求包括所述第一终端当前的地理位置，所述装置还包括：第三信息接收模块，设置为接收所述AR服务器的推送的与所述地理位置对应的预设地理范围内的至少一个推送对象的AR信息。
第五方面，本发明实施例提供了一种增强现实AR的信息处理系统，可包括：AR服务器和终端设备，其中，所述AR服务器为第三方面提供的任意一项所述的增强现实AR的信息处理装置；所述终端设备为第四方面提供的任一项所述的增强现实AR的信息处理装置。
第六方面，本发明实施例提供了一种AR服务器，包括：存储有可执行程序代码的存储器；与所述存储器耦合的处理器；所述处理器调用所述存储器中存储的所述可执行程序代码，执行如本发明实施例第一方面任一方法中所描述的部分或全部步骤。
第七方面，本发明实施例提供了一种终端设备，包括：存储有可执行程序 代码的存储器；与所述存储器耦合的处理器；所述处理器调用所述存储器中存储的所述可执行程序代码，执行如本发明实施例第二方面任一方法中所描述的部分或全部步骤。
第八方面，本发明提供一种计算机存储介质，用于储存为本发明实施例第三方面提供的增强现实AR的信息处理装置所用的计算机软件指令，其包含用于执行上述方面所设计的程序。
第九方面，本发明提供一种计算机存储介质，用于储存为本发明实施例第四方面提供的增强现实AR的信息处理装置所用的计算机软件指令，其包含用于执行上述方面所设计的程序。
实施本发明实施例，具有如下有益效果：
本发明实施例，通过AR服务器接收第一终端发送的针对目标对象的AR请求，并向所述第一终端发送所述目标对象的第一AR信息，AR服务器接收所述第一终端发送的所述目标对象的AR更新信息，并根据所述AR更新信息将所述第一AR信息更新为第二AR信息，其中，所述AR更新信息为所述第一终端对比出所述第一AR信息和目标扫描信息存在不一致时生成的信息，所述目标扫描信息为所述第一终端扫描并获得的所述目标对象的AR相关信息。本发明实施例通过在用户的终端设备扫描比对出目标对象的AR信息与AR服务器提供的信息不一致时，提示AR服务器根据终端设备提供的最新的AR信息进行更新或重新采集更新，从而使得当有其它终端设备同样获取该目标对象的AR信息时，可以获得准确性、时效性较高的AR信息，解决了现有技术中终端设备无法获得时效性较高的AR信息的问题，提高了AR服务器和终端设备之间的AR信息交互的时效性和准确性。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本发明实施例提供的一种增强现实AR的网络架构图；
图2是本发明实施例提供的一种增强现实AR的信息处理方法的流程示意图；
图3是本发明实施例提供的一种增强现实AR的信息处理装置的结构示意图；
图4是本发明实施例提供的另一种增强现实AR的信息处理装置的结构示意图；
图5是本发明实施例提供的又一种增强现实AR的信息处理装置的结构示意图；
图6是本发明实施例提供的又一种增强现实AR的信息处理装置的结构示意图；
图7是本发明实施例提供的又一种增强现实AR的信息处理装置的结构示意图；
图8是本发明实施例提供的一种AR服务器的结构示意图；
图9是本发明实施例提供的一种终端设备的结构示意图；
图10是本发明实施例提供的另一种终端设备的结构示意图。
具体实施方式
为了使本技术领域的人员更好地理解本发明方案，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分的实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都应当属于本发明保护的范围。
以下分别进行详细说明。
本发明的说明书和权利要求书及所述附图中的术语“第一”、“第二”、“第三”和“第四”等是用于区别不同对象，而不是用于描述特定顺序。此外，术语“包括”和“具有”以及它们任何变形，意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元，而是可选地还包括没有列出的步骤或单元，或可选地还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。
在本文中提及“实施例”意味着，结合实施例描述的特定特征、结构或特性可以包含在本发明的至少一个实施例中。在说明书中的各个位置出现该短语并不一定均是指相同的实施例，也不是与其它实施例互斥的独立的或备选的实施例。本领域技术人员显式地和隐式地理解的是，本文所描述的实施例可以与其它实 施例相结合。
以下，对本申请中的部分用语进行解释说明，以便于本领域技术人员理解。
1)、终端设备，又称之为用户设备(User Equipment，UE)，是一种向用户提供语音和/或数据连通性的设备，例如，具有无线连接功能的手持式设备、车载设备等。常见的终端设备例如包括：手机、平板电脑、笔记本电脑、掌上电脑、移动互联网设备(Mobile Internet Device，MID)、可穿戴设备、智能手环、计步器、MP3播放器(Moving Picture Experts Group Audio Layer III，动态影像专家压缩标准音频层面3)、MP4(Moving Picture Experts Group Audio Layer IV，动态影像专家压缩标准音频层面3)播放器、个人数字助理(Personal Digital Assistant，PDA)和膝上型便携计算机等。
2)、增强现实(Augmented Reality，AR)，是通过计算机系统提供的信息增加用户对现实世界感知的技术，是把原本在现实世界的一定时间空间范围内很难体验到的实体信息(视觉信息，声音，味道，触觉等)，通过智能终端等科学技术，模拟仿真后再叠加，将虚拟的信息应用到真实世界，被人类感官所感知，从而达到超越现实的感官体验，实现对现实的增强，其具有三个突出的特点：真实世界和虚拟世界的信息集成；具有实时交互性；在三维尺度空间中增添定位虚拟物体。
3)、“多个”是指两个或两个以上。“和/或”，描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。
为了便于理解本发明实施例，下面先对本发明实施例的网络构架进行描述。请参阅图1，图1是本发明实施例提供的一种增强现实AR的网络架构图。如图1所示，本发明实施例的网络架构是一个基于客户端-服务器架构提供AR业务的架构，可以包括，AR服务器，终端设备(支持AR应用的终端设备)，其中，终端设备通过相关的AR应用向AR服务器请求相关的AR业务，AR服务器则通过网络(如Internet)向终端设备发送提前采集存储的相应的AR信息。还可以理解的是，以上图1中的网络架构只是本发明实施例中较优的一种实施方式，本发明实施例中的网络架构包括但不仅限于以上网络架构，只要能够实现本发明中增强现实AR的信息处理方法的网络架构均属于本发明所保护和涵盖的范 围。
图2是本发明实施例提供的一种增强现实AR的信息处理方法的流程示意图，下面将结合附图2从AR服务器和终端设备(第一终端)的交互侧对本发明实施例中的一种增强现实AR的信息处理方法进行详细介绍，该方法包括以下步骤S201-步骤S208。
步骤S201：第一终端向AR服务器发送针对目标对象的AR请求。
具体地，第一终端为支持AR应用的终端设备，第一终端向AR服务器发送针对目标对象的AR请求，表示使用该第一终端的用户此时需要通过第一终端查看目标对象的AR信息。例如，用户需要查看的目标对象可以为建筑物、商店、餐厅、日常各类生活用品、各类食品等等，而其对应的AR信息，则可以是建筑物、商店、餐厅的地理位置、名称、形状、类型、建造年代、内部构造、营业时间和经营范围等，而日常生活用品的AR信息则可以为其功能，材料、价格，生产日期，使用年限、内部结构、相关评价等。食品的AR信息则可以是食材、颜色、味道、口感、营养价值和相关评价等，本发明实施例在此不一一列举。
步骤S202：AR服务器接收第一终端发送的针对目标对象的AR请求。
具体地，AR服务器接收步骤S201中第一终端发送的针对目标对象的AR请求。其中AR请求中可以包含目标对象的地理位置、名称、属性信息或者标识信息等，以便于AR服务器能精确并唯一确定该目标对象，从而查找出该目标对象的相关AR信息。
步骤S203：AR服务器向所述第一终端发送所述目标对象的第一AR信息。
具体地，AR服务器接收到第一终端发送的针对目标对象的AR请求后，根据第一终端发送的AR请求提取预先采集存储的该目标对象的第一AR信息。其中，该第一AR信息可以是通过人工采集上传到服务其中的，也可以是通过各类传感器采集的发送至该服务器的，本发明对此不作具体限定。
步骤S204：第一终端接收所述AR服务器发送的所述目标对象的第一AR信息。
具体地，第一终端接收步骤S203中的AR服务器发送的所述目标对象的第一AR信息。
步骤S205：第一终端将所述第一AR信息与目标扫描信息进行对比，当比对出存在不一致时，生成AR更新信息。
具体地，目标扫描信息为所述第一终端扫描并获得的所述目标对象的AR相关信息；第一终端可以在发起AR请求之前，或者同时，或者之后通过摄像头或其它传感器对目标对象进行扫描，也可以通过其他信息获取方式获取的该目标对象的相关AR信息。然后第一终端将所述第一AR信息与目标扫描信息进行对比，当比对出存在不一致时，生成AR更新信息。该AR更新信息可以是提示AR服务器需要具体更新哪些信息以及更新为哪些信息，也可以是AR服务器需要进行该目标对象的AR信息更新的触发条件。即AR服务器接收到该AR更新信息，可以根据该AR更新信息直接进行更新，或者是主动去采集更换该目标对象的第一AR信息。而主动采集的方式可以是向相关工作人员或者是采集设备发送信息更新提示，提示工作人员或相关设备当前该目标对象的AR信息存在误差或者是已经过期，需要进行重新采集或测量，从而保证AR信息的准确性和时效性。
需要说明的是，本发明实施例中所指的第一终端比对出第一AR信息和目标扫描信息不一致的情况可以包含多种，例如，第一AR信息和目标扫描信息中包含的信息种类数量一样，只要有一项信息不一致，则可以视为本发明实施例中的不一致；或者，目标扫描信息中的信息种类大于第一AR信息，或目标扫描信息中的信息种类小于第一AR信息时，且目标扫描信息中包含了第一AR信息中未包含的信息，或包含的某种信息与第一AR信息中的该信息不一致时，均可以视为本发明实施例中的不一致，本发明对此不作具体限定。
在一种可能的实现方式中，所述目标扫描信息为所述第一终端通过摄像头扫描，且经过图像处理、特征提取并结合预设规则计算获得的所述目标对象的AR相关信息。例如，第一终端通过自身的摄像头获取某餐厅的招牌图像，并通过图像处理、特征提取等步骤识别出该餐厅的具体名称和标识等AR相关信息。
步骤S206：第一终端向所述AR服务器发送所述AR更新信息。
具体地，第一终端将自身生成的AR更新信息发送给AR服务器，以便于AR服务器根据该AR更新信息进行目标对象的AR信息的更新，从而为用户提供实时的准确性高的AR信息。可以理解的是，AR更新信息需要经过一定的验证或者是发送该AR更新信息的第一终端需要经过验证，否则可能会存在随意篡改目标对象的AR信息的恶意现象等。
步骤S207：AR服务器接收所述第一终端发送的所述目标对象的AR更新 信息。
具体地，AR服务器接收步骤S206中第一终端发送的目标对象的AR更新信息。
步骤S208：AR服务器根据所述AR更新信息将所述第一AR信息更新为第二AR信息。
具体地，AR服务器根据所述AR更新信息将所述第一AR信息更新为第二AR信息。即此时AR服务器认为当前存储的目标对象的第一AR信息存在误差，或者是信息已经过期，不具有时效性，则需要将不具有时效性的第一AR信息更新为具有时效性的第二AR信息。
在一种可能的实现方式中，所述AR服务器将所述第一AR信息中与所述目标扫描信息不一致的部分替换为所述AR更新信息，生成第二AR信息。即只修改不一致的地方进行替换生成新的AR信息。
在一种可能的实现方式中，所述AR服务器根据所述AR更新信息重新采集所述目标对象的AR信息，生成第二AR信息并对所述第一AR信息进行替换。即此时AR更新信息可能只是提示或者触发进行更新的条件，并未包含具体需要更新哪些信息，此时AR服务器可以主动进行重新采集，以便于及时更新目标对象的AR信息。可以理解的是，若AR更新信息中包含了具体需要更新哪些信息，AR服务器也仍然可以选择自己重新采集，以保证更新后的AR信息的真实性和权威性。
在一种可能的实现方式中，所述AR服务器将所述第二AR信息发送至所述第一终端，所述第一终端接收所述AR服务器发送的第二AR信息。即AR服务器更新完之后，可以将更新后的第二AR信息重新发送给第一终端，以保证第一终端可以获得完整的具有时效性的目标对象的AR信息。可以理解的是，后续若有其它的终端需要获取目标对象的AR信息时，AR服务器就可以将更新后的第二AR信息发送给该终端，因此，该交互过程可以视为集众多终端的力量帮助完善AR服务器的AR信息的动态更新。
在一种可能的实现方式中，所述AR服务器根据所述AR请求，获取所述第一终端当前的地理位置；向所述第一终端推送与所述地理位置对应的预设地理范围内的至少一个推送对象的AR信息。即AR服务器可以根据第一终端发送的AR请求获知该终端当前处于的地理位置或其它相关信息，从而查找该地理位置 的预设范围内的一些其它物体或对象的AR信息，并向第一终端进行主动推送，体现人性化和个性化的服务，更加方便用户使用和体验。进一步地，在AR服务器向第一终端推送之前，AR服务器接收第二终端发送的所述至少一个推送对象的AR信息，即AR服务器向第一终端推送的内容可以是其它终端实时向AR服务器汇报产生的，如此一来，便可以完善整个信息处理系统的良性循环。
下面结合一些实际的应用场景对本发明实施例进行说明，例如，使用者1当前处在某一街道，扫描场景包括苏宁电器店铺和街道，则AR服务器根据使用者1扫描到的信息将静态模型信息发送给使用者1，但是下发的静态模型信息中是国美电器的信息(此店铺原先是国美电器，现在变成了苏宁电器)，那么使用者1将此错误信息返回至AR服务器，AR服务器将此静态商铺信息重新建立模型(改为苏宁电器)，并将新的模型信息发送给使用者1。又例如。同时，使用者1所处位置是666路公交车经过的街道，AR服务器获得了该使用者1的地理位置之后需要有选择性的向该用户推送该666的AR信息，此时，正好使用者2在另外一处位置扫描到了666公交车，将此车的位置信息、方向发送给AR服务器，AR服务器根据此可以更新并生成666公交车动态模型信息，并将此信息发送给使用者1，至此，使用者1的AR模型初始化加载完毕。该应用场景将AR模型分为静态模型+动态模型两部分，其中静态模型由AR应用提供商预先采集并生成，使用者在动态使用中动态加载，同时应用信息软件扫描识别到的场所或物体，并与静态模型相比较，若有不一致的地方，则上传至服务器进行矫正，服务器记录此信息，并将新生成的模型下发到使用者应用中；动态模型则由多个应用使用者共同完成初始化的建立：使用者1将扫描到的场所中的动态物体1信息(物体名称、位置、方向等)发送给服务器，服务器建立初始化模型，使用者2在另一位置若将会出现动态物体1，则服务器将此物体的模型信息下发到使用者2中。由此，本技术方案在动态使用AR应用过程中动态初始化AR模型，提升用户体验。
本发明实施例，通过AR服务器接收第一终端发送的针对目标对象的AR请求，并向所述第一终端发送所述目标对象的第一AR信息，AR服务器接收所述第一终端发送的所述目标对象的AR更新信息，并根据所述AR更新信息将所述第一AR信息更新为第二AR信息，其中，所述AR更新信息为所述第一终端对比出所述第一AR信息和目标扫描信息存在不一致时生成的信息，所述目标扫 描信息为所述第一终端扫描并获得的所述目标对象的AR相关信息。本发明实施例通过在用户的终端设备扫描比对出目标对象的AR信息与AR服务器提供的信息不一致时，提示AR服务器根据终端设备提供的最新的AR信息进行更新或重新采集更新，从而使得当有其它终端设备同样获取该目标对象的AR信息时，可以获得准确性、时效性较高的AR信息，解决了现有技术中终端设备无法获得时效性较高的AR信息的问题，提高了AR服务器和终端设备之间的AR信息交互的时效性和准确性。
本发明实施例还提供了一种增强现实AR的信息处理装置10，如图3所示，图3是本发明实施例提供的增强现实AR的信息处理装置10的结构示意图，下面将结合附图3，对增强现实AR的信息处理装置10的结构进行详细介绍。该装置10可包括：第一接收模块101、第一发送模块102、第二接收模块103和更新模块104，其中
第一接收模块101，设置为接收第一终端发送的针对目标对象的AR请求；
第一发送模块102，设置为向所述第一终端发送所述目标对象的第一AR信息；
第二接收模块103，设置为接收所述第一终端发送的所述目标对象的AR更新信息；
更新模块104，设置为根据所述AR更新信息将所述第一AR信息更新为第二AR信息，其中，所述AR更新信息为所述第一终端对比出所述第一AR信息和目标扫描信息存在不一致时生成的信息，所述目标扫描信息为所述第一终端扫描并获得的所述目标对象的AR相关信息。
具体地，如图4所示，图4是本发明实施例提供的另一种增强现实AR的信息处理装置10的结构示意图，所述装置10还包括：
第二发送模块105，设置为将所述第二AR信息发送至所述第一终端。
进一步地，所述更新模块104，具体设置为：
将所述第一AR信息中与所述目标扫描信息不一致的部分替换为所述AR更新信息，生成第二AR信息；或者
根据所述AR更新信息重新采集所述目标对象的AR信息，生成第二AR信息并对所述第一AR信息进行替换。
再进一步地，其特征在于，所述装置10还包括：获取模块106，设置为根 据所述AR请求，获取所述第一终端当前的地理位置；
推送模块107，设置为向所述第一终端推送与所述地理位置对应的预设地理范围内的至少一个推送对象的AR信息。
再进一步地，所述装置，还包括：
第三接收模块108，设置为接收第二终端发送的所述至少一个推送对象的AR信息。
可理解的是，增强现实AR的信息处理装置10中各模块的功能可对应参考上述图1至图2中的各方法实施例中的具体实现方式，这里不再赘述。
在本实施例中，增强现实AR的信息处理装置10是以模块的形式来呈现。这里的“模块”可以指特定应用集成电路(application-specific integrated circuit，ASIC)，执行一个或多个软件或固件程序的处理器和存储器，集成逻辑电路，和/或其他可以提供上述功能的器件。此外，更新模块104可通过图8所示的AR服务器中的处理器301来实现，第一接收模块101、第一发送模块102和第二接收模块103可通过图8所示的AR服务器中的通信接口303来实现。
本发明实施例还提供了又一种增强现实AR的信息处理装置20，如图5所示，图5是本发明实施例提供的增强现实AR的信息处理装置的结构示意图，下面将结合附图5，对装置20的结构进行详细介绍。该装置20可包括：请求发送模块201、第一信息接收模块202和生成模块203和信息发送模块204，其中
请求发送模块201，设置为向AR服务器发送针对目标对象的AR请求；
第一信息接收模块202，设置为接收所述AR服务器发送的所述目标对象的第一AR信息；
生成模块203，设置为将所述第一AR信息与目标扫描信息进行对比，当比对出存在不一致时，生成AR更新信息，其中，所述目标扫描信息为所述第一终端扫描并获得的所述目标对象的AR相关信息；
信息发送模块204，设置为向所述AR服务器发送所述AR更新信息，所述AR更新信息用于所述AR服务器根据所述AR更新信息将所述第一AR信息更新为第二AR信息。
具体地，所述目标扫描信息为所述第一终端通过摄像头扫描，且经过图像处理、特征提取并结合预设规则计算获得的所述目标对象的AR相关信息。
进一步地，如图6所示，图6是本发明实施例提供的又一种增强现实AR 的信息处理装置20的结构示意图，所述装置，还包括：
第二信息接收模块205，设置为接收所述AR服务器发送的第二AR信息。
再进一步地，所述AR请求包括所述第一终端当前的地理位置；所述装置20还包括：
第三信息接收模块206，设置为接收所述AR服务器的推送的与所述地理位置对应的预设地理范围内的至少一个推送对象的AR信息。
可理解的是，增强现实AR的信息处理装置20中各模块的功能可对应参考上述图1至图2中的各方法实施例中的具体实现方式，这里不再赘述。
在本实施例中，增强现实AR的信息处理装置20是以模块的形式来呈现。这里的“模块”可以指特定应用集成电路(application-specific integrated circuit，ASIC)，执行一个或多个软件或固件程序的处理器和存储器，集成逻辑电路，和/或其他可以提供上述功能的器件。此外，生成模块203可通过图9所示的终端设备40的处理器401来实现，请求发送模块201、第一信息接收模块202和信息发送模块204可通过图9所示的终端设备40的通信接口403来实现。
图7是本发明实施例中的一种增强现实AR的信息处理系统的结构示意图，该系统00包括AR服务器01与终端设备02，其中
AR服务器01可以包括上述图5实施例中的增强现实AR的信息处理装置10，终端设备02可以为上述图6实施例中的增强现实AR的信息处理装置20。可理解的是，本发明实施例中的增强现实AR的信息处理系统00还可以包括相关的基站、基站控制器、路由设备、交换设备和核心网服务器等设备。
本发明实施例还提供了一种AR服务器30，如图8所示，图8是本发明实施例中的AR服务器30的结构示意图，下面将结合附图8对AR服务器30的结构进行详细介绍。该AR服务器30包括至少一个处理器301，至少一个存储器302、至少一个通信接口303。所述处理器301、所述存储器302和所述通信接口303通过所述通信总线连接并完成相互间的通信。
处理器301可以是通用中央处理器(CPU)，微处理器，特定应用集成电路(application-specific integrated circuit，ASIC)，或一个或多个用于控制以上方案程序执行的集成电路。
通信接口303，用于与其他设备或通信网络通信，如以太网，无线接入网(RAN)，无线局域网(Wireless Local Area Networks，WLAN)等。
存储器302可以是只读存储器(read-only memory，ROM)或可存储静态信息和指令的其他类型的静态存储设备，随机存取存储器(random access memory，RAM)或者可存储信息和指令的其他类型的动态存储设备，也可以是电可擦可编程只读存储器(Electrically Erasable Programmable Read-Only Memory，EEPROM)、只读光盘(Compact Disc Read-Only Memory，CD-ROM)或其他光盘存储、光碟存储(包括压缩光碟、激光碟、光碟、数字通用光碟、蓝光光碟等)、磁盘存储介质或者其他磁存储设备、或者能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质，但不限于此。存储器可以是独立存在，通过总线与处理器相连接。存储器也可以和处理器集成在一起。
其中，所述存储器302用于存储执行以上方案的应用程序代码，并由处理器301来控制执行。所述处理器301用于执行所述存储器302中存储的应用程序代码。
存储器302存储的代码可被所述处理器301执行以上提供的AR服务器30执行的图1-图2的增强现实AR的信息处理方法，比如接收第一终端发送的针对目标对象的AR请求；向所述第一终端发送所述目标对象的第一AR信息；接收所述第一终端发送的所述目标对象的AR更新信息；根据所述AR更新信息将所述第一AR信息更新为第二AR信息，其中，所述AR更新信息为所述第一终端对比出所述第一AR信息和目标扫描信息存在不一致时生成的信息，所述目标扫描信息为所述第一终端扫描并获得的所述目标对象的AR相关信息。
本发明实施例还提供了一种终端设备40，如图9所示，图9是本发明实施例中的终端设备的结构示意图，下面将结合附图9对终端设备40的结构进行详细介绍。该终端设备40包括至少一个处理器401，至少一个存储器402、至少一个通信接口403。所述处理器401、所述存储器402和所述通信接口403通过所述通信总线连接并完成相互间的通信。
处理器401可以是通用中央处理器(CPU)，微处理器，特定应用集成电路(application-specific integrated circuit，ASIC)，或一个或多个用于控制以上方案程序执行的集成电路。
通信接口403，用于与其他设备或通信网络通信，如以太网，无线接入网(RAN)，无线局域网(Wireless Local Area Networks，WLAN)等。
存储器402可以是只读存储器(read-only memory，ROM)或可存储静态信息和指令的其他类型的静态存储设备，随机存取存储器(random access memory，RAM)或者可存储信息和指令的其他类型的动态存储设备，也可以是电可擦可编程只读存储器(Electrically Erasable Programmable Read-Only Memory，EEPROM)、只读光盘(Compact Disc Read-Only Memory，CD-ROM)或其他光盘存储、光碟存储(包括压缩光碟、激光碟、光碟、数字通用光碟、蓝光光碟等)、磁盘存储介质或者其他磁存储设备、或者能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质，但不限于此。存储器可以是独立存在，通过总线与处理器相连接。存储器也可以和处理器集成在一起。
其中，所述存储器402用于存储执行以上方案的应用程序代码，并由处理器401来控制执行。所述处理器401用于执行所述存储器402中存储的应用程序代码。
存储器402存储的代码可被所述处理器401执行以上提供的终端设备40执行的图1-图2的增强现实AR的信息处理方法，比如向AR服务器发送针对目标对象的AR请求；接收所述AR服务器发送的所述目标对象的第一AR信息；将所述第一AR信息与目标扫描信息进行对比，当比对出存在不一致时，生成AR更新信息，其中，所述目标扫描信息为所述第一终端扫描并获得的所述目标对象的AR相关信息；向所述AR服务器发送所述AR更新信息，所述AR更新信息用于所述AR服务器根据所述AR更新信息将所述第一AR信息更新为第二AR信息。
请参阅图10，图10是本发明实施例提供的终端设备的另一实施例的结构示意图。该终端设备50可以为智能移动终端(如手机)，终端设备50包括：射频(英文：radio frequency，RF)电路501、存储有一个或多个计算机程序的存储器502、输入装置503、输出装置504、传感器505、音频电路506、无线保真(英文：wireless fidelity，WiFi)模块507、包括有一个或多个处理核心的处理器508、以及电源503等部件。本领域技术人员可以理解，图10中示出的终端设备结构并不构成对终端设备的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。其中：
RF电路501可用于收发信息或通话过程中，信号的接收和发送，特别地， 将基站的下行信息接收后，交由一个或多个处理器508处理；另外，将涉及上行的数据发送给基站。通常，RF电路501包括但不限于天线、至少一个放大器、调谐器、一个或多个振荡器、用户身份模块(英文：subscriber identity module，SIM)卡、收发信机、耦合器、低噪声放大器(英文：low noise amplifier，LNA)、双工器等。此外，RF电路501还可以通过无线通信与网络或其他终端设备进行通信。所述无线通信可以使用任一通信标准或协议，包括但不限于全球移动通讯系统(英文：global system of mobile communication，GSM)、通用分组无线服务(英文：general packet radio service，GPRS)、码分多址(英文：code division multiple access，CDMA)、宽带码分多址(英文：wideband code division multiple access，WCDMA)、长期演进(英文：long term evolution，LTE)、电子邮件、短消息服务(英文：short messaging service，SMS)等。
存储器502可用于存储计算机程序以及模块，处理器508通过运行存储在存储器502的计算机程序以及模块，从而执行各种功能应用以及数据处理。存储器502可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等；存储数据区可存储根据终端设备50的使用所创建的数据(比如拍摄的照片、音频数据、视频数据等)等。此外，存储器502可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。相应地，存储器502还可以包括存储器控制器，以提供处理器508和输入装置503对存储器502的访问。
输入装置503可用于接收输入的数字或字符信息，以及产生与用户设置以及功能控制有关的键盘、鼠标、操作杆、光学或者轨迹球信号输入。具体地，输入装置503可包括触敏表面5031以及其他输入设备5032。触敏表面5031，也称为触摸显示面板或者触控板，可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触敏表面5031上或在触敏表面5031附近的操作)，并根据预先设定的程式驱动相应的连接装置。可选的，触敏表面5031可包括触摸检测装置和触摸控制器两个部分。其中，触摸检测装置检测用户的触摸方位，并检测触摸操作带来的信号，将信号传送给触摸控制器；触摸控制器从触摸检测装置上接收触摸信息，并将它转换成触点坐标，再送给处理器508，并能接收处理器508发来的命令并加以执行。此外，可以采用电阻 式、电容式、红外线以及表面声波等多种类型实现触敏表面5031。除了触敏表面5031，输入装置503还可以包括其他输入设备5032。具体地，其他输入设备5032可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。
输出装置504可用于显示由用户输入的信息或提供给用户的信息以及终端设备50的各种图形用户界面，这些图形用户界面可以由图形、文本、图标、视频和其任意组合来构成。输出装置504可包括显示面板5041，可选的，显示面板5041可以采用液晶显示器(英文：liquid crystal display，LCD)、有机发光二极管(英文：organic light-emitting diode，OLED)等形式来配置。进一步的，触敏表面5031可覆盖显示面板5041，当触敏表面5031检测到在其上或附近的触摸操作后，传送给处理器508以确定触摸事件的类型，随后处理器508根据触摸事件的类型在显示面板5041上提供相应的视觉输出。虽然在图3中，触敏表面5031与显示面板5041是作为两个独立的部件来实现输入和输入功能，但是在某些实施例中，可以将触敏表面5031与显示面板5041集成而实现输入和输出功能。
终端设备50还可包括至少一种传感器505，比如距离传感器、光传感器、运动传感器以及其他传感器。具体地，距离传感器用于检测所述终端设备屏幕与覆盖所述终端设备的物体之间的距离，光传感器用于检测所述终端设备外部环境的光信号。作为运动传感器的一种，重力加速度传感器可检测各个方向上(一般为三轴)加速度的大小，静止时可检测出重力的大小及方向，可用于识别终端设备50姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等；至于终端设备50还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器，此处不再赘述。
音频电路506、扬声器5061、传声器5062可提供用户与终端设备50之间的音频接口。音频电路506可将接收到的音频数据转换后的电信号，传输到扬声器5061，由扬声器5061转换为声音信号输出；另一方面，传声器5062将收集的声音信号转换为电信号，由音频电路506接收后转换为音频数据，再将音频数据输出处理器508处理后，经RF电路501以发送给比如另一设备，或者将音频数据输出至存储器502以便进一步处理。音频电路506还可能包括耳塞插孔，以提供外设耳机与终端设备50的通信。
WiFi属于短距离无线传输技术，终端设备50通过WiFi模块507可以帮助用户收发电子邮件、浏览网页和访问流式媒体等，它为用户提供了无线的宽带互联网访问。虽然图3示出了WiFi模块507，但是可以理解的是，其并不属于终端设备50的必须构成，完全可以根据需要在不改变发明的本质的范围内而省略。
处理器508是终端设备50的控制中心，利用各种接口和线路连接整个终端设备50的各个部分，通过运行或执行存储在存储器502内的计算机程序和/或模块，以及调用存储在存储器502内的数据，执行终端设备50的各种功能和处理数据，从而对终端设备50进行整体监控。可选的，处理器508可包括一个或多个处理核心；优选的，处理器508可集成应用处理器和调制解调处理器，其中，应用处理器主要处理操作系统、用户界面和应用程序等，调制解调处理器主要处理无线通信。可以理解的是，上述调制解调处理器也可以不集成到处理器508中。
终端设备50还包括给各个部件供电的电源503(比如电池)，优选的，电源可以通过电源管理系统与处理器508逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。电源503还可以包括一个或多个直流或交流电源、再充电系统、电源故障检测电路、电源转换器或者逆变器、电源状态指示器等任意组件。
尽管未示出，终端设备50还可以包括摄像头、蓝牙模块等，此处不再赘述。具体在本发明实施例中，终端设备的输出装置504(或输入装置503)是触摸屏显示器，终端设备50还包括有存储器502、处理器508、以及一个或多个的计算机程序，其中一个或多个计算机程序存储于存储器502中，处理器508用于调用存储器502(非易失性存储器)存储的增强现实AR的信息处理的程序执行前述方法实施例中的各方法步骤流程，在此不再赘述。
本发明实施例还提供一种计算机存储介质，其中，该计算机存储介质可存储有程序，该程序执行时包括上述方法实施例中记载的任何一种增强现实AR的信息处理方法的部分或全部步骤。
需要说明的是，对于前述的各方法实施例，为了简单描述，故将其都表述为一系列的动作组合，但是本领域技术人员应该知悉，本发明并不受
所描述的动作顺序的限制，因为依据本发明，某些步骤可以采用其他顺序 或者同时进行。其次，本领域技术人员也应该知悉，说明书中所描述的实施例均属于优选实施例，所涉及的动作和模块并不一定是本发明所必须的。
在上述实施例中，对各个实施例的描述都各有侧重，某个实施例中没有详述的部分，可以参见其他实施例的相关描述。
在本申请所提供的几个实施例中，应该理解到，所揭露的装置，可通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本发明各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储器中。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储器中，包括若干指令用以使得一台计算机设备(可为个人计算机、服务器或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储器包括：U盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成，该程序可以存储于一计算机可读存 储器中，存储器可以包括：闪存盘、只读存储器(英文：Read-Only Memory，简称：ROM)、随机存取器(英文：Random Access Memory，简称：RAM)、磁盘或光盘等。
以上对本发明实施例进行了详细介绍，本文中应用了具体个例对本发明的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本发明的方法及其核心思想；同时，对于本领域的一般技术人员，依据本发明的思想，在具体实施方式及应用范围上均会有改变之处，综上所述，本说明书内容不应理解为对本发明的限制。

Claims (19)

  1. 一种增强现实AR的信息处理方法，其特征在于，包括：
    AR服务器接收第一终端发送的针对目标对象的AR请求；
    所述AR服务器向所述第一终端发送所述目标对象的第一AR信息；
    所述AR服务器接收所述第一终端发送的所述目标对象的AR更新信息；
    所述AR服务器根据所述AR更新信息将所述第一AR信息更新为第二AR信息，其中，所述AR更新信息为所述第一终端对比出所述第一AR信息和目标扫描信息存在不一致时生成的信息，所述目标扫描信息为所述第一终端扫描并获得的所述目标对象的AR相关信息。
  2. 如权利要求1所述的方法，其特征在于，所述AR服务器根据所述AR更新信息将所述第一AR信息更新为第二AR信息之后，还包括：
    所述AR服务器将所述第二AR信息发送至所述第一终端。
  3. 如权利要求1所述的方法，其特征在于，所述AR服务器根据所述AR更新信息将所述第一AR信息更新为第二AR信息，包括：
    所述AR服务器将所述第一AR信息中与所述目标扫描信息不一致的部分替换为所述AR更新信息，生成第二AR信息；或者
    所述AR服务器根据所述AR更新信息重新采集所述目标对象的AR信息，生成第二AR信息并对所述第一AR信息进行替换。
  4. 如权利要求1-3任意一项所述的方法，其特征在于，所述方法还包括：
    所述AR服务器根据所述AR请求，获取所述第一终端当前的地理位置；
    向所述第一终端推送与所述地理位置对应的预设地理范围内的至少一个推送对象的AR信息。
  5. 如权利要求4所述的方法，其特征在于，所述推送与所述地理位置对应的预设地理范围内的至少一个推送对象的AR信息之前，包括：
    所述AR服务器接收第二终端发送的所述至少一个推送对象的AR信息。
  6. 一种增强现实AR的信息处理方法，其特征在于，包括：
    第一终端向AR服务器发送针对目标对象的AR请求；
    所述第一终端接收所述AR服务器发送的所述目标对象的第一AR信息；
    所述第一终端将所述第一AR信息与目标扫描信息进行对比，当比对出存在不一致时，生成AR更新信息，其中，所述目标扫描信息为所述第一终端扫描并获得的所述目标对象的AR相关信息；
    所述第一终端向所述AR服务器发送所述AR更新信息，所述AR更新信息用于所述AR服务器根据所述AR更新信息将所述第一AR信息更新为第二AR信息。
  7. 如权利要求6所述的方法，其特征在于，所述目标扫描信息为所述第一终端通过摄像头扫描，且经过图像处理、特征提取并结合预设规则计算获得的所述目标对象的AR相关信息。
  8. 如权利要求6所述的方法，其特征在于，所述第一终端向所述AR服务器发送所述AR更新信息之后，还包括：
    所述第一终端接收所述AR服务器发送的第二AR信息。
  9. 如权利要求6-8任意一项所述的方法，其特征在于，所述AR请求包括所述第一终端当前的地理位置，所述方法还包括：
    所述第一终端接收所述AR服务器的推送的与所述地理位置对应的预设地理范围内的至少一个推送对象的AR信息。
  10. 一种增强现实AR的信息处理装置，其特征在于，包括：
    第一接收模块，设置为接收第一终端发送的针对目标对象的AR请求；
    第一发送模块，设置为向所述第一终端发送所述目标对象的第一AR信息；
    第二接收模块，设置为接收所述第一终端发送的所述目标对象的AR更新信息；
    更新模块，设置为根据所述AR更新信息将所述第一AR信息更新为第二AR信息，其中，所述AR更新信息为所述第一终端对比出所述第一AR信息和目标扫描信息存在不一致时生成的信息，所述目标扫描信息为所述第一终端扫描并获得的所述目标对象的AR相关信息。
  11. 如权利要求10所述的装置，其特征在于，所述装置还包括：
    第二发送模块，设置为将所述第二AR信息发送至所述第一终端。
  12. 如权利要求10所述的装置，其特征在于，所述更新模块具体设置为：
    将所述第一AR信息中与所述目标扫描信息不一致的部分替换为所述AR更新信息，生成第二AR信息；或者
    根据所述AR更新信息重新采集所述目标对象的AR信息，生成第二AR信息并对所述第一AR信息进行替换。
  13. 如权利要求10-12任意一项所述的装置，其特征在于，所述装置还包括：
    获取模块，设置为根据所述AR请求，获取所述第一终端当前的地理位置；
    推送模块，设置为向所述第一终端推送与所述地理位置对应的预设地理范围内的至少一个推送对象的AR信息。
  14. 如权利要求13所述的装置，其特征在于，所述装置还包括：
    第三接收模块，设置为接收第二终端发送的所述至少一个推送对象的AR信息。
  15. 一种增强现实AR的信息处理装置，其特征在于，包括：
    请求发送模块，设置为向AR服务器发送针对目标对象的AR请求；
    第一信息接收模块，设置为接收所述AR服务器发送的所述目标对象的第一AR信息；
    生成模块，设置为将所述第一AR信息与目标扫描信息进行对比，当比对出存在不一致时，生成AR更新信息，其中，所述目标扫描信息为所述第一终端扫描并获得的所述目标对象的AR相关信息；
    信息发送模块，设置为向所述AR服务器发送所述AR更新信息，所述AR更新信息用于所述AR服务器根据所述AR更新信息将所述第一AR信息更新为第二AR信息。
  16. 如权利要求15所述的装置，其特征在于，所述目标扫描信息为所述第一终端通过摄像头扫描，且经过图像处理、特征提取并结合预设规则计算获得的所述目标对象的AR相关信息。
  17. 如权利要求15所述的装置，其特征在于，所述装置还包括：
    第二信息接收模块，设置为接收所述AR服务器发送的第二AR信息。
  18. 如权利要求15-17任意一项所述的装置，其特征在于，所述AR请求包括所述第一终端当前的地理位置，所述装置还包括：
    第三信息接收模块，设置为接收所述AR服务器的推送的与所述地理位置对应的预设地理范围内的至少一个推送对象的AR信息。
  19. 一种增强现实AR的信息处理系统，包括AR服务器和终端设备，其中所述AR服务器包括如权利要求10-12任一项所述的增强现实AR的信息处理装置；
    所述终端设备包括如权利要求15-17任一项所述的增强现实AR的信息处理装置。
PCT/CN2016/097148 2016-07-29 2016-08-29 一种增强现实ar的信息处理方法、装置及系统 WO2018018698A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610616780.1 2016-07-29
CN201610616780.1A CN106250187A (zh) 2016-07-29 2016-07-29 一种增强现实ar的信息处理方法、装置及系统

Publications (1)

Publication Number Publication Date
WO2018018698A1 true WO2018018698A1 (zh) 2018-02-01

Family

ID=57607321

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/097148 WO2018018698A1 (zh) 2016-07-29 2016-08-29 一种增强现实ar的信息处理方法、装置及系统

Country Status (2)

Country Link
CN (1) CN106250187A (zh)
WO (1) WO2018018698A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110070448A (zh) * 2019-03-08 2019-07-30 阿里巴巴集团控股有限公司 一种电子保单的处理方法及服务器
CN114710472A (zh) * 2020-12-16 2022-07-05 中国移动通信有限公司研究院 一种ar视频通话的处理方法、装置及通信设备

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107247548B (zh) * 2017-05-31 2018-09-04 腾讯科技（深圳）有限公司 图像显示方法、图像处理方法及装置
CN107450088B (zh) * 2017-06-08 2021-05-14 百度在线网络技术（北京）有限公司 一种基于位置的服务lbs的增强现实定位方法及装置
CN110020340A (zh) * 2017-08-22 2019-07-16 阿里巴巴集团控股有限公司 一种数据处理的方法、装置和客户端
CN107608712B (zh) * 2017-10-27 2021-11-16 北京小米移动软件有限公司 版本管理方法及装置
CN111429148A (zh) * 2019-01-09 2020-07-17 北京京东尚科信息技术有限公司 评价界面进入方法及装置
CN111796846B (zh) * 2020-07-06 2023-12-12 广州一起精彩艺术教育科技有限公司 信息更新方法、装置、终端设备及可读存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102843349A (zh) * 2011-06-24 2012-12-26 中兴通讯股份有限公司 实现移动增强现实业务的方法及系统、终端及服务器
US20130288717A1 (en) * 2011-01-17 2013-10-31 Lg Electronics Inc Augmented reality (ar) target updating method, and terminal and server employing same
CN103516737A (zh) * 2012-06-21 2014-01-15 中兴通讯股份有限公司 增强现实内容的获取方法和移动增强现实服务器及客户端
CN103945274A (zh) * 2013-04-19 2014-07-23 达腾科公司 提供对应于电视节目的交互增强现实信息的方法和设备
CN105190704A (zh) * 2013-05-09 2015-12-23 三星电子株式会社 用于提供包括增强现实信息的内容的方法和装置

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101299910B1 (ko) * 2010-08-18 2013-08-23 주식회사 팬택 증강 현실 서비스의 공유 방법 및 그를 위한 사용자 단말기와 원격자 단말기
US8550909B2 (en) * 2011-06-10 2013-10-08 Microsoft Corporation Geographic data acquisition by user motivation
US9171384B2 (en) * 2011-11-08 2015-10-27 Qualcomm Incorporated Hands-free augmented reality for wireless communication devices

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130288717A1 (en) * 2011-01-17 2013-10-31 Lg Electronics Inc Augmented reality (ar) target updating method, and terminal and server employing same
CN102843349A (zh) * 2011-06-24 2012-12-26 中兴通讯股份有限公司 实现移动增强现实业务的方法及系统、终端及服务器
CN103516737A (zh) * 2012-06-21 2014-01-15 中兴通讯股份有限公司 增强现实内容的获取方法和移动增强现实服务器及客户端
CN103945274A (zh) * 2013-04-19 2014-07-23 达腾科公司 提供对应于电视节目的交互增强现实信息的方法和设备
CN105190704A (zh) * 2013-05-09 2015-12-23 三星电子株式会社 用于提供包括增强现实信息的内容的方法和装置

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110070448A (zh) * 2019-03-08 2019-07-30 阿里巴巴集团控股有限公司 一种电子保单的处理方法及服务器
CN110070448B (zh) * 2019-03-08 2023-10-03 创新先进技术有限公司 一种电子保单的处理方法及服务器
CN114710472A (zh) * 2020-12-16 2022-07-05 中国移动通信有限公司研究院 一种ar视频通话的处理方法、装置及通信设备

Also Published As

Publication number Publication date
CN106250187A (zh) 2016-12-21

Similar Documents

Publication Publication Date Title
WO2018018698A1 (zh) 一种增强现实ar的信息处理方法、装置及系统
US10636221B2 (en) Interaction method between user terminals, terminal, server, system, and storage medium
CN106161628B (zh) 拍摄文件上传方法及装置
WO2019184889A1 (zh) 增强现实模型的调整方法、装置、存储介质和电子设备
KR101977526B1 (ko) 화상 스플라이싱 방법, 단말, 및 시스템
US10817255B2 (en) Scene sound effect control method, and electronic device
WO2017041664A1 (zh) 一种征信评分确定方法、装置及存储介质
CN106780684B (zh) 一种动画效果实现方法及装置
US10675541B2 (en) Control method of scene sound effect and related products
EP3429176B1 (en) Scenario-based sound effect control method and electronic device
US9824476B2 (en) Method for superposing location information on collage, terminal and server
WO2016173350A1 (zh) 图片处理方法及装置
CN105227598B (zh) 一种基于云存储的资源分享方法、装置和系统
TW201541337A (zh) 移動終端中訊息的顯示方法、裝置和系統
US20160119695A1 (en) Method, apparatus, and system for sending and playing multimedia information
CN105513098B (zh) 一种图像处理的方法和装置
JP6535690B2 (ja) オンライン・アカウントを関連付ける方法
US20160330587A1 (en) Information obtaining method, server, terminal, and system
CN108429805B (zh) 一种文件下载处理方法、发送终端及接收终端
WO2013185574A1 (zh) 一种获取地点描述信息的方法、终端、地点服务器及系统
US10853412B2 (en) Scenario-based sound effect control method and electronic device
CN114510417A (zh) 一种图像渲染效果测试方法、装置、电子设备和存储介质
CN113012267A (zh) 一种特效动画的测试方法和相关装置
CN111986251A (zh) 物体体积测量方法、装置、测量设备及存储介质
CN110019583B (zh) 一种基于虚拟现实的环境展示方法和系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16910277

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16910277

Country of ref document: EP

Kind code of ref document: A1