CN102810099B - The storage method and device of augmented reality view - Google Patents

The storage method and device of augmented reality view Download PDF

Info

Publication number
CN102810099B
CN102810099B CN201110147806.XA CN201110147806A CN102810099B CN 102810099 B CN102810099 B CN 102810099B CN 201110147806 A CN201110147806 A CN 201110147806A CN 102810099 B CN102810099 B CN 102810099B
Authority
CN
China
Prior art keywords
augmented reality
storage
view
reality content
reality view
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201110147806.XA
Other languages
Chinese (zh)
Other versions
CN102810099A (en
Inventor
黄成�
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201110147806.XA priority Critical patent/CN102810099B/en
Publication of CN102810099A publication Critical patent/CN102810099A/en
Application granted granted Critical
Publication of CN102810099B publication Critical patent/CN102810099B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a kind of storage method and device of augmented reality view, wherein, this method includes：Augmented reality content is obtained, wherein, augmented reality content is used for user terminal displaying augmented reality view；According to the personalization preferences of user and the context creation of user and store the multimedia object corresponding to the augmented reality view.The present invention solves the problems, such as that selectively storage augmented reality view can not be needed according to user in the prior art, and then can flexibly, simply carry out the effect of augmented reality view storage.

Description

The storage method and device of augmented reality view
Technical field
The present invention relates to the communications field, in particular to a kind of storage method and device of augmented reality view.
Background technology
With maturation and the development of intelligent terminal, development of Mobile Internet technology, the augmented reality in laboratory was once confined to (AugmentedReality, abbreviation AR) technology starts to come into the popular visual field, it is large quantities of using image recognition, terminal positioning technology as The internet on basis/mobile Internet AR applications start to emerge in large numbers, and are known as mobile augmented reality (Mobile AR) application, this causes Industry larger concern, becomes technical research hot spot.
The research and application of mobile augmented reality technology, virtual augmented reality Information application to real world changes User observes the mode of world around --- by traditional WEB page browse queries pattern based on text input, it is changed into Shot based on camera, capture hot spot and displaying live view enhancement information new mode.
As shown in Figure 1, augmented reality operation system composition of the prior art, including：Augmented reality server 100, with The augmented reality content server 110 of the communication of augmented reality server 100, the communication network to communicate with augmented reality server 100 Network 120 and the augmented reality terminal 130 to communicate with communication network 120.Wherein：
Augmented reality server 100, the functional entity that augmented reality service provider disposes in network side, is responsible for safeguarding and uses Family service order relation and preference are set, and according to user's request or business set it is having been captured to user terminal delivering, can For the augmented reality target of access, and associated augmented reality content, provide dynamic augmented reality service to the user.
Augmented reality content server 110, the functional entity that augmented reality content supplier disposes in network side, storage with Augmented reality target is issued in augmented reality server 100, such as POI (point of interest), associated augmented reality content, bag Include：The various multimedia messages such as word, image, audio, video.
Communication network 120, network communication link is provided between augmented reality server 100 and augmented reality terminal 130 Wired, cordless communication network.
Augmented reality terminal 130, what user used possesses the communication terminal of augmented reality professional ability, basic except providing Communication function beyond, augmented reality business experience can also be provided to the user.
Mobile augmented reality user using mobile augmented reality terminal (such as：Smart mobile phone) in the same of shooting surrounding scenes When can obtain augmented reality business experience, there are following business scenario：The augmented reality application run on customer mobile terminal (ARApplication) the augmented reality target (AR Target) based on user current location capture AR service provider's deployment, For example with the relevant hot spot in geographical location (POI), and obtained and the corresponding increasing of augmented reality target according to the selection of user Strong real content (AR Content), including：Word, picture, audio, video.Augmented reality, which is applied, combines user terminal geography Finger print information is (for example：Longitude and latitude, direction etc.), the surrounding reality of the augmented reality content of acquisition and terminal camera shooting is believed Cease to merge in screen and show, augmented reality view (AR View) is presented to user, it is a kind of by augmented reality application offer, will The augmented reality content of acquisition merges to render with camera captured in real-time picture on terminal display shows formed sight Examine view.So that user obtains unusual augmented reality business experience.
But according to shooting environmental (park, market), augmented reality content characteristic (type, form) and the SOT state of termination The difference of (memory space), augmented reality user have different storage demands for different augmented reality views, and user is sometimes It may want to only store camera shooting outdoor scene, sometimes it may be desirable that the augmented reality that augmented reality application is obtained and rendered Content is stored together with outdoor scene information, that is, stores augmented reality view full detail, and generating in augmented reality perhaps strengthens now Real-time coupling object, it is convenient subsequently to browse.But existing mobile augmented reality terminal (collection) shooting storage scheme can only be remembered The outdoor scene information that record camera captures, does not provide augmented reality view the Save option, and augmented reality view to the user Store function.
If it is desired to which the augmented reality content additionally shown is stored together with camera shooting outdoor scene information, one is not Gratifying method is exactly to ask third party to shoot record active user from the external world using apparatus for making a video recording (mobile phone or video camera) Shown augmented reality view on terminal screen, so as to realize that augmented reality view stores indirectly, the method needs third party Support and it is complicated obviously user can not be allowed to be satisfied with, further, since user terminal screen is carried out by third party device weight New shooting, its image quality must be inferior to raw frames, so as to cause distortion to a certain extent, simultaneously because needing Re-shoot, then can not flexibly obtain the augmented reality view of storage required for user.
Another scheme is exactly by the similar screenshotss technology in computation, intercepts and preserves user in display screen The augmented reality view seen on curtain.This requires the screenshotss that similar computer Print Screen key functions are installed on user terminal Software is realized, however, one side in the market few mobile terminals possess this function, on the other hand the technology can only intercept And all the elements shown on screen are stored, selectively storage augmented reality view can not be needed according to user.
It can be seen from the above that the storage scheme of augmented reality view is needed by third party's hardware and/or soft in the prior art It the help of part and can cause distortion to a certain extent when by third party's hardware, can not flexibly obtain user institute Need the augmented reality view stored；When by third party software, selectively storage enhancing can not be needed existing according to user Real-time coupling.
The content of the invention
It is a primary object of the present invention to provide a kind of storage method and device of augmented reality view, to solve existing skill The problem of can not needing selectively storage augmented reality view in art according to user.
According to an aspect of the invention, there is provided a kind of storage method of augmented reality view, this method include：Obtain Augmented reality content, wherein, the augmented reality content is used for user terminal displaying augmented reality view；According to the individual character of user Change the context creation of preference and user and store the multimedia object corresponding to the augmented reality view.
According to the personalization preferences of user and the context creation of user and store corresponding to the more of augmented reality view The step of media object, includes：Receive the storage of augmented reality view and judge request；The enhancing set in inquiry personalization preferences shows Whether real-time coupling memory module indicates to carry out the storage of augmented reality view according to personalization preferences and context；If so, then Create and store corresponding to the more of augmented reality view using the augmented reality content for meeting personalization preferences and context Media object；If it is not, the multimedia object corresponding to augmented reality view is then created and stores using augmented reality content, or Person is without using augmented reality content creating and stores the multimedia object corresponding to augmented reality view.
Included using augmented reality content to create and store the step of the multimedia object corresponding to augmented reality view： To send augmented reality view storage judge request entity return storage affirmative acknowledgement, and to perform augmented reality View synthesis The entity of processing sends storage and starts control instruction, for indicating to start to create multimedia object and stored.Without using Augmented reality content creating and store corresponding to augmented reality view multimedia object the step of include：To transmission augmented reality View storage judges that the entity of request returns to storage negative response, is not sent out to the entity for performing the processing of augmented reality View synthesis Storage is sent to start control instruction.
Create and store corresponding to augmented reality using the augmented reality content for meeting personalization preferences and context The step of multimedia object of view, includes：Obtain and the relevant augmented reality content characteristic information of augmented reality view, judgement Whether augmented reality content characteristic information meets the augmented reality view storage rule set in personalization preferences；User is obtained to work as Preceding context, judges whether context meets the augmented reality view storage rule set in personalization preferences；If enhancing is existing Real content characteristic information and context meet the augmented reality view storage rule set in personalization preferences, then using enhancing Real content creates and stores the multimedia object corresponding to augmented reality view.
Judge augmented reality content characteristic information by following steps and whether context meets in personalization preferences and set The augmented reality view storage rule put：Judge whether is augmented reality content characteristic described in augmented reality content characteristic information Meet that augmented reality view storage rule allows the augmented reality content characteristic of storage, wherein, augmented reality content characteristic includes At least one of：The augmented reality target type associated with augmented reality content, augmented reality content multiple media types, increase Strong real content size；Judge whether user's current context feature described in context meets augmented reality view storage rule Then allow the user's context feature of storage, wherein, user's context feature includes at least one of：User terminal currently remains Remaining memory space, user current location, user terminal current residual electricity.
Included using augmented reality content to create and store the step of the multimedia object corresponding to augmented reality view： Pair augmented reality content relevant with augmented reality view and terminal camera shooting live-action data cache；According to terminal Real time status information and augmented reality content show control information by institute's augmented reality content of caching and the outdoor scene of terminal taking Data are synthesized；The data that synthesis obtains are exported to memory and are stored.
When the data for obtaining synthesis are exported to memory and stored, the storage method of augmented reality view is also wrapped Include：The data that synthesis obtains are exported to terminal presentation facility.
After creating and storing corresponding to the multimedia object of augmented reality view using augmented reality content, enhancing The storage method of real view further includes：Receive the storage selection request of augmented reality view；Stored and selected according to augmented reality view Select and request to generate storage control instruction；If storage control, which is designated as storage, starts control instruction, send augmented reality content and close Start to ask into input, start synthesis processing, and store augmented reality content；If storage control is designated as storage, termination control refers to Show, then send augmented reality content synthetic input and stop request, terminate synthesis processing, stop storage augmented reality content.
According to another aspect of the present invention, there is provided a kind of storage device of augmented reality view, the device include：Obtain Unit, obtains augmented reality content, wherein, augmented reality content is used for user terminal displaying augmented reality view；Execution unit, For the personalization preferences according to user and the context creation of user and store the multimedia corresponding to augmented reality view Object.
Execution unit includes：Receiving module, judges request for receiving the storage of augmented reality view；Enquiry module, is used for In inquiry personalization preferences the augmented reality view memory module that sets whether indicate according to personalization preferences and context into The storage of row augmented reality view；Processing module, for being carried out in memory module instruction according to personalization preferences and context During the storage of augmented reality view, whether created simultaneously using augmented reality content according to personalization preferences and context determination Storage corresponds to the multimedia object of augmented reality view, if so, then being corresponded to using augmented reality content to create and store The multimedia object of augmented reality view；Augmented reality is not carried out in memory module instruction according to personalization preferences and context During the storage of view, the multimedia object corresponding to augmented reality view is created and stores using augmented reality content, or Without using augmented reality content creating and store the multimedia object corresponding to augmented reality view.
Processing module includes：First processing submodule, for being corresponded to using augmented reality content to create and store During the multimedia object of augmented reality view, judge that the entity of request returns to storage and certainly should to the storage of augmented reality view is sent Answer, and send storage to the entity for performing the processing of augmented reality View synthesis and start control instruction, for indicating to start to more matchmakers Body object is created and stored；Second processing submodule, for corresponding to without using augmented reality content creating and storage During the multimedia object of augmented reality view, judge that the entity return storage negative of request should to the storage of augmented reality view is sent Answer, not sending storage to the entity for performing the processing of augmented reality View synthesis starts control instruction.
Processing module includes：First acquisition submodule, for obtaining and the relevant augmented reality content of augmented reality view Characteristic information and obtain the current context of user；Judging submodule, for judge augmented reality content characteristic information and Hereafter whether meet the augmented reality view storage rule set in personalization preferences；First sub-module stored, for when enhancing When real content characteristic information and context meet the augmented reality view storage rule set in personalization preferences, increasing is used Strong real content creates and stores the multimedia object corresponding to augmented reality view.
Judging submodule includes：First judging submodule, for judging the increasing described in augmented reality content characteristic information Whether strong real content feature meets that augmented reality view storage rule allows the augmented reality content characteristic of storage, wherein, increase Strong real content feature includes at least one of：The augmented reality target type associated with augmented reality content, enhancing are existing Real content multiple media types, augmented reality content sizes of memory；Second judgment submodule, for judging the use described in context Whether family current context feature meets that augmented reality view storage rule allows the user's context feature of storage, wherein, use Family contextual feature includes at least one of：User terminal current residual storage space, user current location, user terminal are worked as Preceding remaining capacity.
Processing module includes：Cache sub-module, for corresponding to enhancing using augmented reality content to create and store Pair shot with the relevant augmented reality content of augmented reality view and terminal camera after the multimedia object of real view Live-action data is cached；Submodule is synthesized, for showing control letter according to terminal real time status information and augmented reality content Breath is synthesized the live-action data of institute's augmented reality content of caching and terminal taking；Second sub-module stored, for that will close Export to memory and stored into obtained data.
Execution unit further includes：Transport module, exports to terminal presentation facility for will synthesize obtained data.
Processing module further includes：Second acquisition submodule, for receiving the storage selection request of augmented reality view；Generation Module, storage control instruction is requested to generate for storing selection according to augmented reality view；3rd processing submodule, for depositing Storage control be designated as storage start control instruction when, send augmented reality content synthetic input start to ask, start synthesis processing, And store augmented reality content；Fourth process submodule, for store control be designated as storage terminate control instruction when, send Augmented reality content synthetic input stops request, terminates synthesis processing, stops storage augmented reality content.
By the present invention, according to personalization preferences information, (such as memory module, storage preference is (such as：Content type, form, Expense etc.)) and contextual information (such as customer location, terminal capability (memory space) etc.) selectively synchronous storage is real Scape photographing information and augmented reality content, solve in the prior art selectable storage augmented reality can not be needed to regard according to user The problem of figure, and then can flexibly, simply carry out the effect of augmented reality view storage.
Brief description of the drawings
Attached drawing described herein is used for providing a further understanding of the present invention, forms the part of the application, this hair Bright schematic description and description is used to explain the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings：
Fig. 1 is the mobile augmented reality operation system structure diagram according to correlation technique；
Fig. 2 is the preferred structure block diagram of the storage device of augmented reality view according to embodiments of the present invention；
Fig. 3 is the preferred flow charts of the storage method of augmented reality view according to embodiments of the present invention；
Fig. 4 is the structure diagram of mobile augmented reality terminal according to embodiments of the present invention；
Fig. 5 is that augmented reality view storage control module is shown in mobile augmented reality client according to embodiments of the present invention It is intended to；
Fig. 6 is mobile augmented reality client augmented reality View synthesis processing module signal according to embodiments of the present invention Figure；
Fig. 7 is a kind of mobile augmented reality view storage method execution flow chart according to embodiments of the present invention；
Fig. 8 is another mobile augmented reality view storage method execution flow chart according to embodiments of the present invention.
Embodiment
Come that the present invention will be described in detail below with reference to attached drawing and in conjunction with the embodiments.It should be noted that do not conflicting In the case of, the feature in embodiment and embodiment in the application can be mutually combined.
Embodiment 1
Fig. 2 is the preferred structure block diagram of the storage device of augmented reality view according to embodiments of the present invention, the device bag Include：Sequentially connected acquiring unit 202 and execution unit 204.During augmented reality view is stored, acquiring unit 202 Augmented reality content is obtained, wherein, the augmented reality content is used for user terminal displaying augmented reality view；Execution unit 204 correspond to more matchmakers of the augmented reality view according to the personalization preferences of user and the context creation of user and storage Body object is (that is, execution unit 204 uses augmented reality according to the personalization preferences of user and the context of user Content creating simultaneously stores the multimedia object corresponding to augmented reality view).
Preferably, whether execution unit 204 uses increasing according to the personalization preferences of user and the context determination of user Strong real content creates and stores the multimedia object corresponding to the augmented reality view；If so, then using in augmented reality Hold and create and store the multimedia object corresponding to the augmented reality view, here it is possible to preferably according to the individual character of user The enhancing that the context of change preference and user meet personalization preferences and context from multiple augmented reality content selections shows Real content creates and stores the multimedia object corresponding to the augmented reality view.
In the preferred embodiment, according to personalization preferences information, (such as memory module, storage preference is (such as：Content class Type, form, required expense etc.)) and contextual information (such as customer location, terminal capability (memory space) etc.) have selection Synchronously storage shoot on location information and augmented reality content, solution can not need selectively deposit according to user in the prior art on ground The problem of storing up augmented reality view, and then can flexibly, simply carry out the effect of augmented reality view storage.
Above-mentioned personalization preferences information (Personalization) is used for according to user setting come to AR contents Reason, it includes memory module, storage preference (such as content type, form, context, size of contents) etc..
Above-mentioned contextual information (Contextualization) be used for according to the user's context of collection to AR contents into Row processing, it includes：Customer location, terminal capability (such as memory space).
A kind of preferable execution unit 204 is present embodiments provided, it includes：Sequentially connected receiving module 2041, look into Ask module 2042 and processing module 2043.
Receiving module 2041 receives the storage of augmented reality view and judges request；Then, enquiry module 2042 inquires about described Whether the augmented reality view memory module set in property preference is indicated according to the personalization preferences and the context Carry out the storage of the augmented reality view；Then, processing module 2043 is indicated according to the personalization in the memory module When preference and the context carry out the storage of the augmented reality view, according to the personalization preferences and it is described up and down Text judges whether to create and store the multimedia object corresponding to the augmented reality view using the augmented reality content, If so, then using the augmented reality content come create and store corresponding to the augmented reality view multimedia object ( It is exactly that selection meets the augmented reality content of personalization preferences and context to create and store corresponding to the augmented reality The multimedia object of view, it is preferred that can be existing from multiple enhancings according to the personalization preferences of user and the context of user The augmented reality content that real content selection meets personalization preferences and context is existing corresponding to the enhancing to create and store The multimedia object of real-time coupling), otherwise, then correspond to the augmented reality without using the augmented reality content creating and storage The multimedia object of view；In memory module instruction not according to carrying out the personalization preferences and the context During the storage of augmented reality view, create and store corresponding to the augmented reality view using the augmented reality content Multimedia object, or without using the augmented reality content creating and store the multimedia corresponding to the augmented reality view Object.In the preferred embodiment, to whether carrying out the storage of augmented reality view and judging, storage speed is improved, letter Flow is changed.
Preferably, the increasing is not carried out according to the personalization preferences and the context in memory module instruction During the storage of strong real view, it can be regarded using all augmented reality contents to create and store corresponding to the augmented reality The multimedia object of figure.
The present embodiment additionally provides a kind of preferable processing module 2043, it includes：At first processing submodule and second Manage submodule.
The multimedia object corresponding to the augmented reality view is being created and is storing using the augmented reality content (and corresponded to using the augmented reality content for meeting the personalization preferences and the context to create and store The multimedia object of the augmented reality view) when, the first processing submodule judges to the augmented reality view storage is sent The entity of request returns to storage affirmative acknowledgement, and sends storage to the entity for performing the processing of augmented reality View synthesis and start to control Instruction, for indicating to start that the multimedia object is created and stored；Without using the augmented reality content creating And when storing the multimedia object corresponding to the augmented reality view, second processing submodule is regarded to the augmented reality is sent Figure storage judges that the entity of request returns to storage negative response, is not sent to the entity for performing the processing of augmented reality View synthesis Storage starts control instruction.In the preferred embodiment, the operation of storage is stored and stopped by instruction, improves storage Speed, simplifies flow.
The present embodiment additionally provides a kind of preferable processing module 2043, it includes：Sequentially connected first obtains submodule Block, judging submodule and the first sub-module stored.
First acquisition submodule obtains augmented reality content characteristic information relevant with the augmented reality view and obtains Take the current context of the user；Then, judging submodule judge the augmented reality content characteristic information and it is described up and down Whether text meets the augmented reality view storage rule set in the personalization preferences；When the augmented reality content characteristic is believed When breath and the context meet the augmented reality view storage rule set in the personalization preferences, the first storage submodule Block creates and stores the multimedia object corresponding to the augmented reality view using the augmented reality content.At this preferably In embodiment, the characteristic information of extraction is judged, improves the speed of storage.
A kind of preferable judging submodule judging submodule is present embodiments provided, it includes：First sub- judgment module and Second sub- judgment module.
First sub- judgment module judges that the augmented reality content characteristic described in the augmented reality content characteristic information is It is no to meet that the augmented reality view storage rule allows the augmented reality content characteristic of storage, wherein, in the augmented reality Holding feature includes at least one of：The augmented reality target type associated with the augmented reality content, in augmented reality Hold multiple media types, augmented reality content sizes of memory；Second sub- judgment module judges that the user described in the context works as Whether front upper and lower text feature meets that the augmented reality view storage rule allows the user's context feature of storage, wherein, institute Stating user's context feature includes at least one of：User terminal current residual storage space, user current location, user are whole Hold current residual electricity.In the preferred embodiment, storage class or form and residual memory space etc. are judged, carried High judgement speed, simplifies flow.
The present embodiment additionally provides a kind of preferable processing module 2043, it includes：Cache sub-module, for using increasing Strong real content creates and stores after the multimedia object corresponding to augmented reality view pair and the augmented reality view Relevant augmented reality content and terminal camera shooting live-action data are cached；Submodule is synthesized, for according to terminal Real time status information and augmented reality content show control information by institute's augmented reality content of caching and the terminal taking Live-action data is synthesized；Second sub-module stored, exports to memory for will synthesize obtained data and is stored.At this In preferred embodiment, the data of synthesis are stored, ensure that the data that synthesis obtains are stored, simply carry out strengthening existing Real-time coupling stores.
Preferably, execution unit 204 further includes：Transport module 2044, for by it is described synthesize obtained data export to Terminal presentation facility.
Preferably, the processing module 2043 further includes：Second acquisition submodule, for receiving the storage of augmented reality view Selection request；Submodule is generated, storage control instruction is requested to generate for storing selection according to the augmented reality view；3rd Submodule is handled, for when the storage control is designated as storage and starts control instruction, it is defeated to send the synthesis of augmented reality content Enter and start to ask, start synthesis processing, and store the augmented reality content；Fourth process submodule, in the storage When control is designated as storage termination control instruction, sends augmented reality content synthetic input and stop asking, terminate synthesis processing, stop Only store the augmented reality content.
Preferably, the storage device of augmented reality view further includes：First storage unit 206, updating block 208 and second Storage unit 210, wherein, the first storage unit 206 is stored the live-action data of terminal taking；Updating block 208 updates Augmented reality view；Second storage unit 210 is closed the augmented reality view after renewal and the live-action data of terminal taking Into, and the data that synthesis is obtained are stored.In the preferred embodiment, the data of synthesis are stored, ensures synthesis Obtained data are stored, simple to carry out augmented reality view storage.
Embodiment 2
Fig. 3 is the preferred flow charts of the storage method of augmented reality view according to embodiments of the present invention, and this method includes：
S302, obtains augmented reality content, wherein, the augmented reality content is used for user terminal displaying augmented reality and regards Figure；
S304, corresponds to the augmented reality according to the personalization preferences of user and the context creation of user and storage The multimedia object of view according to the context of the personalization preferences of user and user (that is, use augmented reality Content creating simultaneously stores the multimedia object corresponding to augmented reality view).
Preferably, in above-mentioned steps S304, according to the personalization preferences of user and the context determination of user whether Using augmented reality content creating and store the multimedia object corresponding to the augmented reality view；If so, then using enhancing Real content creates and stores the multimedia object corresponding to the augmented reality view, here it is possible to preferably according to user Personalization preferences and the context of user created from the satisfactory augmented reality content of multiple augmented reality content selections Build and store the multimedia object corresponding to the augmented reality view.
In the preferred embodiment, according to personalization preferences information, (such as memory module, storage preference is (such as：Content class Type, form, expense etc.)) and contextual information (such as customer location, terminal capability (memory space) etc.) it is selectively same Step storage shoot on location information and augmented reality content, solve selectively storage can not be needed to increase according to user in the prior art The problem of strong real view, and then can flexibly, simply carry out the effect of augmented reality view storage.
Preferably, the enhancing is corresponded to now according to the personalization preferences of user and the context creation of user and storage The step of multimedia object of real-time coupling, includes：Receive the storage of augmented reality view and judge request；Inquire about the personalization preferences Whether the augmented reality view memory module of middle setting is indicated according to carrying out the personalization preferences and the context The storage of augmented reality view；If augmented reality view memory module is indicated according to the personalization preferences and the context The storage of the augmented reality view is carried out, then is showed using the enhancing for meeting the personalization preferences and the context Real content come create and store corresponding to the augmented reality view multimedia object (it is preferable, in this step, according to institute State personalization preferences and whether the context determination is created and stored corresponding to described using the augmented reality content The multimedia object of augmented reality view, if so, then being come using the augmented reality content for meeting personalization preferences and context Create and store the multimedia object corresponding to the augmented reality view)；If augmented reality view memory module indicates not root The storage of the augmented reality view is carried out according to the personalization preferences and the context, then using in the augmented reality Hold to create and store the multimedia object corresponding to the augmented reality view, or created without using the augmented reality content Build and store the multimedia object corresponding to the augmented reality view.In the preferred embodiment, to whether strengthen now The storage of real-time coupling is judged, improves storage speed, simplifies flow.
Preferably, the increasing is not carried out according to the personalization preferences and the context in memory module instruction During the storage of strong real view, it can be regarded using all augmented reality contents to create and store corresponding to the augmented reality The multimedia object of figure.
Preferably, create and store the multimedia corresponding to the augmented reality view using the augmented reality content The step of object (and created simultaneously using the augmented reality content for meeting the personalization preferences and the context Storage corresponds to the step of multimedia object of the augmented reality view) include：Stored to the augmented reality view is sent Judge that the entity of request returns to storage affirmative acknowledgement, and send storage to the entity for performing the processing of augmented reality View synthesis and start Control instruction, for indicating to start that the multimedia object is created and stored.Created without using the augmented reality content Build and include the step of storing the multimedia object corresponding to the augmented reality view：Deposited to the augmented reality view is sent Storage judges that the entity of request returns to storage negative response, does not send storage to the entity for performing the processing of augmented reality View synthesis Start control instruction.In the preferred embodiment, the operation of storage is stored and stopped by instruction, improves storage speed Degree, simplifies flow.
Preferably, created simultaneously using the augmented reality content for meeting the personalization preferences and the context The step of storing the multimedia object corresponding to the augmented reality view includes：Obtain and the relevant enhancing of augmented reality view Real content characteristic information, judges whether augmented reality content characteristic information meets the augmented reality set in personalization preferences and regard Figure storage rule；The current context of user is obtained, judges whether context meets the augmented reality set in personalization preferences View storage rule；Regarded if augmented reality content characteristic information and context meet the augmented reality set in personalization preferences Figure storage rule, then create and store the multimedia pair corresponding to the augmented reality view using the augmented reality content As.In the preferred embodiment, the characteristic information of extraction is judged, improves the speed of storage.
Preferably, judge whether augmented reality content characteristic information and context meet personalization partially by following steps The augmented reality view storage rule set in good：Judge that the augmented reality content described in augmented reality content characteristic information is special Whether sign meets that augmented reality view storage rule allows the augmented reality content characteristic of storage, wherein, in the augmented reality Holding feature includes at least one of：In the augmented reality target type associated with the augmented reality content, augmented reality Hold multiple media types, augmented reality size of contents；Judge whether user's current context feature described in the context is full The foot augmented reality view storage rule allows the user's context feature of storage, wherein, the user's context feature bag Include at least one of：User terminal current residual storage space, user current location, user terminal current residual electricity. In this preferred embodiment, storage class or form and residual memory space etc. are judged, improve judgement speed, is simplified Flow.
Preferably, create and store the multimedia corresponding to the augmented reality view using the augmented reality content The step of object (and created simultaneously using the augmented reality content for meeting the personalization preferences and the context Storage corresponds to the step of multimedia object of the augmented reality view) include：Pair with the relevant enhancing of augmented reality view Real content and terminal camera shooting live-action data are cached；According to terminal real time status information and augmented reality content Show control information to be synthesized the live-action data of institute's augmented reality content of caching and terminal taking；Obtained number will be synthesized Stored according to output to memory.In the preferred embodiment, the data of synthesis are stored, ensures the number that synthesis obtains According to being stored, augmented reality view storage is simply carried out.
Preferably, when the data for obtaining synthesis are exported to memory and stored, the storage side of augmented reality view Method further includes：The data that synthesis obtains are exported to terminal presentation facility.
The multimedia object corresponding to the augmented reality view is being created and is storing using the augmented reality content Afterwards, the storage method of augmented reality view further includes：Receive the storage selection request of augmented reality view；Regarded according to augmented reality Figure storage selection requests to generate storage control instruction；If storage control, which is designated as storage, starts control instruction, it is existing to send enhancing Real content synthetic input starts to ask, and starts synthesis processing, and store augmented reality content；If storage control is designated as storage eventually Only control instruction, then send augmented reality content synthetic input and stop request, terminate synthesis processing, stop in storage augmented reality Hold.
Preferably, after performing storage operation to augmented reality view according to memory module, the storage of augmented reality view Method further includes：The live-action data of terminal taking is stored；Update augmented reality view；Augmented reality after renewal is regarded Scheme to be synthesized with the live-action data of terminal taking, and the data that synthesis is obtained are stored.In the preferred embodiment, will The data of synthesis are stored, and ensure that the data that synthesis obtains are stored, simple to carry out augmented reality view storage.
Embodiment 3
As shown in figure 4, the present embodiment provides a kind of 400 structure diagram of mobile augmented reality terminal, including：
1) camera 401, for the outdoor scene information (Camera View) of physical world around captured in real-time user.Some Camera possesses video memory, can cache the outdoor scene information photographed.Inputted and asked according to user during shooting, will can photographed Outdoor scene information is stored to nonvolatile storage 405；
2) display screen 402, are presented camera 401 for user and shoot outdoor scene information in the case where the modification of augmented reality content renders Augmented reality (Augmented Reality, AR) content；
3) GPS module, compass, sensor etc. 403, wherein GPS module lead to GPS (GPS) satellite News, provide terminal positional information (longitude and latitude) in real time.Compass, sensor, for gathering user terminal state, including：Shooting Head direction and ground angle etc.；
4) user's input module 404, for receiving augmented reality operation input by user, including：Augmented reality view is deposited Store up mode setting operation, augmented reality view storage preference operation (increase, delete, renewal preference), the storage of augmented reality view Selection operation (start to store, stop storage) etc.；
5) memory 405, for user data (camera outdoor scene, augmented reality content etc.) forever is locally stored；
6) mobile augmented reality client 410, there is provided the client functionality entity of mobile augmented reality professional ability, including Following functions module：
A) mobile augmented reality application access interface 411, the augmented reality operated in mobile augmented reality terminal 400 should The support augmented reality professional ability of the offer of mobile augmented reality client 410, bag are provided with 420,430,440 by the interface Include：Augmented reality target search and positioning；Augmented reality content server side obtains；Augmented reality content terminal side displaying etc..
B) mobile augmented reality content obtaining and displaying rendering module 412, are responsible for according to 400 phase of mobile augmented reality terminal Close information (for example：The user terminal location that GPS module 403 obtains, or augmented reality target image captured by camera 401) It is associated augmented reality content, and augmented reality content displaying control information to mobile augmented reality server acquisition request.
In addition, it is responsible for according to augmented reality content displaying control information, with reference to 400 information (example of mobile augmented reality terminal Such as：The user terminal state that compass, sensor etc. 403 gathers), control acquired mobile augmented reality content and camera The 401 outdoor scene information photographed merge displaying on display screen 402；
C) mobile augmented reality user individual preference setup module 413, is responsible for being fed back according to user's input module 404 User input operation, to record mobile augmented reality user individual preference set, including：Augmented reality content obtaining is inclined It is good, augmented reality view storage preference etc., wherein, above-mentioned augmented reality content obtaining preference obtains mobile increase for recording user The preference of strong real content is set；Above-mentioned augmented reality view storage preference is used to record user's storage mobile augmented reality view Preference set, including：Memory module preference is set, storage rule preference is set.
Preferably, mobile augmented reality view memory module preference sets and includes：Pattern 1, the mobile enhancing of all acquisitions Real content does not store；Pattern 2, the augmented reality content of all acquisitions store；Pattern 3, regards according to mobile augmented reality 415 judging result of figure storage control module decides whether to store augmented reality content.
Preferably, mobile augmented reality view storage rule preference, which is set, refers in the case where 3 preference of pattern is set, mobile enhancing Storage selection preference of the real user for augmented reality view.On the one hand, it is feature phase with handled augmented reality content Preference is closed, including：Wish related augmented reality target type, augmented reality content media form and other and the increasing of storage Strong real view storage associated rights, cost information etc.；On the other hand, it is and the movement that must is fulfilled for of storage augmented reality view The setting of augmented reality terminal 400, ability related preferences, including：Storage format setting, storage fragmentation size, terminal remain The information such as remaining electricity.
Augmented reality view storage selection preference in augmented reality view storage preference refer to that user sends temporarily with Specific augmented reality view storage Correlation selection request, including：Augmented reality content identification, storage selection request classification (start Storage, stop storage).
D) mobile augmented reality user's context access modules 414, obtain above and below mobile augmented reality user to access Literary information, including：The function such as GPS module, compass, sensor etc. 403, memory 405 is real in mobile augmented reality terminal 400 The user and its using terminal contextual information that body collects, including：Customer position information (longitude and latitude), terminal's status information (camera direction and ground angle), terminal configuration information (storage format setting), terminal ability information (deposit by memory residue Store up space) etc..
E) mobile augmented reality view storage control module 415, receives mobile augmented reality content obtaining and displaying renders The augmented reality view storage that module 412 is sent judges request, special according to the augmented reality content carried in the request Sign, and the end message that mobile augmented reality user's context access modules 414 gather, with reference to mobile augmented reality user Property the record of preference logging modle 413 user preference, perform the augmented reality view storage control and judge.And according to judgement As a result to mobile augmented reality content obtaining and the displaying feedback storage response of rendering module 412, and when confirming to store to movement Augmented reality View synthesis processing module 416 sends storage control instruction.
In addition, the interim augmented reality of user fed back according to mobile augmented reality user individual preference logging modle 413 View storage selection request, storage control instruction is sent to mobile augmented reality View synthesis processing module 416.
F) mobile augmented reality View synthesis processing module 416, receives mobile augmented reality view storage control module 415 The augmented reality view storage control instruction of transmission, and performed according to instruction classification and correspond to augmented reality view multimedia object Synthesis processing operation.
Control and indicate for " storage starts ", mobile augmented reality View synthesis processing module 416 will ask input to be passed through Mobile augmented reality content obtaining and the augmented reality content of the displaying displaying control of rendering module 412, request input shooting The first 401 outdoor scene information photographed, perform synthesis processing, and composite signal is illustrated in display screen 402, and send to storage Device 405 stores.
For " storage terminates " control instruction, mobile augmented reality View synthesis processing module 416 will no longer input enhancing Real content and outdoor scene information, stop synthesis processing operation, so as to terminate the wound corresponding to augmented reality view multimedia object Build and store.
7) augmented reality applies 420,430,440, there is provided the end side application program of mobile augmented reality business service, leads to Cross mobile augmented reality application access interface 411 and access the support augmented reality business that mobile augmented reality client 410 provides Ability, provides various forms of augmented reality business experiences on this basis.
Embodiment 4
As shown in figure 5, the present embodiment provides mobile augmented reality view storage control in a kind of mobile augmented reality client Molding block 500, including：Sequentially connected storage instruction unit 503, storage judging part 501, storage condition extraction unit 502.
Judging part 501 is stored to receive mobile augmented reality content obtaining and show the augmented reality that rendering module 510 is sent View storage judgement request, and set partially according to the augmented reality view memory module that the inquiry of storage condition extraction unit 502 returns The augmented reality view storage is carried out well to judge.
When the memory module of mobile augmented reality user individual preference setup module 520 sets preference to be arranged to pattern 1 When, augmented reality view storage judging result is "false", i.e., does not store；
When the memory module of mobile augmented reality user individual preference setup module 520 sets preference to be arranged to pattern 2 When, augmented reality view storage judging result is "true", that is, is stored；
When the memory module of mobile augmented reality user individual preference setup module 520 sets preference to be arranged to pattern 3 When, the augmented reality view storage condition information progress augmented reality view extracted according to storage condition extraction unit 502 is deposited Storage judges.The storage condition information includes：Mobile augmented reality content obtaining and the transmitted enhancing of displaying rendering module 510 are existing Real content characteristic, the storage that mobile augmented reality user individual preference setup module 520 records judge preference, and mobile enhancing The terminal configuration information and/or terminal ability information that real user contextual access module 530 gathers.
If the augmented reality content characteristic meets augmented reality view storage preference, for example：Augmented reality target class Type or augmented reality content format are to store record in preference to allow the type or form of storage, and augmented reality content Feature meets terminal setting and terminal ability information, for example：Terminal storage setting options are " True ", and memory residue is deposited Storage space can accommodate augmented reality size of contents, then storage judging part 501 judges for augmented reality view storage As a result it is "true", that is, stores, is otherwise "false", i.e., does not store.
In addition, storage judging part 501 is also responsible for receiving the use of mobile augmented reality user individual preference setup module 520 Family augmented reality view storage selection request, including：
Selection 1, stops storing some augmented reality view stored, respective stored judging result is "false"；
Selection 2, starts to store some augmented reality view without storage, respective stored judging result is "true"；
Storage condition extraction unit 502 is responsible for 520 record of inquiry mobile augmented reality user individual preference setup module Augmented reality view memory module set preference, and when memory module set preference be arranged to pattern 3 when, be responsible for acquisition request with The augmented reality view storage judges relevant storage condition information：
Mobile augmented reality content obtaining and displaying rendering module 510 are asked, extracts augmented reality content characteristic, including： Augmented reality content identification, augmented reality content media form, augmented reality target type, augmented reality size of contents and Relevant copyright, cost information are stored with augmented reality content；
Ask mobile augmented reality user individual preference setup module 520 to extract the storage of augmented reality view to judge partially It is good；
Mobile augmented reality user's context access modules 530 are asked to extract terminal configuration information and/or ability information；
Storage condition extraction unit 502 " can at the same time be extracted during pattern 3 " and returned above-mentioned in memory module query result Storage condition information extremely stores judging part 501, it is not necessary to obtains at twice.
In addition, augmented reality content characteristic in above-mentioned storage condition information can also the storage of augmented reality view judge please Ask middle carrying, it is not necessary to additional extractions.
Store instruction unit 503 and receive the storage judging result that storage judging part 501 is sent, generate and send corresponding storage Control instruction.
When it is "false" to store judging result, sends and increase to mobile augmented reality content obtaining and displaying rendering module 510 Strong real view " storage negative response ".
When it is "true" to store judging result, sends and increase to mobile augmented reality content obtaining and displaying rendering module 510 Strong real view " storage confirms response ".And send augmented reality view to mobile augmented reality View synthesis processing module 540 " storage starts control instruction ".
The storage response (confirming response, negative response), and storage control instruction (start to indicate, terminate instruction) are taken Band storage controls corresponding augmented reality content identification.
Embodiment 5
As shown in fig. 6, mobile augmented reality View synthesis handles mould in mobile augmented reality client proposed by the present invention Block 600, including：Sequentially connected synthesis control unit 601, synthetic input portion 602 and synthesis output section 603.
Synthesis control unit 601 is responsible for receiving the augmented reality that mobile augmented reality view storage control module 610 is sent View storage control instruction, performs the control of augmented reality View synthesis.
When reception augmented reality view storage starts control instruction, control unit 601 is synthesized to mobile augmented reality content Obtain and displaying rendering module 620 sends synthetic input and starts to ask, request will be corresponding with augmented reality content identification and be passed through Cross displaying control information and terminal's status information coordinates the augmented reality content under displaying control to export caching to synthetic input portion 602.Meanwhile synthesize control unit 601 and send synthetic input request to camera 630, camera 630 is asked by the outdoor scene number of shooting According to output caching to synthetic input portion 602.
When reception augmented reality view storage terminates control instruction, control unit 601 is synthesized to mobile augmented reality content Obtain and displaying rendering module 620 sends synthetic input and stops request, synthetic input portion 602 no longer caches augmented reality content. Meanwhile synthesize control unit 601 and send synthetic input stopping request to camera 630, synthetic input portion 602 no longer caches outdoor scene letter Breath.Hereafter, mobile augmented reality content obtaining and displaying rendering module 620 corresponding with augmented reality content identification will strengthen existing Real content directly renders displaying in display screen 640, and camera 630 shoots outdoor scene information and will directly store to memory 650.
It is responsible for caching mobile augmented reality content obtaining and shows the process that rendering module 620 inputs in synthetic input portion 602 Show the augmented reality content of control, be also responsible for the outdoor scene information that caching camera 630 inputs.
The live-action data for caching synthetic input portion 602 is responsible in synthesis output section 603 and augmented reality content is synthesized The composite signal of processing, generation fusion augmented reality content and live-action data.
Synthesis output section 603 exports composite signal to indicator screen 640 to be shown to user.Synthesizing output section 603 will Composite signal is exported to memory 650 and is locally stored.
Embodiment 6
As shown in fig. 7, the present embodiment provides a kind of mobile augmented reality view storage method execution flow chart, this method bag Include following steps：
Step 701：According to perception (for example image of user current location (longitude and latitude) or user terminal to physical world Recognition result), user's mobile augmented reality client sends mobile augmented reality mesh to network side mobile augmented reality server Access request is marked, or mobile augmented reality server is set according to user's mobile augmented reality business and actual search filtering knot Fruit, the augmented reality target actively captured to user's mobile augmented reality client push.It is existing to having obtained enhancing according to user The selection of real target, the mobile augmented reality content obtaining of user's mobile augmented reality client and displaying rendering module request obtain Take augmented reality content corresponding with augmented reality target.
Step 702：Mobile augmented reality content obtaining and displaying rendering module are stored to mobile augmented reality view to be controlled Module sends the storage of augmented reality view and judges request, request judge whether using the augmented reality content storage obtained and Create the corresponding multimedia object of augmented reality view.
Step 703：Mobile augmented reality view storage control module inquiry mobile augmented reality user individual preference is set Put the augmented reality view memory module that module is recorded and preference is set：
If provided as " pattern 1 ", then perform step 707；
If provided as " pattern 2 ", then perform step 709；
If provided as " pattern 3 ", then perform step 704；
Step 704：Storage condition extraction unit in mobile augmented reality view storage control module is to mobile augmented reality Content obtaining and displaying rendering module are inquired about and extract augmented reality content characteristic, including：Augmented reality content identification, enhancing are existing Real content media form, augmented reality target type, augmented reality size of contents and with augmented reality content store it is relevant Copyright, cost information.
If the storage of augmented reality view judges to have carried above-mentioned augmented reality content characteristic in request in step 702, Then ignore this step；
Step 705：Storage condition extraction unit in mobile augmented reality view storage control module is to mobile augmented reality User individual preference setup module inquiry mobile augmented reality user individual preference is set, it includes：Wish the increasing of storage Strong real-world objects type, augmented reality content media form, and other and the relevant user preference of augmented reality view storage Set (for example：When augmented reality size of contents accounts for memory remaining space half, it would not allow for storing).It is also, mobile Storage condition extraction unit in augmented reality view storage control module is inquired about to mobile augmented reality end message access modules User's context, it includes：Terminal configuration information (memory setting), terminal ability information (memory residual memory space) Deng.
Step 706：Augmented reality of the judging part according to extraction is stored in mobile augmented reality view storage control module Content characteristic, mobile augmented reality user individual preference are set and user's context carries out augmented reality view storage result and sentences It is disconnected：
If it is judged that being "false", i.e., do not store, then perform step 707；
If it is judged that being "true", that is, store, then perform step 709.
Step 707：Storage judging part in mobile augmented reality view storage control module is to mobile augmented reality content Obtain and displaying rendering module sends " storage negative response ", indicate to store and create without using acquired augmented reality content Build the corresponding multimedia object of augmented reality view.
Step 708：Augmented reality content is directly rendered displaying by mobile augmented reality content obtaining and displaying rendering module To user terminal displays screen, augmented reality view will not be stored.
Step 709：Storage judging part in mobile augmented reality view storage control module is to mobile augmented reality content Obtain and displaying rendering module is sent " storage confirms response ".Also, instruction unit is stored at mobile augmented reality View synthesis Reason module is sent " storage starts control instruction ".
Mobile augmented reality content obtaining and displaying rendering module prepare to receive synthetic input request according to response, by institute State the synthetic input portion that augmented reality content renders to mobile augmented reality synthesis processing module；
Control unit is synthesized in mobile augmented reality View synthesis processing module caching is sent to synthetic input portion according to instruction Request, indicates that it prepares order caching synthesis processing data.Meanwhile control unit is synthesized respectively to user terminal camera and movement Augmented reality content obtaining and displaying rendering module send synthetic input request, and request camera exports captured live-action data Caching asks mobile augmented reality content obtaining and displaying rendering module to correspond to augmented reality content identification to synthetic input portion And coordinate the augmented reality content output caching of control to synthetic input portion by displaying control information and terminal's status information.
Step 710：The physical world live-action data of synthetic input portion caching terminal camera shooting input, and mobile enhancing Real content obtains and the augmented reality content by displaying control of displaying rendering module input.Synthesis output section will synthesize defeated The live-action data and augmented reality content for entering portion's caching carry out synthesis processing, create more matchmakers corresponding to the augmented reality view Body object.
Step 711：Synthesis output section, which exports composite signal to terminal display screen to user, to be shown, and is synthesized defeated Go out portion and export composite signal to memory to be stored.
Step 712：Synthetic input portion judges whether augmented reality content inputs displaying and finish, if displaying finishes, goes to Step 713；Finished if not showing, go to step 710.
Step 713：Terminate the processing of augmented reality View synthesis.Preferably, synthetic input portion is sent slow to synthesis control unit Deposit ending request, synthesis control unit sends synthesis to user terminal camera according to the request and is disposed request, terminates to image The input-buffer of head shooting live-action data.
Embodiment 7
As shown in figure 8, the present embodiment provides another mobile augmented reality view storage method execution flow chart, this method Include the following steps：
Step 801：Mobile augmented reality view storage control module receives mobile augmented reality user individual preference and sets The interim augmented reality view storage selection request of user for putting module feedback.
Step 802：Mobile augmented reality view storage control module store judging part according to it is described storage selection ask into Row storage judges that storage instruction unit is according to storage judging result generation storage control instruction：
When selection request be 1 when, be responsible for mobile augmented reality View synthesis processing module transmission augmented reality view " deposit Storage terminates control instruction "；
When selection request be 2 when, be responsible for mobile augmented reality View synthesis processing module transmission augmented reality view " deposit Storage starts control instruction ".
Step 803：Instruction classification is controlled to perform corresponding storage handover operation according to storage：
If " storage terminates control instruction ", then perform step 804；
If " storage starts control instruction ", then perform step 805.
Step 804：Mobile augmented reality View synthesis processing module receives the storage control instruction, synthesis control unit hair Synthetic input is sent to stop request, synthetic input portion will no longer cache augmented reality content and camera shooting outdoor scene information.Hereafter, Mobile augmented reality content obtaining and displaying rendering module will augmented reality content corresponding with augmented reality content identification it is direct Displaying is rendered in display screen, camera shooting outdoor scene information will be stored directly to memory, will not be used acquired increasing Strong real content stores and creates the corresponding multimedia object of augmented reality view.
Step 805：Mobile augmented reality View synthesis processing module receives the storage control instruction, synthesis control unit hair Synthetic input is sent to start to ask, request will be corresponding with augmented reality content identification and by displaying control information and the SOT state of termination Information coordinates the augmented reality content under displaying control, and the live-action data of camera shooting to export caching to synthetic input Portion.Processing is synthesized with shooting live-action data so as to perform augmented reality content, and composite signal is stored to memory.
According to the description of above-mentioned each embodiment, the AR applications of each embodiment operation on mobile terminals can basis User individual preference and/or user's context flexibly select to implement augmented reality application related information the Save option：
Only storage shoot on location information, does not store AR augmented reality contents；
Shoot on location information is stored with AR augmented realities content synchronization；
According to user individual preference (content type, form, expense etc.), and/or user's context (memory space etc.), Selectively synchronous storage shoot on location information and AR augmented reality contents.
It can be seen from the above description that the present invention realizes following technique effect：According to information-setting by user, deposit It is selectively synchronous to store up preference information (such as content type, form, expense) and terminal's status information (such as memory space) Shoot on location information and augmented reality content are stored, is solved in the prior art since the storage scheme of augmented reality view is more multiple The problem of user experience declines caused by miscellaneous, and then can flexibly, simply carry out augmented reality view storage Effect.
Obviously, those skilled in the art should be understood that above-mentioned each module of the invention or each step can be with general Computing device realize that they can be concentrated on single computing device, or be distributed in multiple computing devices and formed Network on, alternatively, they can be realized with the program code that computing device can perform, it is thus possible to which they are stored Performed in the storage device by computing device, and in some cases, can be with different from shown in order execution herein The step of going out or describing, they are either fabricated to each integrated circuit modules respectively or by multiple modules in them or Step is fabricated to single integrated circuit module to realize.Combined in this way, the present invention is not restricted to any specific hardware and software.
The foregoing is only a preferred embodiment of the present invention, is not intended to limit the invention, for the skill of this area For art personnel, the invention may be variously modified and varied.Within the spirit and principles of the invention, that is made any repaiies Change, equivalent substitution, improvement etc., should all be included in the protection scope of the present invention.

Claims (14)

  1. A kind of 1. storage method of augmented reality view, it is characterised in that including：
    Augmented reality content is obtained, wherein, the augmented reality content is used for user terminal displaying augmented reality view；
    According to the personalization preferences of user and the context creation of user and store corresponding to the more of the augmented reality view Media object；
    Wherein, the augmented reality view is corresponded to according to the personalization preferences of user and the context creation of user and storage Multimedia object the step of include：Receive the storage of augmented reality view and judge request；Inquire about in the personalization preferences and set Augmented reality view memory module whether indicate to carry out the enhancing according to the personalization preferences and the context it is existing The storage of real-time coupling；If so, then come using the augmented reality content for meeting the personalization preferences and the context Create and store the multimedia object corresponding to the augmented reality view；If it is not, then created using the augmented reality content Build and store the multimedia object corresponding to the augmented reality view, or without using the augmented reality content creating and deposit Multimedia object of the storage corresponding to the augmented reality view.
  2. 2. according to the method described in claim 1, it is characterized in that,
    The step of using the augmented reality content to create and store the multimedia object corresponding to the augmented reality view Including：
    Storage affirmative acknowledgement is returned to the entity for sending augmented reality view storage and judging request, and to performing augmented reality View synthesis processing entity send storage start control instruction, for indicate start to the multimedia object carry out create with Storage；
    The step of without using the augmented reality content creating and storing the multimedia object corresponding to the augmented reality view Including：
    Judge that the entity of request returns to storage negative response to the augmented reality view storage is sent, it is not existing to enhancing is performed The entity of real-time coupling synthesis processing sends storage and starts control instruction.
  3. 3. method according to claim 1 or 2, it is characterised in that using meet the personalization preferences and it is described on The augmented reality content hereafter is wrapped to create and store the step of the multimedia object corresponding to the augmented reality view Include：
    Acquisition and the relevant augmented reality content characteristic information of the augmented reality view, judge the augmented reality content characteristic Whether information meets the augmented reality view storage rule set in the personalization preferences；
    The current context of the user is obtained, judges whether the context meets the enhancing set in the personalization preferences Real view storage rule；
    If the augmented reality content characteristic information and the context meet the enhancing set in the personalization preferences and show Real-time coupling storage rule, then create and store more matchmakers corresponding to the augmented reality view using the augmented reality content Body object.
  4. 4. according to the method described in claim 3, it is characterized in that, judge the augmented reality content characteristic by following steps Whether information and the context meet the augmented reality view storage rule set in the personalization preferences：
    Judge whether the augmented reality content characteristic described in the augmented reality content characteristic information meets the augmented reality View storage rule allow storage augmented reality content characteristic, wherein, the augmented reality content characteristic include it is following at least One of：The augmented reality target type associated with the augmented reality content, augmented reality content multiple media types, enhancing are existing Real size of contents；
    Judge whether user's current context feature described in the context meets the augmented reality view storage rule Allow the user's context feature of storage, wherein, the user's context feature includes at least one of：User terminal is current Residual memory space, user current location, user terminal current residual electricity.
  5. 5. method according to claim 1 or 2, it is characterised in that create and store using the augmented reality content Corresponding to the augmented reality view multimedia object the step of include：
    Pair augmented reality content relevant with the augmented reality view and terminal camera shooting live-action data cache；
    Control information is showed by institute's augmented reality content of caching and institute according to terminal real time status information and augmented reality content The live-action data for stating terminal taking is synthesized；
    The data that synthesis obtains are exported to memory and are stored.
  6. 6. according to the method described in claim 5, deposited it is characterized in that, being exported in the data for obtaining synthesis to memory Chu Shi, further includes：
    The data that the synthesis obtains are exported to terminal presentation facility.
  7. 7. method according to claim 1 or 2, it is characterised in that create and deposit using the augmented reality content After storage is corresponding to the multimedia object of the augmented reality view, further include：
    Receive the storage selection request of augmented reality view；
    Selection is stored according to the augmented reality view and requests to generate storage control instruction；
    If the storage control, which is designated as storage, starts control instruction, send augmented reality content synthetic input and start to ask, Start synthesis processing, and store the augmented reality content；
    If the storage control is designated as storage and terminates control instruction, send augmented reality content synthetic input and stop request, Synthesis processing is terminated, stops storing the augmented reality content.
  8. A kind of 8. storage device of augmented reality view, it is characterised in that including：
    Acquiring unit, for obtaining augmented reality content, wherein, it is existing that the augmented reality content is used for user terminal displaying enhancing Real-time coupling；
    Execution unit, corresponds to the enhancing for the personalization preferences according to user and the context creation of user and storage The multimedia object of real view；
    Wherein, the execution unit includes：Receiving module, judges request for receiving the storage of augmented reality view；Enquiry module, For inquiring about in the personalization preferences whether the augmented reality view memory module set is indicated according to the personalization preferences And the context carries out the storage of the augmented reality view；Processing module, for indicating basis in the memory module When the personalization preferences and the context carry out the storage of the augmented reality view, according to the personalization preferences with And whether the context determination is created and stored corresponding to the augmented reality view using the augmented reality content Multimedia object, if so, then creating and storing corresponding to the more of the augmented reality view using the augmented reality content Media object；The augmented reality is not carried out in memory module instruction according to the personalization preferences and the context During the storage of view, the multimedia pair corresponding to the augmented reality view is created and stores using the augmented reality content As, or without using the augmented reality content creating and store the multimedia object corresponding to the augmented reality view.
  9. 9. device according to claim 8, it is characterised in that the processing module includes：
    First processing submodule, for being regarded using the augmented reality content to create and store corresponding to the augmented reality During the multimedia object of figure, judge that the entity of request returns to storage affirmative acknowledgement to the augmented reality view storage is sent, and Storage is sent to the entity for performing the processing of augmented reality View synthesis and starts control instruction, for indicating to start to the multimedia Object is created and stored；
    Second processing submodule, for being regarded without using the augmented reality content creating and storage corresponding to the augmented reality During the multimedia object of figure, judge that the entity of request returns to storage negative response to the augmented reality view storage is sent, and Storage is not sent to the entity for performing the processing of augmented reality View synthesis start control instruction.
  10. 10. device according to claim 8 or claim 9, it is characterised in that the processing module includes：
    First acquisition submodule, for obtaining augmented reality content characteristic information relevant with the augmented reality view and obtaining Take the current context of the user；
    Judging submodule, for judging whether the augmented reality content characteristic information and the context meet the personalization The augmented reality view storage rule set in preference；
    First sub-module stored, for meeting the personalization when the augmented reality content characteristic information and the context During the augmented reality view storage rule set in preference, create and store corresponding to described using the augmented reality content The multimedia object of augmented reality view.
  11. 11. device according to claim 10, it is characterised in that the judging submodule includes：
    First judging submodule, for judging that the augmented reality content characteristic described in the augmented reality content characteristic information is It is no to meet that the augmented reality view storage rule allows the augmented reality content characteristic of storage, wherein, in the augmented reality Holding feature includes at least one of：The augmented reality target type associated with the augmented reality content, in augmented reality Hold multiple media types, augmented reality content sizes of memory；
    Second judgment submodule, for judging whether user's current context feature described in the context meets the increasing Strong real view storage rule allows the user's context feature of storage, wherein, the user's context feature include with down toward It is one of few：User terminal current residual storage space, user current location, user terminal current residual electricity.
  12. 12. device according to claim 8 or claim 9, it is characterised in that the processing module includes：
    Cache sub-module, for creating and storing corresponding to the augmented reality view using the augmented reality content After multimedia object pair with the relevant augmented reality content of the augmented reality view and terminal camera shooting outdoor scene number According to being cached；
    Submodule is synthesized, for showing control information being increased caching according to terminal real time status information and augmented reality content Strong real content and the live-action data of the terminal taking are synthesized；
    Second sub-module stored, exports to memory for will synthesize obtained data and is stored.
  13. 13. device according to claim 12, it is characterised in that the execution unit further includes：
    Transport module, for exporting the obtained data that synthesize to terminal presentation facility.
  14. 14. device according to claim 8 or claim 9, it is characterised in that the processing module further includes：
    Second acquisition submodule, for receiving the storage selection request of augmented reality view；
    Submodule is generated, storage control instruction is requested to generate for storing selection according to the augmented reality view；
    3rd processing submodule, for it is described storage control be designated as storage start control instruction when, send augmented reality in Hold synthetic input to start to ask, start synthesis processing, and store the augmented reality content；
    Fourth process submodule, for when the storage control is designated as storage termination control instruction, sending in augmented reality Hold synthetic input and stop request, terminate synthesis processing, stop storing the augmented reality content.
CN201110147806.XA 2011-05-31 2011-06-02 The storage method and device of augmented reality view Expired - Fee Related CN102810099B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110147806.XA CN102810099B (en) 2011-05-31 2011-06-02 The storage method and device of augmented reality view

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN2011101447254 2011-05-31
CN201110144725 2011-05-31
CN201110144725.4 2011-05-31
CN201110147806.XA CN102810099B (en) 2011-05-31 2011-06-02 The storage method and device of augmented reality view

Publications (2)

Publication Number Publication Date
CN102810099A CN102810099A (en) 2012-12-05
CN102810099B true CN102810099B (en) 2018-04-27

Family

ID=47233806

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201110147806.XA Expired - Fee Related CN102810099B (en) 2011-05-31 2011-06-02 The storage method and device of augmented reality view
CN201110183438.4A Expired - Fee Related CN102810109B (en) 2011-05-31 2011-07-01 The storage method and device of augmented reality view

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201110183438.4A Expired - Fee Related CN102810109B (en) 2011-05-31 2011-07-01 The storage method and device of augmented reality view

Country Status (1)

Country Link
CN (2) CN102810099B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102810099B (en) * 2011-05-31 2018-04-27 中兴通讯股份有限公司 The storage method and device of augmented reality view
EP2770783B1 (en) * 2013-02-21 2018-06-20 Apple Inc. A wearable information system having at least one camera
CN105979099B (en) * 2016-06-28 2019-06-04 Oppo广东移动通信有限公司 Increase the method, apparatus and photographing device of scenery in preview interface
CN106789970A (en) * 2016-12-06 2017-05-31 邹汶坤 A kind of remote exhibition system based on AR/VR technologies
CN109920065B (en) * 2019-03-18 2023-05-30 腾讯科技（深圳）有限公司 Information display method, device, equipment and storage medium
CN113325949A (en) * 2021-05-12 2021-08-31 车捷 XR product constitutes system
WO2023245488A1 (en) * 2022-06-22 2023-12-28 Snap Inc. Double camera streams

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101641963A (en) * 2007-03-12 2010-02-03 佳能株式会社 Head mounted image-sensing display device and composite image generating apparatus
CN102006548A (en) * 2009-09-02 2011-04-06 索尼公司 Information providing method and apparatus, information display method and mobile terminal and information providing system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2008110056A (en) * 2005-08-15 2009-09-27 Конинклейке Филипс Электроникс Н.В. (Nl) SYSTEM, DEVICE AND METHOD FOR ADVANCED REALITY GOGGLES FOR END-USER PROGRAMMING
US20080268876A1 (en) * 2007-04-24 2008-10-30 Natasha Gelfand Method, Device, Mobile Terminal, and Computer Program Product for a Point of Interest Based Scheme for Improving Mobile Visual Searching Functionalities
US20090237328A1 (en) * 2008-03-20 2009-09-24 Motorola, Inc. Mobile virtual and augmented reality system
US20100008265A1 (en) * 2008-07-14 2010-01-14 Carl Johan Freer Augmented reality method and system using logo recognition, wireless application protocol browsing and voice over internet protocol technology
CN102810099B (en) * 2011-05-31 2018-04-27 中兴通讯股份有限公司 The storage method and device of augmented reality view

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101641963A (en) * 2007-03-12 2010-02-03 佳能株式会社 Head mounted image-sensing display device and composite image generating apparatus
CN102006548A (en) * 2009-09-02 2011-04-06 索尼公司 Information providing method and apparatus, information display method and mobile terminal and information providing system

Also Published As

Publication number Publication date
CN102810109A (en) 2012-12-05
CN102810099A (en) 2012-12-05
CN102810109B (en) 2018-01-09

Similar Documents

Publication Publication Date Title
CN102810099B (en) The storage method and device of augmented reality view
CN110602396B (en) Intelligent group photo method and device, electronic equipment and storage medium
CN111083380B (en) Video processing method, electronic equipment and storage medium
CN105338117B (en) For generating AR applications and method, equipment and the system of AR examples being presented
CN106170101B (en) Contents providing system, information processing equipment and content reproducing method
CN107481190B (en) A kind of image processing method and device
CN106231368B (en) Main broadcaster's class interaction platform stage property rendering method and its device, client
US11450044B2 (en) Creating and displaying multi-layered augemented reality
CN107633441A (en) Commodity in track identification video image and the method and apparatus for showing merchandise news
EP2405349A1 (en) Apparatus and method for providing augmented reality through generation of a virtual marker
CN106792228A (en) A kind of living broadcast interactive method and system
CN103389978B (en) A kind of method and system being obtained information by augmented reality
CN109743584B (en) Panoramic video synthesis method, server, terminal device and storage medium
TW202009682A (en) Interactive method and device based on augmented reality
CN114115525B (en) Information display method, device, equipment and storage medium
JP2011233005A (en) Object displaying device, system, and method
CN106658220A (en) Subtitle creating device, demonstration module and subtitle creating demonstration system
CN111083371A (en) Shooting method and electronic equipment
CN113253842A (en) Scene editing method and related device and equipment
CN114125421A (en) Image processing method, mobile terminal and storage medium
CN107204026B (en) Method and device for displaying animation
CN112422812B (en) Image processing method, mobile terminal and storage medium
CN107396142A (en) Interface navigation data processing method
CN115690664A (en) Image processing method and device, electronic equipment and storage medium
CN115103206A (en) Video data processing method, device, equipment, system and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180427

Termination date: 20210602

CF01 Termination of patent right due to non-payment of annual fee