CN102810099A - Storage method and device for augmented reality viewgraphs - Google Patents

Storage method and device for augmented reality viewgraphs Download PDF

Info

Publication number
CN102810099A
CN102810099A CN201110147806XA CN201110147806A CN102810099A CN 102810099 A CN102810099 A CN 102810099A CN 201110147806X A CN201110147806X A CN 201110147806XA CN 201110147806 A CN201110147806 A CN 201110147806A CN 102810099 A CN102810099 A CN 102810099A
Authority
CN
China
Prior art keywords
augmented reality
storage
reality view
reality content
view
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201110147806XA
Other languages
Chinese (zh)
Other versions
CN102810099B (en
Inventor
黄成�
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201110147806.XA priority Critical patent/CN102810099B/en
Publication of CN102810099A publication Critical patent/CN102810099A/en
Application granted granted Critical
Publication of CN102810099B publication Critical patent/CN102810099B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a storage method and a device for augmented reality viewgraphs. The storage method comprises the steps as follows: augmented reality contents are obtained, wherein the augmented reality contents are used for displaying the augmented reality viewgraphs on a user terminal; and multimedia targets corresponding to the augmented reality viewgraphs are created and stored according to the individual preference of a user and the context of the user. The storage method and the device can solve the problem in the prior art that the augmented reality viewgraphs cannot be stored selectively according to the user needs, and can further achieve the effect that the augmented reality viewgraphs can be stored flexibly and simply.

Description

The storage means of augmented reality view and device
Technical field
The present invention relates to the communications field, in particular to a kind of storage means and device of augmented reality view.
Background technology
Maturation and development along with intelligent terminal, mobile Internet technology; Once be confined to breadboard augmented reality (AugmentedReality; Abbreviation AR) technology begins to come into the popular visual field, and large quantities of internets that are the basis with image recognition, terminal positioning technology/mobile Internet AR uses and begins to emerge in large numbers, and is called mobile augmented reality (Mobile AR) and uses; This has caused the bigger concern of industry, becomes the technical research focus.
Move augmented reality Study on Technology and application; Virtual augmented reality information is applied to real world; Changed the mode that the user observes the world around---by traditional WEB page browsing query pattern based on the text input; Change into based on camera and take, catch focus and displaying live view enhanced information new mode.
As shown in Figure 1; Augmented reality operation system of the prior art is formed, and comprising: augmented reality server 100, the augmented reality content server 110 of communicating by letter with augmented reality server 100, the communication network 120 of communicating by letter with augmented reality server 100 and the augmented reality terminal 130 of communicating by letter with communication network 120.Wherein:
Augmented reality server 100; The functional entity that the augmented reality service provider disposes at network side; Be responsible for maintenance customer's service order relation and preference setting; And send the augmented reality target of having caught, can supply visit to user terminal according to user request or business setting, and the augmented reality content that is associated, for the user provides moving augmented reality service.
Augmented reality content server 110; The functional entity that augmented reality content supplier disposes at network side; Issued the augmented reality target in storage and the augmented reality server 100; Like POI (point of interest), the augmented reality content that is associated comprises: various multimedia messagess such as literal, image, audio frequency, video.
Communication network 120 is for providing wired, the cordless communication network of network communication link between augmented reality server 100 and the augmented reality terminal 130.
Augmented reality terminal 130, the communication terminal that possesses the augmented reality professional ability that the user uses except basic communication function is provided, can also provide the augmented reality business experience for the user.
Moving the augmented reality user utilizes and (for example: the real business experience that around taking, can be enhanced in scenery smart mobile phone) moves the augmented reality terminal; Have following business scenario: the augmented reality applications of moving on the customer mobile terminal (ARApplication) is caught the augmented reality target (AR Target) that the AR service provider disposes based on user's current location; Such as the focus (POI) relevant with the geographic position; And obtain and the corresponding augmented reality content of augmented reality target (AR Content) according to user's selection, comprising: literal, picture, audio frequency, video.Augmented reality applications combine the geographical finger print information of user terminal (for example: longitude and latitude, towards etc.); Outdoor scene information around augmented reality content of obtaining and the terminal camera shooting is merged demonstration at screen; Present augmented reality view (AR View) to the user; A kind ofly provide, the augmented reality content of obtaining and the real-time shooting picture of camera are merged to play up on terminal display show formed observation view by augmented reality applications.Make the user obtain unusual augmented reality business experience.
But; According to shooting environmental (park, market), augmented reality content characteristic (type, form), and the difference of the SOT state of termination (storage space); The augmented reality user has different storage demands to different augmented reality views; The user possibly hope only to store camera sometimes and take outdoor scene, possibly hope that sometimes the augmented reality content that augmented reality applications is obtained and played up stores together with outdoor scene information, promptly stores augmented reality view full detail; Generate in the augmented reality perhaps augmented reality view object, convenient follow-up browsing.But existing augmented reality terminal (collection) the shooting storage scheme that moves only can write down the outdoor scene information that camera captures, not for the user provides augmented reality view the Save option, and augmented reality view memory function.
If hope that the augmented reality content of extra displaying is taken outdoor scene information together with camera stores; A not satisfied method asks the third party to use apparatus for making a video recording (mobile phone or video camera) to take the augmented reality view that is shown on the record active user terminal screen from the external world exactly; Thereby realize the storage of augmented reality view indirectly; The method needs the third party to support and complicated operation obviously can't let the user satisfied, in addition, owing to user terminal screen is taken again through third party device; Its image quality must be inferior to raw frames; Thereby cause picture distortion to a certain extent, owing to need take again, then can't obtain the augmented reality view of the required storage of user flexibly simultaneously.
A kind of in addition scheme is exactly that intercepting is also preserved the augmented reality view that the user is seen on display screen by similar screenshotss technology in computation.This screenshotss software that requires similar computer Print Screen key function is installed on the user terminal is realized; Yet; Seldom there is portable terminal to possess this function on the market on the one hand; This technology can only intercepting and is stored all the elements that show on the screen on the other hand, can't selectively store the augmented reality view according to user's needs.
This shows; The storage scheme of augmented reality view need rely on the help of third party's hardware and/or software and when relying on third party's hardware, can cause picture distortion to a certain extent in the prior art, can't obtain the augmented reality view of the required storage of user flexibly; When relying on third party software, can't selectively store the augmented reality view according to user's needs.
Summary of the invention
Fundamental purpose of the present invention is to provide a kind of storage means and device of augmented reality view, to solve the problem that can't selectively store the augmented reality view according to user's needs in the prior art.
According to an aspect of the present invention, a kind of storage means of augmented reality view is provided, this method comprises: obtain the augmented reality content, wherein, said augmented reality content is used for user terminal and shows the augmented reality view; Also store multimedia object according to user's personalization preferences and user's context creation corresponding to said augmented reality view.
Comprise according to user's personalization preferences and user's context creation and storage step: receive the storage of augmented reality view and judge request corresponding to the multimedia object of augmented reality view; Whether the augmented reality view memory module that is provided with in the inquiry personalization preferences is indicated according to personalization preferences and context and is carried out the storage of augmented reality view; If then use to meet personalization preferences and the multimedia object corresponding to the augmented reality view is created and stored to contextual augmented reality content; If not, then use the augmented reality content to create and store multimedia object, perhaps do not use augmented reality content creating and storage multimedia object corresponding to the augmented reality view corresponding to the augmented reality view.
The step that use augmented reality content is created and stored corresponding to the multimedia object of augmented reality view comprises: judge that to sending the storage of augmented reality view the entity of request returns the storage affirmative acknowledgement; And send storage and begin the control indication to carrying out the synthetic entity of handling of augmented reality view, be used for indication and begin multimedia object is created and stored.Do not use augmented reality content creating and storage to comprise corresponding to the step of the multimedia object of augmented reality view: the entity to sending augmented reality view storage judgement request returns the storage negative response, does not begin the control indication to carrying out the synthetic entity transmission storage of handling of augmented reality view.
Use meets the step that personalization preferences and contextual augmented reality content create and store corresponding to the multimedia object of augmented reality view and comprises: obtain the augmented reality content characteristic information relevant with the augmented reality view, judge whether augmented reality content characteristic information meets the augmented reality view storage rule that is provided with in the personalization preferences; Obtain the current context of user, judge whether context meets the augmented reality view storage rule that is provided with in the personalization preferences; If augmented reality content characteristic information and context meet the augmented reality view storage rule that is provided with in the personalization preferences, then use the augmented reality content to create and store multimedia object corresponding to the augmented reality view.
Judge through following steps whether augmented reality content characteristic information and context meet the augmented reality view storage rule that is provided with in the personalization preferences: judge whether the augmented reality content characteristic of describing in the augmented reality content characteristic information satisfies the augmented reality content characteristic that augmented reality view storage rule allows storage; Wherein, the augmented reality content characteristic comprise following one of at least: augmented reality target type, augmented reality content multimedia type, the augmented reality size of contents content associated with augmented reality; Judge whether user's current context characteristic of describing in the context satisfies the user's context characteristic that augmented reality view storage rule allows storage; Wherein, the user's context characteristic comprise following one of at least: user terminal current residual storage space, user's current location, user terminal current residual electric weight.
The step that use augmented reality content is created and stored corresponding to the multimedia object of augmented reality view comprises: augmented reality content relevant with the augmented reality view and terminal camera shooting outdoor scene data are carried out buffer memory; According to terminal real-time status information and the control information of augmented reality content revealing the institute's augmented reality content of buffer memory and the outdoor scene data of terminal taking are synthesized; Exporting the synthetic data that obtain to storer stores.
To synthesize the data that obtain when exporting storer to and storing, the storage means of augmented reality view also comprises: will synthesize the data that obtain and export terminal presentation facility to.
After the multimedia object corresponding to the augmented reality view is created and stored to use augmented reality content, the storage means of augmented reality view also comprised: receive the storage of augmented reality view and select request; Storage selects request to generate storage control indication according to the augmented reality view; Begin the control indication if storage control is designated as storage, then send the synthetic input of augmented reality content and begin request, begin synthetic the processing, and storage augmented reality content; If storage control is designated as storage and stops the control indication, then send the synthetic input of augmented reality content and stop request, stop synthetic the processing, stop to store the augmented reality content.
According to a further aspect in the invention, a kind of memory storage of augmented reality view is provided, this device comprises: acquiring unit, obtain the augmented reality content, and wherein, the augmented reality content is used for user terminal and shows the augmented reality view; Performance element is used for also storing the multimedia object corresponding to the augmented reality view according to user's personalization preferences and user's context creation.
Performance element comprises: receiver module is used to receive the storage of augmented reality view and judges request; Whether enquiry module is used for inquiring about augmented reality view memory module that personalization preferences is provided with and indicates according to personalization preferences and context and carry out the storage of augmented reality view; Processing module; Be used for when memory module indication is carried out the storage of augmented reality view according to personalization preferences and context; Whether use the augmented reality content to create and store multimedia object according to personalization preferences and context determination corresponding to the augmented reality view; If then use the augmented reality content to create and store multimedia object corresponding to the augmented reality view; When memory module indication is not carried out the storage of augmented reality view according to personalization preferences and context; Use the augmented reality content to create and store multimedia object, perhaps do not use augmented reality content creating and storage multimedia object corresponding to the augmented reality view corresponding to the augmented reality view.
Processing module comprises: first processing sub; Be used for when using the augmented reality content to create and store the multimedia object corresponding to the augmented reality view; Judge that to sending the storage of augmented reality view the entity of request returns the storage affirmative acknowledgement; And send storage and begin the control indication to carrying out the synthetic entity of handling of augmented reality view, be used for indication and begin multimedia object is created and stored; Second processing sub; Be used for when not using augmented reality content creating and storage corresponding to the multimedia object of augmented reality view; Judge that to sending the storage of augmented reality view the entity of request returns the storage negative response, do not send storage and begin to control indication to the synthetic entity of handling of execution augmented reality view.
Processing module comprises: first obtains submodule, is used to obtain the augmented reality content characteristic information relevant with the augmented reality view and obtains the current context of user; Judge submodule, be used for judging whether augmented reality content characteristic information and context meet the augmented reality view storage rule that personalization preferences is provided with; First sub module stored is used for when augmented reality content characteristic information and context meet the augmented reality view storage rule that personalization preferences is provided with, using the augmented reality content to create and store the multimedia object corresponding to the augmented reality view.
Judge that submodule comprises: first judges submodule; Be used for judging whether the augmented reality content characteristic that augmented reality content characteristic information is described satisfies the augmented reality content characteristic that augmented reality view storage rule allows storage; Wherein, The augmented reality content characteristic comprise following one of at least: the augmented reality target type content associated, augmented reality content multimedia type, augmented reality content stores size with augmented reality; Second judges submodule; Be used for judging whether user's current context characteristic that context is described satisfies the user's context characteristic that augmented reality view storage rule allows storage; Wherein, the user's context characteristic comprise following one of at least: user terminal current residual storage space, user's current location, user terminal current residual electric weight.
Processing module comprises: cache sub-module is used for after use augmented reality content is created and store corresponding to the multimedia object of augmented reality view, augmented reality content relevant with the augmented reality view and terminal camera shooting outdoor scene data being carried out buffer memory; The synthon module is used for according to terminal real-time status information and the control information of augmented reality content revealing the institute's augmented reality content of buffer memory and the outdoor scene data of terminal taking being synthesized; Second sub module stored is used for exporting the synthetic data that obtain to storer and stores.
Performance element also comprises: transport module is used for exporting the synthetic data that obtain to terminal presentation facility.
Processing module also comprises: second obtains submodule, is used to receive the storage of augmented reality view and selects request; Generate submodule, be used for generating storage control and indicate according to augmented reality view storage selection request; The 3rd processing sub is used for when storage control is designated as storage and begins the control indication, sending the synthetic input of augmented reality content and beginning request, begins synthetic the processing, and storage augmented reality content; The manages submodule everywhere, is used for when storage control is designated as storage and stops the control indication, sending the synthetic input of augmented reality content and stopping request, stops synthetic the processing, stops to store the augmented reality content.
Through the present invention; According to personalization preferences information (like memory module; Storage preference (such as content type, form, expense etc.)) and contextual information (like customer location; Terminal capabilities (such as storage space) etc.) stores synchronized shoot on location information and augmented reality content selectively solve the problem that can't selectively store the augmented reality view according to user's needs in the prior art, and then have reached the effect that can flexibly, simply carry out the storage of augmented reality view.
Description of drawings
Accompanying drawing described herein is used to provide further understanding of the present invention, constitutes the application's a part, and illustrative examples of the present invention and explanation thereof are used to explain the present invention, do not constitute improper qualification of the present invention.In the accompanying drawings:
Fig. 1 is the mobile augmented reality operation system structured flowchart according to correlation technique;
Fig. 2 is the preferred structure block diagram according to the memory storage of the augmented reality view of the embodiment of the invention;
Fig. 3 is the preferred flow charts according to the storage means of the augmented reality view of the embodiment of the invention;
Fig. 4 is the structural representation according to the mobile augmented reality terminal of the embodiment of the invention;
Fig. 5 is according to augmented reality view storage control module synoptic diagram in the mobile augmented reality client of the embodiment of the invention;
Fig. 6 is according to the synthetic processing module synoptic diagram of the mobile augmented reality client augmented reality view of the embodiment of the invention;
Fig. 7 is a kind of mobile augmented reality view storage means flowchart according to the embodiment of the invention;
Fig. 8 is that the another kind according to the embodiment of the invention moves augmented reality view storage means flowchart.
Embodiment
Hereinafter will and combine embodiment to specify the present invention with reference to accompanying drawing.Need to prove that under the situation of not conflicting, embodiment and the characteristic among the embodiment among the application can make up each other.
Embodiment 1
Fig. 2 is that this device comprises according to the preferred structure block diagram of the memory storage of the augmented reality view of the embodiment of the invention: the acquiring unit 202 and the performance element 204 that connect successively.In the process of storage augmented reality view, acquiring unit 202 obtains the augmented reality content, and wherein, said augmented reality content is used for user terminal and shows the augmented reality view; Performance element 204 is also stored the multimedia object (that is to say that performance element 204 uses the augmented reality content creating and stores the multimedia object corresponding to the augmented reality view according to user's personalization preferences and user's context) corresponding to said augmented reality view according to user's personalization preferences and user's context creation.
Preferably, whether performance element 204 uses the augmented reality content creating and stores the multimedia object corresponding to said augmented reality view according to user's personalization preferences and user's context determination; If; Then use augmented reality content creating and storage multimedia object corresponding to said augmented reality view; Here, can be preferably meet personalization preferences and the multimedia object corresponding to said augmented reality view is created and stored to contextual augmented reality content from a plurality of augmented reality content choice according to user's personalization preferences and user's context.
In this preferred embodiment; According to personalization preferences information (like memory module; Storage preference (such as content type, form, required expense etc.)) and contextual information (like customer location; Terminal capabilities (such as storage space) etc.) stores synchronized shoot on location information and augmented reality content selectively solve the problem that can't selectively store the augmented reality view according to user's needs in the prior art, and then have reached the effect that can flexibly, simply carry out the storage of augmented reality view.
Above-mentioned personalization preferences information (Personalization) is used for being provided with according to the user AR content is handled, and it comprises memory module, storage preference (like content type, form, context, size of contents etc.) etc.
Above-mentioned contextual information (Contextualization) is used for according to the user's context of gathering the AR content being handled, and it comprises: customer location, terminal capability (like storage space) etc.
Present embodiment provides a kind of preferred performance element 204, and it comprises: the receiver module 2041, enquiry module 2042 and the processing module 2043 that connect successively.
Receiver module 2041 receives the storage of augmented reality view and judges request; Whether the augmented reality view memory module that is provided with in the said personalization preferences of enquiry module 2042 inquiries then, is indicated according to said personalization preferences and said context and is carried out the storage of said augmented reality view; Then; When processing module 2043 is carried out the storage of said augmented reality view in the indication of said memory module according to said personalization preferences and said context; Whether use said augmented reality content to create and store multimedia object according to said personalization preferences and said context determination corresponding to said augmented reality view; If; Then use said augmented reality content to create and store (just corresponding to the multimedia object of said augmented reality view; Selection meets personalization preferences and the multimedia object corresponding to said augmented reality view is created and stored to contextual augmented reality content; Preferably; Can meet personalization preferences and the multimedia object corresponding to said augmented reality view is created and stored to contextual augmented reality content from a plurality of augmented reality content choice according to user's personalization preferences and user's context), otherwise, said augmented reality content creating and storage multimedia object then do not used corresponding to said augmented reality view; When the indication of said memory module is not carried out the storage of said augmented reality view according to said personalization preferences and said context; Use said augmented reality content to create and store multimedia object, perhaps do not use said augmented reality content creating and storage multimedia object corresponding to said augmented reality view corresponding to said augmented reality view.In this preferred embodiment, the storage of whether carrying out the augmented reality view is judged, improved storage speed, simplified flow process.
Preferably; When the indication of said memory module is not carried out the storage of said augmented reality view according to said personalization preferences and said context, can use all augmented reality contents to create and store multimedia object corresponding to said augmented reality view.
Present embodiment also provides a kind of preferred processing module 2043, and it comprises: first processing sub and second processing sub.
When using said augmented reality content to create and store multimedia object (and use meets said personalization preferences and the multimedia object corresponding to said augmented reality view is created and stored to said contextual said augmented reality content) corresponding to said augmented reality view; First processing sub judges that to sending said augmented reality view storage the entity of request returns the storage affirmative acknowledgement; And send storage and begin the control indication to carrying out the synthetic entity of handling of augmented reality view, be used for indication and begin said multimedia object is created and stored; When not using said augmented reality content creating and storage corresponding to the multimedia object of said augmented reality view; Second processing sub judges that to sending said augmented reality view storage the entity of request returns the storage negative response, does not send storage to the synthetic entity of handling of execution augmented reality view and begins to control indication.In this preferred embodiment, the operation through indication is stored and stopped to store has improved storage speed, has simplified flow process.
Present embodiment also provides a kind of preferred processing module 2043, and it comprises: first of connection obtain submodule, judgement submodule and first sub module stored successively.
First obtains submodule obtains the augmented reality content characteristic information relevant with said augmented reality view and obtains the current context of said user; Then, judge that submodule judges whether said augmented reality content characteristic information and said context meet the augmented reality view storage rule that is provided with in the said personalization preferences; When said augmented reality content characteristic information and said context met the augmented reality view storage rule that is provided with in the said personalization preferences, first sub module stored used said augmented reality content to create and store the multimedia object corresponding to said augmented reality view.In this preferred embodiment, the characteristic information that extracts is judged, improved the speed of storage.
Present embodiment provides a kind of preferred judgement submodule to judge submodule, and it comprises: the first sub-judge module and the second sub-judge module.
The first sub-judge module judges whether the augmented reality content characteristic of describing in the said augmented reality content characteristic information satisfies the augmented reality content characteristic that said augmented reality view storage rule allows storage; Wherein, Said augmented reality content characteristic comprise following one of at least: the augmented reality target type content associated, augmented reality content multimedia type, augmented reality content stores size with said augmented reality; Whether the user's current context characteristic described in the said context of judging the second sub-judge module satisfies the user's context characteristic that said augmented reality view storage rule allows storage; Wherein, said user's context characteristic comprise following one of at least: user terminal current residual storage space, user's current location, user terminal current residual electric weight.In this preferred embodiment, storage class or form and residual memory space etc. are judged, improved judgement speed, simplified flow process.
Present embodiment also provides a kind of preferred processing module 2043; It comprises: cache sub-module is used for after use augmented reality content is created and store corresponding to the multimedia object of augmented reality view, augmented reality content relevant with said augmented reality view and terminal camera shooting outdoor scene data being carried out buffer memory; The synthon module is used for according to terminal real-time status information and the control information of augmented reality content revealing the institute's augmented reality content of buffer memory and the outdoor scene data of said terminal taking being synthesized; Second sub module stored is used for exporting the synthetic data that obtain to storer and stores.In this preferred embodiment, synthetic data are stored, guarantee that the synthetic data that obtain are able to storage, simply carry out the storage of augmented reality view.
Preferably, performance element 204 also comprises: transport module 2044 is used for exporting the said synthetic data that obtain to terminal presentation facility.
Preferably, said processing module 2043 also comprises: second obtains submodule, is used to receive the storage of augmented reality view and selects request; Generate submodule, be used for selecting request to generate storage control indication according to said augmented reality view storage; The 3rd processing sub is used for when said storage control is designated as storage and begins the control indication, sending the synthetic input of augmented reality content and beginning request, begins synthetic the processing, and stores said augmented reality content; The manages submodule everywhere, is used for when said storage control is designated as storage and stops the control indication, sending the synthetic input of augmented reality content and stopping request, stops synthetic the processing, stops to store said augmented reality content.
Preferably, the memory storage of augmented reality view also comprises: first storage unit 206, updating block 208 and second storage unit 210, and wherein, first storage unit 206 is stored the outdoor scene data of terminal taking; Updating block 208 upgrades the augmented reality view; The augmented reality view after second storage unit 210 will be upgraded and the outdoor scene data of terminal taking are synthesized, and will synthesize the data that obtain and store.In this preferred embodiment, synthetic data are stored, guarantee that the synthetic data that obtain are able to storage, simply carry out the storage of augmented reality view.
Embodiment 2
Fig. 3 is that this method comprises according to the preferred flow charts of the storage means of the augmented reality view of the embodiment of the invention:
S302 obtains the augmented reality content, and wherein, said augmented reality content is used for user terminal and shows the augmented reality view;
S304; Also store multimedia object (that is to say, use the augmented reality content creating and store multimedia object) according to user's personalization preferences and user's context creation corresponding to the augmented reality view according to user's personalization preferences and user's context corresponding to said augmented reality view.
Preferably, in above-mentioned steps S304, whether use the augmented reality content creating and store multimedia object corresponding to said augmented reality view according to user's personalization preferences and user's context determination; If; Then use augmented reality content creating and storage multimedia object corresponding to said augmented reality view; Here, can preferably create and store multimedia object from the satisfactory augmented reality content of a plurality of augmented reality content choice corresponding to said augmented reality view according to user's personalization preferences and user's context.
In this preferred embodiment; According to personalization preferences information (like memory module; Storage preference (such as content type, form, expense etc.)) and contextual information (like customer location; Terminal capabilities (such as storage space) etc.) stores synchronized shoot on location information and augmented reality content selectively solve the problem that can't selectively store the augmented reality view according to user's needs in the prior art, and then have reached the effect that can flexibly, simply carry out the storage of augmented reality view.
Preferably, comprise according to user's personalization preferences and user's context creation and storage step: receive the storage of augmented reality view and judge request corresponding to the multimedia object of said augmented reality view; Whether inquire about the augmented reality view memory module that is provided with in the said personalization preferences indicates according to said personalization preferences and said context and carries out the storage of said augmented reality view; If the indication of augmented reality view memory module is carried out the storage of said augmented reality view according to said personalization preferences and said context; Use then that to meet the multimedia object that said personalization preferences and said contextual said augmented reality content create and store corresponding to said augmented reality view (preferred; In this step; Whether use said augmented reality content to create and store multimedia object according to said personalization preferences and said context determination corresponding to said augmented reality view; If then use to meet personalization preferences and the multimedia object corresponding to said augmented reality view is created and stored to contextual augmented reality content); If the indication of augmented reality view memory module is not carried out the storage of said augmented reality view according to said personalization preferences and said context; Then use said augmented reality content to create and store multimedia object, perhaps do not use said augmented reality content creating and storage multimedia object corresponding to said augmented reality view corresponding to said augmented reality view.In this preferred embodiment, the storage of whether carrying out the augmented reality view is judged, improved storage speed, simplified flow process.
Preferably; When the indication of said memory module is not carried out the storage of said augmented reality view according to said personalization preferences and said context, can use all augmented reality contents to create and store multimedia object corresponding to said augmented reality view.
Preferably; The step (and use meets said personalization preferences and the step corresponding to the multimedia object of said augmented reality view is created and stored to said contextual said augmented reality content) of using said augmented reality content to create and store corresponding to the multimedia object of said augmented reality view comprising: judge that to sending said augmented reality view storage the entity of request returns the storage affirmative acknowledgement; And send storage and begin the control indication to carrying out the synthetic entity of handling of augmented reality view, be used for indication and begin said multimedia object is created and stored.Do not use said augmented reality content creating and storage to comprise corresponding to the step of the multimedia object of said augmented reality view: the entity to sending said augmented reality view storage judgement request returns the storage negative response, does not begin the control indication to carrying out the synthetic entity transmission storage of handling of augmented reality view.In this preferred embodiment, the operation through indication is stored and stopped to store has improved storage speed, has simplified flow process.
Preferably; Use meets the step that said personalization preferences and said contextual said augmented reality content create and store corresponding to the multimedia object of said augmented reality view and comprises: obtain the augmented reality content characteristic information relevant with the augmented reality view, judge whether augmented reality content characteristic information meets the augmented reality view storage rule that is provided with in the personalization preferences; Obtain the current context of user, judge whether context meets the augmented reality view storage rule that is provided with in the personalization preferences; If augmented reality content characteristic information and context meet the augmented reality view storage rule that is provided with in the personalization preferences, then use said augmented reality content to create and store multimedia object corresponding to said augmented reality view.In this preferred embodiment, the characteristic information that extracts is judged, improved the speed of storage.
Preferably; Judge through following steps whether augmented reality content characteristic information and context meet the augmented reality view storage rule that is provided with in the personalization preferences: judge whether the augmented reality content characteristic of describing in the augmented reality content characteristic information satisfies the augmented reality content characteristic that augmented reality view storage rule allows storage; Wherein, said augmented reality content characteristic comprise following one of at least: augmented reality target type, augmented reality content multimedia type, the augmented reality size of contents content associated with said augmented reality; Judge whether user's current context characteristic of describing in the said context satisfies the user's context characteristic that said augmented reality view storage rule allows storage; Wherein, said user's context characteristic comprise following one of at least: user terminal current residual storage space, user's current location, user terminal current residual electric weight.In this preferred embodiment, storage class or form and residual memory space etc. are judged, improved judgement speed, simplified flow process.
Preferably, the step (and use meets said personalization preferences and the step corresponding to the multimedia object of said augmented reality view is created and stored to said contextual said augmented reality content) of using said augmented reality content to create and store corresponding to the multimedia object of said augmented reality view comprising: augmented reality content relevant with the augmented reality view and terminal camera shooting outdoor scene data are carried out buffer memory; According to terminal real-time status information and the control information of augmented reality content revealing the institute's augmented reality content of buffer memory and the outdoor scene data of terminal taking are synthesized; Exporting the synthetic data that obtain to storer stores.In this preferred embodiment, synthetic data are stored, guarantee that the synthetic data that obtain are able to storage, simply carry out the storage of augmented reality view.
Preferably, will synthesize the data that obtain when exporting storer to and storing, the storage means of augmented reality view also comprises: will synthesize the data that obtain and export terminal presentation facility to.
After the multimedia object corresponding to said augmented reality view is created and stored to the said augmented reality content of use, the storage means of augmented reality view also comprised: receive the storage of augmented reality view and select request; Storage selects request to generate storage control indication according to the augmented reality view; Begin the control indication if storage control is designated as storage, then send the synthetic input of augmented reality content and begin request, begin synthetic the processing, and storage augmented reality content; If storage control is designated as storage and stops the control indication, then send the synthetic input of augmented reality content and stop request, stop synthetic the processing, stop to store the augmented reality content.
Preferably, to after the augmented reality view execution storage operation, the storage means of augmented reality view also comprises: the outdoor scene data of terminal taking are stored according to memory module; Upgrade the augmented reality view; The augmented reality view after upgrading and the outdoor scene data of terminal taking are synthesized, and will synthesize the data that obtain and store.In this preferred embodiment, synthetic data are stored, guarantee that the synthetic data that obtain are able to storage, simply carry out the storage of augmented reality view.
Embodiment 3
As shown in Figure 4, present embodiment provides a kind of mobile augmented reality terminal 400 structural representations, comprising:
1) camera 401, are used for taking in real time the outdoor scene information (Camera View) that user's ambient is managed the world.Some camera possesses video memory, the outdoor scene information that can buffer memory photographs.Import request according to the user during shooting, can be with outdoor scene information stores to the nonvolatile memory 405 that photographs;
2) display screen 402, take augmented reality (Augmented Reality, AR) content of outdoor scene information under the modification of augmented reality content is played up for the user presents camera 401;
3) GPS module, compass, sensors etc. 403, wherein GPS module and Global Positioning System (GPS) (GPS) satellite communication provides terminal positional information (longitude and latitude) in real time.Compass, sensor are used for gathering user terminal state, comprising: camera towards, with the ground angle etc.;
4) user's load module 404; Be used for receiving the operation of augmented reality user input; Comprise: augmented reality view memory module setting operation, augmented reality view storage preference operation (increasing, delete, upgrade preference), augmented reality view storage selection operation (begin storage, stop storage) etc.;
5) storer 405, are used for permanent local storaging user data (camera outdoor scene, augmented reality content etc.);
6) move augmented reality client 410, the client functionality entity that moves the augmented reality professional ability be provided, comprise following functional module:
A) move augmented reality applications access interface 411; Operate in the augmented reality applications 420,430,440 that moves on the augmented reality terminal 400 and move the support augmented reality professional ability that augmented reality client 410 provides, comprising: augmented reality target search and location through this interface accessing; Augmented reality content server side is obtained; Augmented reality content terminal side displaying etc.
B) moving the augmented reality content obtains and shows rendering module 412; Be responsible for according to moving augmented reality terminal 400 relevant informations (for example: the user terminal location that GPS module 403 is obtained; Perhaps camera 401 captured augmented reality target images) obtain the augmented reality content that is associated to mobile augmented reality server requests, and the control information of augmented reality content displaying.
In addition; Be responsible for according to the control information of augmented reality content displaying; (for example: the user terminal state that compass, sensor etc. 403 are gathered), the outdoor scene information that mobile augmented reality content that control is obtained and camera 401 photograph merges displaying on display screen 402 in conjunction with moving augmented reality terminal 400 information;
C) move augmented reality user individual preference module 413 is set; Responsible user's input operation of being fed back according to user's load module 404; Move the setting of augmented reality user individual preference in order to write down, comprising: the augmented reality content is obtained preference, augmented reality view storage preference etc.; Wherein, above-mentioned augmented reality content is obtained preference and is used for recording user and obtains the preference setting of moving the augmented reality content; Above-mentioned augmented reality view storage preference is used for the preference setting that the augmented reality view is moved in the recording user storage, comprising: the memory module preference is provided with, the storage rule preference is provided with.
Preferably, move the setting of augmented reality view memory module preference and comprise: pattern 1, all mobile augmented reality contents of obtaining are not all stored; Pattern 2, all augmented reality contents of obtaining are all stored; Whether mode 3 stores the augmented reality content according to mobile augmented reality view storage control module 415 judged results decision.
Preferably, move the setting of augmented reality view storage rule preference and be meant under the mode 3 preference is provided with, move the augmented reality user and select preference to the storage of augmented reality view.On the one hand, be and the characteristic related preferences of processing augmented reality content, comprise: relevant augmented reality target type, augmented reality content media form and other and the relevant copyright of augmented reality view storage, cost information etc. of hoping storage; On the other hand, be setting, the ability related preferences at the mobile augmented reality terminal 400 that must satisfy with storage augmented reality view, comprising: information such as storage format setting, storage fragmentation size, terminal dump energy.
Augmented reality view storage in the augmented reality view storage preference selects preference to be meant the relevant selection request of the interim augmented reality view storage that send and specific of user; Comprise: request classification (begin storage, stop storage) is selected in augmented reality content identification, storage.
D) move augmented reality user's context access modules 414; Obtain mobile augmented reality user context information in order to visit; Comprise: move GPS module, compass, sensor etc. 403 on the augmented reality terminal 400; The user that storer 405 functional entitys such as grade collect and use the terminal contextual information comprises: customer position information (longitude and latitude), terminal's status information (camera towards, with ground angle); The terminal is provided with information (storage format setting), terminal ability information (storer residual memory space) etc.
E) move augmented reality view storage control module 415; Receive the augmented reality view storage judgement request that rendering module 412 transmissions were obtained and showed to the augmented reality content of moving; According to the said augmented reality content characteristic that carries in the described request; And the end message of mobile augmented reality user's context access modules 414 collections, in conjunction with the user preference that moves augmented reality user individual preference logging modle 413 records, carry out said augmented reality view storage control judgement.And obtain and show that rendering module 412 feedback store reply to mobile augmented reality content, and when confirming storage, send storage control and indicate to the synthetic processing module 416 of mobile augmented reality view according to judged result.
In addition, select request, send storage control indication to the synthetic processing module 416 of mobile augmented reality view according to the interim augmented reality view storage of the user who moves augmented reality user individual preference logging modle 413 feedbacks.
F) move the synthetic processing module 416 of augmented reality view; Indication is controlled in the augmented reality view storage that receives mobile augmented reality view storage control module 415 transmissions, and according to indicating the classification execution corresponding to the synthetic processing operation of augmented reality view multimedia object.
For " storage beginning " control indication; The said augmented reality content that the synthetic processing module 416 of mobile augmented reality view will ask input to obtain and show rendering module 412 displaying controls through moving the augmented reality content; The outdoor scene information that request input camera 401 photographs; Carry out synthetic the processing, and composite signal is illustrated in display screen 402, and be sent to storer 405 storages.
For " storage stops " control indication, move the synthetic processing module 416 of augmented reality view and will no longer import augmented reality content and outdoor scene information, stop the synthetic operation of handling, thereby stop establishment and storage corresponding to augmented reality view multimedia object.
7) augmented reality applications 420,430,440; The end side application program that moves the augmented reality business service is provided; Move the support augmented reality professional ability that augmented reality client 410 provides through moving 411 visits of augmented reality applications access interface, multi-form augmented reality business experience is provided on this basis.
Embodiment 4
As shown in Figure 5, present embodiment provides and moves augmented reality view storage control module 500 in a kind of mobile augmented reality client, comprising: the storage indication portion 503 that connects successively, storage judging part 501, storage condition extraction portion 502.
Storage judging part 501 receives and moves the augmented reality content and obtain and show the augmented reality view storage that rendering module 510 sends and judge request, and according to the augmented reality view memory module that 502 inquiries of storage condition extraction portion are returned preference is set and carries out said augmented reality view storage and judge.
When moving memory module that augmented reality user individual preference is provided with module 520 and preference is set is set to pattern 1, augmented reality view storage judged result is " vacation ", does not promptly store;
When moving memory module that augmented reality user individual preference is provided with module 520 and preference is set is set to pattern 2, augmented reality view storage judged result be " very ", promptly stores;
When moving memory module that augmented reality user individual preference is provided with module 520 and preference is set is set to mode 3, the augmented reality view storage condition information of extracting according to storage condition extraction portion 502 is carried out said augmented reality view storage and is judged.Said storage condition information comprises: move the augmented reality content and obtain and show the rendering module 510 augmented reality content characteristic that sends; Move the storage judgement preference that augmented reality user individual preference is provided with module 520 records, and the terminal that mobile augmented reality user's context access modules 530 is gathered is provided with information and/or terminal ability information.
If said augmented reality content characteristic meets augmented reality view storage preference; For example: augmented reality target type or augmented reality content format are type or the forms that record allows storage in the storage preference; And the augmented reality content characteristic meets that the terminal is provided with and terminal ability information, and for example: terminal storage is provided with option and is " True ", and the storer residual memory space can hold the augmented reality size of contents; Store judging part 501 so and be " very " to said augmented reality view storage judged result; I.e. storage, otherwise be " vacation ", promptly do not store.
In addition, the mobile augmented reality user individual preference of the also responsible reception of storage judging part 501 is provided with user's augmented reality view storage of module 520 and selects to ask, and comprising:
Select 1, stop to store the augmented reality view that certain is being stored, the respective stored judged result is " vacation ";
Select 2, begin to store the augmented reality view that certain does not have storage, the respective stored judged result is " very ";
The augmented reality view memory module that the storage condition extraction portion mobile augmented reality user individual preference of 502 responsible inquiries is provided with module 520 records is provided with preference; And when memory module is provided with preference and is set to mode 3, be responsible for acquisition request and the relevant storage condition information of said augmented reality view storage judgement:
Request is moved the augmented reality content and is obtained and show rendering module 510; Extract the augmented reality content characteristic, comprising: augmented reality content identification, augmented reality content media form, augmented reality target type, augmented reality size of contents and copyright, the cost information relevant with the augmented reality content stores;
Request is moved augmented reality user individual preference module 520 extraction augmented reality view storage judgement preferences is set;
Request is moved augmented reality user's context access modules 530 extraction terminals information and/or ability information is set;
Storage condition extraction portion 502 can extract and return above-mentioned storage condition information to storing judging part 501 simultaneously when the memory module Query Result is " mode 3 ", needn't obtain at twice.
In addition, the augmented reality content characteristic in the above-mentioned storage condition information also can carry in the augmented reality view storage judgement request, needn't additional extractions.
Storage indication portion 503 receives the storage judged result that storage judging part 501 sends, and generates and sends corresponding storage control indication.
When storage judged result when be " vacation ", obtain and show rendering module 510 transmission augmented reality views " storage negative response " to mobile augmented reality content.
When storage judged result when be " very ", obtain and show rendering module 510 transmission augmented reality views " memory verification is replied " to mobile augmented reality content.And to the synthetic processing module 540 transmission augmented reality views " storage begins the control indication " of mobile augmented reality view.
(affirmation is replied, negative response) replied in said storage, and the corresponding augmented reality content identification of storage control is all carried in storage control indication (begin indication, stop indication).
Embodiment 5
As shown in Figure 6, move the synthetic processing module 600 of augmented reality view in the mobile augmented reality client that the present invention proposes, comprising: the synthetic control part 601 that connects successively, synthetic input part 602 and synthetic efferent 603.
Synthetic control part 601 is responsible for receiving and is moved the augmented reality view storage control indication that augmented reality view storage control module 610 is sent, and carries out the synthetic control of augmented reality view.
When receiving augmented reality view storage beginning control indication; Synthetic control part 601 obtains and shows that rendering module 620 sends synthetic input and begins request to mobile augmented reality content, and request will be corresponding with the augmented reality content identification and through showing that control information and terminal's status information cooperate the augmented reality content output buffers of showing under the control extremely to synthesize input part 602.Simultaneously, synthetic control part 601 sends to camera 630 and synthesizes the input request, and request camera 630 is with the extremely synthetic input part 602 of the outdoor scene data output buffers of taking.
When receiving the storage of augmented reality view and stop the control indication, synthetic control part 601 obtains and shows that rendering module 620 sends synthetic input and stops request to mobile augmented reality content, synthesizes no longer buffer memory augmented reality content of input part 602.Simultaneously, synthetic control part 601 sends synthetic input to camera 630 and stops request, and synthetic input part 602 is buffer memory outdoor scene information no longer.After this, move the augmented reality content and obtain and show that the augmented reality content that rendering module 620 will be corresponding with the augmented reality content identification directly plays up displaying at display screen 640, camera 630 shooting outdoor scene information will directly be stored to storer 650.
Synthetic input part 602 is responsible for buffer memory and is moved the augmented reality content through displaying control that rendering module 620 inputs were obtained and showed to the augmented reality content, also is responsible for the outdoor scene information of buffer memory camera 630 inputs.
Synthetic efferent 603 responsible outdoor scene data and the augmented reality contents that will synthesize input part 602 buffer memorys are synthesized processing, generate the composite signal that merges augmented reality content and outdoor scene data.
Synthetic efferent 603 exports composite signal to indicator screen 640 and shows to the user.Synthetic efferent 603 exports composite signal to storer 650 and carries out this locality storage.
Embodiment 6
As shown in Figure 7, present embodiment provides a kind of mobile augmented reality view storage means flowchart, and this method comprises the steps:
Step 701: according to the perception (such as image recognition result) of user's current location (longitude and latitude) or user terminal to physical world; The user moves the augmented reality client and moves the mobile augmented reality target access request of augmented reality server transmission to network side; Perhaps move the augmented reality server and move augmented reality business setting and actual search filter result, initiatively move the augmented reality target that the augmented reality client push is caught to the user according to the user.To obtaining the selection of augmented reality target, the mobile augmented reality content that the user moves the augmented reality client is obtained and is showed the augmented reality content that the rendering module acquisition request is corresponding with the augmented reality target according to the user.
Step 702: mobile augmented reality content is obtained and is showed that rendering module sends the storage of augmented reality view to mobile augmented reality view storage control module and judges request, asks to judge whether to use the augmented reality content stores multimedia object corresponding with creating the augmented reality view that has obtained.
Step 703: move the inquiry of augmented reality view storage control module and move augmented reality user individual preference and the augmented reality view memory module that module writes down is set preference is set:
If be set to " pattern 1 ", then execution in step 707;
If be set to " pattern 2 ", then execution in step 709;
If be set to " mode 3 ", then execution in step 704;
Step 704: the storage condition extraction portion that moves in the augmented reality view storage control module obtains and shows rendering module inquiry and extraction augmented reality content characteristic to mobile augmented reality content, comprising: augmented reality content identification, augmented reality content media form, augmented reality target type, augmented reality size of contents and copyright, the cost information relevant with the augmented reality content stores.
If carried above-mentioned augmented reality content characteristic in the augmented reality view storage judgement request in the step 702, then ignored this step;
Step 705: the storage condition extraction portion that moves in the augmented reality view storage control module is provided with the mobile augmented reality user individual preference setting of module inquiry to mobile augmented reality user individual preference; It comprises: augmented reality target type, the augmented reality content media form of hoping storage; And other user preference settings relevant (for example:, will not allow storage) when the augmented reality size of contents accounts for storer remaining space one half with the storage of augmented reality view.And; Storage condition extraction portion in the mobile augmented reality view storage control module is to mobile augmented reality end message access modules inquiring user context; It comprises: the terminal is provided with information (storer setting), terminal ability information (storer residual memory space) etc.
Step 706: the storage judging part that moves in the augmented reality view storage control module carries out the judgement of augmented reality view event memory according to the augmented reality content characteristic that extracts, mobile augmented reality user individual preference setting and user's context:
If judged result is " vacation ", promptly do not store, then execution in step 707;
If judged result is " very ", i.e. storage, then execution in step 709.
Step 707: the storage judging part that moves in the augmented reality view storage control module obtains and shows that rendering module sends " storage negative response " to mobile augmented reality content, and indication does not use the augmented reality content of being obtained to store and create the multimedia object of augmented reality view correspondence.
Step 708: move the augmented reality content and obtain and show that rendering module is directly played up the augmented reality content and show that to the user terminal displays screen, the augmented reality view will not be stored.
Step 709: the storage judging part that moves in the augmented reality view storage control module obtains and shows rendering module transmission " memory verification is replied " to mobile augmented reality content.And storage indication portion sends " storage begins the control indication " to the synthetic processing module of mobile augmented reality view.
Mobile augmented reality content is obtained and is showed that rendering module synthesizes the request of input according to replying to prepare to receive, said augmented reality content is played up to the synthetic input part that moves the synthetic processing module of augmented reality;
Move and synthesize control part in the synthetic processing module of augmented reality view, indicate it to prepare to receive buffer memory and synthesize deal with data according to indicating to synthetic input part transmission cache request.Simultaneously; Synthetic control part is respectively to the user terminal camera and move the augmented reality content and obtain and show that rendering module sends synthetic input request; The request camera with captured outdoor scene data output buffers to synthetic input part, request move the augmented reality content obtain and show rendering module with the augmented reality content identification corresponding and through showing that augmented reality content output buffers that control information and terminal's status information cooperate control is to synthetic input part.
Step 710: synthetic input part buffer memory terminal camera is taken the physical world outdoor scene data of importing, and moves the augmented reality content through displaying control that the rendering module input was obtained and showed to the augmented reality content.Synthetic efferent will synthesize the outdoor scene data and the augmented reality content of input part buffer memory and synthesize processing, create the multimedia object corresponding to said augmented reality view.
Step 711: synthetic efferent exports composite signal to the terminal display screen and shows to the user, and synthetic efferent exports composite signal to storer and stores.
Step 712: synthetic input part judges that whether the augmented reality content is imported displaying and finished, if displaying finishes, then goes to step 713; If do not show to finish, then go to step 710.
Step 713: finish the synthetic processing of augmented reality view.Preferably, synthetic input part sends the buffer memory ending request to synthetic control part, and synthetic control part sends the synthetic request of disposing according to this request to the user terminal camera, finishes the input-buffer that camera is taken the outdoor scene data.
Embodiment 7
As shown in Figure 8, present embodiment provides the another kind of augmented reality view storage means flowchart that moves, and this method comprises the steps:
Step 801: mobile augmented reality view storage control module receives the interim augmented reality view storage of the user selection request that augmented reality user individual preference is provided with the module feedback of moving.
Step 802: move augmented reality view storage control module storage judging part and select request to store judgement according to said storage, storage indication portion generates storage control indication according to the storage judged result:
When selecting request to be 1, be responsible for sending augmented reality view " storage stops the control indication " to the synthetic processing module of mobile augmented reality view;
When selecting request to be 2, be responsible for sending augmented reality view " storage begins the control indication " to the synthetic processing module of mobile augmented reality view.
Step 803: carry out corresponding bank switching operation according to storage control indication classification:
If " storage stops the control indication ", then execution in step 804;
If " storage begins the control indication ", then execution in step 805.
Step 804: the synthetic processing module of mobile augmented reality view receives said storage control indication, and the synthetic input of synthetic control part transmission stops request, and synthetic input part is with no longer buffer memory augmented reality content and camera are taken outdoor scene information.After this; Moving the augmented reality content obtains and shows that the augmented reality content that rendering module will be corresponding with the augmented reality content identification directly plays up displaying at display screen; Camera is taken outdoor scene information will directly be stored to storer, store and create the corresponding multimedia object of augmented reality view with not re-using the augmented reality content of being obtained.
Step 805: move the synthetic processing module of augmented reality view and receive said storage control indication; Synthetic control part sends synthetic input and begins request; Request will be corresponding with the augmented reality content identification and show control augmented reality content down through showing that control information and terminal's status information cooperate, and the outdoor scene data output buffers that camera is taken is to synthesizing input part.Thereby carry out the augmented reality content and take the synthetic processing of outdoor scene data, and composite signal is stored to storer.
Description according to above-mentioned each embodiment can know that the AR that each embodiment operates on the portable terminal uses and can select to implement augmented reality applications relevant information the Save option flexibly according to user individual preference and/or user's context:
Only store shoot on location information, do not store AR augmented reality content;
Shoot on location information and the storage of AR augmented reality content synchronization;
According to user individual preference (content type, form, expense etc.), and/or user's context (storage space etc.), selectively stores synchronized shoot on location information and AR augmented reality content.
From above description; Can find out; The present invention has realized following technique effect: according to information-setting by user, storage preference information (like content type, form, expense etc.) and terminal's status information (like storage space etc.) stores synchronized shoot on location information and augmented reality content selectively; Solve in the prior art because the problem that the comparatively complicated user experience that causes of the storage scheme of augmented reality view descends, and then reached and flexibly, simply to carry out the effect that the augmented reality view is stored.
Obviously, it is apparent to those skilled in the art that above-mentioned each module of the present invention or each step can realize with the general calculation device; They can concentrate on the single calculation element; Perhaps be distributed on the network that a plurality of calculation element forms, alternatively, they can be realized with the executable program code of calculation element; Thereby; Can they be stored in the memory storage and carry out, and in some cases, can carry out step shown or that describe with the order that is different from here by calculation element; Perhaps they are made into each integrated circuit modules respectively, perhaps a plurality of modules in them or step are made into the single integrated circuit module and realize.Like this, the present invention is not restricted to any specific hardware and software combination.
The above is merely the preferred embodiments of the present invention, is not limited to the present invention, and for a person skilled in the art, the present invention can have various changes and variation.All within spirit of the present invention and principle, any modification of being done, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (16)

1. the storage means of an augmented reality view is characterized in that, comprising:
Obtain the augmented reality content, wherein, said augmented reality content is used for user terminal and shows the augmented reality view;
Also store multimedia object according to user's personalization preferences and user's context creation corresponding to said augmented reality view.
2. method according to claim 1 is characterized in that, comprises according to user's personalization preferences and user's context creation and the storage step corresponding to the multimedia object of said augmented reality view:
Receive the storage of augmented reality view and judge request;
Whether inquire about the augmented reality view memory module that is provided with in the said personalization preferences indicates according to said personalization preferences and said context and carries out the storage of said augmented reality view;
If then use to meet said personalization preferences and the multimedia object corresponding to said augmented reality view is created and stored to said contextual said augmented reality content; If not, then use said augmented reality content to create and store multimedia object, perhaps do not use said augmented reality content creating and storage multimedia object corresponding to said augmented reality view corresponding to said augmented reality view.
3. method according to claim 2 is characterized in that,
The step of using said augmented reality content to create and store corresponding to the multimedia object of said augmented reality view comprises:
Entity to sending said augmented reality view storage judgement request returns the storage affirmative acknowledgement, and begins the control indication to carrying out the synthetic entity transmission storage of handling of augmented reality view, is used for indication and begins said multimedia object is created and stored;
Do not use said augmented reality content creating and storage to comprise corresponding to the step of the multimedia object of said augmented reality view:
Judge that to sending said augmented reality view storage the entity of request returns the storage negative response, do not send storage and begin to control indication to the synthetic entity of handling of execution augmented reality view.
4. according to claim 2 or 3 described methods, it is characterized in that, use to meet the step that said personalization preferences and said contextual said augmented reality content create and store corresponding to the multimedia object of said augmented reality view and comprise:
Obtain the augmented reality content characteristic information relevant, judge whether said augmented reality content characteristic information meets the augmented reality view storage rule that is provided with in the said personalization preferences with said augmented reality view;
Obtain the current context of said user, judge whether said context meets the augmented reality view storage rule that is provided with in the said personalization preferences;
If said augmented reality content characteristic information and said context meet the augmented reality view storage rule that is provided with in the said personalization preferences, then use said augmented reality content to create and store multimedia object corresponding to said augmented reality view.
5. method according to claim 4 is characterized in that, judges through following steps whether said augmented reality content characteristic information and said context meet the augmented reality view storage rule that is provided with in the said personalization preferences:
Judge whether the augmented reality content characteristic of describing in the said augmented reality content characteristic information satisfies the augmented reality content characteristic that said augmented reality view storage rule allows storage; Wherein, said augmented reality content characteristic comprise following one of at least: augmented reality target type, augmented reality content multimedia type, the augmented reality size of contents content associated with said augmented reality;
Judge whether user's current context characteristic of describing in the said context satisfies the user's context characteristic that said augmented reality view storage rule allows storage; Wherein, said user's context characteristic comprise following one of at least: user terminal current residual storage space, user's current location, user terminal current residual electric weight.
6. according to claim 2 or 3 described methods, it is characterized in that the step of using said augmented reality content to create and store corresponding to the multimedia object of said augmented reality view comprises:
Augmented reality content relevant with said augmented reality view and terminal camera shooting outdoor scene data are carried out buffer memory;
According to terminal real-time status information and the control information of augmented reality content revealing the institute's augmented reality content of buffer memory and the outdoor scene data of said terminal taking are synthesized;
Exporting the synthetic data that obtain to storer stores.
7. method according to claim 6 is characterized in that, will synthesize the data that obtain when exporting storer to and storing, and also comprises:
Export the said synthetic data that obtain to terminal presentation facility.
8. according to claim 2 or 3 described methods, it is characterized in that, after the multimedia object corresponding to said augmented reality view is created and stored to the said augmented reality content of use, also comprise:
Receive the storage of augmented reality view and select request;
Select request to generate storage control indication according to said augmented reality view storage;
Begin the control indication if said storage control is designated as storage, then send the synthetic input of augmented reality content and begin request,
Begin synthetic the processing, and store said augmented reality content;
If said storage control is designated as storage and stops the control indication, then send the synthetic input of augmented reality content and stop request, stop synthetic the processing, stop to store said augmented reality content.
9. the memory storage of an augmented reality view is characterized in that, comprising:
Acquiring unit is used to obtain the augmented reality content, and wherein, said augmented reality content is used for user terminal and shows the augmented reality view;
Performance element is used for also storing the multimedia object corresponding to said augmented reality view according to user's personalization preferences and user's context creation.
10. device according to claim 9 is characterized in that, said performance element comprises:
Receiver module is used to receive the storage of augmented reality view and judges request;
Whether enquiry module is used for inquiring about augmented reality view memory module that said personalization preferences is provided with and indicates according to said personalization preferences and said context and carry out the storage of said augmented reality view;
Processing module; Be used for when the indication of said memory module is carried out the storage of said augmented reality view according to said personalization preferences and said context; Whether use said augmented reality content to create and store multimedia object according to said personalization preferences and said context determination corresponding to said augmented reality view; If then use said augmented reality content to create and store multimedia object corresponding to said augmented reality view; When the indication of said memory module is not carried out the storage of said augmented reality view according to said personalization preferences and said context; Use said augmented reality content to create and store multimedia object, perhaps do not use said augmented reality content creating and storage multimedia object corresponding to said augmented reality view corresponding to said augmented reality view.
11. device according to claim 10 is characterized in that, said processing module comprises:
First processing sub; Be used for when using said augmented reality content to create and store the multimedia object corresponding to said augmented reality view; Judge that to sending said augmented reality view storage the entity of request returns the storage affirmative acknowledgement; And send storage and begin the control indication to carrying out the synthetic entity of handling of augmented reality view, be used for indication and begin said multimedia object is created and stored;
Second processing sub; Be used for when not using said augmented reality content creating and storage corresponding to the multimedia object of said augmented reality view; Judge that to sending said augmented reality view storage the entity of request returns the storage negative response, do not send storage and begin to control indication to the synthetic entity of handling of execution augmented reality view.
12., it is characterized in that said processing module comprises according to claim 10 or 11 described devices:
First obtains submodule, is used to obtain the augmented reality content characteristic information relevant with said augmented reality view and obtains the current context of said user;
Judge submodule, be used for judging whether said augmented reality content characteristic information and said context meet the augmented reality view storage rule that said personalization preferences is provided with;
First sub module stored; Be used for when said augmented reality content characteristic information and said context meet the augmented reality view storage rule that said personalization preferences is provided with, using said augmented reality content to create and store multimedia object corresponding to said augmented reality view.
13. device according to claim 12 is characterized in that, said judgement submodule comprises:
First judges submodule; Be used for judging whether the augmented reality content characteristic that said augmented reality content characteristic information is described satisfies the augmented reality content characteristic that said augmented reality view storage rule allows storage; Wherein, Said augmented reality content characteristic comprise following one of at least: the augmented reality target type content associated, augmented reality content multimedia type, augmented reality content stores size with said augmented reality;
Second judges submodule; Be used for judging whether user's current context characteristic that said context is described satisfies the user's context characteristic that said augmented reality view storage rule allows storage; Wherein, said user's context characteristic comprise following one of at least: user terminal current residual storage space, user's current location, user terminal current residual electric weight.
14., it is characterized in that said processing module comprises according to claim 10 or 11 described devices:
Cache sub-module is used for after the said augmented reality content of use is created and store corresponding to the multimedia object of said augmented reality view, augmented reality content relevant with said augmented reality view and terminal camera shooting outdoor scene data being carried out buffer memory;
The synthon module is used for according to terminal real-time status information and the control information of augmented reality content revealing the institute's augmented reality content of buffer memory and the outdoor scene data of said terminal taking being synthesized;
Second sub module stored is used for exporting the synthetic data that obtain to storer and stores.
15. device according to claim 14 is characterized in that, said performance element also comprises:
Transport module is used for exporting the said synthetic data that obtain to terminal presentation facility.
16., it is characterized in that said processing module also comprises according to claim 10 or 11 described devices:
Second obtains submodule, is used to receive the storage of augmented reality view and selects request;
Generate submodule, be used for selecting request to generate storage control indication according to said augmented reality view storage;
The 3rd processing sub is used for when said storage control is designated as storage and begins the control indication, sending the synthetic input of augmented reality content and beginning request, begins synthetic the processing, and stores said augmented reality content;
The manages submodule everywhere, is used for when said storage control is designated as storage and stops the control indication, sending the synthetic input of augmented reality content and stopping request, stops synthetic the processing, stops to store said augmented reality content.
CN201110147806.XA 2011-05-31 2011-06-02 The storage method and device of augmented reality view Expired - Fee Related CN102810099B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110147806.XA CN102810099B (en) 2011-05-31 2011-06-02 The storage method and device of augmented reality view

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201110144725.4 2011-05-31
CN201110144725 2011-05-31
CN2011101447254 2011-05-31
CN201110147806.XA CN102810099B (en) 2011-05-31 2011-06-02 The storage method and device of augmented reality view

Publications (2)

Publication Number Publication Date
CN102810099A true CN102810099A (en) 2012-12-05
CN102810099B CN102810099B (en) 2018-04-27

Family

ID=47233806

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201110147806.XA Expired - Fee Related CN102810099B (en) 2011-05-31 2011-06-02 The storage method and device of augmented reality view
CN201110183438.4A Expired - Fee Related CN102810109B (en) 2011-05-31 2011-07-01 The storage method and device of augmented reality view

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201110183438.4A Expired - Fee Related CN102810109B (en) 2011-05-31 2011-07-01 The storage method and device of augmented reality view

Country Status (1)

Country Link
CN (2) CN102810099B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104007817A (en) * 2013-02-21 2014-08-27 Metaio有限公司 A wearable information system having at least one camera
CN105979099A (en) * 2016-06-28 2016-09-28 广东欧珀移动通信有限公司 Method and device for adding scenery in preview interface and shooting device
CN106789970A (en) * 2016-12-06 2017-05-31 邹汶坤 A kind of remote exhibition system based on AR/VR technologies
CN102810109B (en) * 2011-05-31 2018-01-09 中兴通讯股份有限公司 The storage method and device of augmented reality view
WO2020186988A1 (en) * 2019-03-18 2020-09-24 腾讯科技(深圳)有限公司 Information display method and device, terminal, and storage medium
WO2023245488A1 (en) * 2022-06-22 2023-12-28 Snap Inc. Double camera streams

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113325949A (en) * 2021-05-12 2021-08-31 车捷 XR product constitutes system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080268876A1 (en) * 2007-04-24 2008-10-30 Natasha Gelfand Method, Device, Mobile Terminal, and Computer Program Product for a Point of Interest Based Scheme for Improving Mobile Visual Searching Functionalities
US20100008265A1 (en) * 2008-07-14 2010-01-14 Carl Johan Freer Augmented reality method and system using logo recognition, wireless application protocol browsing and voice over internet protocol technology
CN101641963A (en) * 2007-03-12 2010-02-03 佳能株式会社 Head mounted image-sensing display device and composite image generating apparatus
CN102006548A (en) * 2009-09-02 2011-04-06 索尼公司 Information providing method and apparatus, information display method and mobile terminal and information providing system

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2008110056A (en) * 2005-08-15 2009-09-27 Конинклейке Филипс Электроникс Н.В. (Nl) SYSTEM, DEVICE AND METHOD FOR ADVANCED REALITY GOGGLES FOR END-USER PROGRAMMING
US20090237328A1 (en) * 2008-03-20 2009-09-24 Motorola, Inc. Mobile virtual and augmented reality system
CN102810099B (en) * 2011-05-31 2018-04-27 中兴通讯股份有限公司 The storage method and device of augmented reality view

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101641963A (en) * 2007-03-12 2010-02-03 佳能株式会社 Head mounted image-sensing display device and composite image generating apparatus
US20080268876A1 (en) * 2007-04-24 2008-10-30 Natasha Gelfand Method, Device, Mobile Terminal, and Computer Program Product for a Point of Interest Based Scheme for Improving Mobile Visual Searching Functionalities
US20100008265A1 (en) * 2008-07-14 2010-01-14 Carl Johan Freer Augmented reality method and system using logo recognition, wireless application protocol browsing and voice over internet protocol technology
CN102006548A (en) * 2009-09-02 2011-04-06 索尼公司 Information providing method and apparatus, information display method and mobile terminal and information providing system

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102810109B (en) * 2011-05-31 2018-01-09 中兴通讯股份有限公司 The storage method and device of augmented reality view
CN104007817A (en) * 2013-02-21 2014-08-27 Metaio有限公司 A wearable information system having at least one camera
CN104007817B (en) * 2013-02-21 2019-02-12 苹果公司 Wearable information system at least one video camera
CN105979099A (en) * 2016-06-28 2016-09-28 广东欧珀移动通信有限公司 Method and device for adding scenery in preview interface and shooting device
CN105979099B (en) * 2016-06-28 2019-06-04 Oppo广东移动通信有限公司 Increase the method, apparatus and photographing device of scenery in preview interface
CN106789970A (en) * 2016-12-06 2017-05-31 邹汶坤 A kind of remote exhibition system based on AR/VR technologies
WO2020186988A1 (en) * 2019-03-18 2020-09-24 腾讯科技(深圳)有限公司 Information display method and device, terminal, and storage medium
US11790612B2 (en) 2019-03-18 2023-10-17 Tencent Technology (Shenzhen) Company Limited Information display method and device, terminal, and storage medium
WO2023245488A1 (en) * 2022-06-22 2023-12-28 Snap Inc. Double camera streams

Also Published As

Publication number Publication date
CN102810109B (en) 2018-01-09
CN102810099B (en) 2018-04-27
CN102810109A (en) 2012-12-05

Similar Documents

Publication Publication Date Title
CN102810109A (en) Storing method and device for augmented reality view
CN102843349B (en) Realize the method and system, terminal and server of mobile augmented reality business
CN103369049B (en) Mobile terminal and server exchange method and system thereof
EP2690580B1 (en) Identification code processing system, identification code processing method thereof, and apparatus for supporting same
US8174561B2 (en) Device, method and program for creating and displaying composite images generated from images related by capture position
CN101911072B (en) The method searched in collection of data items
CN110084153A (en) For sharing the smart camera of picture automatically
CN102592178A (en) Information display system, information display apparatus, information provision apparatus and storage medium
CN102958114B (en) The method for accessing augmented reality user's context
CN104102429A (en) Integrated viewfinder and digital media
CN103309895A (en) Mobile augmented reality searching method, client, server and searching system
CN102843347A (en) System, method, terminal and server for achieving mobile augmented reality service
CN102958009B (en) The transmission method and mobile augmented reality server of augmented reality information
JP2011233005A (en) Object displaying device, system, and method
CN105827959A (en) Geographic position-based video processing method
CN102572183A (en) Sharing of media file including META information
TW201814553A (en) Method and system for remote management of location-based space object
KR20130024266A (en) Creation system and method for multi code, and device supporting the same
US8918087B1 (en) Methods and systems for accessing crowd sourced landscape images
KR20150064485A (en) Method for providing video regarding poi, method for playing video regarding poi, computing device and computer-readable medium
CN102592255B (en) Information display system, information display apparatus, and storage medium
JP6617547B2 (en) Image management system, image management method, and program
CN110377147B (en) Method and system for amplifying reality
CN102821145A (en) Content display method, server and client
KR100866379B1 (en) System and method for object-based online post-it service in mobile environment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180427

Termination date: 20210602