CN103729409A

CN103729409A - Method and device for generating visual scene information

Info

Publication number: CN103729409A
Application number: CN201310667637.1A
Authority: CN
Inventors: 李盘林; 杜琳
Original assignee: Beijing Zhigu Ruituo Technology Services Co Ltd
Current assignee: Beijing Zhigu Ruituo Technology Services Co Ltd
Priority date: 2013-12-10
Filing date: 2013-12-10
Publication date: 2014-04-16

Abstract

The invention provides a method and device for generating visual scene information. The method for generating the visual scene information comprises the steps of determining request information of a visual scene request according to the visual scene request, oriented towards an assigned target, of a user, obtaining a picture which is required by generation of the visual scene information of the assigned target and accords with the request information from a third party if the picture which is required by generation of the visual scene information of the assigned target and accords with the request information does not exist in stored pictures, and generating the visual scene information of the assigned target according to the obtained picture. According to the scene for generating the visual scene information, the visualization requirement of the user can be well met.

Description

Generate method and the device of Visual Scene information

Technical field

The embodiment of the present invention relates to field of computer technology, relates in particular to a kind of method and device that generates Visual Scene information.

Background technology

More and more users like checking Visual Scene information with map, such as panoramic picture, 3D figure etc.Conventionally, Map Services business gathers the picture of each place or target by specific equipment, and is kept in map data base, when user wants to check the Visual Scene information of certain target, can from map data base, transfer corresponding picture and synthesize.

But, because the picture of preserving in map data base normally gathers under certain state, such as what gather at fine day, when user wants to check under other state, during such as the Visual Scene information of certain target of rainy day, often cannot realize.

Summary of the invention

In view of this, one object of the present invention is to provide a kind of scheme that generates Visual Scene information.

For achieving the above object, according to an aspect of the present invention, provide a kind of method of Visual Scene information, comprising:

Visual Scene request according to user for intended target, determines the solicited message of described Visual Scene request;

If lack in the picture of having stored, generate the Visual Scene information picture required and that conform to described request information of described intended target, from third party, obtain the Visual Scene information picture required and that conform to described request information that generates described intended target;

According to the described picture obtaining, generate the Visual Scene information of described intended target.

For achieving the above object, according to a further aspect of the invention, provide a kind of device that generates Visual Scene information, described device comprises:

Request determination module, for the Visual Scene request for intended target according to user, determines the solicited message of described Visual Scene request;

Picture acquisition module, if lack for the picture of having stored the Visual Scene information picture required and that conform to described request information that generates described intended target, from third party, obtain the Visual Scene information picture required and that conform to described request information that generates described intended target;

Information generating module, for according to the described picture obtaining, generates the Visual Scene information of described intended target.

For achieving the above object, according to a further aspect of the invention, provide a kind of method that generates Visual Scene information, described method comprises:

If the picture of having stored comprises the Visual Scene information picture required and that conform to described request information that generates described intended target, and described in the picture that conforms to do not meet quality requirements, from third party obtain generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements;

Picture acquisition module, if comprise for the picture of having stored the Visual Scene information picture required and that conform to described request information that generates described intended target, and described in the picture that conforms to do not meet quality requirements, from third party obtain generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements;

One aspect of the present invention is by the Visual Scene request for intended target according to user, determine the solicited message of described Visual Scene request, if lack in the picture of having stored, generate the Visual Scene information picture required and that conform to described request information of described intended target, from third party, obtain the Visual Scene information picture required and that conform to described request information that generates described intended target, and according to the described picture obtaining, generate the Visual Scene information of described intended target, a kind of scheme that generates Visual Scene information is provided, and can meet preferably user's visual demand.

Accompanying drawing explanation

Fig. 1 is the process flow diagram of a kind of embodiment of the method one that generates Visual Scene information provided by the invention;

Fig. 2 is the process flow diagram of a kind of embodiment of the method two that generates Visual Scene information provided by the invention;

Fig. 3 a is the structural drawing of a kind of device embodiment mono-that generates Visual Scene information provided by the invention;

Fig. 3 b is the structural drawing of a kind of optional embodiment of Fig. 3 a illustrated embodiment;

Fig. 3 c is the structural drawing of another optional embodiment of Fig. 3 a illustrated embodiment;

Fig. 3 d is the structural drawing of another optional embodiment of Fig. 3 a illustrated embodiment;

Fig. 4 a is the structural drawing of a kind of embodiment bis-that generates Visual Scene information provided by the invention;

Fig. 4 b is the structural drawing of a kind of optional embodiment of Fig. 4 a illustrated embodiment;

Fig. 4 c is the structural drawing of another optional embodiment of Fig. 4 a illustrated embodiment;

Fig. 4 d is the structural drawing of another optional embodiment of Fig. 4 a illustrated embodiment;

Fig. 5 is the structural drawing of a kind of device embodiment tri-that generates Visual Scene information provided by the invention;

Fig. 6 is the structural drawing of a kind of device embodiment tetra-that generates Visual Scene information provided by the invention.

Embodiment

Below in conjunction with drawings and Examples, the specific embodiment of the present invention is described in further detail.Following examples are used for illustrating the present invention, but are not used for limiting the scope of the invention.

Fig. 1 is the process flow diagram of a kind of embodiment of the method one that generates Visual Scene information provided by the invention.As shown in Figure 1, described method comprises:

101, the Visual Scene request for intended target according to user, determines the solicited message of described Visual Scene request.

For instance, the present embodiment can be carried out by the device that generates Visual Scene information, the device that generates Visual Scene information can be realized with software, be arranged in the application program that map is relevant, correspondingly, user can, using a certain target in map as intended target, send Visual Scene request.Wherein, described intended target can include but not limited to: buildings, natural landscape, street, viaduct etc.

Wherein, described request information can be obtained from Visual Scene request, also can by alternate manner, obtain based on Visual Scene request.

Preferably, described request information comprise following at least one: request time, Weather information, event.Wherein, request time can be a date, such as on October 1st, 2013, can be also a time point or time period, such as 10 thirty of the morning, the mornings 10 to 11 point, October etc., can be also a kind of time attribute, such as the morning, winter etc.Weather information is used to indicate weather category, such as cloudy, fine, rain, snow, mist, haze etc.Event includes but not limited to: all kinds of activities and performance etc., and such as temple fair, gala parade, autographed copy sale, theatrical evening etc.

For instance, in the optional scene of one, when user wants to check the Visual Scene information of intended target in certain time, user can set corresponding request time in Visual Scene request, this request time can be current time, can be also At All Other Times; In another optional scene, when user wants to check the Visual Scene information of intended target under certain weather conditions, user can set corresponding Weather information in Visual Scene request; In another optional scene, when user wants to check the Visual Scene information of intended target when there is certain event, user can set corresponding event in Visual Scene request.

In the optional embodiment of one, the described Visual Scene request for intended target according to user, determine and comprise the solicited message of described Visual Scene request:

By receiving user, for the time of the Visual Scene request of intended target, be defined as the request time in described request information; Or,

The request time that user in described Visual Scene request is set is defined as the request time in described request information.

Wherein, by receiving user, for the time of the Visual Scene request of intended target, be defined as request time, be equivalent to using current time as request time.And the request time that in Visual Scene request, user sets can be current time, can be also At All Other Times.

It should be noted that, except above-mentioned two kinds of modes, to also have other mode to determine request time.For instance, the event that can set in Visual Scene request according to user, inquiry obtains the time that described event occurs in described intended target periphery certain limit, and using this time as request time, wherein, inquiry specifically can realize by search public information data storehouse.

In another optional embodiment, the described Visual Scene request for intended target according to user, determine and comprise the solicited message of described Visual Scene request:

The Weather information that user in described Visual Scene request is set is defined as the Weather information in described request information; Or,

According to described intended target and described request time, during by the described request time described in the Weather information at intended target place be defined as the Weather information in described request information.

Wherein, while determining the described request time described in the Weather information at intended target place, can have multiple implementation, such as inquiry meteorogical phenomena database.

The event that user in described Visual Scene request is set is defined as the event in described request information; Or,

According to described intended target and described request time, the event occurring in during by the described request time in described intended target periphery certain limit is defined as the event in described request information.

Wherein, while determining the described request time, occur in the event in described intended target periphery certain limit, can have multiple implementation, such as inquiry public information data storehouse.Wherein, described intended target periphery certain limit is what kind of scope on earth, can be set by user, or, according to the configuration of acquiescence, set.For instance, described intended target periphery certain limit can be centered by described intended target, 20 meters of scopes that are radius.Conventionally, in described intended target periphery certain limit, event has impact to the Visual Scene information of described intended target.

If lack in 102 pictures of having stored, generate the Visual Scene information picture required and that conform to described request information of described intended target, from third party, obtain the Visual Scene information picture required and that conform to described request information that generates described intended target.

Wherein, Visual Scene information includes but not limited to: panoramic picture, 3D figure etc.Conventionally, panoramic picture is the image of the peripheral region that can see in intended target place of subscriber station, and wherein, peripheral region is preferably the region that horizontal direction 360 degree centered by intended target and vertical direction 360 are spent; 3D figure is the figure in each region of the intended target that can see around intended target of user, and wherein, each region preferably includes the All Ranges of described intended target.Correspondingly, when described Visual Scene request is panoramic picture request, described Visual Scene information is scene image; When described Visual Scene request is the request of 3D figure, described Visual Scene information is 3D figure.

Conventionally, generate the Visual Scene informational needs plurality of pictures of intended target.For instance, the picture of the peripheral region that the panoramic picture of generation intended target need to be taken conventionally in described intended target periphery certain limit, the 3D figure that generates intended target needs the picture of the regional of described intended target conventionally.

In the scene of panoramic picture, store together with picture usually used as the label of picture the spot for photography of picture, spot for photography can obtain by obtaining locator data when the pictures taken, also can obtain by later stage picture processing, and the present embodiment does not limit this.Further, the label of picture can also comprise the event in weather and/or the picture in shooting time, picture.For instance, the label of picture can comprise spot for photography and shooting time simultaneously, or, comprise the weather in spot for photography and picture simultaneously, or, comprise the event in spot for photography and picture simultaneously, or, comprise the weather in spot for photography, shooting time, picture simultaneously, or, comprise the event in spot for photography, shooting time, picture simultaneously, or, comprise the event in weather, the picture in spot for photography, picture simultaneously, or, comprise the event in weather, the picture in spot for photography, shooting time, picture simultaneously.

In the scene of 3D figure, the object of picture is stored together with picture as the label of picture, and the object of picture can be by identifying and obtain the content of picture, can be also to obtain according to user's input; The object of picture can be the reference object of this picture, and the focus of taking, can not be also reference object, but other object of the reference object periphery of the picture that is ingested; One pictures can comprise one or more objects, correspondingly, has one or more object tag, and the present embodiment does not limit this.Further, the label of picture can also comprise the event in weather and/or the picture in shooting time, picture.For instance, the label of picture can comprise object and the shooting time of picture simultaneously, or, comprise the weather in object and the picture of picture simultaneously, or, comprise the event in object and the picture of picture simultaneously, or, comprise the object of picture simultaneously, shooting time, weather in picture, or, comprise the object of picture simultaneously, shooting time, event in picture, or, comprise the object of picture simultaneously, weather in picture, event in picture, or, comprise the object of picture simultaneously, shooting time, weather in picture, event in picture.

Can generate again in the scheme of 3D rendering by generating panorama image, the label of the picture of having stored can comprise the spot for photography of picture and the object of picture simultaneously, further, also comprise the event in weather and/or the picture in shooting time, picture, the present embodiment does not limit this.

Correspondingly, can whether whether conform to request time, Weather information and/or event in described request information respectively according to the event in weather and/or picture in the shooting time of picture, picture, to judge whether described picture conforms to solicited message.

Further, judge that picture has nothing in common with each other with the method that in solicited message, whether each information conforms to.Particularly, for Weather information, can judge whether to conform to according to whether the weather category of the weather in picture and Weather information indication in solicited message is identical.For event, can judge whether to conform to according to whether the event in picture and event in solicited message be identical.

For request time, can be according to the shooting time of picture, judge whether described picture conforms to the described request time.Preferably, can according to the time period under the shooting time of picture whether with the described request time under the time period whether conform to judge.Correspondingly, when described request information comprises the described request time, described method also comprises:

If the time period did not conform to the affiliated time period of described request time under the shooting time of the picture of having stored, the picture of having stored described in determining does not conform to described request information.

Wherein, the time period can hour, day, month or season etc. be unit.For instance, when request time is at 9 in the morning, can think under shooting time that the time period is that the picture that the morning, 8-10 was ordered all conforms to this request time; When request time is on July 10th, 2012, can think that time period under shooting time is that the picture in 2011,2012 or 5 days-July 15 July in 2013 all conforms to this request time, and/or, think that the picture that the affiliated time period of shooting time is July all conforms to this request time, and/or, think that the picture that the affiliated time period of shooting time is summer all conforms to this request time.The present embodiment is not construed as limiting this.

Alternatively, in the picture of having stored, according to type and the solicited message of intended target, Visual Scene information, search Target Photo.For instance, in panoramic picture request user to have set request time be on July 10th, 2012, do not set Weather information and event, in described intended target periphery certain limit, take and shooting time be that the picture on July 10th, 2012 is Target Photo.Further, in order to expand the scope of Target Photo, the solicited message that can also set according to user be determined other solicited message, then searches the picture that the solicited message set with user and/or definite other solicited message conform to.For instance, in panoramic image scene request user to have set request time be on October 1st, 2013, do not set Weather information and event, the Weather information that can determine described intended target on October 1 place in 2013 is fine day, the event occurring in intended target periphery certain limit is parade on National Day, thereby in the picture of taking in intended target periphery certain limit according on October 1st, 2013 and/or fine day, National Day, Target Photo was searched in parade, such as what take in described intended target periphery certain limit, and shooting time is that the picture on October 1st, 2013 is Target Photo, the picture of the parade on National Day of the fine day of taking in described intended target periphery certain limit on October 1st, 2012 is also Target Photo.

Again for instance, in the request of 3D figure user to have set request time be on July 10th, 2012, do not set Weather information and event, shooting time is that the picture of the described intended target on July 10th, 2012 is Target Photo.Further, in order to expand the scope of Target Photo, the solicited message that can also set according to user be determined other solicited message, then searches the picture that the solicited message set with user and/or definite other solicited message conform to.For instance, in the request of 3D figure user to have set request time be on October 1st, 2013, do not set Weather information and event, the Weather information that can determine described intended target on October 1 place in 2013 is fine day, the event occurring in intended target periphery certain limit is parade on National Day, thereby in the picture of intended target according on October 1st, 2013 and/or fine day, National Day, Target Photo was searched in parade, such as the picture of the described intended target of taking on October 1st, 2013 is Target Photo, the fine day that on October 1st, 2012 takes, in described intended target periphery certain limit, at the picture of parade on National Day, be just also Target Photo.

In the present embodiment, the picture of intended target refers to that object comprises the picture of described intended target, particularly, can be to comprise described intended target entirety, can be also the part that comprises described intended target.

Further, in Target Photo, search and generate the required picture of Visual Scene information, such as, if want generating panorama image, in Target Photo, search the picture in each region around intended target, if generate 3D figure, in Target Photo, search the picture in each region of intended target, as the Visual Scene information picture required and that conform to solicited message that generates described intended target.

In the optional embodiment of one, because there is regular hour scope the time period, even have certain periodicity, the view in intended target periphery certain limit may change in the meantime, causes the Visual Scene information of intended target also can change.For the Visual Scene information of the demand of being more close to the users is provided, more preferably, described request information also comprises: view changes.Particularly, view changes and can include but not limited to: sign changes, buildings changes, condition variation etc.; Wherein, sign changes and comprises the variation of Sign Board, billboard etc., and buildings changes newly-built, the trimming, dismounting etc. that comprise buildings, and ground condition changes the variation that comprises road, overline bridge etc.Conventionally, described view changes can be according to intended target, or intended target and request time are determined.Wherein, determine that described view variation can have multiple implementation, such as inquiry public information data storehouse.

Particularly, when determine that the view variation in solicited message also has multiple choices.In the optional embodiment of one, first according to the out of Memory except view changes in solicited message, in the picture of having stored, search, find out the Visual Scene information picture required and that conform to described out of Memory that generates described intended target, then determine and between the shooting time of the picture having found and request time, whether exist view to change, whether the view when judging request time in the Visual Scene information of intended target is different during with respect to the shooting time of the picture having found, thereby the view while filtering out shooting time in the Visual Scene information of intended target during with request time identical picture as the Visual Scene information picture required and that conform to described request information that generates described intended target.In another optional embodiment, first according to the view in the request time in solicited message and intended target periphery certain limit, change, the identical time period of view while determining with request time in the Visual Scene information of intended target, then at the shooting time of having stored, in the picture of described identical time period, search, find out generate the Visual Scene information of described intended target required and with the picture conforming to the out of Memory request time except described view variation in solicited message, as the Visual Scene information picture required and that conform to described request information that generates described intended target.

For instance, if after the shooting time of the required picture of the Visual Scene information of the described intended target of generation of having stored, before request time, in intended target periphery certain limit how some billboards, and this can affect the Visual Scene information of intended target, if only generate the Visual Scene information of intended target according to the required picture of the Visual Scene information of the described intended target of generation of having stored, in the Visual Scene information generating, there is no these billboards, want to see with user request time time Visual Scene information variant, adopt the method for the present embodiment can avoid this situation.

Alternatively, described in 102, from third party, obtain the Visual Scene information picture required and that conform to described request information that generates described intended target, comprising:

To third party, send picture request, described picture request is for asking to generate the Visual Scene information picture required and that conform to described request information of described intended target;

Receive the Visual Scene information picture required and that conform to described request information of the described intended target of generation that described third party returns.

Wherein, third party can be any communication facilities, such as computer, mobile phone etc.Particularly, the mode that sends picture request also can have multiple, such as by social networks transmission etc.Alternatively, described picture request carries described request information, is used to indicate the information of described intended target and is used to indicate the information of the type of Visual Scene information.

Under the described request time scene that is current time, alternatively, describedly to third party, send picture request and comprise:

Third party in described intended target periphery certain limit sends the request of shooting, and described shooting request is for asking described third party to take the required picture of Visual Scene information that generates described intended target.

Wherein, the request of taking is equivalent to a kind of special picture request.Because request time is current time, the picture of current shooting conforms to request time, and weather, event when in the picture of current shooting, weather, event are all with request time conform to, therefore, can ask third party in described intended target periphery certain limit to take and return the picture of shooting.

It should be noted that, under the described request time scene that is current time, even if be not that the picture of current shooting also may conform to request time, therefore, also can the third party outside described intended target periphery certain limit send picture request.

More preferably, the picture that described third party returns is asked picture, generates the Visual Scene information picture required and that conform to described request information of described intended target.Certainly, the picture that third party returns may not conform to solicited message, or, not that the Visual Scene information of the described intended target of generation is required.Preferably, after the picture returning the described third party of described reception, can also judge whether the picture that described third party returns is the Visual Scene information picture required and that conform to described request information that generates described intended target.

It should be noted that, no matter whether the picture that described third party returns is the Visual Scene information picture required and that conform to described request information that generates described intended target, preferably, can store described picture after receiving the picture that described third party returns, so that follow-up use.

Conventionally, third party can have multiple, correspondingly, can to multiple third parties, send picture request simultaneously, also can be in a certain order, such as priority orders, first to first third party, send picture request, the picture returning described first third party of judgement is not while generating the Visual Scene information picture required and that conform to described request information of described intended target, can send picture request to second third party, until receive the Visual Scene information picture required and that conform to described request information of the described intended target of generation that certain third party returns, or, until traversal is over, all third parties do not get asked picture yet.

In a kind of possible scene, third party for various reasons, such as do not receive request, shoot function fault etc. due to communication issue, do not return to picture, or, the picture returning is not the Visual Scene information picture required and that conform to described request information that generates described intended target, correspondingly, described after third party sends picture request, also comprise:

The Visual Scene information picture required and that conform to described request information of the described intended target of generation that described third party returns if do not receive within a certain period of time, generates the Visual Scene information of described intended target according to the described picture of having stored;

Present described Visual Scene information, and point out variant.

Wherein, how long certain hour specifically can be set by the user, or, according to the configuration of acquiescence, set, such as, be made as 10 seconds.More preferably, the time span of this certain hour is taken into account third-party treatment effeciency and user's experience.

Wherein, the presentation mode of described Visual Scene information can have multiple, such as, being directly presented on the above intended target place of map, to be presented on the wicket superposeing on map medium, the present embodiment does not limit this.Further, point out discrepant mode also can have multiple, such as, point out, process that described Visual Scene information is pointed out etc. with special color with prompting message, further, can also point out concrete difference, with solicited message do not conform to part be what or at which, the present embodiment is not construed as limiting this.

103,, according to the described picture obtaining, generate the Visual Scene information of described intended target.

More preferably, after the Visual Scene information of the described intended target of described generation, also comprise: present described Visual Scene information.Wherein, the presentation mode of described Visual Scene information can have multiple, such as, being directly presented on the above intended target place of map, to be presented on the wicket superposeing on map medium, the present embodiment does not limit this.

In a kind of scene, in the picture of having stored, there is the picture of the Visual Scene information subregion required and that conform to described request information that generates described intended target, and lack the picture in Visual Scene information other region required and that conform to described request information that generates described intended target, under this scene, in a kind of optional embodiment, only need obtain from third party the picture in described other region.Particularly, 102 comprise:

If lack in the picture of having stored, generate the picture of the Visual Scene information subregion required and that conform to described request information of described intended target, from third party, obtain the picture of the Visual Scene information described subregion required and that conform to described request information that generates described intended target.

Particularly, when sending picture request to described third party or taking request, can specify required described subregion, so that described third party provides the picture of described subregion targetedly.

Correspondingly, 103 comprise: according to the Visual Scene information of the picture of the described subregion obtaining and the described intended target of generation of storing picture required and that conform to described request information, generate the Visual Scene information of described intended target.

In another optional embodiment under above-mentioned scene, even if there is the picture of the Visual Scene information subregion required and that conform to described request information that generates described intended target in the picture of having stored, also can be not limited to the picture that only obtains other region from third party, correspondingly, when also having the picture of the Visual Scene information described subregion required and that conform to described request information that generates described intended target the picture obtaining from third party, the quality of the picture of the described subregion that the picture of the described subregion that can more store and described third party provide, with select quality preferably picture generate the Visual Scene information of described intended target.Wherein, the quality of picture can be by a class or multiclass because of usually embodiment, light conditions (for example whether glistening, the distribution mode of multiple flashlamp etc.) during such as the shooting angle of the focusing of the resolution of picture, picture, picture, picture shooting when the overlay area of the focal length of camera or visual angle, picture, picture shooting etc.

In a kind of possible scene, the picture of having stored does not lack the Visual Scene information picture required and that conform to described request information that generates described intended target, particularly, the picture of having stored comprises the picture of the Visual Scene information regional required and that conform to described request information that generates described intended target, correspondingly, a kind of optional embodiment is that picture required and that conform to described request information generates the Visual Scene information of described intended target according to the Visual Scene information of the described intended target of generation of having stored.The present embodiment does not limit this.

It should be noted that, for panoramic picture, in the present embodiment, specifically can adopt the synthetic scheduling algorithm of panoramic pictures splicing or method, for example Richard Szeliski.2006.Image alignment and stitching:a tutorial.Found.Trends.Comput.Graph.Vis.2,1 (January2006), the method for introducing in 1-104. generates.For 3D figure, in the present embodiment, specifically can adopt from motion calculation structure (Structure from motion, be called for short SFM) scheduling algorithm or method, for example Noah Snavely, Steven M.Seitz, Richard Szeliski.Modeling the World from Internet Photo Collections.International Journal of Computer Vision, the method for introducing in 2007 generates.

The present embodiment is by the Visual Scene request for intended target according to user, determine the solicited message of described Visual Scene request, if lack in the picture of having stored, generate the Visual Scene information picture required and that conform to described request information of described intended target, from third party, obtain the Visual Scene information picture required and that conform to described request information that generates described intended target, and according to the described picture obtaining, generate the Visual Scene information of described intended target, a kind of scheme that generates Visual Scene information is provided, and can meet preferably user's visual demand.

Fig. 2 is the process flow diagram of a kind of embodiment of the method two that generates Visual Scene information provided by the invention.As shown in Figure 2, the present embodiment comprises:

201, the Visual Scene request for intended target according to user, determines the solicited message of described Visual Scene request.

If 202 pictures of having stored comprise the Visual Scene information picture required and that conform to described request information that generates described intended target, and described in the picture that conforms to do not meet quality requirements, from third party obtain generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements.

Particularly, when determine that the view variation in solicited message also has multiple choices.In the optional embodiment of one, first according to the out of Memory except view changes in solicited message, in the picture of having stored, search, find out the Visual Scene information picture required and that conform to described out of Memory that generates described intended target, then determine and between the shooting time of the picture having found and request time, whether exist view to change, whether the view when judging request time in the Visual Scene information of intended target is different with respect to the shooting time of the picture having found, thereby the view while filtering out shooting time in the Visual Scene information of intended target during with request time identical picture as the Visual Scene information picture required and that conform to described request information that generates described intended target.In another optional embodiment, first according to the view in the request time in solicited message and intended target periphery certain limit, change, the identical time period of view while determining with request time in the Visual Scene information of intended target, then at the shooting time of having stored, in the picture of described identical time period, search, find out generate the Visual Scene information of described intended target required and with the picture conforming to the out of Memory request time except described view variation in solicited message, as the Visual Scene information picture required and that conform to described request information that generates described intended target.

Further, judge whether the Visual Scene information picture required and that conform to solicited message that generates described intended target meets quality requirements.Wherein, quality requirements can be set by user, or, according to the configuration of acquiescence, set.Particularly, the quality of picture can be by a class or multiclass because of usually embodiment, such as the resolution of picture, the focusing of picture, the shooting angle of picture, the focal length of camera or visual angle during picture shooting, the overlay area of picture, whether light conditions during picture shooting (for example glistens, the distribution mode of multiple flashlamp etc.) etc., thereby judge whether picture meets quality requirements, such as the resolution and the difference that generates the required resolution of Visual Scene information of picture, the focusing of picture and the difference that generates the required focusing of Visual Scene information, the shooting angle of picture and the difference that generates the required angle of Visual Scene information, the difference at the focal length of camera or visual angle and the required focal length of generation Visual Scene information or visual angle during picture shooting, the overlay area of picture and the difference that generates the required overlay area of Visual Scene information, whether light conditions during picture shooting (for example glistens, the distribution mode of multiple flashlamp etc.) whether meet the demands with the difference etc. of other picture for generating Visual Scene information.

Alternatively, described in 202 from third party obtain generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements, comprising:

To third party, send picture request, described picture request for ask to generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements;

The Visual Scene information that receives the described intended target of generation that described third party returns is required, conform to described request information and meet the picture of quality requirements.

Wherein, third party can be any communication facilities, such as computer, mobile phone etc.Particularly, the mode that sends picture request also can have multiple, such as by social networks transmission etc.Alternatively, described picture request carry described request information, be used to indicate described intended target information, be used to indicate information and the quality requirements of the type of Visual Scene information.

To the third party in described intended target periphery certain limit, send the request of shooting, described shooting request is for asking described third party to take to generate the Visual Scene information of described intended target required and meet the picture of quality requirements.

More preferably, the picture that described third party returns is asked picture, and the Visual Scene information that generates described intended target is required, conform to described request information and meet the picture of quality requirements.Certainly, the picture that third party returns also may not conform to solicited message, or, not that the Visual Scene information of the described intended target of generation is required, or, do not meet quality requirements.Preferably, after the picture returning the described third party of described reception, can also judge picture that described third party returns be whether generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements.

It should be noted that, though the picture that described third party returns be whether generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements, preferably, after receiving the picture that described third party returns, can store described picture, so that follow-up use.

Conventionally, third party can have multiple, correspondingly, can to multiple third parties, send picture request simultaneously, also can be in a certain order, such as priority orders, first to first third party, send picture request, the picture returning described first third party of judgement is not that the Visual Scene information of the described intended target of generation is required, when conforming to described request information and meeting the picture of quality requirements, can send picture request to second third party, until it is required to receive the Visual Scene information of the described intended target of generation that certain third party returns, conform to described request information and meet the picture of quality requirements, or, until traversal is over, all third parties do not get asked picture yet.

In a kind of possible scene, third party for various reasons, such as do not receive request, shoot function fault etc. due to communication issue, do not return to picture, or, the picture returning be not generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements, correspondingly, described after third party sends picture request, also comprise:

The Visual Scene information of the described intended target of generation that described third party returns if do not receive is within a certain period of time required, conform to described request information and meet the picture of quality requirements, according to the described picture of having stored, generates the Visual Scene information of described intended target;

Present described Visual Scene information, and prompting does not meet quality requirements.

Wherein, the presentation mode of described Visual Scene information can have multiple, such as, being directly presented on the above intended target place of map, to be presented on the wicket superposeing on map medium, the present embodiment does not limit this.Further, the mode that prompting does not meet quality requirements also can have multiple, such as, with prompting message, to point out, with special color, process that described Visual Scene information is pointed out etc., the present embodiment is not construed as limiting this.

203,, according to the described picture obtaining, generate the Visual Scene information of described intended target.

More preferably, after the Visual Scene information of the described intended target of described generation, also comprise:

Present described Visual Scene information.

Wherein, the presentation mode of described Visual Scene information can have multiple, such as, being directly presented on the above intended target place of map, to be presented on the wicket superposeing on map medium, the present embodiment does not limit this.

In a kind of scene, in the picture of having stored, there is the Visual Scene information of the described intended target of generation required, conform to described request information and meet the picture of the subregion of quality requirements, and lack, generate Visual Scene information other region required, that conform to described request information of described intended target and the picture that meets quality requirements, under this scene in a kind of optional embodiment, only need obtain from third party the picture in described other region, particularly, 202 comprise:

The Visual Scene information that generates described intended target if lack in the picture of having stored is required, conform to described request information and meet the picture of the subregion of quality requirements, from third party obtain generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of the described subregion of quality requirements.

Correspondingly, 203 comprise:

Required with the Visual Scene information of the described intended target of generation of storing according to the picture of the described subregion obtaining, conform to described request information and meet the picture of quality requirements, generate the Visual Scene information of described intended target.

In another optional embodiment under above-mentioned scene, even if exist the Visual Scene information of the described intended target of generation required in the picture of having stored, conform to described request information and meet the picture of the subregion of quality requirements, also can be not limited to the picture that only obtains other region from third party, correspondingly, when also having the picture obtaining from third party, the Visual Scene information of the described intended target of generation is required, when conforming to described request information and meeting the picture of described subregion of quality requirements, the quality of the picture of the described subregion that the picture of the described subregion that can more store and described third party provide, with select quality preferably picture generate the Visual Scene information of described intended target.

In a kind of possible scene, in the picture of having stored, do not lack that to generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements, particularly, the picture of having stored comprises that to generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of the regional of quality requirements, correspondingly, a kind of optional embodiment is, required according to the Visual Scene information of the described intended target of generation of having stored, the picture conforming to described request information and meet quality requirements generates the Visual Scene information of described intended target.The present embodiment does not limit this.

The present embodiment is by the Visual Scene request for intended target according to user, determine the solicited message of described Visual Scene request, at the picture of having stored, comprise the Visual Scene information picture required and that conform to described request information that generates described intended target, and described in the picture that conforms to do not meet in the situation of quality requirements, the Visual Scene information of obtaining the described intended target of generation from third party is required, conform to described request information and meet the picture of quality requirements, and according to the described picture obtaining, generate the Visual Scene information of described intended target, a kind of scheme that generates Visual Scene information is provided, can meet preferably user's visual demand, can guarantee further the display effect of Visual Scene information.

Fig. 3 a is the structural drawing of a kind of device embodiment mono-that generates Visual Scene information provided by the invention.As shown in Figure 3 a, device 300 comprises:

Request determination module 31, for the Visual Scene request for intended target according to user, determines the solicited message of described Visual Scene request;

Picture acquisition module 32, if lack for the picture of having stored the Visual Scene information picture required and that conform to described request information that generates described intended target, from third party, obtain the Visual Scene information picture required and that conform to described request information that generates described intended target;

Information generating module 33, for according to the described picture obtaining, generates the Visual Scene information of described intended target.

Device 300 in the present embodiment can be realized with software, is arranged in the application program that map is relevant, and correspondingly, user can, using a certain target in map as intended target, send Visual Scene request.Wherein, described intended target can include but not limited to: buildings, natural landscape, street, viaduct etc.

Wherein, described request information can ask determination module 31 to obtain from Visual Scene request, also can ask determination module 31 based on Visual Scene request by alternate manner, obtain.

In the optional embodiment of one, request determination module 31 specifically for: by receiving user, for the time of the Visual Scene request of intended target, be defined as the request time in described request information; Or the request time that user in described Visual Scene request is set is defined as the request time in described request information.

Wherein, request determination module 31 is defined as request time by receiving user for the time of the Visual Scene request of intended target, is equivalent to using current time as request time.And the request time that in Visual Scene request, user sets can be current time, can be also At All Other Times.

It should be noted that, except above-mentioned two kinds of modes, request determination module 31 also has other mode to determine request time.For instance, the event that request determination module 31 can be set according to user, inquiry obtains the time that described event occurs in described intended target periphery certain limit, and using this time as request time, wherein, inquiry specifically can realize by search public information data storehouse.

In another optional embodiment, request determination module 31 specifically for: by described Visual Scene request user set Weather information be defined as the Weather information in described request information; Or, according to described intended target and described request time, during by the described request time described in the Weather information at intended target place be defined as the Weather information in described request information.

Wherein, when request determination module 31 is determined the described request time described in the Weather information of intended target, can have multiple implementation, such as inquiry meteorogical phenomena database.

In another optional embodiment, request determination module 31 specifically for: by described Visual Scene request user set event be defined as the event in described request information; Or according to described intended target and described request time, the event occurring in during by the described request time in described intended target periphery certain limit is defined as the event in described request information.

Wherein, request determination module 31 occurs in the event in described intended target periphery certain limit while determining the described request time, can have multiple implementation, such as inquiry public information data storehouse.Wherein, described intended target periphery certain limit is what kind of scope on earth, can be set by user, or, according to the configuration of acquiescence, set.For instance, described intended target periphery certain limit can be centered by described intended target, 20 meters of scopes that are radius.Conventionally, in described intended target periphery certain limit, event has impact to the Visual Scene information of described intended target.

Correspondingly, as shown in Figure 3 b, in the optional embodiment of one of the present embodiment, device 300 also comprises: picture screening module 34, for whether whether conforming to request time, Weather information and/or event in described request information respectively according to the event in the weather of the shooting time of picture, picture and/or picture, judge whether described picture conforms to solicited message.

Further, picture screening module 34 judges that picture has nothing in common with each other with the method that in solicited message, whether each information conforms to.Particularly, for Weather information, whether weather category that picture screening module 34 can be indicated with Weather information in solicited message according to the weather in picture is identical judges whether to conform to.For event, picture screening module 34 can judge whether to conform to according to whether the event in picture and event in solicited message be identical.

For request time, picture screening module 34 can be according to the shooting time of picture, judges whether described picture conforms to the described request time.Preferably, picture screening module 34 can according to the time period under the shooting time of picture whether with the described request time under the time period whether conform to judge.Correspondingly when described request information comprises the described request time, picture screening module 34 specifically for: if under the shooting time of the picture of having stored under time period and described request time the time period do not conform to, the picture of having stored described in definite does not conform to described request information.

Wherein, the time period can hour, day, month or season etc. be unit.For instance, when request time is at 9 in the morning, picture screening module 34 can think under shooting time that the time period is that the picture that the morning, 8-10 was ordered all conforms to this request time; When request time is on July 10th, 2012, picture screening module 34 can think that time period under shooting time is that the picture in 2011,2012 or 5 days-July 15 July in 2013 all conforms to this request time, and/or, picture screening module 34 thinks that the picture that the affiliated time period of shooting time is July all conforms to this request time, and/or picture screening module 34 thinks that the picture that the affiliated time period of shooting time is summer all conforms to this request time.The present embodiment is not construed as limiting this.

Alternatively, in the picture of having stored, picture screening module 34 is searched Target Photo according to type and the solicited message of intended target, Visual Scene information.For instance, in panoramic picture request user to have set request time be on July 10th, 2012, do not set Weather information and event, in described intended target periphery certain limit, take and shooting time be that the picture on July 10th, 2012 is Target Photo.Further, in order to expand the scope of Target Photo, the solicited message that request determination module 31 can also be set according to user be determined other solicited message, and correspondingly, picture screening module 34 is searched the picture that the solicited message set with user and/or other definite solicited message conform to.For instance, in panoramic picture request user to have set request time be on October 1st, 2013, do not set Weather information and event, ask determination module 31 can determine that the Weather information at described intended target on October 1 place in 2013 is fine day, the event occurring in intended target periphery certain limit is parade on National Day, thereby in the picture that picture screening module 34 is taken in described intended target periphery certain limit according on October 1st, 2013 and/or fine day, National Day, Target Photo was searched in parade, such as what take in described intended target periphery certain limit, and shooting time is that the picture on October 1st, 2013 is and Target Photo, the picture of the parade on National Day of the fine day of taking in described intended target periphery certain limit on October 1st, 2012 is also Target Photo.

Again for instance, in the request of 3D figure user to have set request time be on July 10th, 2012, do not set Weather information and event, shooting time is that the picture of the described intended target on July 10th, 2012 is Target Photo.Further, in order to expand the scope of Target Photo, the solicited message that request determination module 31 can also be set according to user be determined other solicited message, and correspondingly, picture screening module 34 is searched the picture that the solicited message set with user and/or other definite solicited message conform to.For instance, in the request of 3D figure user to have set request time be on October 1st, 2013, do not set Weather information and event, ask determination module 31 can determine that the Weather information at described intended target on October 1 place in 2013 is fine day, the event occurring in intended target periphery certain limit is parade on National Day, thereby picture screening module 34 in the picture of intended target according on October 1st, 2013 and/or fine day, National Day, Target Photo was searched in parade, such as the picture of the described intended target of taking on October 1st, 2013 is Target Photo, the fine day that on October 1st, 2012 takes, in described intended target periphery certain limit, at the picture of parade on National Day, be just also Target Photo.

Further, picture screening module 34 is searched and is generated the required picture of Visual Scene information in Target Photo, such as, if want generating panorama image, in Target Photo, search the picture in each region around intended target, if generate 3D figure, in Target Photo, search the picture in each region of intended target, as the Visual Scene information picture required and that conform to solicited message that generates described intended target.

In the optional embodiment of one, because there is regular hour scope the time period, even have certain periodicity, the view in intended target periphery certain limit may change in the meantime, causes the Visual Scene information of intended target also can change.For the Visual Scene information of the demand of being more close to the users is provided, more preferably, described request information also comprises: view changes.Particularly, view changes and can include but not limited to: sign changes, buildings changes, condition variation etc.; Wherein, sign changes and comprises the variation of Sign Board, billboard etc., and buildings changes newly-built, the trimming, dismounting etc. that comprise buildings, and ground condition changes the variation that comprises road, overline bridge etc.Conventionally, described view changes can be according to intended target, or intended target and request time are determined.Wherein, request determination module 31 determines that described view variation can have multiple implementation, such as inquiry public information data storehouse.

Particularly, when request determination module 31 determines that the view variation in solicited message also has multiple choices.In the optional embodiment of one, picture screening module 34 is first searched in the picture of having stored according to the out of Memory except view changes in solicited message, find out the Visual Scene information picture required and that conform to described out of Memory that generates described intended target, then ask determination module 31 to be determined and between the shooting time of the picture having found and request time, whether exist view to change, whether the view when judging request time in the Visual Scene information of intended target is different during with respect to the shooting time of the picture having found, thereby thereby identical picture is as the Visual Scene information picture required and that conform to described request information of the described intended target of generation when when picture screening module 34 filters out shooting time, the view in the Visual Scene information of intended target is with request time.In another optional embodiment, request determination module 31 first changes according to the request time in solicited message and the view in intended target periphery certain limit, the identical time period of view while determining with request time in the Visual Scene information of intended target, then picture screening module 34 is searched in the picture of described identical time period at the shooting time of having stored, find out generate the Visual Scene information of described intended target required and with the picture conforming to the out of Memory request time except described view variation in solicited message, as the Visual Scene information picture required and that conform to described request information that generates described intended target.

As shown in Figure 3 c, in the optional embodiment of one of the present embodiment, picture acquisition module 32 comprises:

Transmitting element 321, if lack for the picture of having stored the Visual Scene information picture required and that conform to described request information that generates described intended target, to third party, send picture request, described picture request is for asking to generate the Visual Scene information picture required and that conform to described request information of described intended target;

Receiving element 322, for receiving the Visual Scene information picture required and that conform to described request information of the described intended target of generation that described third party returns.

Wherein, third party can be any communication facilities, such as computer, mobile phone etc.Particularly, the mode that transmitting element 321 sends picture request also can have multiple, such as by social networks transmission etc.Alternatively, described picture request carries described request information, is used to indicate the information of described intended target and is used to indicate the information of the type of Visual Scene information.

Under the described request time scene that is current time, alternatively, transmitting element 321 specifically for: to the third party in described intended target periphery certain limit, send the request of shooting, described shooting request is for asking described third party to take the required picture of Visual Scene information that generates described intended target.

Wherein, the request of taking is equivalent to a kind of special picture request.Because request time is current time, the picture of current shooting conforms to request time, and weather, event when in the picture of current shooting, weather, event are all with request time conform to, therefore, picture acquisition module 32 can ask third party in described intended target periphery certain limit to take and return the picture of shooting.

It should be noted that, under the described request time scene that is current time, even if the picture that is not current shooting also may conform to request time, therefore, transmitting element 321 also can the third party outside described intended target periphery certain limit send picture request.

More preferably, the picture that receiving element 322 receives, the picture that described third party returns is asked picture, generates the Visual Scene information picture required and that conform to described request information of described intended target.Certainly, the picture that receiving element 322 receives also may not conform to solicited message, or, not that the Visual Scene information of the described intended target of generation is required.Preferably, after the picture that picture screening module 34 can also receive at receiving element 322, judge whether the picture that receiving element 322 receives is the Visual Scene information picture required and that conform to described request information that generates described intended target.

It should be noted that, no matter whether the picture that described third party returns is the Visual Scene information picture required and that conform to described request information that generates described intended target, preferably, device 300 also comprises: memory module, the picture receiving for storing received unit 322, so that device 300 follow-up uses.

Conventionally, third party can have multiple, correspondingly, transmitting element 321 can send picture request to multiple third parties simultaneously, also can be in a certain order, such as priority orders, first transmitting element 321 sends picture request to first third party, the picture returning described first third party of picture screening module 34 judgement is not while generating the Visual Scene information picture required and that conform to described request information of described intended target, transmitting element 321 sends picture request to second third party again, until picture screening module 34 judges that it is the Visual Scene information picture required and that conform to described request information that generates described intended target that receiving element 322 receives the picture that certain third party returns, or, until traversal is over, all third parties do not get asked picture yet.

As shown in Figure 3 d, in the optional embodiment of one of the present embodiment, device 300 also comprises: present module 35, after generating the Visual Scene information of described intended target in information generating module 33, present described Visual Scene information.

In a kind of scene, in the picture of having stored, there is the picture of the Visual Scene information subregion required and that conform to described request information that generates described intended target, and lack the picture in Visual Scene information other region required and that conform to described request information that generates described intended target, in the optional embodiment of one under this scene, 32 of picture acquisition modules need obtain from third party the picture in described other region, correspondingly, picture acquisition module 32 is specifically for the picture that generates the Visual Scene information subregion required and that conform to described request information of described intended target if lack in the picture of having stored, from third party, obtain the picture of the Visual Scene information described subregion required and that conform to described request information that generates described intended target.

Particularly, transmitting element 321 can be specified required described subregion when sending picture request to described third party or taking request, so that described third party provides the picture of described subregion targetedly.

Correspondingly, information generating module 33 specifically for: according to the Visual Scene information of the picture of the described subregion obtaining and the described intended target of generation of storing picture required and that conform to described request information, generate the Visual Scene information of described intended target.

In another optional embodiment under above-mentioned scene, even if there is the picture of the Visual Scene information subregion required and that conform to described request information that generates described intended target in the picture of having stored, picture acquisition module 32 also can be not limited to the picture that only obtains other region from third party, correspondingly, when also having the picture of the Visual Scene information described subregion required and that conform to described request information that generates described intended target the picture that picture acquisition module 32 obtains from third party, the quality of the picture of the described subregion that the picture of the described subregion that information generating module 33 can have been stored more and described third party provide, with select quality preferably picture generate the Visual Scene information of described intended target.Wherein, the quality of picture can be by a class or multiclass because of usually embodiment, light conditions (for example whether glistening, the distribution mode of multiple flashlamp etc.) during such as the shooting angle of the focusing of the resolution of picture, picture, picture, picture shooting when the overlay area of the focal length of camera or visual angle, picture, picture shooting etc.

In a kind of possible scene, the picture of having stored does not lack the Visual Scene information picture required and that conform to described request information that generates described intended target, particularly, the picture of having stored comprises the picture of the Visual Scene information regional required and that conform to described request information that generates described intended target, correspondingly, a kind of optional embodiment is, information generating module 33 generates the Visual Scene information of described intended target according to the Visual Scene information picture required and that conform to described request information of the described intended target of generation of having stored.The present embodiment does not limit this.

It should be noted that, information generating module 33 specifically can adopt the synthetic scheduling algorithm of panoramic pictures splicing or method, for example Richard Szeliski.2006.Image alignment and stitching:a tutorial.Found.Trends.Comput.Graph.Vis.2,1 (January2006), the method of introducing in 1-104. generates, the panoramic picture of intended target; Information generating module 33 specifically can adopt from motion calculation structure (Structure from motion, be called for short SFM) scheduling algorithm or method, for example Noah Snavely, Steven M.Seitz, Richard Szeliski.Modeling the World from Internet Photo Collections.International Journal of Computer Vision, the method of introducing in 2007, generates the 3D figure of intended target.

In another possible scene, third party for various reasons, such as because communication issue does not receive request, shoot function fault etc. is not returned to picture, or, the picture returning is not the Visual Scene information picture required and that conform to described request information that generates described intended target, correspondingly, information generating module 33 also for: if receiving element 322 does not receive the Visual Scene information picture required and that conform to described request information of the described intended target of generation that described third party returns after transmitting element 321 sends picture request in certain hour, according to the described picture of having stored, generate the Visual Scene information of described intended target, present module 35 also for: present described Visual Scene information, and point out variant.

Wherein, presenting module 35, to point out discrepant mode also can have multiple, such as, point out, process that described Visual Scene information is pointed out etc. with special color with prompting message, further, can also point out concrete difference, with solicited message do not conform to part be what or at which, the present embodiment is not construed as limiting this.

Fig. 4 a is the structural drawing of a kind of device embodiment bis-that generates Visual Scene information provided by the invention.As shown in Fig. 4 a, device 400 comprises:

Request determination module 41, for the Visual Scene request for intended target according to user, determines the solicited message of described Visual Scene request;

Picture acquisition module 42, if comprise for the picture of having stored the Visual Scene information picture required and that conform to described request information that generates described intended target, and described in the picture that conforms to do not meet quality requirements, from third party obtain generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements;

Information generating module 43, for according to the described picture obtaining, generates the Visual Scene information of described intended target.

Device 400 in the present embodiment can be realized with software, is arranged in the application program that map is relevant, and correspondingly, user can, using a certain target in map as intended target, send Visual Scene request.Wherein, described intended target can include but not limited to: buildings, natural landscape, street, viaduct etc.

Wherein, described request information can ask determination module 41 to obtain from Visual Scene request, also can ask determination module 41 based on Visual Scene request by alternate manner, obtain.

In the optional embodiment of one, request determination module 41 specifically for: by receiving user, for the time of the Visual Scene request of intended target, be defined as the request time in described request information; Or the request time that user in described Visual Scene request is set is defined as the request time in described request information.

Wherein, request determination module 41 is defined as request time by receiving user for the time of the Visual Scene request of intended target, is equivalent to using current time as request time.And the request time that in Visual Scene request, user sets can be current time, can be also At All Other Times.

It should be noted that, except above-mentioned two kinds of modes, request determination module 41 also has other mode to determine request time.For instance, the event that request determination module 41 can be set according to user, inquiry obtains the time that described event occurs in described intended target periphery certain limit, and using this time as request time, wherein, inquiry specifically can realize by search public information data storehouse.

In another optional embodiment, request determination module 41 specifically for: by described Visual Scene request user set Weather information be defined as the Weather information in described request information; Or, according to described intended target and described request time, during by the described request time described in the Weather information at intended target place be defined as the Weather information in described request information.

Wherein, when request determination module 41 is determined the described request time described in the Weather information of intended target, can have multiple implementation, such as inquiry meteorogical phenomena database.

In another optional embodiment, request determination module 41 specifically for: by described Visual Scene request user set event be defined as the event in described request information; Or according to described intended target and described request time, the event occurring in during by the described request time in described intended target periphery certain limit is defined as the event in described request information.

Wherein, request determination module 41 occurs in the event in described intended target periphery certain limit while determining the described request time, can have multiple implementation, such as inquiry public information data storehouse.Wherein, described intended target periphery certain limit is what kind of scope on earth, can be set by user, or, according to the configuration of acquiescence, set.For instance, described intended target periphery certain limit can be centered by described intended target, 20 meters of scopes that are radius.Conventionally, in described intended target periphery certain limit, event has impact to the Visual Scene information of described intended target.

Correspondingly, device 400 also comprises: picture screening module 44, for whether whether conforming to request time, Weather information and/or event in described request information respectively according to the event in the weather of the shooting time of picture, picture and/or picture, judge whether described picture conforms to solicited message.

Further, picture screening module 44 judges that picture has nothing in common with each other with the method that in solicited message, whether each information conforms to.Particularly, for Weather information, whether weather category that picture screening module 44 can be indicated with Weather information in solicited message according to the weather in picture is identical judges whether to conform to.For event, picture screening module 44 can judge whether to conform to according to whether the event in picture and event in solicited message be identical.

For request time, picture screening module 44 can be according to the shooting time of picture, judges whether described picture conforms to the described request time.Preferably, picture screening module 44 can according to the time period under the shooting time of picture whether with the described request time under the time period whether conform to judge.Correspondingly, when described request information comprises the described request time, picture screening module 44 specifically for:

Wherein, the time period can hour, day, month or season etc. be unit.For instance, when request time is at 9 in the morning, picture screening module 44 can think under shooting time that the time period is that the picture that the morning, 8-10 was ordered all conforms to this request time; When request time is on July 10th, 2012, picture screening module 44 can think that time period under shooting time is that the picture in 2011,2012 or 5 days-July 15 July in 2013 all conforms to this request time, and/or, picture screening module 44 thinks that the picture that the affiliated time period of shooting time is July all conforms to this request time, and/or picture screening module 44 thinks that the picture that the affiliated time period of shooting time is summer all conforms to this request time.The present embodiment is not construed as limiting this.

Alternatively, in the picture of having stored, picture screening module 44 is searched Target Photo according to type and the solicited message of intended target, Visual Scene information.For instance, in panoramic picture request user to have set request time be on July 10th, 2012, do not set Weather information and event, in described intended target periphery certain limit, take and shooting time be that the picture on July 10th, 2012 is Target Photo.Further, in order to expand the scope of Target Photo, the solicited message that request determination module 41 can also be set according to user be determined other solicited message, and correspondingly, picture screening module 44 is searched the picture that the solicited message set with user and/or other definite solicited message conform to.For instance, in panoramic image scene request user to have set request time be on October 1st, 2013, do not set Weather information and event, ask determination module 41 can determine that the Weather information at described intended target on October 1 place in 2013 is fine day, the event occurring in intended target periphery certain limit is parade on National Day, thereby in the picture that picture screening module 44 is taken in intended target periphery certain limit according on October 1st, 2013 and/or fine day, National Day, Target Photo was searched in parade, such as what take in described intended target periphery certain limit, and shooting time is that the picture on October 1st, 2013 is Target Photo, the picture of the parade on National Day of the fine day of taking in described intended target periphery certain limit on October 1st, 2012 is also Target Photo.

Again for instance, in the request of 3D figure user to have set request time be on July 10th, 2012, do not set Weather information and event, shooting time is that the picture of the described intended target on July 10th, 2012 is Target Photo.Further, in order to expand the scope of Target Photo, the solicited message that request determination module 41 can also be set according to user be determined other solicited message, and correspondingly, picture screening module 44 is searched the picture that the solicited message set with user and/or other definite solicited message conform to.For instance, in the request of 3D figure user to have set request time be on October 1st, 2013, do not set Weather information and event, ask determination module 41 can determine that the Weather information at described intended target on October 1 place in 2013 is fine day, the event occurring in intended target periphery certain limit is parade on National Day, thereby picture screening module 44 in the picture of intended target according on October 1st, 2013 and/or fine day, National Day, Target Photo was searched in parade, such as the picture of the described intended target of taking on October 1st, 2013 is Target Photo, the fine day that on October 1st, 2012 takes, in described intended target periphery certain limit, at the picture of parade on National Day, be just also Target Photo.

Further, picture screening module 44 is searched and is generated the required picture of Visual Scene information in Target Photo, such as, if want generating panorama image, in Target Photo, search the picture in each region around intended target, if generate 3D figure, in Target Photo, search the picture in each region of intended target, as the Visual Scene information picture required and that conform to solicited message that generates described intended target.

Particularly, when request determination module 41 determines that the view variation in solicited message also has multiple choices.In the optional embodiment of one, picture screening module 44 is first searched in the picture of having stored according to the out of Memory except view changes in solicited message, find out the Visual Scene information picture required and that conform to described out of Memory that generates described intended target, then ask determination module 41 to be determined and between the shooting time of the picture having found and request time, whether exist view to change, whether the view when judging request time in the Visual Scene information of intended target is different with respect to the shooting time of the picture having found, view when thereby picture screening module 44 filters out shooting time in the Visual Scene information of intended target during with request time identical picture as the Visual Scene information picture required and that conform to described request information of the described intended target of generation.In another optional embodiment, request determination module 41 first changes according to the view in the request time in solicited message and intended target periphery certain limit, the identical time period of view while determining with request time in the Visual Scene information of intended target, then picture screening module 44 is searched in the picture of described identical time period at the shooting time of having stored, find out generate the Visual Scene information of described intended target required and with the picture conforming to the out of Memory request time except described view variation in solicited message, as the Visual Scene information picture required and that conform to described request information that generates described intended target.

Further, picture screening module 44 judges whether the Visual Scene information picture required and that conform to solicited message that generates described intended target meets quality requirements.Wherein, quality requirements can be set by user, or, according to the configuration of acquiescence, set.Particularly, first picture screening module 44 can determine the quality of picture, wherein, the quality of picture can be by a class or multiclass because of usually embodiment, such as the resolution of picture, the focusing of picture, the shooting angle of picture, the focal length of camera or visual angle during picture shooting, the overlay area of picture, whether light conditions during picture shooting (for example glistens, the distribution mode of multiple flashlamp etc.) etc., thereby picture screening module 44 can judge whether picture meets quality requirements, such as the resolution and the difference that generates the required resolution of Visual Scene information of picture, the focusing of picture and the difference that generates the required focusing of Visual Scene information, the shooting angle of picture and the difference that generates the required angle of Visual Scene information, the difference at the focal length of camera or visual angle and the required focal length of generation Visual Scene information or visual angle during picture shooting, the overlay area of picture and the difference that generates the required overlay area of Visual Scene information, whether light conditions during picture shooting (for example glistens, the distribution mode of multiple flashlamp etc.) whether meet the demands with the difference etc. of other picture for generating Visual Scene information.

As shown in Fig. 4 c, in the optional embodiment of one of the present embodiment, picture acquisition module 42 comprises:

Transmitting element 421, if comprise for the picture of having stored the Visual Scene information picture required and that conform to described request information that generates described intended target, and described in the picture that conforms to do not meet quality requirements, to third party, send picture request, described picture request for ask to generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements;

Receiving element 422, for receive the Visual Scene information of the described intended target of generation that described third party returns required, conform to described request information and meet the picture of quality requirements.

Wherein, third party can be any communication facilities, such as computer, mobile phone etc.Particularly, send if only 421 modes that send picture requests also can have multiple, such as by social networks transmission etc.Alternatively, described picture request carry described request information, be used to indicate described intended target information, be used to indicate information and the quality requirements of the type of Visual Scene information.

Under the described request time scene that is current time, alternatively, transmitting element 421 specifically for: to the third party in described intended target periphery certain limit, send the request of shooting, described shooting request is for asking described third party to take to generate the Visual Scene information of described intended target required and meet the picture of quality requirements.

Wherein, the request of taking is equivalent to a kind of special picture request.Because request time is current time, the picture of current shooting conforms to request time, and weather, event when in the picture of current shooting, weather, event are all with request time conform to, therefore, transmitting element 421 can ask third party in described intended target periphery certain limit to take and return the picture of shooting.

It should be noted that, under the described request time scene that is current time, even if the picture that is not current shooting also may conform to request time, therefore, transmitting element 421 also can the third party outside described intended target periphery certain limit send picture request.

More preferably, the picture that receiving element 422 receives, the picture that described third party returns is asked picture, the Visual Scene information that generates described intended target is required, conform to described request information and meet the picture of quality requirements.Certainly, the picture that receiving element 422 receives also may not conform to solicited message, or, not that the Visual Scene information of the described intended target of generation is required, or, do not meet quality requirements.Preferably, after receiving element 422 receives the picture that described third party returns, picture screening module 44 can also judge picture that described third party returns be whether generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements.

It should be noted that, though the picture that described third party returns be whether generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements, preferably, device 400 also comprises: memory module, the picture receiving for storing received unit 422, so that follow-up use.

Conventionally, third party can have multiple, correspondingly, transmitting element 421 can send picture request to multiple third parties simultaneously, also can be in a certain order, such as priority orders, first transmitting element 421 sends picture request to first third party, the picture returning described first third party of picture screening module 44 judgement is not that the Visual Scene information of the described intended target of generation is required, when conforming to described request information and meeting the picture of quality requirements, transmitting element 421 can send picture request to second third party, until picture screening module 44 judges picture that certain third party that receiving element 422 receives returns, be that to generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements, or, until traversal is over, all third parties do not get asked picture yet.

As shown in Fig. 4 d, in the optional embodiment of one of the present embodiment, device 400 also comprises: present module 45, for presenting described Visual Scene information.

In a kind of scene, in the picture of having stored, there is the Visual Scene information of the described intended target of generation required, conform to described request information and meet the picture of the subregion of quality requirements, and lack, generate Visual Scene information other region required, that conform to described request information of described intended target and the picture that meets quality requirements, under this scene in a kind of optional embodiment, 42 of picture acquisition modules need obtain from third party the picture in described other region, particularly, picture acquisition module 42 specifically for:

Particularly, transmitting element 421 can be specified required described subregion when sending picture request to described third party or taking request, so that described third party provides the picture of described subregion targetedly.

Correspondingly, information generating module 43 specifically for:

In another optional embodiment under above-mentioned scene, even if exist the Visual Scene information of the described intended target of generation required in the picture of having stored, conform to described request information and meet the picture of the subregion of quality requirements, picture acquisition module 42 also can be not limited to the picture that only obtains other region from third party, correspondingly, when also having the picture that picture acquisition module 42 obtains from third party, the Visual Scene information of the described intended target of generation is required, when conforming to described request information and meeting the picture of described subregion of quality requirements, the quality of the picture of the described subregion that the picture of the described subregion that information generating module 43 can have been stored more and described third party provide, with select quality preferably picture generate the Visual Scene information of described intended target.

In a kind of possible scene, in the picture of having stored, do not lack that to generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements, particularly, the picture of having stored comprises that to generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of the regional of quality requirements, correspondingly, a kind of optional embodiment is, information generating module 43 is required according to the Visual Scene information of the described intended target of generation of having stored, the picture conforming to described request information and meet quality requirements generates the Visual Scene information of described intended target.The present embodiment does not limit this.

It should be noted that, information generating module 43 specifically can adopt the synthetic scheduling algorithm of panoramic pictures splicing or method, for example Richard Szeliski.2006.Image alignment and stitching:a tutorial.Found.Trends.Comput.Graph.Vis.2,1 (January2006), the method of introducing in 1-104. generates, the panoramic picture of intended target; Information generating module 33 specifically can adopt from motion calculation structure (Structure from motion, be called for short SFM) scheduling algorithm or method, for example Noah Snavely, Steven M.Seitz, Richard Szeliski.Modeling the World from Internet Photo Collections.International Journal of Computer Vision, the method of introducing in 2007, generates the 3D figure of intended target.

In another possible scene, third party for various reasons, such as because communication issue does not receive request, shoot function fault etc. is not returned to picture, or, the picture returning is not that the Visual Scene information of the described intended target of generation is required, conform to described request information and meet the picture of quality requirements, correspondingly, information generating module 43 also for: required if receiving element 422 does not receive the Visual Scene information of the described intended target of generation that described third party returns after transmitting element 421 sends picture request in certain hour, conform to described request information and meet the picture of quality requirements, according to the described picture of having stored, generate the Visual Scene information of described intended target, present module 35 also for: present described Visual Scene information, and prompting does not meet quality requirements.

Wherein, presenting module 35, to point out the mode that does not meet quality requirements also can have multiple, such as, with prompting message, to point out, with special color, process that described Visual Scene information is pointed out etc., the present embodiment is not construed as limiting this.

Fig. 5 is the structural drawing of a kind of device embodiment tri-that generates Visual Scene information provided by the invention.As shown in Figure 5, device 500 comprises:

Processor (processor) 51, communication interface (Communications Interface) 52, storer (memory) 53 and communication bus 54.Wherein:

Processor 51, communication interface 52 and storer 53 complete mutual communication by communication bus 54.

Communication interface 52, for communicating by letter such as external units such as third parties.

Processor 51, for executive routine 532, specifically can carry out the correlation step in said method embodiment mono-.

Particularly, program 532 can comprise program code, and described program code comprises computer-managed instruction.

Processor 51 may be a central processor CPU, or specific integrated circuit ASIC(Application Specific Integrated Circuit), or be configured to implement one or more integrated circuit of the embodiment of the present invention.

Storer 53, for depositing program 532.Storer 53 may comprise high-speed RAM storer, also may also comprise nonvolatile memory (non-volatile memory), for example at least one magnetic disk memory.Program 532 specifically can be for making device 500 carry out following steps:

In program 532, the specific implementation of each step can, referring to description corresponding in the corresponding steps in said method embodiment mono-and unit, be not repeated herein.Those skilled in the art can be well understood to, and for convenience and simplicity of description, the specific works process of the equipment of foregoing description and module, can describe with reference to the corresponding process in preceding method embodiment mono-, does not repeat them here.

Fig. 6 is the structural drawing of a kind of device embodiment tetra-that generates Visual Scene information provided by the invention.As shown in Figure 6, device 600 comprises:

Processor (processor) 61, communication interface (Communications Interface) 62, storer (memory) 63 and communication bus 64.Wherein:

Processor 61, communication interface 62 and storer 63 complete mutual communication by communication bus 64.

Communication interface 62, for communicating by letter such as external units such as third parties.

Processor 61, for executive routine 632, specifically can carry out the correlation step in said method embodiment mono-.

Particularly, program 632 can comprise program code, and described program code comprises computer-managed instruction.

Processor 61 may be a central processor CPU, or specific integrated circuit ASIC(Application Specific Integrated Circuit), or be configured to implement one or more integrated circuit of the embodiment of the present invention.

Storer 63, for depositing program 632.Storer 63 may comprise high-speed RAM storer, also may also comprise nonvolatile memory (non-volatile memory), for example at least one magnetic disk memory.Program 632 specifically can be for making device 600 carry out following steps:

In program 632, the specific implementation of each step can, referring to description corresponding in the corresponding steps in said method embodiment bis-and unit, be not repeated herein.Those skilled in the art can be well understood to, and for convenience and simplicity of description, the specific works process of the equipment of foregoing description and module, can describe with reference to the corresponding process in preceding method embodiment bis-, does not repeat them here.

Those of ordinary skills can recognize, unit and the method step of each example of describing in conjunction with embodiment disclosed herein, can realize with the combination of electronic hardware or computer software and electronic hardware.These functions are carried out with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme.Professional and technical personnel can realize described function with distinct methods to each specifically should being used for, but this realization should not thought and exceeds scope of the present invention.

If described function realizes and during as production marketing independently or use, can be stored in a computer read/write memory medium using the form of SFU software functional unit.Based on such understanding, the part that technical scheme of the present invention contributes to original technology in essence in other words or the part of this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprise that some instructions (can be personal computers in order to make a computer equipment, server, or the network equipment etc.) carry out all or part of step of method described in each embodiment of the present invention.And aforesaid storage medium comprises: various media that can be program code stored such as USB flash disk, portable hard drive, ROM (read-only memory) (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CDs.

Above embodiment is only for illustrating the present invention; and be not limitation of the present invention; the those of ordinary skill in relevant technologies field; without departing from the spirit and scope of the present invention; can also make a variety of changes and modification; therefore all technical schemes that are equal to also belong to category of the present invention, and scope of patent protection of the present invention should be defined by the claims.

Claims

1. a method that generates Visual Scene information, is characterized in that, described method comprises:

2. method according to claim 1, is characterized in that, described request information comprise following at least one: request time, Weather information, event.

3. method according to claim 2, is characterized in that, the described Visual Scene request for intended target according to user is determined and comprised the solicited message of described Visual Scene request:

4. method according to claim 2, is characterized in that, the described Visual Scene request for intended target according to user is determined and comprised the solicited message of described Visual Scene request:

5. method according to claim 2, is characterized in that, the described Visual Scene request for intended target according to user is determined and comprised the solicited message of described Visual Scene request:

6. method according to claim 2, is characterized in that, described request information also comprises: view changes.

7. according to arbitrary described method in claim 2～6, it is characterized in that, when described request information comprises the described request time, described method also comprises:

8. method according to claim 1, is characterized in that, the described Visual Scene information picture required and that conform to described request information that generates described intended target that obtains from third party, comprising:

9. method according to claim 8, is characterized in that, when the described request time is current time, describedly to third party, sends picture request and comprises:

10. method according to claim 8 or claim 9, is characterized in that, described after third party sends picture request, also comprises:

Present described Visual Scene information, and point out variant.

11. according to arbitrary described method in claim 1～9, it is characterized in that, in the picture of having stored if described, lack the Visual Scene information picture required and that conform to described request information that generates described intended target, from third party, obtain the Visual Scene information picture required and that conform to described request information that generates described intended target, comprising:

12. methods according to claim 11, is characterized in that, the described picture that described basis is obtained generates the Visual Scene information of described intended target, comprising:

According to the Visual Scene information of the picture of the described subregion obtaining and the described intended target of generation of storing picture required and that conform to described request information, generate the Visual Scene information of described intended target.

13. methods according to claim 1, is characterized in that, after the Visual Scene information of the described intended target of described generation, also comprise:

Present described Visual Scene information.

14. according to arbitrary described method in claim 1～13, and described Visual Scene request is panoramic picture request, and described Visual Scene information is scene image; Or described Visual Scene request is the request of 3D figure, described Visual Scene information is 3D figure.

15. 1 kinds generate the device of Visual Scene information, it is characterized in that, described device comprises:

16. devices according to claim 15, is characterized in that, described request information comprise following at least one: request time, Weather information, event.

17. devices according to claim 16, is characterized in that, described device also comprises:

Picture screening module, if do not conform to for the time period under time period under the shooting time of the picture stored and described request time, the picture of having stored described in definite does not conform to described request information.

18. devices according to claim 15, is characterized in that, described picture acquisition module comprises:

Transmitting element, if lack for the picture of having stored the Visual Scene information picture required and that conform to described request information that generates described intended target, to third party, send picture request, described picture request is for asking to generate the Visual Scene information picture required and that conform to described request information of described intended target;

Receiving element, for receiving the Visual Scene information picture required and that conform to described request information of the described intended target of generation that described third party returns.

19. devices according to claim 18, it is characterized in that, when the described request time is current time, described transmitting element specifically for: to the third party in described intended target periphery certain limit, send the request of shooting, described shooting request is for asking described third party to take the required picture of Visual Scene information that generates described intended target.

20. according to arbitrary described device in claim 15～19, it is characterized in that, described picture acquisition module specifically for: if lack in the picture of having stored, generate the picture of the Visual Scene information subregion required and that conform to described request information of described intended target, from third party, obtain the picture of Visual Scene information described subregion required and that conform to described request information that generates described intended target.

21. devices according to claim 20, it is characterized in that, described information generating module specifically for: according to the Visual Scene information of the picture of the described subregion obtaining and the described intended target of generation of storing picture required and that conform to described request information, generate the Visual Scene information of described intended target.

22. devices according to claim 15, is characterized in that, described device also comprises: present module, for presenting described Visual Scene information.

23. according to arbitrary described device in claim 15～22, it is characterized in that, described Visual Scene request is panoramic picture request, and described Visual Scene information is scene image; Or described Visual Scene request is the request of 3D figure, described Visual Scene information is 3D figure.

24. 1 kinds generate the method for Visual Scene information, it is characterized in that, described method comprises:

25. methods according to claim 24, is characterized in that, described request information comprise following at least one: request time, Weather information, event.

26. according to the method described in claim 24 or 25, it is characterized in that, described from third party obtain generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements, comprising:

27. methods according to claim 26, is characterized in that, described after third party sends picture request, also comprise:

28. according to arbitrary described method in claim 24～27, it is characterized in that, if the picture of having stored described comprises the Visual Scene information picture required and that conform to described request information that generates described intended target, and described in the picture that conforms to do not meet quality requirements, from third party obtain generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements, comprising:

29. methods according to claim 28, is characterized in that, the described picture that described basis is obtained generates the Visual Scene information of described intended target, comprising:

30. methods according to claim 24, is characterized in that, after the Visual Scene information of the described intended target of described generation, also comprise:

Present described Visual Scene information.

31. according to arbitrary described method in claim 24～30, and described Visual Scene request is panoramic picture request, and described Visual Scene information is scene image; Or described Visual Scene request is the request of 3D figure, described Visual Scene information is 3D figure.

32. 1 kinds generate the device of Visual Scene information, it is characterized in that, described device comprises:

33. devices according to claim 32, is characterized in that, described request information comprise following at least one: request time, Weather information, event.

34. according to the device described in claim 32 or 33, it is characterized in that, described picture acquisition module comprises:

Transmitting element, if comprise for the picture of having stored the Visual Scene information picture required and that conform to described request information that generates described intended target, and described in the picture that conforms to do not meet quality requirements, to third party, send picture request, described picture request for ask to generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of quality requirements;

Receiving element, for receive the Visual Scene information of the described intended target of generation that described third party returns required, conform to described request information and meet the picture of quality requirements.

35. according to arbitrary described device in claim 32～34, it is characterized in that, described picture acquisition module is required specifically for: the Visual Scene information that generates described intended target if lack in the picture of having stored, conform to described request information and meet the picture of the subregion of quality requirements, from third party obtain generate the Visual Scene information of described intended target required, conform to described request information and meet the picture of the described subregion of quality requirements.

36. devices according to claim 35, it is characterized in that, described information generating module specifically for: required with the Visual Scene information of the described intended target of generation of storing according to the picture of the described subregion obtaining, conform to described request information and meet the picture of quality requirements, generate the Visual Scene information of described intended target.

37. devices according to claim 32, is characterized in that, described device also comprises: present module, for presenting described Visual Scene information.

38. according to arbitrary described device in claim 32～37, it is characterized in that, described Visual Scene request is panoramic picture request, and described Visual Scene information is scene image; Or described Visual Scene request is the request of 3D figure, described Visual Scene information is 3D figure.