CN102521253A - Visual multi-media management method of network users - Google Patents
Visual multi-media management method of network users Download PDFInfo
- Publication number
- CN102521253A CN102521253A CN2011103649744A CN201110364974A CN102521253A CN 102521253 A CN102521253 A CN 102521253A CN 2011103649744 A CN2011103649744 A CN 2011103649744A CN 201110364974 A CN201110364974 A CN 201110364974A CN 102521253 A CN102521253 A CN 102521253A
- Authority
- CN
- China
- Prior art keywords
- picture
- gps
- unit
- user
- multimedia
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a visual multi-media management method of network users, which is different from an existing method for storing and managing multi-media data by different folders. The visual multi-media management method is characterized by comprising the steps that: a tour route is generated on a map by images, audios, videos and files which are uploaded by users according to GPS (Global Position System) and time information of the images, and the tour route can be displayed on a computer and a mobile terminal; a system provides representative images which are located at the same positions of browsing images in real time, official introduction and comments of other users; own feelings of the users can be edited; the users can select time slots to check travel notes and the users can share tour journals with friends; and an indexing structure is established for the data and the GPS information and the representative images are pre-treated offline.
Description
Technical field
The present invention relates to especially social network data management of network, multimedia retrieval field and map development field particularly generate the travel notes system on map.
Background technology
Along with growth in the living standard, people begin to make earnest efforts tourism, and a large amount of pictures of shooting upload to picture sharing website and social networks in tourism process.Well-known picture sharing website such as Flickr, the picture sum of uploading reaches 5,000,000,000.It is more surprising that picture in the social networks is uploaded quantity, and light Facebook one family has just reached 60,000,000,000.In China, social network sites such as everybody net, happy net become main uploading and the approach of sharing picture.And along with the arrival in 4G epoch, not only at video sharing websites such as Youtube, excellent cruel, potato nets, the video data that the user uploads in the social networks also can sharply rise.Therefore, for so large-scale number of users and multi-medium data, how effectively management is rather important.
Picture and video management mode in the present sharing website social networks are basic identical.Under the user some files are arranged, such way to manage is unfavorable for showing intuitively that to the user locus of these multi-medium datas distributes, and the route of user when travelling.
Along with the progress of science and technology, people have time and GPS writing function when using smart mobile phone and part digital camera to take pictures, and when uploading pictures, but Flickr user manually finds picture position mark on map.On Flickr, when the picture of checking as the user has GPS, this picture corresponding position on map can appear.The TRAVELGUIDE system of Microsoft Research, Asia's issue, this system user can find the position, sight spot on map, add picture and add comment, and system generates route automatically, shows with the animation mode.But this function is only opened figure to certain, or certain travelling, by in the management of the extensive photograph of user, especially is not used in the pictures management of social networks.And the relevant display function to video is not provided more.
The picture management method of existing social networks is failed with visual way management picture.Simultaneously, existing picture management method only can be checked user's picture and comment, will especially use search engine when the user need check representative picture in same sight spot and comment.
Summary of the invention
The purpose of this invention is to provide the abundant network user's multimedia administration method of a kind of form intuitively, with the data that the user selects, is not only picture; Comprise that also video, audio frequency, the literal correspondence position on map shows, and be linked to be tourism route, be linked to be circuit simultaneously; The tourism and the daily life that present the user; Share with the good friend in the social networks, make things convenient for the user, promote better and on map, generate travel notes.
For reaching above purpose, the present invention takes following technical scheme to be achieved:
A kind of visual network user's multimedia administration method is characterized in that, comprises the steps: customer multi-media data input cell 10, specified data GPS unit 20, time window unit 30; Multimedia type selected cell 40; Map self adaptive pantographic unit 50; On map, show multimedia icon and route unit 60; The user browses tourism log unit 70;
10 pairs of pictures 100 of said customer multi-media data input cell, video 110, literal 120 and audio frequency 130 are set up index;
Said specified data GPS unit 20 carries out GPS and confirms building up indexed data in the customer multi-media data input cell 10, comprises the positional information that resolution data is subsidiary; For the data of no positional information, the user carries out manual GPS mark, on map, finds correspondence position; For place name but not GPS information, obtain GPS through place name and GPS conversion API;
30 couples of specified data GPS unit, said time window unit 20 carries out the definite index of GPS and carries out time index;
Said multimedia type selected cell 40 confirms that with time window unit 30 multi-medium data behind the time index carries out the kind selection, comprises that picture, video, literal and audio frequency are a certain, or combination; On the basis of time window unit 30, carry out the index that the multimedia type requires again;
Said map self adaptive pantographic unit 50 is to time window unit 30 indexed results of selecting with multimedia type selected cell 40 that confirm; Carry out confirming of map level of zoom; So that the content of multimedia of selected time window and selection type occupies whole screen just on map, make travel notes that better bandwagon effect arranged;
Said multimedia icon and the route unit 60 of on map, showing; Will be from map self adaptive pantographic unit 50 multi-medium datas and map level of zoom; According to time, GPS, icon deposit position; Corresponding GPS on map shows the multimedia icon according to the time order and function order, and is linked to be route according to time order and function, and generates tourism log;
Said user browses the 70 pairs of tourism logs that generated in tourism log unit and carries out travel notes and browse, and comprises multimedia document browse unit 700, representative diagram blade unit 710 and comment unit 720.
In the such scheme, the concrete steps that said customer multi-media data input cell 10 pairs of pictures, video, literal and audio frequency are set up index are:
Set up concordance list, each multimedia document is a delegation, and columns is 9, and an index type is shown in each tabulation, is respectively: id is the unique numbering of expression picture; Uf is user flag, and whether this figure of expressive notation is user's uploading pictures; U is user Id, the expression Customs Assigned Number; T is time, expression picture uplink time; M is that material representes the multimedia kind; Gps representes the GPS of multimedia document; Url representes the storage address of multimedia document; Icon representes the summary contract drawing target storing place of multimedia document, and wherein the picture icon is for omiting contract drawing, and video icon is the summary contract drawing of first frame, and literal icon and music picture are the icon of expression literal and music; C representes to comment on storage address, and index provides the pointer that points to the data value in the specify columns that is stored in table, and the clooating sequence according to appointment sorts to these pointers then;
30 couples of specified data GPS unit, said time window unit 20 carries out the concrete grammar that index that GPS confirms carries out time index: the time is t to note farthest apart from the present
01, be t apart from modern minimum distance
02With the user-selected time period is t
1And t
2, t when initial
1=t
01, t
2=t
02The present invention provides two kinds of approach to supply user's select time section.Approach one is the concrete starting and ending time of directly input.Approach two is for moving the LR-button of scroll bar.In approach two, the high order end of scroll bar is t
01Low order end is t
02All the time constant, the centre position evenly and the time shine upon one by one, LR-button has been mapped to new t like this
1, t
2According to t
1, t
2Confirm the time index scope.
Definite step of the map level of zoom in the said map self adaptive pantographic unit 50 is: at first obtain the extreme value of GPS on longitude and latitude in specified data GPS unit 20, be designated as LA
mAnd LO
mThen according to LA
m, LO
mValue confirm the level of zoom of map; Method is obtained extreme point up and down for map is chosen to be a certain grade i, and calculates latitude, longitude apart from remembering LA respectively
i, LO
i, when selecting level of zoom, compare LA
m, LA
i, LA
I+1, and LO
m, LO
j, LO
J+1, work as LA
I-1＜LA
m＜LA
i&LO
J-1＜LO
m＜LO
j, (i, j), then selected map level of zoom is k to select k=min.
Representative picture product process in the said representative diagram blade unit 710 comprises that picture library sets up unit, picture library pretreatment unit and representative picture generation unit; Wherein: picture library is set up the unit and is at first used ID uf to distinguish picture whether to be user's uploading pictures, then need not to carry out the corresponding sight spot of GPS picture for non-user's uploading pictures and expands; GPS to user's uploading pictures carries out index in the storehouse; Then need not carry out complement when the picture number reaches 30 when above, otherwise carry out the WEB retrieval, utilize photographic search engine to carry out complement and warehouse-in; Same selection complement number is 30, need carry out the conversion of GPS and place name before this; The picture library pretreatment unit carries out Visual Feature Retrieval Process respectively to picture, an ordering and a type internal sort between KMEANS cluster, class; Said visual signature is a global characteristics, comprises color histogram, color moment, Wavelet Texture; Then, global characteristics is carried out the KMEANS cluster, getting the cluster centre number is 30; Comprise 4 daytime in season black and without the combination of scene type; Through cluster, picture is divided in the different classes according to its color and texture in the picture library, according to picture kind and shooting time ordering; Sort between type of carrying out then, according to GPS, user and the ordering of shooting time distribution range in the class; SIFT coupling ordering in type; To the SIFT matching ratio in all kinds of types of doing: choose a pictures Pi; A certain SIFT is described all SIFT among Xim and another pictures Pj describe Xjn and do similarity measurement, the nearest point of chosen distance is right as the preliminary election coupling, in order to reach symmetry; Have only when the minimum distance point of Xjn also is Xim, just confirm 2 couplings; Count when reaching 3 pairs when the coupling between two pictures, think and sort this two pictures coupling according to the number of picture with other pictures coupling; Representative picture generation unit is for improving the speed of browsing representative picture; Set up index structure: representative picture collection is set up concordance list to representative picture collection; Every representative picture is a delegation; Columns is 5, and an index type is shown in each tabulation, is respectively: id is the unique numbering of expression picture; Gps representes multimedia document GPS; Url representes the storage address of multimedia document; Cluster category label under the clu representative picture; The q representative picture is at class internal sort label; Index provides the pointer that points to the data value in the specify columns that is stored in table, and the clooating sequence according to appointment sorts to these pointers then; When the user browses representative picture; Carry out the GPS index earlier, find the corresponding row of picture in the specific GPS scope, read picture from small to large in proper order according to category label and type internal sort label then; Like clu1q1; Clu2q1 ... Clunq1, clu1q2, clu2q2 ... The selection of n here is 10 according to actual conditions.
Compared with prior art, the invention has the advantages that,, and carry out pre-service, make when the user is online to obtain personal data and reduce the stand-by period for the multimedia document off-line is set up index.Newly upload data for the user, can set up the same index structure with multi-medium data in the warehousing.The representative picture place of choosing is accurate, can reflect that this place represents scenery, can reflect this place Various Seasonal, different time such as daytime, night, and without the visual angle, picture repeatability is few.And the user does not need extra by search engine, can browse the representative picture in this sight spot, has remedied and only can see the sorry of a certain season or time period picture when the user travels.
Description of drawings
Fig. 1 is the general steps synoptic diagram of the inventive method.
Fig. 2 adopts software travel notes interface synoptic diagram in the inventive method.Among the figure: mark 1 is a map area, and mark 2 is the current selection multimedia messages of user zone, comprises shooting time, positional information etc.Mark 3 is a time window, can be chosen in the time range that shows travel notes on the map.Mark 4 is the multimedia browser zone, comprises like picture and video file first frame, has 4 buttons, and last knob down is sight spot before and after the visit, and LR-button is for browsing the representative picture in same sight spot.Mark 5 is comment frame zone, comprises user comment, official's comment, other user comments and good friend's comment.Mark 6 is good friend's window area, and display navigation is crossed the good friend at this sight spot, can go sight-seeing picture and the comment of this good friend when browsing this sight spot.Mark 7 is selected for the multimedia type, but combination in any picture, video, literal and music show.
Fig. 3 is that the representative picture among Fig. 1 generates synoptic diagram.
The multi-medium data index structure figure of Fig. 4 for being adopted in the inventive method.Wherein (a) figure is the multimedia material index result, and uf representes user flag.Whether this figure of mark is user's uploading pictures, in order to distinguish with the figure that from WEB, retrieves.U representes user Id.T representes the picture uplink time.M representes the multimedia kind, like picture, video, literal and music.Gps representes multimedia document GPS.Url representes the storage address of multimedia document.Icon representes the storage address of the icon of multimedia document.C representes to comment on the address.(b) figure is the index structure to representative picture.The picture indices of only setting up: gps representative picture place GPS to representative picture.Url representative picture storage address.Cluster category label under the clu representative picture.The q representative picture is at class internal sort label.
Fig. 5 is the inventive method effect sectional drawing.Wherein (a) figure is the travel notes of user i, and the medium type of selection is a picture.On map, generate travel notes and show route; (b) figure for user i adjustment time window after travel notes, reduce at the visible sight spot of browsing, the picture number reduces.
Embodiment
Fig. 1 has provided among the present invention the general steps synoptic diagram that social networks customer multi-media data is carried out the method for visualized management.Comprise customer multi-media data input cell 10, specified data GPS unit 20, time window unit 30; Multimedia type selected cell 40; Map self adaptive pantographic unit 50; On map, show multimedia icon and route unit 60; The user browses tourism log unit 70.
Multi-medium data in the described customer multi-media data input cell 10 comprises picture 100, video 110, literal 120 and audio frequency 130.Index is set up to picture, video, literal and audio frequency in this unit.
Specifically set up the index step, set up concordance list shown in Fig. 4 (a), each multimedia document is a delegation, and columns is 9, and an index type is shown in each tabulation, is respectively: id is the unique numbering of expression picture; Uf is user flag, and whether this figure of expressive notation is user's uploading pictures; U is user Id, the expression Customs Assigned Number; T is time, expression picture uplink time; M is that material representes the multimedia kind; Gps representes multimedia document GPS; Url representes the storage address of multimedia document; Icon representes the summary contract drawing target storing place of multimedia document, and wherein the icon of picture is for omiting contract drawing, and the icon of video is a slightly contract drawing of first frame, and literal icon and music icon are the icon of expression literal and music; C representes to comment on storage address.Index provides the pointer of the data value in the specify columns of pointing to storage list, and the clooating sequence according to appointment sorts to these pointers then.
Specified data GPS unit 20 carries out GPS and confirms building up index data in the customer multi-media data input cell 10, confirms the positional information that comprises that resolution data is subsidiary; For the data of no positional information, the user carries out manual GPS mark, on map, finds correspondence position; For place name but not GPS information, obtain GPS through place name and GPS conversion API.
10 unit 20, above unit are the off-line pretreatment unit, and off-line is set up index and made the minimizing stand-by period when user is online to obtain personal data.Newly upload data for the user, add in the existing concordance list, set up the same index structure with multi-medium data in the warehousing.
The index that 20 GPS in 30 couples of specified data GPS unit, time window unit confirm carries out time index, and the user can select the concrete time period to carry out travel notes to generate and browse, be convenient to the user and search data targetedly.To setting up index with carrying out time index, the time is t to note farthest apart from the present
01, be t apart from modern minimum distance
02With the user-selected time period is t
1And t
2, t when initial
1=t
01, t
2=t
02The present invention provides two kinds of approach to make user's select time section.Approach one is the concrete starting and ending time of directly input.Approach two is for moving the LR-button of scroll bar.In approach two, the high order end of scroll bar is t
01Low order end is t
02All the time constant, the centre position is mapping one by one evenly, and LR-button has been mapped to new t like this
1, t
2In index, satisfy the index of time requirement.
The multimedia type selects 40 time window unit 30 confirmed that multimedia document data behind the time indexs carry out kind and select, and comprises that picture, video, literal and audio frequency are a certain, or combination; On the basis of time window unit 30, carry out the index that the multimedia type requires again.
Map self adaptive pantographic unit 50 is to time window unit 30 indexed results of selecting with multimedia type selected cell 40 that confirm; Carry out confirming of map level of zoom; So that the content of multimedia of selected time window and selection type occupies whole screen just on map; Make travel notes that better bandwagon effect arranged, step is designated as LA at first to obtain the extreme value of GPS on longitude and latitude in specified data GPS unit 20
mAnd LO
mThen according to LA
m, LO
mValue confirm the level of zoom of map.Method is obtained extreme point up and down for map is chosen to be a certain grade i, and calculates latitude, longitude apart from remembering LA respectively
i, LO
iWhen selecting level of zoom, compare LA
m, LA
i, LA
I+1, and LO
m, LO
j, LO
J+1, work as LA
I-1＜LA
m＜LA
i&LO
J-1＜LO
m＜LO
j, (i, j), then selected map level of zoom is k to select k=min.Here provide and to answer i level LA in the map
i, LO
iData are done reference
| i | LA i(latitude) | LO i(longitude) | i | LA i(latitude) | LO i(longitude) |
| 1 | 170 | 360 | 9 | 2.3 | 1.8 |
| 2 | 132 | 223 | 10 | 0.4 | 0.88 |
| 3 | 80 | 100 | 11 | 0.09619 | 0.4408 |
| 4 | 40 | 57 | 12 | 0.024167 | 0.10987 |
| 5 | 20 | 55 | 13 | 11.958×10 -3 | 27.4673×10 -3 |
| 6 | 11 | 13 | 14 | 6.079×10 -3 | 13.732×10 -3 |
| 7 | 5 | 6 | 15 | 3.0070×10 -3 | 6.8665×10 -3 |
| 8 | 2.6 | 2.8 | 16 | 1.5093×10 -3 | 3.4386×10 -3 |
For example must answer in the map, China can be set at 3rd level, and a province can be set at the 5-6 level, and a school can be set at the 15th grade.
On map, show multimedia icon and route unit 60; Will be from map self adaptive pantographic unit 50 multi-medium datas and map level of zoom; According to time, GPS, icon deposit position; Corresponding GPS on map shows the multimedia icon according to the time order and function order, and is linked to be route according to time order and function, and generates tourism log.
The user browses the 70 pairs of tourism logs that generated in tourism log unit and carries out travel notes and browse, and comprises multimedia document browse unit 700, representative diagram blade unit 710 and comment unit 720.
Function comprises: map mode is switched in (1), and this function is that map carries service, and the pattern pattern travel pattern of taking photo by plane can be selected to add China's figure layer for CHINESE REGION and obtain more detailed information.(2) select whether show route, have route better to understand the travelling route, do not have route can better show icon.(3) synoptic diagram mark 1 map area is showed travel notes at Fig. 2 interface, and when user's mouse touched certain multimedia icon, icon amplified, and selects the multimedia messages zone to show corresponding time of these medium, name location information Fig. 2 mark 2 users.Map center is always current displaying multimedia icon center, improves display effect and has dynamic effect.And the multimedia browser zone shows the amplification icon in Fig. 2 mark 4.(4) when the user wants to browse former multimedia file, double-click icon, for picture, video and literal, open the new page and carry out picture browsing, video playback and literal and browse, for music file, double-click playing back music.(5) multimedia browser zone in Fig. 2 mark 4, knob down is sight spot before and after the visit in the click, clicks LR-button for browsing same sight spot.(6) representative diagram blade unit 710 realization functions are browsed the representative picture in same sight spot.(7) user can use the unfavorable picture of the alternative shooting of representative picture in this place, and implementation method is that url unit in the index structure (a) is revised as the address of depositing this representativeness picture, and this picture is omited contract drawing replacement icon element address corresponding content.(8) comment unit 720 functions are realized in comment zone in Fig. 2 mark 6.Comprise and show current place user comment, official's comment, other user comments and good friend's comment.The storage address of review information is c unit in the index structure (a).Individual subsidiary when wherein user comment is uploaded multimedia document for the user comments on; Official's comment is the comment of the sight spot on the disclosed main stream website; Calling GPS earlier changes place name API, then searches for place name, sight spot introduction (www.wiki.com) on the main use wikipedia among the present invention; This user comment of other users is same place but the different comment of ID for index GPS, and good friend's comment is that same place ID is this user good friend's comment for index GPS.The user can revise review information and issue, revises when revising comment in the former index that content gets final product among the comment address c.It is extra by search engine that this module characteristic is that the user does not need, and can understand this sight spot cultural information behind, other people tourism impression, and the own tourism of editor is experienced and is shared with other people.(9) good friend's window area in Fig. 2 mark 6, display navigation is crossed the good friend at this sight spot, can go sight-seeing the multimedia document of this good friend when browsing this sight spot.Implementation method is this user good friend ID corresponding content of index.(10) user is in the travel log process, can adjust time window scope and the multimedia type of selecting to show at any time, promptly revises the index condition, and system is according to new condition, the multimedia document that index satisfies, travel notes real-time update.
Wherein the representative diagram blade unit 710, show the representative picture in the same place of user's browsing pictures.Comprise that the picture place is accurate, reflect that this place represents scenery, reflect this place, different time such as daytime, night, different visual angles, characteristics such as repeatability is few without season.It is extra by search engine that this module characteristic is that the user does not need, and can browse the representative picture in this sight spot, remedied and only can see the sorry of a certain season or time period picture when the user travels.
Fig. 3 is that the representative picture of service end generates synoptic diagram.Unit 7101～7103 realization picture library is set up function, and the picture library pretreatment unit is realized in Unit 7104～7107, and Unit 7108 are representative picture systematic function.Can show representative picture in real time when browsing in order to reach the user, picture library is set up with the picture library processing unit and is pre-service.Because under a lot of situation of user's pictures taken GPS is non-famous sight spot, only be that the picture that the registered user uploads can't reach requirement therefore, expand the picture at the corresponding sight spot of retrieval GPS from WEB to picture library.Build in the process of storehouse, 7101 for reading user's uploading pictures GPS.Whether the middle ID uf of index of reference structure (a) distinguishes picture is user's uploading pictures, then need not to carry out the corresponding sight spot of GPS picture for non-user's uploading pictures and expands.GPS to user's uploading pictures carries out index in the storehouse, then need not carry out complement when the picture number reaches 30 when above, otherwise carry out the 7103WEB retrieval unit, utilizes photographic search engine to carry out complement and warehouse-in, and selecting the complement number equally is 30.Need carry out the conversion of 7102 unit GPS and place name before this.Then can't provide for the place that can't retrieve among the WEB and to browse representative picture function.Numeral 30 can be adjusted according to actual conditions, only does suggestion here.
Need pre-service is carried out in the storehouse after building the storehouse, 7104～7107 have carried out Visual Feature Retrieval Process respectively, an ordering and a type internal sort between KMEANS cluster, class, and after the complete pre-service, representative picture is the forward picture of ordering in the forward class of ordering.Pre-service picture library establishment step is for to carry visual signature 7104 to picture, and these are characterized as global characteristics, comprises color histogram, color moment, Wavelet Texture.Because of its dimension is low,, and can reflect overall color and texture information so complexity is low when large-scale data is handled.Color and texture information are for picture kind (like sea, high mountain, ancient building), and shooting time (like Various Seasonal, different time) can both be distinguished preferably.Then; Global characteristics is carried out cluster 7015; Use KMEANS clustering method (used characteristic of this paper and KMEANS clustering method are open characteristic and method in this area), getting the cluster centre number is 30, comprise 4 daytime in season black and without the combination of scene type.Through cluster, picture is divided in the different classes according to its color and texture in the picture library, according to picture kind and shooting time ordering.Sort 7016 between type of carrying out then,, avoid the user too to concentrate and cause result for retrieval deficiency in objective property, and make the forward class of ordering then for thinking classification with building, landscape according to GPS, user and the ordering of shooting time distribution range in the class.SIFT coupling ordering 7107 in type, the SIFT matching ratio in all kinds of types of doing.Choose a pictures Pi; A certain SIFT is described all SIFT among Xim and another pictures Pj describe Xjn and do similarity measurement, the nearest point of chosen distance is right as the preliminary election coupling, in order to reach symmetry; Have only when the minimum distance point of Xjn also is Xim, just confirm 2 couplings.Count when reaching 3 pairs when the coupling between two pictures, think this two pictures coupling.Number ordering according to picture and other pictures coupling.So far accomplish in the pre-service storehouse.With reference to existing open source literature (Kennedy L S; Naaman M.Generating Diverse and Representative Image Search Results for Landmarks [c] .Proceeding of the 17th International Conference on World Wide Web.China:ACM Press, the method in 2008:297-306.).
In the representative picture product process process in representative diagram blade unit 710,, set up index structure to representative picture collection in order to improve the speed of browsing representative picture.
Set up the index step for representative picture collection is set up concordance list shown in Fig. 4 (b), every representative picture is a delegation, and columns is 5, and an index type is shown in each tabulation, is respectively: id is the unique numbering of expression picture; Gps representes multimedia document GPS; Url representes the storage address of multimedia document; Cluster category label under the clu representative picture; The q representative picture is at class internal sort label.Index provides the pointer that points to the data value in the specify columns that is stored in table, and the clooating sequence according to appointment sorts to these pointers then.When the user browses representative picture Unit 7108, carry out the GPS index earlier, find the corresponding row of picture in the specific GPS scope; Read picture from small to large in proper order according to category label and type internal sort label then; Like clu1q1, clu2q1 ... Clunq1, clu1q2; Clu2q2 ... The selection of n here provides 10 here and only does reference according to actual conditions.
Claims (5)
1. visual network user's multimedia administration method is characterized in that, comprises the steps: customer multi-media data input cell 10, specified data GPS unit 20, time window unit 30; Multimedia type selected cell 40; Map self adaptive pantographic unit 50; On map, show multimedia icon and route unit 60; The user browses tourism log unit 70;
10 pairs of pictures 100 of said customer multi-media data input cell, video 110, literal 120 and audio frequency 130 are set up index;
Said specified data GPS unit 20 carries out GPS and confirms building up indexed data in the customer multi-media data input cell 10, comprises the positional information that resolution data is subsidiary; For the data of no positional information, the user carries out manual GPS mark, on map, finds correspondence position; For place name but not GPS information, obtain GPS through place name and GPS conversion API;
30 couples of specified data GPS unit, said time window unit 20 carries out the definite index of GPS and carries out time index;
Said multimedia type selected cell 40 confirms that with time window unit 30 multi-medium data behind the time index carries out the kind selection, comprises that picture, video, literal and audio frequency are a certain, or combination; On the basis of time window unit 30, carry out the index that the multimedia type requires again;
Said map self adaptive pantographic unit 50 is to time window unit 30 indexed results of selecting with multimedia type selected cell 40 that confirm; Carry out confirming of map level of zoom; So that the content of multimedia of selected time window and selection type occupies whole screen just on map, make travel notes that better bandwagon effect arranged;
Said multimedia icon and the route unit 60 of on map, showing; Will be from map self adaptive pantographic unit 50 multi-medium datas and map level of zoom; According to time, GPS, icon deposit position; Corresponding GPS on map shows the multimedia icon according to the time order and function order, and is linked to be route according to time order and function, and generates tourism log;
Said user browses the 70 pairs of tourism logs that generated in tourism log unit and carries out travel notes and browse, and comprises multimedia document browse unit 700, representative diagram blade unit 710 and comment unit 720.
2. visual network user's multimedia administration method as claimed in claim 1 is characterized in that, the concrete steps that customer multi-media data input cell 10 pairs of pictures, video, literal and audio frequency are set up index are:
Set up concordance list, each multimedia document is a delegation, and columns is 9, and an index type is shown in each tabulation, is respectively: id is the unique numbering of expression picture; Uf is user flag, and whether this figure of expressive notation is user's uploading pictures; U is user Id, the expression Customs Assigned Number; T is time, expression picture uplink time; M is that material representes the multimedia kind; Gps representes the GPS of multimedia document; Url representes the storage address of multimedia document; Icon representes the summary contract drawing target storing place of multimedia document, and wherein the picture icon is for omiting contract drawing, and video icon is a slightly contract drawing of first frame, and literal icon and music picture are the icon of expression literal and music; C representes to comment on storage address, and index provides the pointer that points to the data value in the specify columns that is stored in table, and the clooating sequence according to appointment sorts to these pointers then.
3. visual network user's multimedia administration method as claimed in claim 1 is characterized in that, 30 couples of specified data GPS unit, said time window unit 20 carries out the concrete grammar that index that GPS confirms carries out time index and is:
Time is t to note farthest apart from the present
01, be t apart from modern minimum distance
02With the user-selected time period is t
1And t
2, t when initial
1=t
01, t
2=t
02The present invention provides two kinds of approach to supply user's select time section.Approach one is the concrete starting and ending time of directly input.Approach two is for moving the LR-button of scroll bar.In approach two, the high order end of scroll bar is t
01Low order end is t
02All the time constant, the centre position evenly and the time shine upon one by one, LR-button has been mapped to new t like this
1, t
2According to t
1, t
2Confirm the time index scope.
4. visual network user's multimedia administration method as claimed in claim 1; It is characterized in that; Definite step of the map level of zoom in the said map self adaptive pantographic unit 50 is: at first obtain the extreme value of GPS on longitude and latitude in specified data GPS unit 20, be designated as LA
mAnd LO
mThen according to LA
m, LO
mValue confirm the level of zoom of map; Method is obtained extreme point up and down for map is chosen to be a certain grade i, and calculates latitude, longitude apart from remembering LA respectively
i, LO
i, when selecting level of zoom, compare LA
m, LA
i, LA
I+1, and LO
m, LO
j, LO
J+1, work as LA
I-1＜LA
m＜LA
i&LO
J-1＜LO
m＜LO
j, (i, j), then selected map level of zoom is k to select k=min.
5. visual network user's multimedia administration method as claimed in claim 1; It is characterized in that; Representative picture product process in the said representative diagram blade unit 710 comprises that picture library sets up unit, picture library pretreatment unit and representative picture generation unit, wherein:
Picture library is set up the unit and is at first used ID uf to distinguish picture whether to be user's uploading pictures, then need not to carry out the corresponding sight spot of GPS picture for non-user's uploading pictures and expands; GPS to user's uploading pictures carries out index in the storehouse; Then need not carry out complement when the picture number reaches 30 when above, otherwise carry out the WEB retrieval, utilize photographic search engine to carry out complement and warehouse-in; Same selection complement number is 30, need carry out the conversion of GPS and place name before this;
The picture library pretreatment unit carries out Visual Feature Retrieval Process respectively to picture, an ordering and a type internal sort between KMEANS cluster, class; Said visual signature is a global characteristics, comprises color histogram, color moment, Wavelet Texture; Then, global characteristics is carried out the KMEANS cluster, getting the cluster centre number is 30; Comprise 4 daytime in season black and without the combination of scene type; Through cluster, picture is divided in the different classes according to its color and texture in the picture library, according to picture kind and shooting time ordering; Sort between type of carrying out then, according to GPS, user and the ordering of shooting time distribution range in the class; SIFT coupling ordering in type; SIFT matching ratio in all kinds of types of doing is: choose a pictures Pi; A certain SIFT is described all SIFT among Xim and another pictures Pj describe Xjn and do similarity measurement, the nearest point of chosen distance is right as the preliminary election coupling, in order to reach symmetry; Have only when the minimum distance point of Xjn also is Xim, just confirm 2 couplings; Count when reaching 3 pairs when the coupling between two pictures, think and sort this two pictures coupling according to the number of picture with other pictures coupling;
Representative picture generation unit is for improving the speed of browsing representative picture; Set up index structure: representative picture collection is set up concordance list to representative picture collection; Every representative picture is a delegation; Columns is 5, and an index type is shown in each tabulation, is respectively: id is the unique numbering of expression picture; Gps representes multimedia document GPS; Url representes the storage address of multimedia document; Cluster category label under the clu representative picture; The q representative picture is at class internal sort label; Index provides the pointer that points to the data value in the specify columns that is stored in table, and the clooating sequence according to appointment sorts to these pointers then; When the user browses representative picture, carry out the GPS index earlier, find the corresponding row of picture in the specific GPS scope, read picture from small to large in proper order according to category label and type internal sort label then.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110364974 CN102521253B (en) | 2011-11-17 | 2011-11-17 | Visual multi-media management method of network users |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110364974 CN102521253B (en) | 2011-11-17 | 2011-11-17 | Visual multi-media management method of network users |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102521253A true CN102521253A (en) | 2012-06-27 |
| CN102521253B CN102521253B (en) | 2013-05-22 |
Family
ID=46292175
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201110364974 Expired - Fee Related CN102521253B (en) | 2011-11-17 | 2011-11-17 | Visual multi-media management method of network users |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102521253B (en) |
Cited By (33)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103049754A (en) * | 2012-12-07 | 2013-04-17 | 东软集团股份有限公司 | Picture recommendation method and device of social network |
| CN103116853A (en) * | 2012-10-12 | 2013-05-22 | 黄伟新 | Community network platform with electronic map as background |
| CN103399885A (en) * | 2013-07-19 | 2013-11-20 | 百度在线网络技术（北京）有限公司 | Mining method and device of POI (point of interest) representing images and server |
| CN103544159A (en) * | 2012-07-12 | 2014-01-29 | 北京蚂蜂窝网络科技有限公司 | Travel social interaction system and method based on position service information |
| CN104133845A (en) * | 2014-06-30 | 2014-11-05 | 百度在线网络技术（北京）有限公司 | Multimedia information display method and multimedia information display processing equipment |
| CN104618513A (en) * | 2015-03-03 | 2015-05-13 | 张子华 | Event recording and sharing system |
| CN104679901A (en) * | 2015-03-19 | 2015-06-03 | 苏州大学 | Travel photo log generation method and system |
| CN104714960A (en) * | 2013-12-13 | 2015-06-17 | 方正国际软件(北京)有限公司 | Method and system for adsorbing multimedia information through track points |
| WO2015117416A1 (en) * | 2014-07-29 | 2015-08-13 | 中兴通讯股份有限公司 | Photograph information processing method, device and terminal |
| CN104965706A (en) * | 2015-06-23 | 2015-10-07 | 武汉传神信息技术有限公司 | System and method for converting travel plan into visualized map |
| CN105049479A (en) * | 2015-05-28 | 2015-11-11 | 成都亿邻通科技有限公司 | Method for providing tour guide description for user |
| CN105095213A (en) * | 2014-04-22 | 2015-11-25 | 小米科技有限责任公司 | Information correlation method and device |
| CN105142113A (en) * | 2015-09-29 | 2015-12-09 | 邢永 | Automatic interpretation system and tour guiding method for scenic spots |
| CN105162876A (en) * | 2015-09-23 | 2015-12-16 | 百度在线网络技术（北京）有限公司 | Method, device and system for presenting geographical position information |
| CN105205093A (en) * | 2015-07-28 | 2015-12-30 | 小米科技有限责任公司 | Method and device for processing images in image library |
| CN105606106A (en) * | 2015-12-31 | 2016-05-25 | 华南师范大学 | Photo taking management method and system based on mobile positioning and electronic map |
| CN105681743A (en) * | 2015-12-31 | 2016-06-15 | 华南师范大学 | Video recording management method and system based on mobile locating and electronic map |
| CN105704444A (en) * | 2015-12-31 | 2016-06-22 | 华南师范大学 | Video shooting management method and system based mobile map and time geography |
| CN105721813A (en) * | 2016-04-06 | 2016-06-29 | 成都都在哪网讯科技有限公司 | Automatic video track forming method and system |
| CN105827959A (en) * | 2016-03-21 | 2016-08-03 | 深圳市至壹科技开发有限公司 | Geographic position-based video processing method |
| CN103593363B (en) * | 2012-08-15 | 2016-12-21 | 中国科学院声学研究所 | The method for building up of video content index structure, video retrieval method and device |
| CN106411679A (en) * | 2015-07-27 | 2017-02-15 | 北京盒陶软件科技有限公司 | Method and system of generating videos based on social information |
| CN106951467A (en) * | 2017-03-01 | 2017-07-14 | 心触动（武汉）文化传媒有限公司 | A kind of photo display method and system of photo sharing platform |
| CN107291959A (en) * | 2017-08-03 | 2017-10-24 | 深圳前海弘稼科技有限公司 | Travel log generation method and mobile terminal |
| WO2017181986A1 (en) * | 2016-04-22 | 2017-10-26 | 腾讯科技（深圳）有限公司 | Data retrieval method and system |
| WO2018006534A1 (en) * | 2016-07-04 | 2018-01-11 | 中兴通讯股份有限公司 | Place recommendation method, device, and computer storage medium |
| CN107656979A (en) * | 2017-09-06 | 2018-02-02 | 北京知识群信息技术有限公司 | A kind of sequential object two-dimensional space display methods and system |
| CN107797738A (en) * | 2017-09-28 | 2018-03-13 | 维沃移动通信有限公司 | The preview display method and mobile terminal of a kind of picture |
| CN109104570A (en) * | 2018-08-28 | 2018-12-28 | 广东小天才科技有限公司 | A kind of image pickup method and wearable device based on wearable device |
| CN109478302A (en) * | 2016-05-10 | 2019-03-15 | T·德兰 | Flow timeline social networks |
| CN109947981A (en) * | 2017-10-30 | 2019-06-28 | 上海全土豆文化传播有限公司 | Video sharing method and device |
| CN111555956A (en) * | 2019-12-11 | 2020-08-18 | 中国科学院软件研究所 | Method for processing picture containing readable geographic position information in instant messaging and electronic device |
| CN112261483A (en) * | 2020-10-21 | 2021-01-22 | 南京维沃软件技术有限公司 | Video output method and device |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1967148A (en) * | 2006-09-30 | 2007-05-23 | 江苏天泽信息产业有限公司 | Track recording method based on GPS for making navigation electronic map and recorder therefor |
-
2011
- 2011-11-17 CN CN 201110364974 patent/CN102521253B/en not_active Expired - Fee Related
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1967148A (en) * | 2006-09-30 | 2007-05-23 | 江苏天泽信息产业有限公司 | Track recording method based on GPS for making navigation electronic map and recorder therefor |
Non-Patent Citations (3)
| Title |
|---|
| MENG，L.: "《MISSING THEORIES AND METHODS》", 《PROCEEDINGS OF THE 21ST INTERNATIONAL CARTOGRAPHIC CONFERENCE (ICC)》 * |
| 凌云等: "《基于用户认知特征的地图可视化系统自适应用户界面研究》", 《测绘学报》 * |
| 李霖等: "《基于地图的地理信息可视化现状与发展》", 《测绘工程》 * |
Cited By (49)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103544159A (en) * | 2012-07-12 | 2014-01-29 | 北京蚂蜂窝网络科技有限公司 | Travel social interaction system and method based on position service information |
| CN103593363B (en) * | 2012-08-15 | 2016-12-21 | 中国科学院声学研究所 | The method for building up of video content index structure, video retrieval method and device |
| CN103116853A (en) * | 2012-10-12 | 2013-05-22 | 黄伟新 | Community network platform with electronic map as background |
| CN103049754B (en) * | 2012-12-07 | 2016-08-03 | 东软集团股份有限公司 | The picture recommendation method of social networks and device |
| CN103049754A (en) * | 2012-12-07 | 2013-04-17 | 东软集团股份有限公司 | Picture recommendation method and device of social network |
| CN103399885A (en) * | 2013-07-19 | 2013-11-20 | 百度在线网络技术（北京）有限公司 | Mining method and device of POI (point of interest) representing images and server |
| CN103399885B (en) * | 2013-07-19 | 2017-02-08 | 百度在线网络技术（北京）有限公司 | Mining method and device of POI (point of interest) representing images and server |
| CN104714960A (en) * | 2013-12-13 | 2015-06-17 | 方正国际软件(北京)有限公司 | Method and system for adsorbing multimedia information through track points |
| CN104714960B (en) * | 2013-12-13 | 2019-09-20 | 方正国际软件(北京)有限公司 | A kind of method and system of tracing point absorption multimedia messages |
| CN105095213A (en) * | 2014-04-22 | 2015-11-25 | 小米科技有限责任公司 | Information correlation method and device |
| CN105095213B (en) * | 2014-04-22 | 2019-10-11 | 小米科技有限责任公司 | Information correlation method and device |
| CN104133845A (en) * | 2014-06-30 | 2014-11-05 | 百度在线网络技术（北京）有限公司 | Multimedia information display method and multimedia information display processing equipment |
| CN105320689A (en) * | 2014-07-29 | 2016-02-10 | 中兴通讯股份有限公司 | Photo information processing method and device as well as terminal |
| WO2015117416A1 (en) * | 2014-07-29 | 2015-08-13 | 中兴通讯股份有限公司 | Photograph information processing method, device and terminal |
| CN104618513A (en) * | 2015-03-03 | 2015-05-13 | 张子华 | Event recording and sharing system |
| CN104679901A (en) * | 2015-03-19 | 2015-06-03 | 苏州大学 | Travel photo log generation method and system |
| CN105049479A (en) * | 2015-05-28 | 2015-11-11 | 成都亿邻通科技有限公司 | Method for providing tour guide description for user |
| CN104965706B (en) * | 2015-06-23 | 2018-03-06 | 语联网（武汉）信息技术有限公司 | A kind of system and method that tour plan is converted into visualized map |
| CN104965706A (en) * | 2015-06-23 | 2015-10-07 | 武汉传神信息技术有限公司 | System and method for converting travel plan into visualized map |
| CN106411679B (en) * | 2015-07-27 | 2019-10-22 | 北京盒陶软件科技有限公司 | One kind generating video method and system based on social information |
| CN106411679A (en) * | 2015-07-27 | 2017-02-15 | 北京盒陶软件科技有限公司 | Method and system of generating videos based on social information |
| CN105205093A (en) * | 2015-07-28 | 2015-12-30 | 小米科技有限责任公司 | Method and device for processing images in image library |
| CN105162876A (en) * | 2015-09-23 | 2015-12-16 | 百度在线网络技术（北京）有限公司 | Method, device and system for presenting geographical position information |
| CN105142113A (en) * | 2015-09-29 | 2015-12-09 | 邢永 | Automatic interpretation system and tour guiding method for scenic spots |
| CN105142113B (en) * | 2015-09-29 | 2018-06-08 | 邢永 | A kind of sight spot automatic briefing system and guidance method |
| CN105704444A (en) * | 2015-12-31 | 2016-06-22 | 华南师范大学 | Video shooting management method and system based mobile map and time geography |
| CN105606106A (en) * | 2015-12-31 | 2016-05-25 | 华南师范大学 | Photo taking management method and system based on mobile positioning and electronic map |
| CN105681743A (en) * | 2015-12-31 | 2016-06-15 | 华南师范大学 | Video recording management method and system based on mobile locating and electronic map |
| CN105681743B (en) * | 2015-12-31 | 2019-04-19 | 华南师范大学 | Video capture management method and system based on running fix and electronic map |
| CN105827959A (en) * | 2016-03-21 | 2016-08-03 | 深圳市至壹科技开发有限公司 | Geographic position-based video processing method |
| CN105721813A (en) * | 2016-04-06 | 2016-06-29 | 成都都在哪网讯科技有限公司 | Automatic video track forming method and system |
| WO2017181986A1 (en) * | 2016-04-22 | 2017-10-26 | 腾讯科技（深圳）有限公司 | Data retrieval method and system |
| US10984059B2 (en) | 2016-04-22 | 2021-04-20 | Tencent Technology (Shenzhen) Company Limited | Data retrieval method and system |
| US11650712B2 (en) | 2016-05-10 | 2023-05-16 | Peer Inc | Selection ring user interface |
| CN109478302A (en) * | 2016-05-10 | 2019-03-15 | T·德兰 | Flow timeline social networks |
| US11966559B2 (en) | 2016-05-10 | 2024-04-23 | Peer Inc | Selection ring user interface |
| CN107577679A (en) * | 2016-07-04 | 2018-01-12 | 西安中兴新软件有限责任公司 | Recommend method and device in a kind of destination |
| WO2018006534A1 (en) * | 2016-07-04 | 2018-01-11 | 中兴通讯股份有限公司 | Place recommendation method, device, and computer storage medium |
| CN106951467A (en) * | 2017-03-01 | 2017-07-14 | 心触动（武汉）文化传媒有限公司 | A kind of photo display method and system of photo sharing platform |
| CN107291959B (en) * | 2017-08-03 | 2020-11-17 | 深圳春沐源控股有限公司 | Travel log generation method and mobile terminal |
| CN107291959A (en) * | 2017-08-03 | 2017-10-24 | 深圳前海弘稼科技有限公司 | Travel log generation method and mobile terminal |
| CN107656979A (en) * | 2017-09-06 | 2018-02-02 | 北京知识群信息技术有限公司 | A kind of sequential object two-dimensional space display methods and system |
| CN107797738A (en) * | 2017-09-28 | 2018-03-13 | 维沃移动通信有限公司 | The preview display method and mobile terminal of a kind of picture |
| CN109947981A (en) * | 2017-10-30 | 2019-06-28 | 上海全土豆文化传播有限公司 | Video sharing method and device |
| CN109947981B (en) * | 2017-10-30 | 2022-03-22 | 阿里巴巴（中国）有限公司 | Video sharing method and device |
| CN109104570A (en) * | 2018-08-28 | 2018-12-28 | 广东小天才科技有限公司 | A kind of image pickup method and wearable device based on wearable device |
| CN111555956A (en) * | 2019-12-11 | 2020-08-18 | 中国科学院软件研究所 | Method for processing picture containing readable geographic position information in instant messaging and electronic device |
| CN111555956B (en) * | 2019-12-11 | 2022-01-11 | 中国科学院软件研究所 | Method for processing picture containing readable geographic position information in instant messaging and electronic device |
| CN112261483A (en) * | 2020-10-21 | 2021-01-22 | 南京维沃软件技术有限公司 | Video output method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102521253B (en) | 2013-05-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102521253B (en) | Visual multi-media management method of network users | |
| US11650712B2 (en) | Selection ring user interface | |
| US8032510B2 (en) | Social aspects of content aggregation, syndication, sharing, and updating | |
| US8655873B2 (en) | System and method for aggregating and distributing geotagged content | |
| US9917804B2 (en) | Multi-post stories | |
| WO2019109245A1 (en) | Method and device for displaying story album | |
| US9026917B2 (en) | System and method for context enhanced mapping within a user interface | |
| US8452855B2 (en) | System and method for presentation of media related to a context | |
| US20130346862A1 (en) | Temporal and geographic presentation and navigation of linked cultural, artistic, and historic content | |
| US20140297666A1 (en) | Managing event data in a diary | |
| US20100171763A1 (en) | Organizing Digital Images Based on Locations of Capture | |
| CN105612472A (en) | Sharing images and comments across different devices | |
| US20090210793A1 (en) | Method and system for traversing digital records with multiple dimensional attributes | |
| TWI464665B (en) | Systems and methods for managing media content using a communications device | |
| WO2014140377A1 (en) | Automated diary population ii | |
| WO2008014406A1 (en) | Method and system for organizing multimedia content | |
| US12015683B2 (en) | Method, apparatus and device for issuing and replying to multimedia content | |
| CN103246710A (en) | Method and device for automatically generating multimedia travel notes | |
| US20170192645A1 (en) | System and method for storing and searching digital media | |
| Pham et al. | Investigating the usability of a mobile location-based annotation system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130522 Termination date: 20151117 |