CN106713728A - Method and system for enhancing scenic spot photographing information - Google Patents
Method and system for enhancing scenic spot photographing information Download PDFInfo
- Publication number
- CN106713728A CN106713728A CN201510770236.8A CN201510770236A CN106713728A CN 106713728 A CN106713728 A CN 106713728A CN 201510770236 A CN201510770236 A CN 201510770236A CN 106713728 A CN106713728 A CN 106713728A
- Authority
- CN
- China
- Prior art keywords
- information
- picture
- module
- geographical position
- photograph
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2405—Monitoring of the internal components or processes of the server, e.g. server load
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides a method and a system for enhancing scenic spot photographing information. The method comprises steps: when a picture is generated through photographing, a photographed geographical position is enhanced, managed and recorded; a compressed data stream for the picture and the geographical position are uploaded to an information service cloud platform; the cloud platform deletes a face area from the received data stream, and the remaining area serves as a to-be-processed picture; the cloud platform selects picture sample space for the scenic spot through the received photographed geographical position, the to-be-processed picture and each sample point in the sample space are subjected to feature point matching, an index number for the sample point with the maximum matching possibility is acquired, building or scenery data in the picture and the local service information are hit through the index number, and the data and the information are transmitted back to a photographing device finally; and the photographing device analyzes the back transmitted information and triggers a new layer for display. The system comprises the photographing device and a distributed clustering server, that is, the information service cloud platform. Thus, the problem that a scenic spot picture loses resource information is solved.
Description
Technical field
The present invention relates to smart machine shooting technology field, the method for information and it is in particular it relates to a kind of enhancing sight spot is taken pictures
System.
Background technology
Go out tourism, people wonder the historical background knowledge of building or landscape, usually surround guide, listen attentively to and tell.Separately
Outward, it is that people retain the necessary means remembered that sight spot is taken pictures, and has also lacked the description of relevant information, as time goes by,
People may greatly have forgotten related data information.It can be seen that, tourism of at present going out is taken pictures and relevant information is asked for, and is entirely
Separate, time and the consumer cost of people can be increased, bring inconvenience.
The content of the invention
The main purpose of the embodiment of the present invention is to provide the method and system that information is taken pictures at a kind of enhancing sight spot, to solve tourism
Take pictures and relevant information is asked for, be entirely separate problem.By the embodiment of the present invention, realization allows photograph " speaking ",
Actively tell building or landscape relevant information and ambient services information in the sight spot captured by people.
The embodiment of the present invention provides a kind of method that information is taken pictures at enhancing sight spot, is applied to smart machine and the information that can be taken pictures
Service cloud platform, including：Take pictures generation photograph when, the geographical position of Strengthening Management records photographing；Extract the pressure of the photograph
Contracting data flow；The compressed data stream and the geographical position are uploaded to information service cloud platform by network；Information service cloud
Platform first does recognition of face to the data flow for receiving, then will delete the data flow after human face region as pending picture；
Information service cloud platform filters out the picture sample space at place sight spot by the shooting geographical position for receiving, and waits to locate by described
Reason picture does Feature Points Matching with each sample point in the sample space, obtains the sample point call number that may greatly match；
Information service cloud platform hits the historical knowledge and local service of building or landscape in the photograph by the call number
Information, then it is back to photographing device；Photographing device parses the enhancement information of passback and creates new figure layer and shows.
Further, in an embodiment of the present invention, it is described take pictures generation photograph when, the geography of Strengthening Management records photographing
Position, including：LBS positioning functions, obtain and shoot particular geographic location；Strengthening Management function, real time record simultaneously preserves bat
Every sheet photo in the geographical position taken the photograph, with photograph management is corresponded.
Further, in an embodiment of the present invention, the compressed data stream of the described extraction photograph, including：Picture pressure
Contracting stream abstraction function, no matter photograph management preserves original photograph using which kind of form, read using specified compression form secondly
System stream, such as be defined as jpeg forms.Real-time in view of information processing, it is necessary to judge the current environment network bandwidth and
Photograph size, decides whether to do data flow gray processing treatment, the data so in the case of ensureing that image characteristic point is distortionless
The amount of flowing to end is small.
Further, in an embodiment of the present invention, the described compressed data stream and the geographical position are by network
Information service cloud platform is reached, including：Network monitoring function, monitors whether network connects；Data are sent by http agreements
Bag and reception response data packet；
Further, in an embodiment of the present invention, described information service cloud platform is first conducted oneself to the data flow for receiving
Face is recognized, then will delete the data flow after human face region as pending picture, including：Face identification functions, if someone
Face, the human face region occurred in locking photograph；All human face regions are deleted in the photograph, noise reduction process, mesh is done
Reduction characteristic value interference.
Further, in an embodiment of the present invention, described information service cloud platform passes through the shooting geographical position for receiving
The picture sample space at sight spot, feature is done by the pending picture with each sample point in the sample space where filtering out
Point matching, obtains the sample point call number that may greatly match, including：Information service cloud platform is based on geographical position to all
Samples pictures do sets classification, divide different sample spaces；Information service cloud platform passes through the shooting geographical position for receiving
One sample space of hit, if a miss sample space, a new sample sky is created based on geographical position is shot
Between, and allow and encourage user to be uploaded to newly sight spot picture and associated description information by photographing device as new sample point
The sample space built；The pending picture does images match respectively with each sample point in the sample space, calculates respective
The feature of matching is counted out；Compare the feature to count out, take its maximum；If the maximum is more than given threshold value,
Then using the sample point belonging to the maximum as the very big picture that may be matched, its call number is obtained；If the maximum is small
In given threshold value then without matching picture, then user is allowed and encouraged using sight spot picture and associated description information as new sample
Point is uploaded to described sample space by photographing device.
Further, in an embodiment of the present invention, described information service cloud platform is by the call number, and hit is described
The historical knowledge and local service information of building or landscape in photograph, then photographing device is back to, including：Historical summary
Storehouse, obtains the historical background knowledge of tourist attractions related building or landscape；Local service information storehouse, obtains food and clothing and lives row phase
Pass information.
Accordingly, the present invention also provides the system that information is taken pictures at a kind of enhancing sight spot, including：
Photographing device, for obtaining photo data and shooting geographical position；
Distributed type assemblies server, as information service cloud platform, safeguards picture sample space and relevant information, and image
Matching treatment.
Further, in an embodiment of the present invention, described photographing device, including：
Photo module, camera obtains current image, and saves as photograph, and triggers LBS locating modules, Strengthening Management mould
Block, mixed-media network modules mixed-media；
LBS locating modules, obtain the geographical position for shooting；
Strengthening Management module, database or file preserve the geographical position of the photograph captured by every in real time, and trigger data stream is carried
Modulus block, enhancement information display module；
Data flow extraction module, original photograph binary stream is read using specified compression form, generally uses jpeg forms, is made
Its size is as far as possible small；
Enhancement information display module, parses the relevant information of passback and creates new figure layer and show；
Mixed-media network modules mixed-media, monitors whether network connects；Based on the REST network architectures, number is sent by the post methods of http agreements
According to bag and reception response data packet.
Further, in an embodiment of the present invention, described distributed type assemblies server, including：
All samples pictures are done sets classification by sample management module based on geographical position, divide different sample spaces, tool
There are newly-built, deletion sample space function and addition, delete sample point function.
Module is retrieved in geographical position, and the shooting geographical position for retrieving photograph whether there is so that the sample at sight spot where filtering out
Space；If not retrieving the position, record the position and create correspondence sample space, then trigger open platform module,
Allow and encourage user to be uploaded to sight spot picture and associated description information by photographing device as new sample point newly-built
Sample space；
Open platform module, it is allowed to user's registration account, uploads the sight spot picture and associated description information autodyned to sample space.
Face recognition module, face is whether there is in identification photograph, calculates its region；
Noise reduction process module, deletes human face region as pending picture, and purpose reduces characteristic value interference, improves matching precision；
Characteristic matching module, the pending picture does images match respectively with each sample point in the sample space, calculates
The feature of each Self Matching is counted out；Compare the feature to count out, take its maximum；If the maximum is more than given
Threshold value, then using the sample point belonging to the maximum as the very big picture that may be matched, obtain its call number；If it is described most
Big value then without matching picture, then triggers open platform module less than given threshold value, it is allowed to and encourage user by sight spot picture and
Associated description information is uploaded to described sample space as new sample point by photographing device；
Knowledge management module, the call number of the sample point according to matching, triggering historical summary module, periphery diet module, friendship
Communication breath, hits the historical background knowledge and local service information of building or landscape in the photograph, then is back to and takes pictures
Equipment.
Historical summary module, safeguards the historical information or associated description information of building or landscape in sight spot；
Periphery diet module, safeguards relevant restaurants information in sight spot；
Transport information module, safeguards the public transport traffic information in sight spot periphery or scenic spot.
By means of above-mentioned technical proposal, the present invention, by LBS location informations, obtains place sight spot figure during equipment is taken pictures
Piece sample space, then based on images match obtain sample point call number, hit photograph in building or landscape historical summary,
The information such as local service.Compared to existing shooting technology, solve that tourism is taken pictures and relevant information is asked for, be entirely separate
Problem, not only obtains auxiliary information in real time beneficial to when taking pictures, and also allows for follow-up photograph and checks, more three-dimensional, various dimensions.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, institute in being described to embodiment below
The accompanying drawing for needing to use is briefly described, it should be apparent that, drawings in the following description are only some implementations of the invention
Example, for those of ordinary skill in the art, on the premise of not paying creative work, can also be according to these accompanying drawings
Obtain other accompanying drawings.
Fig. 1 is the method flow schematic diagram that the photographing device that the present invention is provided obtains enhancement information in real time；
Fig. 2 is the schematic flow sheet that the photographing device that the present invention is provided extracts photo data stream；
Fig. 3 is the method flow schematic diagram of the information service cloud platform treatment enhancing request that the present invention is provided；
Fig. 4 is the schematic flow sheet that the information service cloud platform that the present invention is provided does images match to the photo data stream for receiving；
Fig. 5 is the structured flowchart of photographing device acquisition enhancement information in the system that the present invention is provided；
Fig. 6 is the structured flowchart of distributed type assemblies server process enhancing request in the system that the present invention is provided.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clearly and completely
Description, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.Based on this
Embodiment in invention, the every other reality that those of ordinary skill in the art are obtained under the premise of creative work is not made
Example is applied, the scope of protection of the invention is belonged to.
In the present invention, " photographing device " can be mobile phone, pad, camera or other equipment that can be taken pictures.
As shown in figure 1, obtaining the method flow schematic diagram of enhancement information in real time for a kind of photographing device of the embodiment of the present invention, wrap
Include：
Step S11, take pictures generation photograph when, the geographical position of Strengthening Management records photographing.
Specifically, the step is based on LBS positioning functions, obtain it is specific shoot geographical position, then by described geographical position
It is stored in the database of Strengthening Management or file.Preferably, LBS can navigate to the accurate geographic position taken pictures.
LBS orientates location Based service as, be by the radio communication network of telecommunications mobile operator (such as GSM nets,
CDMA nets) or outside positioning method (such as GPS) obtain the positional information of mobile terminal user (geographical coordinate, or the earth sat
Mark), under the support of GIS platform, provide the user a kind of value-added service of respective service.The present invention is to LBS
The selection of positioning service is not construed as limiting, and can select as needed.
Step S12, extracts the compressed data stream of the photograph.
Specifically, considering the network bandwidth, photo data stream, such as jpeg forms are obtained using compressed format.The present invention is to pressure
Contracting form is not limited, and can be selected according to actual conditions.In a kind of preferred embodiment, it is contemplated that the reality of information processing
When property does gray processing treatment to data flow, it is necessary to judge the current environment network bandwidth and photograph size, is so ensureing image
Data flow is as far as possible small in the case of characteristic point is distortionless.Step S12 can be realized according to specific steps as shown in Figure 2：
Step S121, setting data stream size threshold value K and network bandwidth threshold value U.
Specifically, data stream size threshold value K and network bandwidth threshold value U, 2 values are pre-defined, the present invention
It is not specifically limited, each producer debugs according to actual conditions and sets, it is proposed that value：K=2.5M, U=10M.
Step S122, reads photo data stream, and calculate its size ε with specified compression form.
Specifically, different manufacturers, the original photograph form preserved when taking pictures may be different, so as to cause difference in size very big,
So the present invention reads photo data stream using specified compression form, it is proposed that use jpeg forms.
Step S123, if ε ＞ K, go to step S124, otherwise goes to step S125.
Step S124, the photo data stream makees gray processing, as pending data stream after treatment.
Specifically, opencv image gray processing universal method CV_BGR2GRAY parameter processings can be used.Opencv methods are only
Only it is a kind of image procossing mainstream scheme, the present invention is not construed as limiting to the method for gray processing, can as needed select other images
Processing method.
Step S125, calculates current network bandwidth size ψ.
Step S126, if ψ ＜ U, go to step S124.
Step S13, the compressed data stream and the geographical position are uploaded to information service cloud platform by network.
Specifically, encapsulation of data stream and geographical position are in a packet, based on the REST network architectures, by http agreements
Post methods are uploaded to information cloud service device., it is necessary to audiomonitor network connection state always in a kind of preferred embodiment,
Ensure the integrality of data is activation.
Step S14, the information of parsing described information service cloud platform passback, and the page show.
Specifically, photographing device parses the packet that information service cloud platform is returned according to data form, related building is obtained
Or the background information of landscape, food and clothing live row information on services, can be floated on photograph and shown, it is also possible to set up another button triggering new
Figure layer is built to show.In a kind of preferred embodiment, return data bag is encapsulated using json forms.
Accordingly, as shown in figure 3, being a kind of method flow of information service cloud platform treatment enhancing request of the embodiment of the present invention
Schematic diagram, including：
Step S21, the samples pictures classification based on geographical position to all sight spots, generation sample space { PN| N represents geographical position
Put }.
Specifically, in huge picture sample, the sample difference alienation in similar sight spot is less obvious, this in order to reduce
Error, improves precision, it is necessary to information service cloud platform is done based on geographical position to all samples pictures classifies, and division is different
Sample space, using set { PN| N represents geographical position } represent.
Step S22, waits and receives the geographical position m and photo data stream of photographing device upload.
Specifically, information service cloud platform is constantly in network monitoring state, photographing device is waited to upload enhancing solicited message；
After request has been processed, the step can be immediately returned to.
Step S23, if m ∈ N, go to step S24, otherwise goes to step S25.
Step S24, obtains the sample space P of geographical position mm。
Specifically, information service cloud platform has the geographical position m of user's upload, the geography is obtained from all samples pictures
The sample space P of positionm, purpose reduction seeking scope, raising precision.
Step S25, N=N+m.
Specifically,The geographical position m that i.e. information service cloud platform is uploaded in the absence of user, will automatically record the ground
Reason position, newly-built sample space Pm。
Step S26, the photo data stream respectively with PmIn each sample point do Feature Points Matching, obtain and each sample point
Set { the T that the feature of matching is counted outi| i represents sample point call number }.
Specifically, the samples pictures that the step is the photograph and place sight spot for uploading user do characteristic matching.A kind of preferable
Embodiment in, step S26 can be realized according to specific steps as shown in Figure 4：
Step S261, recognition of face is done to the photo data stream.
Specifically, when user takes pictures, often people's scape unification.Using face recognition technology by all human face regions in photograph
All identify.Can be obtained using opencv recognition of face API services interface.Opencv methods are only a kind of image procossing master
Stream scheme, the present invention is not construed as limiting to the method for recognition of face, can as needed select other image processing methods.
Step S262, if there is human face region, then goes to step S263.
Step S263, removal human face region turns into pending data stream.
Specifically, recognize that the appearance of character features can increase the similarity between image for the building in photograph or landscape,
This discrimination can be reduced on the contrary, so face is noise region, it is necessary to reject.Can be interested using excavating for opencv
Region (Region of Interest, ROI) method extract.It is only a kind of image procossing main flow that Opencv sets ROI methods
Scheme, the present invention is not construed as limiting to setting ROI methods, can as needed select other image processing methods.
Step S264, the pending data stream and PmIn each sample point do Feature Points Matching.
Specifically, for Feature Points Matching, the existing maturation image processing algorithm storehouse opencv of industrial quarters can be according to characteristic point
The api functions such as matching algorithm fast, sift, surf are completed.In a kind of preferred embodiment, it is contemplated that information processing it is real-time
Property, usually using surf algorithms.The present invention can as needed select other images to being not construed as limiting from the method for images match
Processing method.
Step S265, the feature point number that statistics has been matched with each sample point, and form set { Ti| i represents sample point rope
Quotation marks }.
Specifically, photograph can retrieve multiple characteristic points for matching with each sample Point matching, the feature of matching is each calculated
The number of point, forms a sample Point matching sequence { Ti| i represents sample point call number }.
Step S27, compares set { TiIn each element, obtain element maximum max (T).
Specifically, the characteristic point of matching is more, the similarity between explanatory diagram picture is bigger, so filtering out set { TiIn
Maximum.For obtaining max methods, the present invention is not limited, and is selected according to actual algorithm.
Step S28, if max (T) >=W (predetermined threshold), goes to step S29, otherwise goes to step S210.
Specifically, producer is according to actual debugging situation, the size of self-defined threshold value W, it is ensured that the photo data stream that user uploads
Can be coincide with the sample data for matching, reduce similar building or landscape interference matching result.
Step S29, data bank, transport information storehouse, diet information storehouse, other local service storehouses are searched according to sample index i,
Return hit information to photographing device.
Step S210, returns without matched sample message to photographing device, and notifies that user believes the picture and associated description autodyned
Breath is uploaded to sample space P as new sample pointm。
Specifically, in a kind of preferred embodiment, it is contemplated that during without matching pictorial information, not only to inform user, also
In sample space where allowing user to upload original photograph and known background information to sight spot, sample appearance is not only expanded
Amount, also increases interactive, reaches opening.
The present invention, by LBS location informations, obtains place sight spot picture sample space during equipment is taken pictures, then based on figure
The call number of sample point is obtained as matching, the information such as historical summary, local service of building or landscape in hit photograph.Phase
Than existing shooting technology, solve that tourism is taken pictures and relevant information is asked for, be entirely separate problem, not only beneficial to taking pictures
When obtain auxiliary information in real time, also allow for follow-up photograph and check, more three-dimensional, various dimensions.
The present invention also provides a kind of system, including photographing device and distributed type assemblies server.
Specifically, as shown in figure 5, the photographing device includes：
Photo module 51, generates photograph, and trigger LBS locating modules 52, Strengthening Management module 53, mixed-media network modules mixed-media 54；
LBS locating modules 52, obtain the geographical position for shooting；
Strengthening Management module 53, database or file preserve the geographical position of the photograph captured by every, trigger data stream in real time
Extraction module 55, enhancement information display module 56；
Mixed-media network modules mixed-media 54, monitors whether network connects；Based on the REST network architectures, sent by the post methods of http agreements
Packet and reception response data packet.
Data flow extraction module 55, original photograph binary stream is read using specified compression form, generally uses jpeg forms,
Make its size as far as possible small；
Enhancement information display module 56, parses the relevant information of passback and creates new figure layer and show；
Photographing device is based on identical invention thought reality with the method for the acquisition enhancement information shown in Fig. 1 in system shown in Fig. 5
It is existing, its specific embodiment can refer to it is foregoing to taking pictures when photographing device obtain the method introduction of enhancement information in real time, herein not
Repeat again.
Accordingly, as shown in fig. 6, the distributed type assemblies server includes：
Module 61 is retrieved in geographical position, and the shooting geographical position for retrieving photograph whether there is so that the sample at sight spot where filtering out
This space；If not retrieving the position, record the position and create correspondence sample space, then trigger open platform module
70, it is allowed to newly-built with encouraging user to be uploaded to sight spot picture and associated description information by photographing device as new sample point
Sample space；
Face recognition module 62, face is whether there is in identification photograph, calculates its region；
Noise reduction process module 63, rejects human face region as pending picture, and purpose reduces characteristic value interference, improves matching essence
Degree；
Characteristic matching module 64, the pending picture does images match respectively with each sample point in the sample space, meter
The feature for calculating each Self Matching is counted out；Compare the feature to count out, take its maximum；If the maximum is more than given
Threshold value, then using the sample point belonging to the maximum as it is very big may matching picture, obtain its call number；If described
Maximum then without matching picture, then triggers open platform module 70 less than given threshold value, it is allowed to and user is encouraged by sight spot figure
Piece and associated description information are uploaded to described sample space as new sample point by photographing device；
All samples pictures are done sets classification by sample management module 65 based on geographical position, divide different sample spaces,
With newly-built, deletion sample space function and addition, delete sample point function.
Knowledge management module 66, the call number of the sample point according to matching, triggering historical summary module, periphery diet module,
Transport information, hits the historical background knowledge and local service information of building or landscape in the photograph, then returns to bat
According to equipment.
Historical summary module 67, safeguards the historical information or associated description information of building or landscape in sight spot；
Periphery diet module 68, safeguards relevant restaurants information in sight spot；
Transport information module 69, safeguards the public transport traffic information in sight spot periphery or scenic spot.
Open platform module 70, it is allowed to user's registration account, the sight spot picture and associated description information for uploading auto heterodyne is empty to sample
Between.
In a kind of preferred embodiment, knowledge management module 66 includes：
Docking third party's module, manufacturer provides interface, cooperates with third company, extension historical summary module 67, periphery drink
Food module 68, transport information module 69, such as Baidu is known, masses comment on, public transport company.
The side that distributed type assemblies server is asked with the information service cloud platform treatment enhancing shown in Fig. 3 in system shown in Fig. 6
Method realizes that its specific embodiment can refer to foregoing to the treatment enhancing request of information service cloud platform based on identical invention thought
Method introduction, here is omitted.
The present invention, by LBS location informations, obtains place sight spot picture sample space during equipment is taken pictures, then based on figure
The call number of sample point is obtained as matching, the information such as historical summary, local service of building or landscape in hit photograph.Phase
Than existing shooting technology, solve that tourism is taken pictures and relevant information is asked for, be entirely separate problem, not only beneficial to taking pictures
When obtain auxiliary information in real time, also allow for follow-up photograph and check, more three-dimensional, various dimensions.
Particular embodiments described above, has been carried out further specifically to the purpose of the present invention, technical scheme and beneficial effect
It is bright, should be understood that and the foregoing is only specific embodiment of the invention, the protection being not intended to limit the present invention
Scope, all any modification, equivalent substitution and improvements within the spirit and principles in the present invention, done etc., should be included in
Within protection scope of the present invention.
Those skilled in the art will also be appreciated that the various illustrative components, blocks (illustrative that the embodiment of the present invention is listed
Logical block), unit, and step can be realized by the combination of electronic hardware, computer software, or both.For
Clearly show that the replaceability (interchangeability) of hardware and software, above-mentioned various illustrative components (illustrative
Components), unit and step universally describe their function.Such function is by hardware or soft
Part realizes depending on the design requirement of specific application and whole system.Those skilled in the art can be specific for every kind of
Using, it is possible to use various methods realize described function, but this realization is understood not to be protected beyond the embodiment of the present invention
The scope of shield.
Various illustrative logical block described in the embodiment of the present invention, or unit, or device can be by general procedure
Device, digital signal processor, application specific integrated circuit (ASIC), field programmable gate array or other programmable logic devices,
The design of discrete gate or transistor logic, discrete hardware components, or any of the above described combination is come the function realized or described by operate.
General processor can be microprocessor, alternatively, the general processor can also for any traditional processor, controller,
Microcontroller or state machine.Processor can also be realized by the combination of computing device, for example digital signal processor and micro-
Processor, multi-microprocessor, one or more microprocessors combine a Digital Signal Processor Core, or any other class
As configuration realize.
The step of method or algorithm described in the embodiment of the present invention, can be directly embedded into the software mould of hardware, computing device
Block or the combination of both.Software module can be stored in RAM memory, flash memory, ROM memory, EPROM
Other arbitrary shapes in memory, eeprom memory, register, hard disk, moveable magnetic disc, CD-ROM or this area
In the storage medium of formula.Exemplarily, storage medium can be connected with processor, to allow processor from storage medium
Middle reading information, it is possible to deposit write information to storage medium.Alternatively, storage medium can also be integrated into processor.Place
Reason device and storage medium can be arranged in ASIC, and ASIC can be arranged in user terminal.Alternatively, processor and deposit
Storage medium can also be arranged in the different part in user terminal.
In one or more exemplary designs, above-mentioned functions described by the embodiment of the present invention can hardware, software,
Any combination of firmware or this three is realized.If realized in software, these functions can store the matchmaker with computer-readable
On Jie, or it is transmitted on the medium of computer-readable with one or more instructions or code form.Computer readable medium includes computer
Store medium and be easy to so that allowing computer program to be transferred to other local telecommunication medias from a place.Storing medium can be
Any general or special computer can be with the useable medium of access.For example, such computer readable media can include but not
It is limited to RAM, ROM, EEPROM, CD-ROM or other optical disc storages, disk storage or other magnetic storage devices,
Other it is any can be used for carrying or store with instruct or data structure and other can by general or special computer or it is general or
Special processor reads the medium of the program code of form.Additionally, any connection can be properly termed computer-readable
Medium, if for example, software is to pass through coaxial cable, a light from web-site, server or other remote resources
Fiber-optic cable, twisted-pair feeder, Digital Subscriber Line (DSL) or with the wireless way for transmitting such as example infrared, wireless and microwave also by
It is included in defined computer readable medium.Described disk (disk) and disk (disc) include Zip disk, radium-shine
Disk, CD, DVD, floppy disk and Blu-ray Disc, disk is generally with magnetic duplication data, and disk generally carries out light with laser
Learn replicate data.Combinations of the above can also be included in computer readable medium.
Claims (10)
1. a kind of enhancing sight spot is taken pictures the method for information, it is characterised in that the enhancing sight spot is taken pictures the method for information, including：
Take pictures generation photograph when, the geographical position of Strengthening Management records photographing；
Extract the compressed data stream of the photograph；
The compressed data stream and the geographical position are uploaded to information service cloud platform by network；
Information service cloud platform first does recognition of face to the data flow for receiving, then will delete the data flow after human face region as pending picture；
Information service cloud platform filters out the picture sample space at place sight spot by the shooting geographical position for receiving, and the pending picture and each sample point in the sample space are done into Feature Points Matching, obtains the sample point call number that may greatly match；
Information service cloud platform hits the historical knowledge and local service information of building or landscape in the photograph by the call number, then is back to photographing device；
Photographing device parses the enhancement information of passback and creates new figure layer and shows.
2. enhancing sight spot according to claim 1 is taken pictures the method for information, it is characterised in that it is described take pictures generation photograph when, the geographical position of Strengthening Management records photographing, including：
LBS positioning functions, obtain and shoot particular geographic location；
Strengthening Management function, real time record simultaneously preserves the geographical position of shooting, is corresponded with every the sheet photo in photograph management, it is possible to use database or file preservation data.
3. enhancing sight spot according to claim 1 is taken pictures the method for information, it is characterised in that the compressed data stream of the described extraction photograph, including：
Picture compression stream abstraction function, no matter original image is preserved with what form, its binary stream is read by unification with specified compressed format, and purpose makes data flow as far as possible small, and real-time response is such as defined as jpeg compressed formats；
Judge the current environment network bandwidth and data stream size, decide whether to do data flow gray processing treatment based on predetermined threshold, the photo data stream size that definition data stream size threshold value is K, network bandwidth threshold value is U, read in the compressed format is ε, current network bandwidth size ψ, if ε ＞ K or ψ ＜ U, data flow gray processing.
4. enhancing sight spot according to claim 1 is taken pictures the method for information, it is characterised in that described information service cloud platform first does recognition of face to the data flow for receiving, then will delete the data flow after human face region as pending picture, including：
Face identification functions, if face, the human face region occurred in locking photograph；
All human face regions are deleted in the photograph, noise reduction process is done, purpose reduces characteristic value interference, obtains image-region ROI interested.
5. enhancing sight spot according to claim 1 is taken pictures the method for information, it is characterized in that, described information service cloud platform filters out the picture sample space at place sight spot by the shooting geographical position for receiving, the pending picture is done into Feature Points Matching with each sample point in the sample space, the sample point call number that may greatly match is obtained, including：
Information service cloud platform does sets classification to all samples pictures based on geographical position, divides different sample spaces, i.e. { PN| N represents geographical position }；
The shooting geographical position that definition information service cloud platform is received is m, if m ∈ N, the sample space P of hit to placem, obtain Pm；IfA sample space is not ordered then, and the platform can automatically record geographical position m, i.e. N=N+m, and a newly-built corresponding sample space Pm, it is allowed to and encourage user that sight spot picture and associated description information are uploaded into newly-built sample space P by photographing device as new sample pointm；
The pending picture and sample space PmIn each sample point do images match respectively, the feature for counting each Self Matching is counted out, i.e. { Ti| i represents sample point call number }；
Compare set { TiIn each element, obtain element maximum max (T)；
Threshold value W is defined, if max (T) >=W, using the sample point belonging to the maximum as the very big picture that may be matched, its call number i is obtained；If max (T) ＜ W, without matching picture, it is allowed to and encourage user that sight spot picture and associated description information are uploaded into sample space P by photographing device as new sample pointm, i=i+1.
6. enhancing sight spot according to claim 1 is taken pictures the method for information, characterized in that, described information service cloud platform hits the historical knowledge and local service information of building or landscape in the photograph by the call number, photographing device is back to again, including：
Historical summary storehouse, obtains the historical background knowledge of tourist attractions related building or landscape；
Periphery diet restaurant information, obtains restaurant locations and style of cooking characteristic；
Periphery transport information, obtains Bus information；
Other value added service informations, obtain other local service informations.
7. a kind of system, it is characterised in that including：
Photographing device, for obtaining photo data and shooting geographical position；
Distributed type assemblies server, as information service cloud platform, safeguards picture sample space and relevant information, and images match treatment.
8. system according to claim 7, it is characterised in that the photographing device includes：
Photo module, camera obtains current image, and saves as photograph；
LBS locating modules, obtain the geographical position for shooting；
Strengthening Management module, preserves the geographical position of the photograph captured by every in real time；
Data flow extraction module, original photograph binary stream is read using specified compression form, makes its size as far as possible small, is such as defined as jpeg forms,；
Enhancement information display module, parses the relevant information of passback and creates new figure layer and show；
Mixed-media network modules mixed-media, monitors whether network connects；Based on the REST network architectures, packet is sent by the post methods of http agreements and response data packet is received.
9. system according to claim 7, it is characterised in that the distributed type assemblies server includes：
All samples pictures are done sets classification by sample management module based on geographical position, divide different sample spaces, with newly-built, deletion sample space function and addition, delete sample point function.
Module is retrieved in geographical position, and the shooting geographical position for retrieving photograph whether there is so that the sample space at sight spot where filtering out；If not retrieving the position, then record the position and create correspondence sample space, open platform module is triggered again, allow and encourage user to be uploaded to newly-built sample space by photographing device using sight spot picture and associated description information as new sample point, including the sample space in claim 5 division and hit；
Open platform module, it is allowed to user's registration account, uploads the sight spot picture and associated description information autodyned to sample space.
Face recognition module, face is whether there is in identification photograph, calculates its region；
Noise reduction process module, deletes human face region as pending picture, and purpose reduces characteristic value interference, improves matching precision；
Characteristic matching module, the pending picture does images match respectively with each sample point in the sample space, and the feature for counting each Self Matching is counted out；Compare the feature to count out, take its maximum；If the maximum, using the sample point belonging to the maximum as the very big picture that may be matched, obtains its call number more than given threshold value；Without matching picture if the maximum is less than given threshold value, then trigger open platform module, allow and encourage user that sight spot picture and associated description information are uploaded into described sample space, including the Feature Points Matching and statistics in claim 5 by photographing device as new sample point；
Knowledge management module, the call number of the sample point according to matching, triggering historical summary module, periphery diet module, transport information hit the historical background knowledge and local service information of building or landscape in the photograph, then return to photographing device.
10. system according to claim 9, it is characterised in that the knowledge management module includes：
Historical summary module, safeguards the historical information or associated description information of building or landscape in sight spot；
Periphery diet module, safeguards relevant restaurants information in sight spot；
Transport information module, safeguards the public transport traffic information in sight spot periphery or scenic spot.
Docking third party's module, manufacturer provides interface, cooperates with third company, extension historical summary module, periphery diet module, transport information module, such as Baidu is known, masses comment on, public transport company.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510770236.8A CN106713728A (en) | 2015-11-12 | 2015-11-12 | Method and system for enhancing scenic spot photographing information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510770236.8A CN106713728A (en) | 2015-11-12 | 2015-11-12 | Method and system for enhancing scenic spot photographing information |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106713728A true CN106713728A (en) | 2017-05-24 |
Family
ID=58929932
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510770236.8A Pending CN106713728A (en) | 2015-11-12 | 2015-11-12 | Method and system for enhancing scenic spot photographing information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106713728A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109104570A (en) * | 2018-08-28 | 2018-12-28 | 广东小天才科技有限公司 | Shooting method based on wearable device and wearable device |
| CN109345531A (en) * | 2018-10-10 | 2019-02-15 | 四川新网银行股份有限公司 | A kind of method and system based on picture recognition user's shooting distance |
| CN110135222A (en) * | 2018-02-08 | 2019-08-16 | 上海荟宸信息科技有限公司 | A method of realizing the transmission of wisdom commercial circle face characteristic information acquisition terminal data |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120327252A1 (en) * | 2011-06-24 | 2012-12-27 | Nichols Timothy L | Guidance for image capture at different locations |
| CN102915326A (en) * | 2012-08-30 | 2013-02-06 | 杭州藕根科技有限公司 | Mobile terminal scenery identifying system based on GPS (Global Positioning System) and image search technique |
| CN103781020A (en) * | 2013-12-27 | 2014-05-07 | 一派视觉（北京）数字科技有限公司 | Terminal tour-guiding method with photo synthesizing function and system thereof |
| CN104298965A (en) * | 2014-09-12 | 2015-01-21 | 东北大学 | Intelligent scenic spot and scenery recognition system and method oriented to mobile terminal |
| CN104980643A (en) * | 2014-04-10 | 2015-10-14 | 腾讯科技（深圳）有限公司 | Picture processing method, terminal and system |
-
2015
- 2015-11-12 CN CN201510770236.8A patent/CN106713728A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120327252A1 (en) * | 2011-06-24 | 2012-12-27 | Nichols Timothy L | Guidance for image capture at different locations |
| CN102915326A (en) * | 2012-08-30 | 2013-02-06 | 杭州藕根科技有限公司 | Mobile terminal scenery identifying system based on GPS (Global Positioning System) and image search technique |
| CN103781020A (en) * | 2013-12-27 | 2014-05-07 | 一派视觉（北京）数字科技有限公司 | Terminal tour-guiding method with photo synthesizing function and system thereof |
| CN104980643A (en) * | 2014-04-10 | 2015-10-14 | 腾讯科技（深圳）有限公司 | Picture processing method, terminal and system |
| CN104298965A (en) * | 2014-09-12 | 2015-01-21 | 东北大学 | Intelligent scenic spot and scenery recognition system and method oriented to mobile terminal |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110135222A (en) * | 2018-02-08 | 2019-08-16 | 上海荟宸信息科技有限公司 | A method of realizing the transmission of wisdom commercial circle face characteristic information acquisition terminal data |
| CN109104570A (en) * | 2018-08-28 | 2018-12-28 | 广东小天才科技有限公司 | Shooting method based on wearable device and wearable device |
| CN109104570B (en) * | 2018-08-28 | 2021-06-25 | 广东小天才科技有限公司 | Shooting method based on wearable device and wearable device |
| CN109345531A (en) * | 2018-10-10 | 2019-02-15 | 四川新网银行股份有限公司 | A kind of method and system based on picture recognition user's shooting distance |
| CN109345531B (en) * | 2018-10-10 | 2019-07-30 | 四川新网银行股份有限公司 | A kind of method and system based on picture recognition user's shooting distance |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11714523B2 (en) | Digital image tagging apparatuses, systems, and methods | |
| KR101759453B1 (en) | Automated image cropping and sharing | |
| US9058686B2 (en) | Information display system, information display apparatus, information provision apparatus and non-transitory storage medium | |
| CN105814587A (en) | Local real-time facial recognition | |
| CN115690558A (en) | Data processing method and device | |
| JP2008530676A (en) | Storing information for access using acquired images | |
| RU2007112676A (en) | METHOD FOR ADDING GEOGRAPHIC TITLES TO IMAGES AT MOBILE COMMUNICATION TERMINAL | |
| CN112183353A (en) | Image data processing method and device and related equipment | |
| CN111277788B (en) | Monitoring method and monitoring system based on MAC address | |
| WO2018072207A1 (en) | Information pushing method, apparatus, and system | |
| CN104320543A (en) | System and method for automatically making help seeking phone call by shaking mobile phone | |
| CN106713728A (en) | Method and system for enhancing scenic spot photographing information | |
| CN105072478A (en) | Life recording system and method based on wearable equipment | |
| CN104767816A (en) | Photography information collecting method, device and terminal | |
| US9661260B2 (en) | Photograph or video tagging based on peered devices | |
| CN108717464A (en) | photo processing method, device and terminal device | |
| CN105635318A (en) | Image acquisition method and system | |
| CN109168127A (en) | Resource recommendation method, device, electronic equipment and computer-readable medium | |
| CN112487082B (en) | Biological feature recognition method and related equipment | |
| KR100798917B1 (en) | Digital photo contents system and method adn device for transmitting/receiving digital photo contents in digital photo contents system | |
| CN112712564A (en) | Camera shooting method and device, storage medium and electronic device | |
| US9201498B2 (en) | Information display system, information display apparatus and non-transitory storage medium | |
| CN103269419B (en) | Video recording device | |
| CN109523941B (en) | Indoor accompanying tour guide method and device based on cloud identification technology | |
| CN109376262B (en) | Scenic spot offline image identification method and device based on big data processing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170524 |
|
| WD01 | Invention patent application deemed withdrawn after publication |