CN103369049A - Mobile terminal and server interactive method and system thereof - Google Patents
Mobile terminal and server interactive method and system thereof Download PDFInfo
- Publication number
- CN103369049A CN103369049A CN201310307727XA CN201310307727A CN103369049A CN 103369049 A CN103369049 A CN 103369049A CN 201310307727X A CN201310307727X A CN 201310307727XA CN 201310307727 A CN201310307727 A CN 201310307727A CN 103369049 A CN103369049 A CN 103369049A
- Authority
- CN
- China
- Prior art keywords
- server
- image
- portable terminal
- still image
- retrieval
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention provides a mobile terminal and server interactive method which comprises the steps that (100), a mobile terminal obtains a static image; (200), the mobile terminal preprocesses the static image to obtain the preprocessed data; (300), the mobile terminal sends the preprocessed data to a server; (400), the server analyzes the preprocessed data to obtain the analyzed data; (500), the server retrieves a retrieved result relevant to the analyzed data in a database according to the analyzed data; (600), the server feeds back the retrieved result to the mobile terminal; (700), the retrieved result is displayed on the mobile terminal; (800), when a user determines and selects the retrieved result on the mobile terminal, the mobile terminal sends a request message to the server, and the message comprises an identifying message corresponding to the selected retrieved result; (900), the server responds to the request message and sends a further message to the mobile terminal. The invention further provides a mobile terminal and server interactive system for achieving the method.
Description
Technical field
The present invention relates to the communications field, particularly have portable terminal and the exchange method between the server and the system of shoot function.
Background technology
Along with the development of computer and the communication technology, have terminal more and more universal of shoot function.By the shoot function of terminal, people can realize more interacting with real world.The method and system of terminal and server interaction is provided in " Taxi camera shooting insurance method and system thereof " such as application number 03112831.9 publication number CN1482567A.Wherein, allow the taxi driver to utilize camera function with suspect's image taking and upload onto the server, the taxi case that takes place frequently with convenient detection.But the defective of this scheme is the shooting safety system that can only be applied on the taxi, can not be applied in portable terminals such as mobile phone, panel computer.In addition, it can only can not be intervened real world uploading onto the server behind the image taking, therefore for object very limited, only for the suspect, user (taxi driver) can't realize more mutual by this function with real world.
Along with the development of portable terminal technology, utilize portable terminal to come the technology of identification world to continue to bring out." but the mobile phone of automatic input literal, image and typing thereof and processing method " such as application number 200310121279.0 publication number CN1630302A.It discloses a kind of method: the user can take the work that business card realizes extracting the typing card information by mobile phone, has saved the time cost of manual typing card information for the user.Application number 200420097921.6 publication number CN2745280Y " can do the camera mobile phone of character translation " discloses a kind of method for another example: it allows the user by the mobile phone photographic images, then by the Word message in the middle of the identification module extraction image, by the translation module of embedded in mobile phone the user is translated and be shown to the Word message that extracts again.But these two kinds of methods have a common deficiency: because do not have and server generation reciprocation, mobile phone can only extract the Word message that has existed in the middle of the gained image or the information that is pre-stored in mobile phone this locality of taking, therefore feedack is very limited, and the actual effect of information is also poor.
Along with the development of the Internet, this class defective progressively is resolved.Increasing technology allows portable terminal that the picture of the gained of taking pictures is sent to server and analyzes coupling, again by server feedback to a large amount of information of user." network audio VOD system and obtain the method for network audio " such as application number 200910237452.0 publication number CN102055758A discloses a kind of method: the user can identify by wireless program request pen and be printed on the coding on the books and periodicals magazine in order to obtain the network information identification code that wherein comprises, then identification code is sent to the webserver, by server the result who obtains is sent to the user again.Information---the music that this just can provide books itself to provide for the reader.But the inconvenience of this technology also is very obvious, the first, and it needs publisher to print in advance corresponding coding, and the second, need to be the hardware device of the independent configure dedicated of user--wireless program request pen.
And because mobile phone, panel computer etc. have the portable terminal (especially intelligent mobile terminal) of shoot function and are widely used, increasing people begins in the corresponding technology of mobile phone exploitation, need not like this as the user but joins the hardware device of configure dedicated.
" based on the personal identification method of mobile phone pick-up head combining with human face recognition technique " such as application number 200810033287.2 publication number CN101226591A discloses a kind of method: it allows mobile phone cam to gather the image information of human face photo, again this information is sent to server and carries out identification, and then the highest information of matching degree is sent to the user of mobile phone terminal.Speed and the accuracy of identification have so just greatly been improved.Just, this application only limits to recognition of face, does not have very widely purposes.
" a kind of device and method that utilizes image analysis technology identification product " such as application number 200510028959.7 publication number CN1916932A discloses a kind of method of identifying product: use mobile phone photograph, to take again the photo of gained and issue server with the form of " multimedia message ", send corresponding data to mobile phone by server again.The advantage of this invention is that camera terminal has been locked on the mobile phone, and shortcoming is to send on the server with the form of " multimedia message ", and " multimedia message " write and send the operation that needs the user extra, reduced user's experience.
The problem that the user experiences is along with the development of wireless Internet progressively is resolved.Now, the cost of Wireless Data Transmission is more and more lower, and transmission speed is more and more faster.Therefore, increasing technology all is based upon on the basis of Wireless Data Transmission.By have shoot function strengthen the method for reality identification also more and more, such as bar code, two-dimension code, digital watermarking, embedded mark etc.By these modes, portable terminal can be identified picture, and to carry out secondary mutual with the user.
At present, being used for the most general method of recognition value is to utilize mobile scanning terminal bar code and two-dimension code." portable terminal and server exchange method and system thereof " such as application number 200510033918.7 publication number CN1841425A, such as " the realizing the method for information interactive operation based on portable terminal capable of taking pictures " of application number 200610157181.4 publication number CN1988703A, such as " by the mobile information acquisition of wireless network " of application number 200810009436.1 publication number CN101241557A.These inventions all are by scanning two-dimension code or bar code, obtain pre-stored information in the middle of coding.But their defective also is very obvious: the appearance on image of two-dimension code and bar code, destroyed the globality of original image.Simultaneously, also there is the problem of printing in advance in the appearance of two-dimension code and bar code.
In order to keep the globality of original image, digital watermark technology is a huge improvement.Unlike bar code and two-dimension code, it almost is transparent, thereby does not disturb the content of file and picture.Therefore, " embedded media marker character and generation and the use its system and method " of application number 201010591230.1 publication number CN102110235A discloses another method: by the document piece that has EMM to indicate is taken pictures, thereby realize that portable terminal is to the identification of document.Although yet this method has guaranteed the integrality of image, its defective also is very obvious: it requires the picture producer and printer that picture is carried out preliminary treatment, namely needs to print in advance digital watermarking.
So, a lot of technology of image being carried out Direct Recognition have appearred now.Disclose a kind of method such as application number 201010151399.5 publication No. CN102238466A " a kind of cell phone system of mobile augmented reality ": this system allows user by after the mobile phone photographic images, and the image that will take again gained sends on the server together with user's geographical coordinate.Server feeds back corresponding information again by the search of user coordinates being mated corresponding picture.This advantage of system is not need image itself is carried out preliminary treatment or prints in advance, but shortcoming is also clearly: because main quantitatively be geographical coordinate, therefore, the captured picture of user is irremovable in a short time, so only limit to the field such as billboard ad.For transportable image (such as books, magazine) or from the image that network is downloaded, do not have recognition capability.
Also someone discloses different image search engine technology.Disclose a kind of method of picture search such as " based on the image search engine of picture material " of application number 200810025589.5 publication number CN101329677A: the user can be at computer or mobile phone input picture and Word message, then be committed to server, after the server feedback result, carry out postsearch screening, this process is until obtain final satisfied result repeatedly again.The advantage of this method is anywhere searching image of user, and shortcoming is that it obtains pictorial information by shape and color, can not identify for image.Require simultaneously the user to submit the literal relevant with picture to, but also need repeatedly category filter.
In sum, there is following defective at least in the interaction technique between terminal of the prior art and the server:
1. pending image need to pass through aftertreatment, for example needs to print additional in advance two-dimension code, bar code or other specific codings, perhaps needs to increase digital watermarking.
2. in some cases, image must be positioned at specific geographical position, and the user is photographic images whenever and wherever possible.
3. in some cases, the user has taken after the image, still need use terminal to submit to semanteme and keyword to analyze to server, needs the additional information outside the image.
4. the image acquisition mode is loaded down with trivial details, and the step such as often need to take pictures, focus on, upload.
Summary of the invention
In view of this, the main purpose of the present invention is to provide a kind of portable terminal and server exchange method and system thereof, to overcome defects of the prior art.The invention provides a kind of portable terminal and server exchange method, comprise following steps:
Step 100, described acquisition for mobile terminal still image;
Step 200, described portable terminal carries out preliminary treatment to the still image that obtains, and obtains preprocessed data;
Step 300, described portable terminal is sent to server with preprocessed data;
Step 400, described server is resolved preprocessed data, obtains resolution data;
Step 500, described server is retrieved the result for retrieval relevant with described still image according to resolution data in database;
Step 600, described server feeds back described result for retrieval to portable terminal;
Step 700 shows described result for retrieval at described portable terminal;
Step 800, when the user when described portable terminal is confirmed and is selected one or more result for retrieval, described portable terminal sends solicited message to server, described request information comprises the identifying information corresponding with the result for retrieval of selecting;
Step 900, described server response described request information sends further information to described portable terminal.
The present invention also provides portable terminal and the server interactive system that realizes said method.
The invention provides a kind of new portable terminal and system and the method thereof of server interaction has the following advantages:
1. image does not need through aftertreatment, does not need to print additional two-dimension code, bar code, does not need digital watermarking.
2. user's photographic images whenever and wherever possible.
3. the user has taken after the image, and server can feed back to the information that comprises in the middle of this image of user immediately.Do not need the user to submit to semanteme and keyword to analyze.
4. the user uses cost of the present invention very low.
5. the image acquisition mode is simple, and once photo taking need not to focus on, and automatically uploads.
Description of drawings
Fig. 1 is the structural representation of portable terminal and server interactive system.
Fig. 2 is the schematic flow sheet of portable terminal and server exchange method.
Embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, the present invention is described in further detail in connection with accompanying drawing.This description is that unrestriced mode has been introduced the embodiment consistent with principle of the present invention by example, the description of these execution modes is enough detailed, so that those skilled in the art can put into practice the present invention, in the situation that do not depart from the scope of the present invention the structure that to use other execution modes with spirit and can change and/or replace each key element.Therefore, should not understand the following detailed description from restrictive, sense.
Fig. 1 is the structural representation of portable terminal and server interactive system.As shown in Figure 1, the portable terminal among the present invention and server interactive system mainly comprise portable terminal 10, server 20.Wherein, portable terminal 10 among the present invention includes but not limited to following equipment: mobile phone (being also referred to as cell phone, mobile phone etc.), especially smart mobile phone is such as the iPhone Series Intelligent mobile phone that iOS series operating system is installed of Apple, the smart mobile phone of the Android of Google series operating system, the smart mobile phone etc. that the smart mobile phone of the Windows of Microsoft series operating system is installed and other any operating systems are installed are installed; Panel computer is such as the iPad of Apple series panel computer, the panel computer of the Android of Google series operating system, the panel computer etc. that the panel computer of the Windows of Microsoft series operating system is installed and other any operating systems are installed are installed; Personal digital assistant (being called for short PDA); And any mobile electronic device of knowing of other those skilled in the art.Server 20 among the present invention includes but not limited to following equipment: IBM server catalyst Catalyst, Dell server catalyst Catalyst, HP server catalyst Catalyst, Sun server catalyst Catalyst, association series server, and any server of knowing of other those skilled in the art.
Among the present invention, portable terminal 10 further comprises acquiring unit 11, image pretreatment unit 12, the first communication unit 13, display unit 14 and selected cell 15.
Wherein, described acquiring unit 11 is used for obtaining still image.Acquiring unit 11 can extract still image automatically from " multimedia message " that portable terminal 10 receives, perhaps specifies still image by the user in " multimedia message "; Acquiring unit 11 can also be by screenshotss mode from user's browsing or the document (for example video documents, email documents, electronic publication document or other any documents that may comprise image) watched, obtain still image; Acquiring unit 11 can also be downloaded still image from the Internet by wired or wireless network; Preferably, acquiring unit 11 be the camera that carries of portable terminal 10 or with portable terminal 10 interconnective cameras, obtain still image by the form of taking, such as the shooting of any print medias such as magazine is obtained photo as still image.When by behind the camera photographic images, can be by the mode of menu setecting, the image of taking is carried out preliminary treatment and uploads onto the server.
Described image pretreatment unit 12 is used for still image is carried out preliminary treatment, obtains preprocessed data, and preprocessed data is the data with predefined data structure.Communication data amount such as for minimizing and server can adopt the image JPG form that compressed.In order to guarantee data security, also general picture format can be transformed into some own proprietary file formats; Or the mode by encrypting, after secret key encryption, send to again server.In addition, image pretreatment unit 12 is selectable units, also can still image not carried out preliminary treatment and directly send to server, and in this case, those skilled in the art should be understood that preliminary treatment is a kind of do-nothing operation.
The first communication unit 13 is used for and server communicates.For example, portable terminal 10 can send to server 20 with preprocessed data by the first communication unit 13; Portable terminal 10 can also send to server 20 with solicited message by the first communication unit 13.For another example, portable terminal 10 can receive result for retrieval from server 20 by the first communication unit 13; Portable terminal 10 can also receive further information from server 20 by the first communication unit 13.Preferably, the mode of wireless network is adopted in communication between the first communication unit 13 and the server 20, such as GPRS etc.Preferred, when WIFI or bluetooth or other local networks exist in the situation, preferentially adopt local network to communicate.
Display unit 14 is used for demonstration information on described portable terminal 10, for example, and the result for retrieval of display server 20 feedbacks.When showing, display unit 14 can be with thumbnail, text box, and dialog box, radio box, check box, video, the forms such as audio frequency or waterfall stream show, can also show with any display mode that those skilled in the art know.
Selected cell 15 is used for the user and confirms solicited message to server 20.That is, the user can confirm and selects one or more result for retrieval at described portable terminal 10 by selected cell 15.After this, portable terminal 10 sends solicited message to server, and described request information comprises the identifying information corresponding with the result for retrieval of selecting.
Among the present invention, server 20 further comprises:
Second communication unit 21 is used for and portable terminal 10 communicates.For example, server 20 can receive preprocessed data from portable terminal 10 by second communication unit 21; Server 20 can also receive solicited message from portable terminal 10 by second communication unit 21.For another example, server 20 can send to portable terminal 10 with result for retrieval by second communication unit 21; Server 20 can also send to portable terminal 10 with further information by second communication unit 21.Preferably, the mode of wireless network is adopted in communication between second communication unit 13 and the portable terminal 20, such as GPRS etc.Preferred, when WIFI or bluetooth or other local networks exist in the situation, preferentially adopt local network to communicate
In a preferred embodiment, the communication between server 20 and the portable terminal 10 can be thought the communication between the first communication unit 13 and the second communication unit 21.
Resolution unit 22 is used for preprocessed data is resolved, and obtains resolution data.For example, by the identification to still image or preprocessed data, obtain the resolution data with the original static image correlation, resolution data comprises the combination of following arbitrary characteristics of image or arbitrary image feature: the SIFT feature, color character, unity and coherence in writing feature, shape facility etc.; Resolution data can also comprise by OCR and obtains text message in the image.
Database 23 is used for the information that storage is associated with described still image.Canned data can include, but are not limited to following arbitrary characteristics of image or arbitrary image Feature Combination in the database 23: the memory address of original image, SIFT feature, color character, unity and coherence in writing feature, shape facility etc.Database 23 for example is MySQL, and SQL Server, ORACLE, Sybase, DB2 etc. also can be the databases that those skilled in the art configure voluntarily according to prior art, still can be the structured documents of plain text.The type of database can be that relationship type also can be non-relevant database.In the present embodiment, database 23 is included in the server 20.In another embodiment, database 23 can be independent of server 20 and exist, and in this case, server 20 is connected to database 23 by wired or wireless mode.
The result for retrieval relevant with described still image retrieved according to resolution data in database retrieval unit 24 in database 23.
Can combining image feature (SIFT feature, color character, unity and coherence in writing feature, arbitrary or combination in any in the shape facility) and text feature, perhaps merely by characteristics of image, or merely by text feature, retrieve.
Be retrieved as example with the SIFT feature, the still image of can be at first delivering to server 20 at server 20 handle mobile terminals 10 extracts the SIFT feature, then with the SFIT Characteristic Contrast of the SIFT feature extracted and pre-stored other image at database 23, and then obtain corresponding result for retrieval.Can come fast finding by B-tree during retrieval, also can search by the Hash mode..When data volume is large, can also improve search efficiency by distributed mode.
Those skilled in the art should know, and use the mode of further feature and combination in any thereof also within protection scope of the present invention.Because the information (for example feature of still image) that pre-stored still image is associated in database 23, so still image do not need through aftertreatment, for example do not need to print additional two-dimension code, bar code, do not need digital watermarking.
Interaction success feedback unit 25, the solicited message that response portable terminal 10 sends sends further information to portable terminal 10.
Fig. 2 is the schematic flow sheet of portable terminal 10 of the present invention and server 20 exchange methods.As shown in Figure 2, method of the present invention mainly may further comprise the steps:
Step 100 is obtained still image by portable terminal 10.Portable terminal 10 can extract still image automatically from " multimedia message " that receive, perhaps specifies still image by the user in " multimedia message "; Portable terminal 10 can also be by screenshotss mode from user's browsing or the document (for example video documents, email documents, electronic publication document or other any documents that may comprise image) watched, obtain still image; Portable terminal 10 can also be downloaded still image from the Internet by wired or wireless network; Preferably, portable terminal 10 use carry or interconnective camera with it, obtain still image by the form of taking, such as the shooting of the print medias such as magazine is obtained photo as still image.
Step 200,10 pairs of still images that obtain of portable terminal carry out preliminary treatment, obtain preprocessed data.Preprocessed data is the data with predefined data structure.Communication data amount such as for minimizing and server can adopt the image JPG form that compressed.In order to guarantee data security, also general picture format can be transformed into some own proprietary file formats; Or the mode by encrypting, after secret key encryption, send to again server.In addition, step 200 is optional steps, also can still image not carried out preliminary treatment and directly send to server, and in this case, those skilled in the art should be understood that preliminary treatment is a kind of do-nothing operation.
Step 300, portable terminal 10 is sent to server 20 with preprocessed data.
Preferably, when using the camera photographic images, the user only need to click the hardware button of shooting or be presented on the touch controlled key of touch-screen, and then portable terminal 10 is finished focusing, shooting, the optional preliminary treatment to still image automatically, and will send to server through pretreated image.
Step 400,20 pairs of preprocessed datas of server are resolved, and obtain resolution data.For example, by the identification to still image or preprocessed data, obtain the resolution data with the original static image correlation, resolution data comprises the combination of following arbitrary characteristics of image or arbitrary image feature: the SIFT feature, color character, unity and coherence in writing feature, shape facility etc.; Resolution data can also comprise by OCR and obtains text message in the image.
Step 500, server 20 is retrieved the result for retrieval relevant with described still image according to resolution data in database 23.Wherein, database 23 is used for the information that storage is associated with described still image, comprise memory address and arbitrary characteristics of image of following information or the combination of arbitrary image feature of original image: the SIFT feature, color character, the unity and coherence in writing feature, shape facility etc., even also comprise text message in the image.Database 23 for example is MySQL, and SQLServer, ORACLE, Sybase, DB2 etc. also can be the databases that those skilled in the art configure voluntarily according to prior art, can also be the structured documents of plain text.The type of database can be that relationship type also can be non-relevant database.In the present embodiment, database 23 is included in the server 20.In another embodiment, database 23 can be independent of server 20 and exist, and in this case, server 20 is connected to database 23 by wired or wireless mode.
Can combining image feature (SIFT feature, color character, unity and coherence in writing feature, arbitrary or combination in any in the shape facility) and text feature, perhaps merely by characteristics of image, or merely by text feature, retrieve.
Be retrieved as example with the SIFT feature, the still image of can be at first delivering to server 20 at server 20 handle mobile terminals 10 extracts the SIFT feature, then with the SFIT Characteristic Contrast of the SIFT feature extracted and pre-stored other image at database 23, and then obtain corresponding result for retrieval.Can come fast finding by B-tree during retrieval, also can search by the Hash mode..When data volume is large, can also improve search efficiency by distributed mode.
Those skilled in the art should know, and use the mode of further feature and combination in any thereof also within protection scope of the present invention.Because the information (for example feature of still image) that pre-stored still image is associated in database 23, so still image do not need through aftertreatment, for example do not need to print additional two-dimension code, bar code, do not need digital watermarking.
Step 600, server 20 is to the described result for retrieval of portable terminal 10 feedbacks.
Step 700 shows described result for retrieval at portable terminal 10.When showing, can be with thumbnail, text box, dialog box, radio box, check box, video, the forms such as audio frequency or waterfall stream show, can also show with any display mode that those skilled in the art know.
Step 800, when the user when portable terminal 10 is confirmed and is selected one or more result for retrieval, described portable terminal 10 sends solicited messages to server 20, described request information comprises the identifying information corresponding with the result for retrieval of selecting.
Step 900, server 20 response described request information send further information to described portable terminal 10.Described further information generally includes the content information with the result for retrieval height correlation.Further information can also comprise to be shared, buy, and video, voice are liked, the relevant informations such as collection.Sharing as example, when user selection is shared button, where portable terminal 10 can the inquiry users be wanted to share, such as Sina's microblogging, Tengxun's microblogging, everybody, in the school, happy etc.The user shares such as Sina's microblogging after further selecting, and portable terminal 10 can allow subscriber authorisation and the microblogging account number by the user send an information, simultaneously notice (such as@) his good friend he using corresponding the application.
Portable terminal of the present invention and server interactive system and method thereof can be used or be combined in multiple environment or the field.
In a preferred embodiment of the invention, portable terminal of the present invention and server interactive system and method thereof can be applied to retrieve and buy in the environment of commodity.
In this environment, the user can take the image that contains the interested commodity of user by the camera of portable terminal, and for example image is coloured picture or the advertisement figure of some magazine, and perhaps there is any image on the print media in all.For example, take the front cover coloured picture of certain magazine, comprise a BMW and a cap on this coloured picture.Subsequently, portable terminal is selectable to carry out preliminary treatment to the image that photographs, and pretreated data are sent to server.Server is resolved preprocessed data, and pre-stored characteristics of image in server database compares, and uploads the merchandise news that comprises in the image as result for retrieval thereby retrieve the user.For example, two kinds of BMWs that comprise in the front cover coloured picture and these two kinds of commodity of cap.
Mode and the method for retrieval also can be multiple.Take the SIFT signature search as example, can be at first be stored in every one page of magazine in the database of server and extract the SIFT feature of every one page, then extract the SIFT that portable terminal is delivered to the image of server at server.SFIT feature with the SIFT feature extracted and pre-stored other image at server end compares afterwards.The result of retrieval finds out which page or leaf that this pictures is which of which magazine phase, returns that one page magazine or advertiser or Information Provider according to the requirement of magazine afterwards the corresponding merchandise news that provides to the user is provided.
Described merchandise news includes but not limited in the price, title, stock, specification, manufacturing side's information of commodity a certain or a few or all.Subsequently, server sends the merchandise news that retrieves to portable terminal, and is shown to the user at portable terminal.The user can browse these commodity and merchandise news by portable terminal, and therefrom selects the commodity of own needs.For example, the user can select to return in the commodity of its portable terminal one by the mode of single choice, and such as cap, portable terminal can further show the price of this cap, supplier, background knowledge of designer etc.The user can select to return one or more in the information of its mobile terminal by the mode of single choice or final election for another example, and such as history and the price of BMW, system can further show the developing history of BMW and different prices of different styles etc.When commodity that the user determines to want to buy, send the purchase payment request information by portable terminal phase server, server passes through Mobile banking after identifying, the mobile payment mode of all categories such as mobile-phone payment or mobile phone wallet is finished payment, to user's portable terminal transmission payment interaction success information (being further information).Thus, the present invention has finished the retrieval of physical goods by portable terminal, server and has bought function.
In another preferred embodiment of the present invention, portable terminal of the present invention and server interactive system and method thereof can be used in the environment of video frequency searching.
In this environment, the user can by the camera of portable terminal, take the image in papery or the video placard, perhaps in browsing page, by the video interception on the web page acquisition by mobile terminal or video image.Subsequently, portable terminal carries out preliminary treatment to image, and pretreated data are sent to server.Server is resolved preprocessed data, retrieves the video information with image correlation in database.Subsequently, server sends the video information that retrieves to portable terminal, and is shown to the user at portable terminal, is the placard of which film such as what judge user's shooting, returns afterwards corresponding film clips information.Video information may include but not limited to: video name, thumbnail, definition, playout length, video-on-demand times etc.The user can browse these video informations by portable terminal, and according to portable terminal in the software and hardware situation, select to wish the video of watching.When video that the user determines to want to watch, send video request information by portable terminal phase server, server through identification after, send interaction success information to user's portable terminal.Simultaneously, server is to user's portable terminal transmission of video.
Thus, the present invention has finished retrieval and viewing function to video by portable terminal, server.
In a preferred embodiment of the invention, portable terminal of the present invention and server interactive system and method thereof can be applied to retrieve in the environment with the positioning electronic map.
In this environment, the user can by the camera of portable terminal, take the papery simple map of on-site landmark or tourist attraction.Subsequently, portable terminal carries out preliminary treatment to image, and pretreated data are sent to server.Server is resolved preprocessed data, retrieves the cartographic information with image correlation in database.Subsequently, server sends the cartographic information that retrieves to portable terminal, and is shown to the user at portable terminal.Cartographic information may include but not limited to: corresponding retail shop Business Information etc. on particular location, thumbnail and the map.The user can browse these cartographic informations by portable terminal, and selects the electronic chart of hope.When electronic chart that the user determines to want, send the electronic chart solicited message by portable terminal phase server, server through identification after, send interaction success information to user's portable terminal.Simultaneously, server is to the electronic chart of user's portable terminal transmission user selection.
Thus, the present invention has finished navigation feature to electronic chart by portable terminal, server.
At last, those skilled in the art are to be understood that the system and method that the present invention describes not is relevant with any specific device but can realize by the combination of any suitable assembly inherently.In addition, various types of fexible units are used in the instruction that can describe according to the present invention, can also construct isolated plant to carry out method step described herein.The present invention has also described some middle embodiments and/or embodiment, and its purpose all is illustrative rather than restrictive from any aspect.What it will be appreciated by those skilled in the art that is that many various combinations of hardware, software and firmware all are suitable for putting into practice the present invention.For example, described software can realize with various different programmings or descriptive language, for example, and Assembler, C/C++, Perl, Shell, PHP, Java etc.
In addition, according to disclosed specification of the present invention, of the present invention other realize for those skilled in the art it being obvious.The various aspects of described execution mode and/or embodiment can be used for system and method for the present invention separately or with any combination.Specification and example wherein should be only regard as exemplary, actual range of the present invention and spirit represented by appended claims.
Claims (10)
1. a portable terminal and server exchange method is characterized in that, described method comprises following steps:
Step 100, described acquisition for mobile terminal still image;
Step 200, described portable terminal carries out preliminary treatment to the still image that obtains, and obtains preprocessed data;
Step 300, described portable terminal is sent to server with preprocessed data;
Step 400, described server is resolved preprocessed data, obtains resolution data;
Step 500, described server is retrieved the result for retrieval relevant with described still image according to resolution data in database;
Step 600, described server feeds back described result for retrieval to portable terminal;
Step 700 shows described result for retrieval at described portable terminal;
Step 800, when the user when described portable terminal is confirmed and is selected one or more result for retrieval, described portable terminal sends solicited message to server, described request information comprises the identifying information corresponding with the result for retrieval of selecting;
Step 900, described server response described request information sends further information to described portable terminal.
2. exchange method according to claim 1, wherein in step 100-step 300, portable terminal uses camera, obtain still image by the form of taking, when using the camera photographic images, the user only need to click the hardware button of shooting or be presented on the touch controlled key of touch-screen, and then portable terminal is finished focusing, shooting, the preliminary treatment to still image automatically, and will send to server through pretreated image.
3. exchange method according to claim 1, wherein said resolution data comprises following arbitrary characteristics of image of described still image or the combination of arbitrary image feature: SIFT feature, color character, unity and coherence in writing feature, shape facility; The following arbitrary characteristics of image of the described still image of storage or arbitrary image Feature Combination in the described database: the memory address of original image, SIFT feature, color character, unity and coherence in writing feature, shape facility; The characteristics of image of storing in the described database is consistent on type with the characteristics of image that described resolution data comprises.
4. exchange method according to claim 1, wherein in step 700, with thumbnail, text box, dialog box, radio box, check box, video, the forms such as audio frequency or waterfall stream show result for retrieval.
5. exchange method according to claim 1, described further information comprises the content information with the result for retrieval height correlation, for example comprises and sharing, buy, video, voice are liked, the relevant informations such as collection.
6. a portable terminal and server interactive system comprise: portable terminal, server; It is characterized in that, described portable terminal comprises:
Acquiring unit is used for obtaining still image;
The image pretreatment unit is used for still image is carried out preliminary treatment, obtains preprocessed data;
The first communication unit is used for and server communicates;
Display unit is used for demonstration information on described portable terminal;
Selected cell is used for the user and confirms solicited message to server.
Described server comprises:
The second communication unit is used for and portable terminal communicates;
Resolution unit is used for preprocessed data is resolved, and obtains resolution data;
Database is used for the information that storage is associated with described still image;
The result for retrieval relevant with described still image retrieved according to resolution data in the database retrieval unit in database;
The interaction success feedback unit, response described request information sends further information to described portable terminal.
7. interactive system according to claim 6, wherein acquiring unit is camera, obtain still image by the form of taking, when using the camera photographic images, the user only need to click the hardware button of shooting or be presented on the touch controlled key of touch-screen, then portable terminal is finished focusing, shooting, the preliminary treatment to still image automatically, and will send to server through pretreated image.
8. interactive system according to claim 6, wherein said resolution data comprises following arbitrary characteristics of image of described still image or the combination of arbitrary image feature: SIFT feature, color character, unity and coherence in writing feature, shape facility; The following arbitrary characteristics of image of the described still image of storage or arbitrary image Feature Combination in the described database: the memory address of original image, SIFT feature, color character, unity and coherence in writing feature, shape facility; The characteristics of image of storing in the described database is consistent on type with the characteristics of image that described resolution data comprises.
9. interactive system according to claim 6, wherein display unit is with thumbnail, text box, dialog box, radio box, check box, video, the forms such as audio frequency or waterfall stream show result for retrieval.
10. interactive system according to claim 6, described further information comprises the content information with the result for retrieval height correlation, for example comprises and sharing, buy, video, voice are liked, the relevant informations such as collection.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310307727.XA CN103369049B (en) | 2013-07-22 | 2013-07-22 | Mobile terminal and server exchange method and system thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310307727.XA CN103369049B (en) | 2013-07-22 | 2013-07-22 | Mobile terminal and server exchange method and system thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103369049A true CN103369049A (en) | 2013-10-23 |
| CN103369049B CN103369049B (en) | 2016-05-04 |
Family
ID=49369570
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310307727.XA Expired - Fee Related CN103369049B (en) | 2013-07-22 | 2013-07-22 | Mobile terminal and server exchange method and system thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103369049B (en) |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104574156A (en) * | 2015-01-26 | 2015-04-29 | 网易有道信息技术（北京）有限公司 | Commodity expanding information matching and obtaining method and device |
| CN104580121A (en) * | 2013-10-28 | 2015-04-29 | 腾讯科技（深圳）有限公司 | People search/people information matching and pushing method, system, client and server |
| CN104598902A (en) * | 2015-01-29 | 2015-05-06 | 百度在线网络技术（北京）有限公司 | Method and device for identifying screenshot and browser |
| CN104618741A (en) * | 2015-03-02 | 2015-05-13 | 浪潮软件集团有限公司 | Information pushing system and method based on video content |
| CN104867097A (en) * | 2014-02-26 | 2015-08-26 | 腾讯科技（深圳）有限公司 | Method and device for generating watermark picture |
| CN105303217A (en) * | 2015-10-13 | 2016-02-03 | 北京工业大学 | Efficient implicit two-dimensional code system |
| CN105491418A (en) * | 2015-11-30 | 2016-04-13 | 上海联彤网络通讯技术有限公司 | Remote control device and method, and electronic device |
| WO2016095638A1 (en) * | 2014-12-19 | 2016-06-23 | 百度在线网络技术（北京）有限公司 | Method and apparatus for providing direct-presentation service at user equipment and network device |
| CN105893519A (en) * | 2016-03-30 | 2016-08-24 | 深圳市讯联智付网络有限公司 | Analyzing device and method for online transactions, online transaction method and user terminal |
| CN106020662A (en) * | 2016-04-29 | 2016-10-12 | 广东小天才科技有限公司 | Method and device for rapid content searching of mobile terminal |
| WO2016173180A1 (en) * | 2015-04-29 | 2016-11-03 | 百度在线网络技术（北京）有限公司 | Image-based information acquisition method and device |
| CN106126755A (en) * | 2016-08-24 | 2016-11-16 | 广东华邦云计算股份有限公司 | A kind of purchase method based on image recognition |
| CN106407984A (en) * | 2015-07-31 | 2017-02-15 | 腾讯科技（深圳）有限公司 | Target object recognition method and device |
| CN106407483A (en) * | 2016-12-07 | 2017-02-15 | 连惠城 | Electronic photo album with text search function |
| WO2017063515A1 (en) * | 2015-10-16 | 2017-04-20 | 阿里巴巴集团控股有限公司 | Information pushing method and device |
| WO2017148120A1 (en) * | 2016-02-29 | 2017-09-08 | 北京小米移动软件有限公司 | Method, apparatus and system for acquiring image |
| CN108154074A (en) * | 2016-12-02 | 2018-06-12 | 金德奎 | A kind of image matching method identified based on position and image |
| CN108845888A (en) * | 2018-05-24 | 2018-11-20 | 郑州云海信息技术有限公司 | A kind of method and system based on TensorFlow image recognition diagnosis memory failure |
| CN109146457A (en) * | 2018-08-01 | 2019-01-04 | 阿里巴巴集团控股有限公司 | Data input householder method and device |
| CN109168069A (en) * | 2018-09-03 | 2019-01-08 | 聚好看科技股份有限公司 | A kind of recognition result subregion display methods, device and smart television |
| CN109479180A (en) * | 2016-09-27 | 2019-03-15 | 华为技术有限公司 | In the method and terminal of urgency traffic interface display current geographic position |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1914611A (en) * | 2004-01-29 | 2007-02-14 | 泽塔普利株式会社 | Information search system, information search method, information search device, information search program, image recognition device, image recognition method, image recognition program, and sales sy |
| CN102063436A (en) * | 2009-11-18 | 2011-05-18 | 腾讯科技（深圳）有限公司 | System and method for realizing merchandise information searching by using terminal to acquire images |
| CN102576365A (en) * | 2009-10-06 | 2012-07-11 | 高通股份有限公司 | Systems and methods for merchandising transactions via image matching in a content delivery system |
| CN102761612A (en) * | 2012-06-29 | 2012-10-31 | 惠州Tcl移动通信有限公司 | Method and system for photographing and automatic uploading based on wireless communication equipment |
| CN103067854A (en) * | 2011-10-21 | 2013-04-24 | 昆山研达电脑科技有限公司 | Mobile phone navigation method and mobile phone navigation method system based on terminal computing |
-
2013
- 2013-07-22 CN CN201310307727.XA patent/CN103369049B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1914611A (en) * | 2004-01-29 | 2007-02-14 | 泽塔普利株式会社 | Information search system, information search method, information search device, information search program, image recognition device, image recognition method, image recognition program, and sales sy |
| CN102576365A (en) * | 2009-10-06 | 2012-07-11 | 高通股份有限公司 | Systems and methods for merchandising transactions via image matching in a content delivery system |
| CN102063436A (en) * | 2009-11-18 | 2011-05-18 | 腾讯科技（深圳）有限公司 | System and method for realizing merchandise information searching by using terminal to acquire images |
| CN103067854A (en) * | 2011-10-21 | 2013-04-24 | 昆山研达电脑科技有限公司 | Mobile phone navigation method and mobile phone navigation method system based on terminal computing |
| CN102761612A (en) * | 2012-06-29 | 2012-10-31 | 惠州Tcl移动通信有限公司 | Method and system for photographing and automatic uploading based on wireless communication equipment |
Cited By (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104580121A (en) * | 2013-10-28 | 2015-04-29 | 腾讯科技（深圳）有限公司 | People search/people information matching and pushing method, system, client and server |
| CN104580121B (en) * | 2013-10-28 | 2019-03-15 | 腾讯科技（深圳）有限公司 | Missing/personal information matching push method, system, client and server |
| CN104867097A (en) * | 2014-02-26 | 2015-08-26 | 腾讯科技（深圳）有限公司 | Method and device for generating watermark picture |
| WO2016095638A1 (en) * | 2014-12-19 | 2016-06-23 | 百度在线网络技术（北京）有限公司 | Method and apparatus for providing direct-presentation service at user equipment and network device |
| CN104574156A (en) * | 2015-01-26 | 2015-04-29 | 网易有道信息技术（北京）有限公司 | Commodity expanding information matching and obtaining method and device |
| CN104598902A (en) * | 2015-01-29 | 2015-05-06 | 百度在线网络技术（北京）有限公司 | Method and device for identifying screenshot and browser |
| CN104618741A (en) * | 2015-03-02 | 2015-05-13 | 浪潮软件集团有限公司 | Information pushing system and method based on video content |
| US10296997B2 (en) | 2015-04-29 | 2019-05-21 | Baidu Online Network Technology (Beijing) Co., Ltd. | Image-based information acquisition method and apparatus |
| WO2016173180A1 (en) * | 2015-04-29 | 2016-11-03 | 百度在线网络技术（北京）有限公司 | Image-based information acquisition method and device |
| CN106407984A (en) * | 2015-07-31 | 2017-02-15 | 腾讯科技（深圳）有限公司 | Target object recognition method and device |
| CN105303217A (en) * | 2015-10-13 | 2016-02-03 | 北京工业大学 | Efficient implicit two-dimensional code system |
| CN105303217B (en) * | 2015-10-13 | 2018-12-18 | 北京工业大学 | A kind of efficient implicit 2 D code system |
| WO2017063515A1 (en) * | 2015-10-16 | 2017-04-20 | 阿里巴巴集团控股有限公司 | Information pushing method and device |
| CN106598980B (en) * | 2015-10-16 | 2020-03-10 | 阿里巴巴集团控股有限公司 | Information pushing method and device |
| CN106598980A (en) * | 2015-10-16 | 2017-04-26 | 阿里巴巴集团控股有限公司 | Information push method and device |
| CN105491418A (en) * | 2015-11-30 | 2016-04-13 | 上海联彤网络通讯技术有限公司 | Remote control device and method, and electronic device |
| WO2017148120A1 (en) * | 2016-02-29 | 2017-09-08 | 北京小米移动软件有限公司 | Method, apparatus and system for acquiring image |
| CN105893519A (en) * | 2016-03-30 | 2016-08-24 | 深圳市讯联智付网络有限公司 | Analyzing device and method for online transactions, online transaction method and user terminal |
| CN106020662A (en) * | 2016-04-29 | 2016-10-12 | 广东小天才科技有限公司 | Method and device for rapid content searching of mobile terminal |
| CN106020662B (en) * | 2016-04-29 | 2019-04-30 | 广东小天才科技有限公司 | Content method for fast searching and device applied to mobile terminal |
| CN106126755A (en) * | 2016-08-24 | 2016-11-16 | 广东华邦云计算股份有限公司 | A kind of purchase method based on image recognition |
| CN109479180A (en) * | 2016-09-27 | 2019-03-15 | 华为技术有限公司 | In the method and terminal of urgency traffic interface display current geographic position |
| CN109479180B (en) * | 2016-09-27 | 2023-07-11 | 华为技术有限公司 | Method and terminal for displaying current geographic position on emergency call interface |
| CN108154074A (en) * | 2016-12-02 | 2018-06-12 | 金德奎 | A kind of image matching method identified based on position and image |
| CN106407483A (en) * | 2016-12-07 | 2017-02-15 | 连惠城 | Electronic photo album with text search function |
| CN108845888A (en) * | 2018-05-24 | 2018-11-20 | 郑州云海信息技术有限公司 | A kind of method and system based on TensorFlow image recognition diagnosis memory failure |
| CN109146457A (en) * | 2018-08-01 | 2019-01-04 | 阿里巴巴集团控股有限公司 | Data input householder method and device |
| CN109168069A (en) * | 2018-09-03 | 2019-01-08 | 聚好看科技股份有限公司 | A kind of recognition result subregion display methods, device and smart television |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103369049B (en) | 2016-05-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103369049B (en) | Mobile terminal and server exchange method and system thereof | |
| US20190235814A1 (en) | Building an infrastructure of actionable elements related to printed items | |
| JP5951759B2 (en) | Extended live view | |
| CN102369724B (en) | Automatically capturing information, for example, use document awareness apparatus capturing information | |
| KR100980748B1 (en) | System and methods for creation and use of a mixed media environment | |
| US20170249337A1 (en) | System and method for accessing electronic data via an image search engine | |
| JP2014241151A (en) | Use of image-derived information as search criteria for internet and other search engines | |
| US20140111542A1 (en) | Platform for recognising text using mobile devices with a built-in device video camera and automatically retrieving associated content based on the recognised text | |
| US20110145068A1 (en) | Associating rendered advertisements with digital content | |
| JP2014524062A5 (en) | ||
| DE202010018557U1 (en) | Linking rendered ads to digital content | |
| JP5395920B2 (en) | Search device, search method, search program, and computer-readable recording medium storing the program | |
| DE202010018551U1 (en) | Automatically deliver content associated with captured information, such as information collected in real-time | |
| CN104504155B (en) | A kind of data capture method and system based on picture search | |
| EP2482210A2 (en) | System and methods for creation and use of a mixed media environment | |
| US11397976B2 (en) | Durable memento method | |
| US20160034496A1 (en) | System And Method For Accessing Electronic Data Via An Image Search Engine | |
| US20070182826A1 (en) | Data access, resolution, and delivery method through the use of multi-bit digital icons | |
| JP5233328B2 (en) | Advertisement display system using photo attribute information and advertisement display method using the system | |
| JP6340124B1 (en) | Photo production system, sales system, photo production apparatus and program | |
| US20090234723A1 (en) | Publicly generated advertisement system and method | |
| KR20220003200A (en) | Method and system for providing video content service | |
| AU2012205152B2 (en) | A platform for recognising text using mobile devices with a built-in device video camera and automatically retrieving associated content based on the recognised text | |
| KR20230061288A (en) | Method for serving an online business card |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160504 Termination date: 20170722 |