CN103731558A - Book locating method based on camera of mobile phone - Google Patents
Book locating method based on camera of mobile phone Download PDFInfo
- Publication number
- CN103731558A CN103731558A CN201410009144.3A CN201410009144A CN103731558A CN 103731558 A CN103731558 A CN 103731558A CN 201410009144 A CN201410009144 A CN 201410009144A CN 103731558 A CN103731558 A CN 103731558A
- Authority
- CN
- China
- Prior art keywords
- mobile phone
- user
- camera
- books
- prompting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses a book locating method based on the camera of a mobile phone. According to the method, a user can photograph text information on the spines of books on a bookshelf through the camera of the mobile phone, the mobile phone identifies the text information according to the photographed images to match the book information searched by the user and prompts the user that a book to be read is found after successful matching. The book locating method can help the user, who searches for books especially when books are disorderly arranged on the bookshelf, to rapidly find the required book through the camera of the mobile phone, avoid the problem of omission during manual book searching and accordingly improve the book locating efficiency.
Description
Technical field
The present invention relates to a kind of books localization method based on mobile phone camera.
Background technology
Along with the arrival of era of knowledge-driven economy, people are more and more for the demand of books, and the function center of gravity in library turns to " reader's center mode " by traditional " literature centre's pattern ".But in the face of the immense book perils of the sea is to find the books of oneself wanting, even find according to library's classifying and numbering method, on a bookshelf, finding out the books that oneself will borrow also needs to spend a period of time when going to library to borrow books.
Chinese patent literature CN10324690A has announced a kind of Intelligent book locating system based on ultra-high frequency RFID technology, and specific features is: Intelligent bookshelf, communication base station, system server, searching terminal, consist of; On described Intelligent bookshelf, be equipped with for representing the ultrahigh frequency RFID shelf label of bookshelf positional information and for reading the read write line of ultra-high frequency RFID label, being placed on every books in bookshelf and being all equipped with for identifying the book labels of book information; Intelligent bookshelf is by the sky alignment label emitting radio frequency signal of read write line inside, read write line reads shelf label in equivalent layer and the information of book labels, and the book information obtaining to computer feedback and the positional information of books, complete books search and information feedback task; Described communication base station is used for connecting ultrahigh frequency radio frequency identification (RFID) reader and system server, be responsible for the communication between read write line and server, accept the search instruction of server and call the read work that corresponding read write line carries out electronic tag, accept the electronic labeling information that read write line reads and pass to system server; Described system server comprises the database of storage library book information and for realizing the retrieval software of books positioning function; Described searching terminal is used for realizing man-machine interaction, accepts reader or the managerial personnel of library demand information to books, and resulting books positional information is fed back to reader or managerial personnel of library.
The disclosed books navigation system of above-mentioned patent, needs a large amount of hardware devices, needs a large amount of manpowers to set up, and causes cost higher.
Summary of the invention
The technical problem to be solved in the present invention is to provide a kind of books localization method based on mobile phone camera, and user can utilize the camera of mobile phone to carry out books location, greatly facilitates reader, has improved borrowing efficiency.For solving the problems of the technologies described above, technical scheme of the present invention comprises the following steps:
Step 1, on mobile phone, enable these books localization method;
The user interface of step 2, demonstration books localization method, described user interface comprises edit box, drop-down menu, button control and video preview district, edit box wants for inputting user the book information of searching, drop-down menu is selected prompting mode for user, wherein prompting mode comprises three kinds of patterns: silent mode, acoustic pattern and vibration mode, button control is confirmed book information and the selected prompt modes inputted for user, video preview district is for showing the present image that camera photographs;
Step 3, user input and want the book information of searching and in drop-down menu, select prompting mode in edit box;
Step 4, user's button click control, confirm that after the book information and prompting mode of input, mobile phone camera is opened automatically, the picture that the real-time demonstration in video preview district is being taken;
Step 5, user aim at the books spine on bookshelf in suitable distance by camera, carry out follow shot;
Step 6, mobile phone camera are focused automatically;
After step 7, mobile phone camera are focused successfully, mobile phone is processed camera preview frame video in real time, and character recognition module identifies Word message wherein from each frame video;
Step 8, character recognition module mate the Word message identifying with the book information of user's input;
The book information selection that the match is successful in drop-down menu of the Word message that step 9, character recognition module identify and user's input is pointed out accordingly.
This method can be transplanted to other mobile terminals that Andriod operating system or IOS operating system are housed, and this mobile terminal is furnished with cam device.
In step 2, described three kinds of prompting modes refer to: no matter select which kind of prompting mode, the book information of the Word message identifying when character recognition module and user's input is when the match is successful, all can be with a kind of visual effect prompting user in video preview district, such as showing red framework, in red framework, be the books that need to search, and red block is known from experience constantly flicker; When user selects silent mode, video preview district only shows that above-mentioned visual effect points out; When user selects a sound pattern, not only video preview district shows that above-mentioned visual effect points out, and the loud speaker of mobile phone sends the sound that certain frequency " ticks " and points out; When user selects vibration mode, not only video preview district shows that above-mentioned visual effect points out, and mobile phone can be pointed out with certain frequency vibration.In three, in the middle of prompt modes, except independent selection a kind of pattern wherein, also can there is following a kind of combination to select for user: acoustic pattern adds vibration mode; Be drop-down menu provide four kinds can selection mode.In the middle of the video photographing, have a plurality of words can with input characters matching time, point out in video preview district respectively a plurality of red frameworks of flickering display.When mobile phone camera is nearer apart from the word matching, the frequency of red prompting framework flicker is higher, and the frequency that loud speaker sends voice prompt is higher, and the frequency of mobile phone vibration is also higher; When mobile phone camera is far away apart from the word matching, the frequency of red prompting framework flicker is lower, and the frequency that loud speaker sends voice prompt is lower, and the frequency of mobile phone vibration is also lower.
In step 3, when user inputs book information in edit box, can point out historical input message; The book information of inputting can comprise title, author, publishing house etc., or one of them, or wherein both, or all.
In step 7, described character recognition module can be identified Chinese information, also can identify foreign language and other characters of this technical support.
The present invention has following beneficial effect:
Compare with RFID method, the present invention can utilize the mobile phone camera of carrying, and realizes the quick location of books by the mode of capture video, convenient and swift, cost-saving.
Figure of description
Fig. 1 is the framework schematic diagram of books localization method of the present invention.
Fig. 2 is the operational flow diagram of books localization method of the present invention.
Fig. 3 is the layout of first Activity of books localization method of the present invention.
Fig. 4 and Fig. 5 are the layout of second Activity of books localization method of the present invention.
Embodiment
In conjunction with Figure of description, the specific embodiment of the present invention is elaborated.The invention provides a kind of books localization method based on mobile phone camera, as shown in Figure 1, the operational flow diagram of this method as shown in Figure 2 for it module frame comprising.Comprise the following steps:
1, on mobile phone, enable these books localization method;
2, the user interface that shows books localization method, described user interface comprises edit box, drop-down menu, button control and video preview district, edit box wants for inputting user the book information of searching, drop-down menu is selected prompting mode for user, wherein prompting mode comprises three kinds of patterns: silent mode, acoustic pattern and vibration mode, button control is confirmed book information and the selected prompt modes inputted for user, video preview district is for showing the present image that camera photographs;
3, user inputs and wants the book information of searching and in drop-down menu, select prompting mode in edit box;
4, user's button click control, confirms that after the book information and prompting mode of input, mobile phone camera is opened automatically, the picture that the real-time demonstration in video preview district is being taken;
5, user aims at the books spine on bookshelf in suitable distance by camera, carries out follow shot;
6, mobile phone camera is focused automatically;
7, after mobile phone camera is focused successfully, mobile phone is processed camera preview frame video in real time, and character recognition module identifies Word message wherein from each frame video;
8, character recognition module mates the Word message identifying with the book information of user's input;
The book information of the Word message that 9, character recognition module identifies and user input after the match is successful according to user the selection in drop-down menu point out accordingly.
This method can be transplanted to other mobile terminals that Andriod operating system or IOS operating system are housed, and this mobile terminal is furnished with camera.
When user inputs book information in edit box, can point out historical input message; The book information of inputting can comprise title, author, publishing house etc., or one of them, or wherein both, or all.
Described character recognition module can be identified Chinese information, also can identify foreign language and other characters of this technical support.
The book information of the Word message identifying when character recognition module and user's input is when the match is successful, described three kinds of prompting modes refer to: no matter select which kind of prompting mode, all can be with a kind of visual effect prompting user in video preview district, such as showing red framework, in red framework, be the books that need to search, and red block is known from experience constantly flicker; When user selects silent mode, video preview district only shows that above-mentioned visual effect points out; When user selects a sound pattern, not only video preview district shows that above-mentioned visual effect points out, and the loud speaker of mobile phone sends the sound that certain frequency " ticks " and points out; When user selects vibration mode, not only video preview district shows that above-mentioned visual effect points out, and mobile phone can be pointed out with certain frequency vibration.In three, in the middle of prompt modes, except independent selection a kind of pattern wherein, also can there is following a kind of combination to select for user: acoustic pattern adds vibration mode; Be drop-down menu provide four kinds can selection mode.In the middle of the video photographing, have a plurality of words can with input characters matching time, point out in video preview district respectively a plurality of red frameworks of flickering display.When mobile phone camera is nearer apart from the word matching, the frequency of red prompting framework flicker is higher, and the frequency that loud speaker sends voice prompt is higher, and the frequency of mobile phone vibration is also higher; When mobile phone camera is far away apart from the word matching, the frequency of red prompting framework flicker is lower, and the frequency that loud speaker sends voice prompt is lower, and the frequency of mobile phone vibration is also lower.
Take under Android system and realize said method as example, a kind of books localization method based on mobile phone camera of the present invention is described below:
1, two Activity classes of instantiation, difference called after MainActivity.java and NextActivity.java, then will in AndroidManifest.xml, increase the statement of these two Activity, then obtain hardware right to use and the vibration authority of camera, example code is as follows:
<uses-permission?android:name="android.permission.CAMERA"/>
<uses-feature?android:name="android.hardware.camera"/>
<uses-feature?android:name="android.hardware.camera.autofocus"/>
<uses-permission?android:name="android.permission.VIBRATE"/>
2, under layout catalogue, create the topology file statement of NextActivity, called after next_activity.xml; Then in activity_main.xml and next_activity.xml, realize its layout, MainActivity comprises edit box, key zone, NextActivity comprises editing area and video preview district, as shown in Figure 3, the layout effect of NextActivity as shown in Figure 4 and Figure 5 for the layout effect of MainActivity.
3, at middle instantiation AutoCompleteTextView, realize when editing area input characters, can point out historical input message.
4, the Activity that configures first startup in AndroidManifest.xml is MainActivity, then after clicking " confirmations " button, and the redirect of realization from MainActivity to NextActivity.Example code is as follows:
Intent?intent=new?Intent();
intent.setClass(MainActivity.this,NextActivity.class);
5, open camera code as follows:
Camera?myCamera=Camera.open(CameraInfo.CAMERA_FACING_BACK);
6, camera automatic focus code is as follows:
7, in NextActivity, realize PreviewCallback interface, code is as follows:
public?class?NextActivityextends?Activity?implements?SurfaceHolder.Callback,PreviewCallback,OnClickListener
8, in onPreviewFrame function, realize character recognition, the core code that obtains preview frame video is:
Bitmap?bmp=BitmapFactory.decodeByteArray(tmp,0,tmp.length);
9, in CompareString function, the character obtaining is mated with the character of input, the match is successful returns to True;
If 10 CompareString return values are True, use canvas.drawRect to draw red rectangle frame, by position and the size of the red rectangle frame demonstration of its setting parameter are set, by cycle count mode, set the frequency of its demonstration;
11, the character boundary judgement mobile phone camera identifying by detection is to the distance between the figure book that will locate;
12, by playSounds function play cuing sound, the frequency of its play cuing sound is set in parameter list; By controlling vibrating motor, mobile phone is vibrated, core code is:
Vibrator?mVibrator=(Vibrator).getApplication().getSystemService(Service.VIBRATOR_SERVICE);
mVibrator.vibrate(long?milliseconds...，int?repeat);
As can be seen here, the present invention can help user when finding books, especially the books on the bookshelf are put more rambling time, utilization is furnished with the mobile phone of camera, the books that quick-searching is wanted to user, while having avoided artificial searching, easily omit the problem of books, improved books location efficiency.
Obviously, above-described embodiment is only used to giving an example of this method realization is clearly described, and the not restriction to execution mode.For those of ordinary skill in the field, can also make on the basis of the above description other multi-form variation or changes.Here exhaustive without also giving all execution modes.And the apparent variation of being extended out thus or change are still among protection scope of the present invention.
Claims (9)
1. the books localization method based on mobile phone camera, is characterized in that, comprises the steps:
Step 1, on mobile phone, enable these books localization method;
The user interface of step 2, demonstration books localization method, described user interface comprises edit box, drop-down menu, button control and video preview district, edit box wants for inputting user the book information of searching, drop-down menu is selected prompting mode for user, wherein prompting mode comprises three kinds of patterns: silent mode, acoustic pattern and vibration mode, button control is confirmed book information and the selected prompt modes inputted for user, video preview district is for showing the present image that camera photographs;
Step 3, user input and want the book information of searching and in drop-down menu, select prompting mode in edit box;
Step 4, user's button click control, confirm that after the book information and prompting mode of input, mobile phone camera is opened automatically, the picture that the real-time demonstration in video preview district is being taken;
Step 5, user aim at the books spine on bookshelf in suitable distance by camera, carry out follow shot;
Step 6, mobile phone camera are focused automatically;
After step 7, mobile phone camera are focused successfully, mobile phone is processed camera preview frame video in real time, and character recognition module identifies Word message wherein from each frame video;
Step 8, character recognition module mate the Word message identifying with the book information of user's input;
The book information of the Word message that step 9, character recognition module identify and user input after the match is successful according to user the selection in drop-down menu point out accordingly.
2. a kind of books localization method based on mobile phone camera according to claim 1, is characterized in that: this method can be transplanted to other mobile terminals that Andriod operating system or IOS operating system are housed, and this mobile terminal is furnished with camera.
3. a kind of books localization method based on mobile phone camera according to claim 1, it is characterized in that: in step 2, described three kinds of prompting modes refer to: no matter select which kind of prompting mode, the book information of the Word message identifying when character recognition module and user's input is when the match is successful, all can be with a kind of visual effect prompting user in video preview district, such as showing red framework, in red framework, be the books that need to search, and red block is known from experience constantly flicker; When user selects silent mode, video preview district only shows that above-mentioned visual effect points out; When user selects a sound pattern, not only video preview district shows that above-mentioned visual effect points out, and the loud speaker of mobile phone sends the sound that certain frequency " ticks " and points out; When user selects vibration mode, not only video preview district shows that above-mentioned visual effect points out, and mobile phone can be pointed out with certain frequency vibration.
4. according to a kind of books localization method based on mobile phone camera described in claim 1,3, it is characterized in that: in three in the middle of prompt modes, except independent selection a kind of pattern wherein, also can there is following a kind of combination to select for user: acoustic pattern adds vibration mode; Be drop-down menu provide four kinds can selection mode.
5. visual cues effect according to claim 3, such as red framework prompting, it is characterized in that: in the middle of the video photographing, have a plurality of words can with input characters matching time, point out in video preview district respectively a plurality of red frameworks of flickering display.
6. according to three kinds of prompt modes described in claim 3,4,5, it is characterized in that: when mobile phone camera is nearer apart from the word matching, the frequency of red prompting framework flicker is higher, and the frequency that loud speaker sends voice prompt is higher, and the frequency of mobile phone vibration is also higher; When mobile phone camera is far away apart from the word matching, the frequency of red prompting framework flicker is lower, and the frequency that loud speaker sends voice prompt is lower, and the frequency of mobile phone vibration is also lower.
7. a kind of books localization method based on mobile phone camera according to claim 1, is characterized in that: in step 3, when user inputs book information in edit box, can point out historical input message.
8. according to a kind of books localization method based on mobile phone camera described in claim 1,7, it is characterized in that: in step 3, the book information of inputting can comprise title, author, publishing house etc., or one of them, or wherein both, or all.
9. a kind of books localization method based on mobile phone camera according to claim 1, is characterized in that: in step 7, described character recognition module can be identified Chinese information, also can identify foreign language and other characters of this technical support.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410009144.3A CN103731558B (en) | 2014-01-08 | 2014-01-08 | A kind of books localization method based on mobile phone camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410009144.3A CN103731558B (en) | 2014-01-08 | 2014-01-08 | A kind of books localization method based on mobile phone camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103731558A true CN103731558A (en) | 2014-04-16 |
| CN103731558B CN103731558B (en) | 2016-04-27 |
Family
ID=50455476
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410009144.3A Expired - Fee Related CN103731558B (en) | 2014-01-08 | 2014-01-08 | A kind of books localization method based on mobile phone camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103731558B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105183744A (en) * | 2015-06-29 | 2015-12-23 | 努比亚技术有限公司 | Method and device for carrying out paper book keyword retrieval by mobile phone |
| CN105725526A (en) * | 2016-03-28 | 2016-07-06 | 钱月珍 | Office bookcase |
| CN105913436A (en) * | 2016-04-13 | 2016-08-31 | 乐视控股（北京）有限公司 | Wind information determining method and mobile terminal |
| CN106295529A (en) * | 2016-08-01 | 2017-01-04 | 北京易道博识科技有限公司 | A kind of Table recognition method and system of mobile terminal |
| CN107730174A (en) * | 2017-10-14 | 2018-02-23 | 浙江瑞丰信息科技有限公司 | Internet of Things luggage administrative system |
| CN108960224A (en) * | 2018-06-26 | 2018-12-07 | 广东工业大学 | A kind of library search method, apparatus and system |
| CN109297489A (en) * | 2018-07-06 | 2019-02-01 | 广东数相智能科技有限公司 | A kind of indoor navigation method based on user characteristics, electronic equipment and storage medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5963134A (en) * | 1997-07-24 | 1999-10-05 | Checkpoint Systems, Inc. | Inventory system using articles with RFID tags |
| CN102063617A (en) * | 2010-12-31 | 2011-05-18 | 天津大学 | Automatic inspection robot for shelved books based on image recognition technology |
| CN102384745A (en) * | 2011-08-18 | 2012-03-21 | 南京信息工程大学 | Method of mobile phone navigation in library and system |
| CN103295034B (en) * | 2013-04-30 | 2015-10-21 | 中南大学 | A kind of embedded Books Chaotic Frame checking system based on DSP and method |
-
2014
- 2014-01-08 CN CN201410009144.3A patent/CN103731558B/en not_active Expired - Fee Related
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105183744A (en) * | 2015-06-29 | 2015-12-23 | 努比亚技术有限公司 | Method and device for carrying out paper book keyword retrieval by mobile phone |
| CN105725526A (en) * | 2016-03-28 | 2016-07-06 | 钱月珍 | Office bookcase |
| CN105725526B (en) * | 2016-03-28 | 2018-06-29 | 广东开林家具制造有限公司 | Office bookcase |
| CN105913436A (en) * | 2016-04-13 | 2016-08-31 | 乐视控股（北京）有限公司 | Wind information determining method and mobile terminal |
| CN106295529A (en) * | 2016-08-01 | 2017-01-04 | 北京易道博识科技有限公司 | A kind of Table recognition method and system of mobile terminal |
| CN107730174A (en) * | 2017-10-14 | 2018-02-23 | 浙江瑞丰信息科技有限公司 | Internet of Things luggage administrative system |
| CN107730174B (en) * | 2017-10-14 | 2021-02-02 | 首鼎科技股份有限公司 | Internet of things luggage management system |
| CN108960224A (en) * | 2018-06-26 | 2018-12-07 | 广东工业大学 | A kind of library search method, apparatus and system |
| CN109297489A (en) * | 2018-07-06 | 2019-02-01 | 广东数相智能科技有限公司 | A kind of indoor navigation method based on user characteristics, electronic equipment and storage medium |
| CN109297489B (en) * | 2018-07-06 | 2022-08-02 | 广东数相智能科技有限公司 | Indoor navigation method based on user characteristics, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103731558B (en) | 2016-04-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103731558B (en) | A kind of books localization method based on mobile phone camera | |
| CN104063175B (en) | Metadata token system and user terminal apparatus | |
| CN105094760B (en) | A kind of picture indicia method and device | |
| US9773101B2 (en) | Method for displaying contents and electronic device thereof | |
| CN104077026B (en) | The method and apparatus of service page of the display for executing application | |
| CN104380717B (en) | Information processing unit, information processing method and computer readable storage medium | |
| CN103729120A (en) | Method for generating thumbnail image and electronic device thereof | |
| CN103577788A (en) | Augmented reality realizing method and augmented reality realizing device | |
| CN102754352A (en) | Method and apparatus for providing information of multiple applications | |
| CN107798931A (en) | A kind of intelligent children education learning system and method | |
| CN105302315A (en) | Image processing method and device | |
| CN105578045A (en) | Terminal and shooting method of terminal | |
| CN105528444A (en) | Method and device for generating photo album | |
| CN104050838A (en) | Reading system, device and method capable of recognizing and reading common printed matter | |
| US20210240773A1 (en) | Systems and methods for proactive information discovery with multiple senses | |
| JP6323202B2 (en) | System, method and program for acquiring video | |
| CN104881451A (en) | Image searching method and image searching device | |
| JP2001092838A (en) | Multimedia information collecting and managing device and storing medium storing program | |
| TWM594323U (en) | Intelligent meeting record system | |
| CN105404696A (en) | Method, system and device for downloading photographs in photograph album | |
| CN105528450A (en) | Method and device for naming photo album | |
| US20140333786A1 (en) | System and method for remotely creating and processing media files | |
| CN115858833A (en) | Picture display method, information display method and device and electronic equipment | |
| CN103338330A (en) | Picture processing method and device, and terminal | |
| JP2007108989A (en) | Information processing system and information processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information |
Inventor after: Li Shibao Inventor after: Lu Jinbo Inventor after: Gu Chaozhi Inventor after: Ge Yuming Inventor after: Liu Jianhang Inventor after: Ma Pengcheng Inventor after: Lou Linlin Inventor after: Shu Ruo Inventor before: Li Shibao Inventor before: Gu Chaozhi Inventor before: Ge Yuming Inventor before: Liu Jianhang Inventor before: Ma Pengcheng Inventor before: Lou Linlin Inventor before: Shu Ruo |
|
| COR | Change of bibliographic data | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160427 Termination date: 20180108 |