CN105204752A - Method and system for achieving interaction in projection type reading - Google Patents
Method and system for achieving interaction in projection type reading Download PDFInfo
- Publication number
- CN105204752A CN105204752A CN201410244485.9A CN201410244485A CN105204752A CN 105204752 A CN105204752 A CN 105204752A CN 201410244485 A CN201410244485 A CN 201410244485A CN 105204752 A CN105204752 A CN 105204752A
- Authority
- CN
- China
- Prior art keywords
- page
- content
- pages
- projection
- word
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a method and system for achieving interaction in projection type reading. The method includes the steps that projection is conducted on an electronic book or a printed book so as to obtain a corresponding projection page; movement of an infrared pen in the projection page is positioned in an infrared mode, and a movement trace of the infrared pen in the projection page in the page content is obtained; redrawing is conducted according to the movement trace of the infrared pen so as to generate notes corresponding to the page content, and the notes are stored in a corresponding catalogue. The system comprises a projection module, a movement positioning module and a redrawing module. By the adoption of the method and system, projection of a paper version and projection of the electronic book can be stored at the same time, so that subsequent operation is conducted on the content of the projection of the paper version and the content of the projection of the electronic book.
Description
Technical field
The present invention relates to interactive application technology, particularly relate to during a kind of projection is read and realize mutual method and system.
Background technology
In the process of carrying out projection reading, be usually to need the content of reading to be projected by projector, can read easily by the projection page to make everybody.Wherein, for realize projection read device include newspaper reading device and portable electronic book reading device, realized the content projection of the papery space of a whole page by newspaper reading device, by portable electronic book reading device by the content in e-book to outer projection.
But, realize in the process that the many people of reading content share in the mode of being read by projection, each realizes device that projection reads all cannot the projection of compatible hard-copies and the projection of e-book, and then also cannot carry out follow-up operation to the content of the projection of hard-copies and the projection of e-book, be confined to single function, the reading requirement of user cannot be met.
Summary of the invention
Based on this, be necessary to provide the projection of the compatible hard-copies of a kind of energy and the projection of e-book, in reading with the projection of the content of hard-copies projection and e-book projection being carried out to subsequent operation, realize mutual method.
In addition, there is a need to provide the projection of the compatible hard-copies of a kind of energy and the projection of e-book, in reading with the projection of the content of hard-copies projection and e-book projection being carried out to subsequent operation, realize mutual system.
Projection realizes a mutual method in reading, and comprises the steps:
E-book or paper book are projected to be projected accordingly the page;
The movement of infrared pen in the described projection in the infrared location page, obtains the mobile vestige of infrared pen on content of pages in the described projection page;
Carry out redrawing to generate notes corresponding to described content of pages according to the mobile vestige of described infrared pen, and described notes are saved in corresponding catalogue.
Wherein in an embodiment, the described mobile vestige according to described infrared pen carries out redrawing to generate notes corresponding to described content of pages, and after described notes being saved to the step in corresponding catalogue, described method also comprises:
Trigger and the content of pages that page turning obtains current display in the described projection page is carried out to the described projection page;
From catalogue, the notes obtaining preserving are extracted according to the content of pages of current display;
Merge described notes and content of pages, and the notes merged and content of pages are shown in the projection page.
Wherein in an embodiment, the described projection page is projected by e-book and obtains, and described triggering is carried out to the described projection page step that page turning obtains the content of pages of current display in the described projection page and comprised:
Catch user's gesture, obtain the current gesture that content of pages in the projection page is triggered to follow the tracks of described user's gesture;
Identify described gesture, to obtain triggering the gesture of content of pages being carried out to page turning;
The gesture of carrying out page turning along with described triggering page content performs corresponding page turning action with the content of pages after obtaining page turning at the projection page, and is shown in the projection page.
Wherein in an embodiment, the content of pages in the described projection page to project the surface plot picture obtained to the front cover of paper book, and described method also comprises:
Finger image analysis is carried out to described surface plot picture and obtains corresponding book information;
Carry out according to described book information searching for the relevant information obtaining described paper book, and be projected to the described projection page.
Wherein in an embodiment, described to e-book project to be projected accordingly the page step after, described method also comprises:
The word to be checked of content of pages in the described projection page is obtained according to the position of infrared pen in content of pages;
Carry out search according to described word to be checked and obtain corresponding Query Result, and be projected to the described projection page.
Wherein in an embodiment, describedly carry out after finger image analysis obtains the step of corresponding book information to described surface plot picture, described method also comprises:
The click triggered in described content of pages by described infrared pen obtains the selection area containing word to be checked in the described projection page;
Judge whether to there is the e-book conformed to described book information, if yes, then extracted the word to be checked obtaining described selection area and comprise by described e-book, if NO, then
Word refinement is carried out to the content of pages in the projection page, and obtains word to be checked according to the position of infrared pen in content of pages;
Carry out search according to described word to be checked and obtain corresponding Query Result, and be projected to the described projection page.
Projection realizes a mutual system in reading, and comprising:
Projection module, for projecting to be projected accordingly the page to e-book or paper book;
Mobile position-fixed module, for the movement of infrared pen in the described projection in the infrared location page, obtains the mobile vestige of infrared pen on content of pages in the described projection page;
Redrawing module, redrawing to generate notes corresponding to described content of pages for carrying out according to the mobile vestige of described infrared pen, and described notes are saved in corresponding catalogue.
Wherein in an embodiment, described system also comprises:
Page processing module, carries out to the described projection page content of pages that page turning obtains current display in the described projection page for triggering;
Notes extraction module, for extracting the notes obtaining preserving from catalogue according to the content of pages of current display;
The notes merged and content of pages for merging described notes and content of pages, and are shown in the projection page by Fusion Module.
Wherein in an embodiment, the described projection page is projected by e-book and obtains, and described page processing module comprises:
Gesture capturing unit, for catching user's gesture, obtains the current gesture triggered the content of pages in the projection page to follow the tracks of described user's gesture;
Recognition unit, for identifying described gesture, to obtain triggering the gesture of content of pages being carried out to page turning;
Page turning performance element, performs corresponding page turning action with the content of pages after obtaining page turning for the gesture of carrying out page turning along with described triggering page content at the projection page, and is shown in the projection page.
Wherein in an embodiment, the content of pages in the described projection page to project the surface plot picture obtained to the front cover of paper book, and described system also comprises:
Finger image analysis module, obtains corresponding book information for carrying out finger image analysis to described surface plot picture;
Books search module, searches for for carrying out according to described book information the relevant information obtaining described paper book, and is projected to the described projection page.
Wherein in an embodiment, described system also comprises:
Word locating module, for obtaining the word to be checked of content of pages in the described projection page according to the position of infrared pen in content of pages;
First word search module, obtains corresponding Query Result for carrying out search according to described word to be checked, and is projected to the described projection page.
Wherein in an embodiment, described system also comprises:
Region acquisition module, the click for being triggered in described content of pages by described infrared pen obtains the selection area containing word to be checked in the described projection page;
, there is for judging whether the e-book conformed to described book information in judge module, if yes, then notifies word extraction module, if NO, then notifies that word refines module;
Described word extraction module is used for extracting by described e-book the word to be checked obtaining described selection area and comprise;
Described word refines module and is used for carrying out word refinement to the content of pages in the projection page, and obtains word to be checked according to the position of infrared pen in content of pages;
Second word search module, obtains corresponding Query Result for carrying out search according to described word to be checked, and is projected to the described projection page.
Above-mentioned projection realizes mutual method and system in reading, to project to be projected accordingly the page to e-book or paper book, along with in the projection page, infrared location is carried out in the movement of infrared pen, to obtain the mobile vestige of infrared pen on content of pages in the projection page, carry out according to mobile vestige redrawing the notes obtained in the Current projection page corresponding to content of pages, and be saved in corresponding catalogue, thus make realized projection read the compatibility projection of hard-copies and the projection of e-book, and also can realize follow-up operation to content of pages by any movement of infrared pen, improve the interactivity that projection is read.
Accompanying drawing explanation
Fig. 1 is that in an embodiment, projection realizes mutual method flow diagram in reading;
Fig. 2 is that in another embodiment, projection realizes mutual method flow diagram in reading;
Fig. 3 triggers in Fig. 2 to carry out to the projection page method flow diagram that page turning obtains the content of pages of current display in the projection page;
Fig. 4 is that in another embodiment, projection realizes mutual method flow diagram in reading;
Fig. 5 is that in another embodiment, projection realizes mutual method flow diagram in reading;
Fig. 6 is that in another embodiment, projection realizes mutual method flow diagram in reading;
Fig. 7 is that in an embodiment, projection realizes mutual system architecture schematic diagram in reading;
Fig. 8 is that in another embodiment, projection realizes mutual system architecture schematic diagram in reading;
Fig. 9 is the system architecture schematic diagram of page processing module in Fig. 8;
Figure 10 is that in another embodiment, projection realizes mutual system architecture schematic diagram in reading;
Figure 11 is that in another embodiment, projection realizes mutual system architecture schematic diagram in reading;
Figure 12 is that in another embodiment, projection realizes mutual system architecture schematic diagram in reading.
Embodiment
In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
In one embodiment, as shown in Figure 1, a kind of projection realizes mutual method in reading, and comprises the steps:
Step 110, projects to be projected accordingly the page to e-book or paper book.
In the present embodiment, e-book is stored in any terminal equipment to be existed in digital form, and paper book then exists with paper-based form.The projection page is the region that projector projects goes out, and in a preferred embodiment, this region is rectangular area.
According to the needs that Current projection formula is read, can project to e-book or paper book, with the page that projected accordingly, the content in e-book or paper book is shown in the projection page as content of pages, and then the reading realized between many people be shared.
Step 130, the movement of infrared pen in the infrared positioning projection page, obtains the mobile vestige of infrared pen on content of pages in the projection page.
In the present embodiment, infrared pen realizes the interactive operation between user and the projection page by being used for, to realize the random manipulation that projection is read.Concrete, by the infrared ray sent by the infrared pen of infrared camera record, the infrared pen occurred in the record projection page moves, and to obtain the mobile vestige of infrared pen on content of pages in the projection page, completes the infrared location of carrying out the movement of infrared pen.
Such as, undertaken in the process of projection reading by the content of pages shown by the projection page, if desired emphasis marks certain passage, then user can manipulate infrared pen and moves on this section of word, now, the infrared ray that sends of the infrared pen of movement is namely corresponding this section of literal mobile vestige.
Step 150, carries out redrawing to generate notes corresponding to content of pages according to the mobile vestige of infrared pen, and notes is saved in corresponding catalogue.
In the present embodiment, the computing machine on backstage redraws according to the mobile vestige of infrared pen on content of pages, namely the mobile vestige of infrared pen is redrawn according to the region of certain ratio corresponding to computing machine, redraw vestige and the picture of background transparent to be formed to contain, this picture is the notes corresponding to content of pages triggering infrared pen movement.
By redrawing vestige and the form of the picture of background transparent stores to notes to contain, and not needing the content of pages corresponding to it of corresponding stored extraly, greatly saving storage space, it also avoid the redundancy of storage.
By reciprocal process as above, even if the reading making user carry out e-book or paper book by the mode that projection is read also can be taken down notes to the content write in e-book or paper book, greatly facilitate the projection reading that user carries out, make projection read the mode that also can adapt to current mankind reading, and then improve the adaptability that user carries out projection reading.
That reads in projection as above realizes in reciprocal process, what define under paper book and e-book two kinds of scenes is mutual, the books making user no matter have which kind of type can both realize projection by method as above and read and alternately, greatly improve the scope of application that projection is read.
As shown in Figure 2, in one embodiment, after above-mentioned steps 150, method as above further comprises following steps:
Step 210, triggers and carries out to the projection page content of pages that page turning obtains current display in the projection page.
In the present embodiment, intercept and obtain after the content of pages triggered in the projection page carries out the instruction of page turning, will carry out page turning according to this instruction, the content of pages that shows in the conversion projection page, is shown in the target pages content corresponding to this instruction in the projection page.
Step 230, extracts the notes obtaining preserving from catalogue according to the content of pages of current display.
In the present embodiment, obtaining triggering after the page carries out the target pages content of page turning to projection, by extracting notes corresponding with it from catalogue, namely containing and redrawing vestige and the picture of background transparent.
Step 250, merges notes and content of pages, and the notes merged and content of pages is shown in the projection page.
In the present embodiment, because notes contain to redraw vestige and the picture of background transparent, therefore, directly notes and content of pages can be combined together and show, make to project and both to have shown content of pages in the page and also show the notes that user once write, greatly facilitate user and check.
As shown in Figure 3, in another embodiment, the projection page is projected by e-book and obtains, and above-mentioned steps 210 comprises:
Step 211, catches user's gesture, obtains the current gesture triggered the content of pages in the projection page to follow the tracks of user's gesture.
In the present embodiment, catch user's gesture by optical camera, and carry out real-time follow-up, to obtain the current gesture triggered the content of pages shown in the projection page of user.
Step 213, identifies this gesture, to obtain triggering the gesture of content of pages being carried out to page turning.
In the present embodiment, for knowing user view, will the current gesture that content of pages in the projection page is triggered be identified, and then know that this gesture is the gesture triggering and content of pages is carried out to page turning.
Such as, trigger the gesture that downward page turning carried out to content of pages can be within a certain period of time by the right side to the gesture moved left, triggering the gesture of carrying out upwards page turning to content of pages can be within a certain period of time by the gesture of left-to-right movement, can as required and the use habit of user arrange neatly.
Further, for increasing the degree of accuracy of gesture identification, employing depth camera is carried out catching of user's gesture and followed the tracks of.
Step 215, the gesture of carrying out page turning along with triggering page content performs corresponding page turning action with the content of pages after obtaining page turning at the projection page, and is shown in the projection page.
In the present embodiment, followed by the gesture that triggering page content carries out page turning, page turning action will be performed in the projection page, so that the current content of pages be shown in the projection page is stirred to target pages content.
In addition, catch and identify that required page when including reading also amplifies by user's gesture of obtaining and the page such as to reduce at the gesture, do not enumerate one by one at this.
As shown in Figure 4, in one embodiment, the content of pages in the projection page to project the surface plot picture obtained to the front cover of paper book, and method as above also comprises:
Step 410, carries out finger image analysis to surface plot picture and obtains corresponding book information.
In the present embodiment, for paper book page speech, its content of pages corresponding to every one page exists all in the form of images, i.e. paper book image, therefore, for obtaining the book information corresponding to paper book, carry out finger image analysis by the surface plot picture being projected on paper book in the projection page.
Concrete, surface plot picture will be caught by optical camera, by the surface plot Image relaying of catching in the computing machine on backstage, computing machine will carry out feature extraction to surface plot picture, and according to extract the feature obtained carry out characteristic matching in the books property data base set up in advance, obtain to search and extract on books that the feature that obtains matches, and then obtain corresponding book information, wherein, book information have recorded the information such as publication title, store in the books property data base set up in advance feature and with the book information corresponding to feature.
Step 430, carries out according to book information searching for the relevant information obtaining paper book, and is projected to the projection page.
In the present embodiment, with book information be key word carry out search can obtain current relevant information of carrying out the paper book of projection reading, such as, the information such as author, publishing house, comment of this paper book, reads to facilitate user.
As shown in Figure 5, in one embodiment, after above-mentioned steps 110, method as above further comprises following steps:
Step 510, obtains the word to be checked of content of pages in the projection page according to the position of infrared pen in content of pages.
In the present embodiment, after the page that projects e-book to be projected accordingly, will obtain the position of infrared pen in content of pages, the word corresponding to this position is the word to be checked that user needs to carry out inquiring about.
Concrete, user realizes to be checked word selected to the click of content of pages by infrared pen in the projection page, that is, along with the clicking operation that infrared pen triggers content of pages in the projection page, infrared pen will send infrared ray, the infrared ray that infrared camera will be caught infrared pen and sends, obtain the position of infrared pen in content of pages to carry out infrared location to infrared pen, and then carry out according to the position obtained the word to be checked that word extraction can obtain content of pages in the projection page.
Wherein, infrared pen enters to represent by the infrared elements of a fix in the position of content of pages, along with infrared pen is to the click of content of pages, the computing machine on backstage calculates to obtain its position relative to the projection page by carrying out ratio according to the infrared elements of a fix, and then the mouse controlled in the projection page moves on this position.
Step 530, carries out search according to word to be checked and obtains corresponding Query Result, and be projected to the projection page.
In the present embodiment, web search will be carried out using word to be checked as key word to obtain corresponding Query Result, the Query Result obtained will be projected in the projection page, the word enquiring carried out with completing user.
As shown in Figure 6, in one embodiment, after above-mentioned steps 410, method as above further comprises following steps:
Step 610, the click triggered in content of pages by infrared pen obtains the selection area containing word to be checked in the projection page.
In the present embodiment, content of pages is the paper book image projecting obtained to paper book, the click sent out along with infrared style of writing will obtain region chosen in this paper book image, and namely contain the selection area of document to be checked, this selection area is a part for paper book image.
Step 630, judges whether to there is the e-book conformed to book information, if yes, then enters step 650, if NO, then enter step 670.
In the present embodiment, corresponding book information is obtained owing to having carried out finger image analysis to the surface plot picture of paper book, therefore, to search in a computer according to book information, to judge whether corresponding e-book, if had, then directly can enter the digital form that step 650 acquires word to be checked in chosen area, if do not had, then OCR (OpticalCharacterRecognition, optical character identification) technology can only be adopted to obtain word to be checked by step 670.
Step 650, is extracted the word to be checked obtaining selection area and comprise by e-book.
In the present embodiment, this e-book is consistent with paper book, such as, has identical publication title with paper book.Content in e-book is searched, to acquire the region matched with the selection area of paper book in e-book, and obtains by the extracted region acquired the word to be checked that chosen area comprises.
Step 670, carries out word refinement to the content of pages in the projection page, and obtains word to be checked according to the position of infrared pen in content of pages.
In the present embodiment, when the e-book consistent with paper book cannot be acquired, employing OCR technology is carried out word refinement to the content of pages existed with paper book image format by the computing machine on backstage, and then obtains word to be checked according to the position of infrared pen in content of pages.
Step 690, carries out search according to word to be checked and obtains corresponding Query Result, and be projected to the projection page.
In the present embodiment, corresponding Query Result can be obtained with word to be checked for key word carries out search, and be projected in the projection page, Query Result is invested in the content of pages of the projection page.
Mutual method is realized in being read by projection as above, projection will be made to read and to be taken into account all types of books, and possessed abundant interactive function, and by visible ray catch to realize respectively with the mode of infrared location projection read in gesture interaction and alternately infrared, wherein, gesture interaction will be used for the rough operation realizing triggering the projection page, infrared mutual then for realizing the accurate operation projected in the page, the two be combined with each other, and substantially increases mutual degree of accuracy.
As shown in Figure 7, in one embodiment, a kind of projection realizes mutual system in reading, and comprises projection module 710, mobile position-fixed module 730 and redraws module 750.
Projection module 710, for projecting to be projected accordingly the page to e-book or paper book.
In the present embodiment, e-book is stored in any terminal equipment to be existed in digital form, and paper book then exists with paper-based form.The projection page is the region that projector projects goes out, and in a preferred embodiment, this region is rectangular area.
According to the needs that Current projection formula is read, projection module 710 pairs of e-book or paper book project, with the page that projected accordingly, the content in e-book or paper book is shown in the projection page as content of pages, and then the reading realized between many people is shared.
Mobile position-fixed module 730, for the movement of infrared pen in the infrared positioning projection page, obtains the mobile vestige of infrared pen on content of pages in the projection page.
In the present embodiment, infrared pen realizes the interactive operation between user and the projection page by being used for, to realize the random manipulation that projection is read.Concrete, the infrared ray that mobile position-fixed module 730 will be sent by the infrared pen of infrared camera record, the infrared pen occurred in the record projection page moves, and to obtain the mobile vestige of infrared pen on content of pages in the projection page, completes the infrared location of carrying out the movement of infrared pen.
Such as, undertaken in the process of projection reading by the content of pages shown by the projection page, if desired emphasis marks certain passage, then user can manipulate infrared pen and moves on this section of word, now, the infrared ray that sends of the infrared pen of movement is namely corresponding this section of literal mobile vestige.
Redrawing module 750, redrawing to generate notes corresponding to content of pages for carrying out according to the mobile vestige of infrared pen, and notes are saved in corresponding catalogue.
In the present embodiment, the module 750 that redraws in the computing machine on backstage redraws according to the mobile vestige of infrared pen on content of pages, namely the mobile vestige of infrared pen is redrawn according to the region of certain ratio corresponding to computing machine, redraw vestige and the picture of background transparent to be formed to contain, this picture is the notes corresponding to content of pages triggering infrared pen movement.
Redraw module 750 by redrawing vestige and the form of the picture of background transparent stores to notes to contain, and do not need the content of pages corresponding to it of corresponding stored extraly, greatly save storage space, it also avoid the redundancy of storage.
By reciprocal process as above, even if the reading making user carry out e-book or paper book by the mode that projection is read also can be taken down notes to the content write in e-book or paper book, greatly facilitate the projection reading that user carries out, make projection read the mode that also can adapt to current mankind reading, and then improve the adaptability that user carries out projection reading.
That reads in projection as above realizes in reciprocal process, what define under paper book and e-book two kinds of scenes is mutual, the books making user no matter have which kind of type can both realize projection by method as above and read and alternately, greatly improve the scope of application that projection is read.
As shown in Figure 8, in one embodiment, system as above further comprises page processing module 810, notes extraction module 830 and Fusion Module 850.
Page processing module 810, carries out to the projection page content of pages that page turning obtains current display in the projection page for triggering.
In the present embodiment, intercept obtain trigger projection the page in content of pages carry out the instruction of page turning after, page processing module 810 will carry out page turning according to this instruction, and the content of pages shown in the conversion projection page, is shown in the target pages content corresponding to this instruction in the projection page.
Notes extraction module 830, for extracting the notes obtaining preserving from catalogue according to the content of pages of current display.
In the present embodiment, obtaining triggering after to projection, the page carries out the target pages content of page turning, notes extraction module 830, by extracting notes corresponding with it from catalogue, namely contains and redraws vestige and the picture of background transparent.
The notes merged and content of pages for merging notes and content of pages, and are shown in the projection page by Fusion Module 850.
In the present embodiment, because notes contain to redraw vestige and the picture of background transparent, therefore, notes and content of pages directly can combine together and show by Fusion Module 850, make to project and both to have shown content of pages in the page and also show the notes that user once write, greatly facilitate user and check.
As shown in Figure 9, in one embodiment, the projection page is projected by e-book and obtains, and above-mentioned page processing module 810 comprises gesture capturing unit 811, recognition unit 813 and page turning performance element 815.
Gesture capturing unit 811, for catching user's gesture, obtains the current gesture triggered the content of pages in the projection page to follow the tracks of user's gesture.
In the present embodiment, catch user's gesture by gesture capturing unit 811, and carry out real-time follow-up, to obtain the current gesture triggered the content of pages shown in the projection page of user.This gesture capturing unit 811 can be optical camera.
Recognition unit 813, for identifying this gesture, to obtain triggering the gesture of content of pages being carried out to page turning.
In the present embodiment, for knowing user view, recognition unit 813 will identify the current gesture triggered the content of pages in the projection page, and then knows that this gesture is the gesture triggering and content of pages is carried out to page turning.
Such as, trigger the gesture that downward page turning carried out to content of pages can be within a certain period of time by the right side to the gesture moved left, triggering the gesture of carrying out upwards page turning to content of pages can be within a certain period of time by the gesture of left-to-right movement, can as required and the use habit of user arrange neatly.
Further, for increasing the degree of accuracy of gesture identification, gesture capturing unit can be depth camera, to carry out catching and following the tracks of of user's gesture.
Page turning performance element 815, performs corresponding page turning action with the content of pages after obtaining page turning for the gesture of carrying out page turning along with content of pages at the projection page, and is shown in the projection page.
In the present embodiment, followed by the gesture that triggering page content carries out page turning, page turning performance element 815 will perform page turning action in the projection page, to stir the current content of pages be shown in the projection page to target pages content.
In addition, catch and identify that required page when including reading also amplifies by user's gesture of obtaining and the page such as to reduce at the gesture, do not enumerate one by one at this.
As shown in Figure 10, in one embodiment, the content of pages in the projection page to project the surface plot picture obtained to the front cover of paper book, and system as above also comprises finger image analysis module 1010 and books search module 1030.
Finger image analysis module 1010, obtains corresponding book information for carrying out finger image analysis to surface plot picture.
In the present embodiment, the paper book page is sayed, its content of pages corresponding to every one page exists all in the form of images, i.e. paper book image, therefore, for obtaining the book information corresponding to paper book, finger image analysis module 1010 carries out finger image analysis by the surface plot picture being projected on paper book in the projection page.
Concrete, finger image analysis module 1010 will catch surface plot picture by optical camera, by the surface plot Image relaying of catching in the computing machine on backstage, computing machine will carry out feature extraction to surface plot picture, and according to extract the feature obtained carry out characteristic matching in the books property data base set up in advance, obtain to search and extract on books that the feature that obtains matches, and then obtain corresponding book information, wherein, book information have recorded the information such as publication title, store in the books property data base set up in advance feature and with the book information corresponding to feature.
Books search module 1030, searches for for carrying out according to book information the relevant information obtaining paper book, and is projected to the projection page.
In the present embodiment, books search module 1030 with book information be key word carry out search can obtain current relevant information of carrying out the paper book of projection reading, such as, the information such as author, publishing house, comment of this paper book, reads to facilitate user.
As shown in figure 11, in one embodiment, system as above further comprises word locating module 1110 and the first word search module 1130.
Word locating module 1110, for obtaining the word to be checked of content of pages in the projection page according to the position of infrared pen in content of pages.
In the present embodiment, after the page that projects e-book to be projected accordingly, word locating module 1110 will obtain the position of infrared pen in content of pages, and the word corresponding to this position is the word to be checked that user needs to carry out inquiring about.
Concrete, user realizes to be checked word selected to the click of content of pages by infrared pen in the projection page, that is, along with the clicking operation that infrared pen triggers content of pages in the projection page, infrared pen will send infrared ray, the infrared ray that infrared camera will be caught infrared pen and sends, word locating module 1110 carries out infrared location to infrared pen and obtains the position of infrared pen in content of pages, and then carries out according to the position obtained the word to be checked that word extraction can obtain content of pages in the projection page.
Wherein, infrared pen enters to represent by the infrared elements of a fix in the position of content of pages, along with infrared pen is to the click of content of pages, word locating module 1110 in the computing machine on backstage by carry out according to the infrared elements of a fix ratio calculate with obtain its relative to projection the page position, and then control projection the page in mouse move on this position.
First word search module 1130, obtains corresponding Query Result for carrying out search according to word to be checked, and is projected to the projection page.
In the present embodiment, the first word search module 1130 will carry out web search to obtain corresponding Query Result using word to be checked as key word, will be projected to by the Query Result obtained in the projection page, the word enquiring carried out with completing user.
As shown in figure 12, in one embodiment, system as above further comprises region acquisition module 1210, judge module 1230, word extraction module 1250, word refinement module 1270 and the second word search module 1290.
Region acquisition module 1210, the click for being triggered in content of pages by infrared pen obtains the selection area containing word to be checked in the projection page.
In the present embodiment, content of pages is the paper book image projecting obtained to paper book, the click sent out along with infrared style of writing will obtain region chosen in this paper book image, and namely contain the selection area of document to be checked, this selection area is a part for paper book image.
, there is for judging whether the e-book conformed to book information in judge module 1230, if yes, then notifies word extraction module 1250, if NO, then notifies that word refines module 1270.
In the present embodiment, corresponding book information is obtained owing to having carried out finger image analysis to the surface plot picture of paper book, therefore, judge module 1230 will be searched in a computer according to book information, to judge whether corresponding e-book, if had, then directly can notify that word extraction module 1250 acquires the digital form of word to be checked in chosen area, if no, then can only notify that word refines module 1270 and adopts OCR technology to obtain word to be checked.
Word extraction module 1250, for being extracted the word to be checked obtaining selection area and comprise by e-book.
In the present embodiment, this e-book is consistent with paper book, such as, has identical publication title with paper book.Content in word extraction module 1250 pairs of e-book is searched, and to acquire the region matched with the selection area of paper book in e-book, and obtains by the extracted region acquired the word to be checked that chosen area comprises.
Word refines module 1270, and for carrying out word refinement to the content of pages in the projection page, and the position of infrared pen in content of pages obtains word to be checked.
In the present embodiment, when the e-book consistent with paper book cannot be acquired, word in the computing machine on backstage refines module 1270 and employing OCR technology is carried out word refinement to the content of pages existed with paper book image format, and then obtains word to be checked according to the position of infrared pen in content of pages.
Second word search module 1290, obtains corresponding Query Result for carrying out search according to word to be checked, and is projected to the projection page.
In the present embodiment, the second word search module 1290 can obtain corresponding Query Result with word to be checked for key word carries out search, and is projected in the projection page, to be invested by Query Result in the content of pages of the projection page.
Mutual system is realized in being read by projection as above, projection will be made to read and to be taken into account all types of books, and possessed abundant interactive function, and by visible ray catch to realize respectively with the mode of infrared location projection read in gesture interaction and alternately infrared, wherein, gesture interaction will be used for the rough operation realizing triggering the projection page, infrared mutual then for realizing the accurate operation projected in the page, the two be combined with each other, and substantially increases mutual degree of accuracy.
One of ordinary skill in the art will appreciate that all or part of flow process realized in above-described embodiment method, that the hardware that can carry out instruction relevant by computer program has come, described program can be stored in a computer read/write memory medium, as in the embodiment of the present invention, this program can be stored in the storage medium of computer system, and performed by least one processor in this computer system, to realize the flow process of the embodiment comprised as above-mentioned each side method.Wherein, described storage medium can be magnetic disc, CD, read-only store-memory body (Read-OnlyMemory, ROM) or random store-memory body (RandomAccessMemory, RAM) etc.
The above embodiment only have expressed several embodiment of the present invention, and it describes comparatively concrete and detailed, but therefore can not be interpreted as the restriction to the scope of the claims of the present invention.It should be pointed out that for the person of ordinary skill of the art, without departing from the inventive concept of the premise, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection domain of patent of the present invention should be as the criterion with claims.
Claims (12)
1. projection realizes a mutual method in reading, and comprises the steps:
E-book or paper book are projected to be projected accordingly the page;
The movement of infrared pen in the described projection in the infrared location page, obtains the mobile vestige of infrared pen on content of pages in the described projection page;
Carry out redrawing to generate notes corresponding to described content of pages according to the mobile vestige of described infrared pen, and described notes are saved in corresponding catalogue.
2. method according to claim 1, is characterized in that, the described mobile vestige according to described infrared pen carries out redrawing to generate notes corresponding to described content of pages, and after described notes being saved to the step in corresponding catalogue, described method also comprises:
Trigger and the content of pages that page turning obtains current display in the described projection page is carried out to the described projection page;
From catalogue, the notes obtaining preserving are extracted according to the content of pages of current display;
Merge described notes and content of pages, and the notes merged and content of pages are shown in the projection page.
3. method according to claim 2, is characterized in that, the described projection page is projected by e-book and obtains, and described triggering is carried out to the described projection page step that page turning obtains the content of pages of current display in the described projection page and comprised:
Catch user's gesture, obtain the current gesture that content of pages in the projection page is triggered to follow the tracks of described user's gesture;
Identify described gesture, to obtain triggering the gesture of content of pages being carried out to page turning;
The gesture of carrying out page turning along with described triggering page content performs corresponding page turning action with the content of pages after obtaining page turning at the projection page, and is shown in the projection page.
4. method according to claim 1, is characterized in that, the content of pages in the described projection page to project the surface plot picture obtained to the front cover of paper book, and described method also comprises:
Finger image analysis is carried out to described surface plot picture and obtains corresponding book information;
Carry out according to described book information searching for the relevant information obtaining described paper book, and be projected to the described projection page.
5. method according to claim 1, is characterized in that, described to e-book project to be projected accordingly the page step after, described method also comprises:
The word to be checked of content of pages in the described projection page is obtained according to the position of infrared pen in content of pages;
Carry out search according to described word to be checked and obtain corresponding Query Result, and be projected to the described projection page.
6. method according to claim 4, is characterized in that, describedly carries out after finger image analysis obtains the step of corresponding book information to described surface plot picture, and described method also comprises:
The click triggered in described content of pages by described infrared pen obtains the selection area containing word to be checked in the described projection page;
Judge whether to there is the e-book conformed to described book information, if yes, then extracted the word to be checked obtaining described selection area and comprise by described e-book, if NO, then
Word refinement is carried out to the content of pages in the projection page, and obtains word to be checked according to the position of infrared pen in content of pages;
Carry out search according to described word to be checked and obtain corresponding Query Result, and be projected to the described projection page.
7. projection realizes a mutual system in reading, and it is characterized in that, comprising:
Projection module, for projecting to be projected accordingly the page to e-book or paper book;
Mobile position-fixed module, for the movement of infrared pen in the described projection in the infrared location page, obtains the mobile vestige of infrared pen on content of pages in the described projection page;
Redrawing module, redrawing to generate notes corresponding to described content of pages for carrying out according to the mobile vestige of described infrared pen, and described notes are saved in corresponding catalogue.
8. system according to claim 7, is characterized in that, described system also comprises:
Page processing module, carries out to the described projection page content of pages that page turning obtains current display in the described projection page for triggering;
Notes extraction module, for extracting the notes obtaining preserving from catalogue according to the content of pages of current display;
The notes merged and content of pages for merging described notes and content of pages, and are shown in the projection page by Fusion Module.
9. system according to claim 8, is characterized in that, the described projection page is projected by e-book and obtains, and described page processing module comprises:
Gesture capturing unit, for catching user's gesture, obtains the current gesture triggered the content of pages in the projection page to follow the tracks of described user's gesture;
Recognition unit, for identifying described gesture, to obtain triggering the gesture of content of pages being carried out to page turning;
Page turning performance element, performs corresponding page turning action with the content of pages after obtaining page turning for the gesture of carrying out page turning along with described triggering page content at the projection page, and is shown in the projection page.
10. system according to claim 7, is characterized in that, the content of pages in the described projection page to project the surface plot picture obtained to the front cover of paper book, and described system also comprises:
Finger image analysis module, obtains corresponding book information for carrying out finger image analysis to described surface plot picture;
Books search module, searches for for carrying out according to described book information the relevant information obtaining described paper book, and is projected to the described projection page.
11. systems according to claim 7, is characterized in that, described system also comprises:
Word locating module, for obtaining the word to be checked of content of pages in the described projection page according to the position of infrared pen in content of pages;
First word search module, obtains corresponding Query Result for carrying out search according to described word to be checked, and is projected to the described projection page.
12. systems according to claim 10, is characterized in that, described system also comprises:
Region acquisition module, the click for being triggered in described content of pages by described infrared pen obtains the selection area containing word to be checked in the described projection page;
, there is for judging whether the e-book conformed to described book information in judge module, if yes, then notifies word extraction module, if NO, then notifies that word refines module;
Described word extraction module is used for extracting by described e-book the word to be checked obtaining described selection area and comprise;
Described word refines module and is used for carrying out word refinement to the content of pages in the projection page, and obtains word to be checked according to the position of infrared pen in content of pages;
Second word search module, obtains corresponding Query Result for carrying out search according to described word to be checked, and is projected to the described projection page.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410244485.9A CN105204752B (en) | 2014-06-04 | 2014-06-04 | Projection realizes interactive method and system in reading |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410244485.9A CN105204752B (en) | 2014-06-04 | 2014-06-04 | Projection realizes interactive method and system in reading |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105204752A true CN105204752A (en) | 2015-12-30 |
| CN105204752B CN105204752B (en) | 2018-08-03 |
Family
ID=54952473
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410244485.9A Expired - Fee Related CN105204752B (en) | 2014-06-04 | 2014-06-04 | Projection realizes interactive method and system in reading |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105204752B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108287903A (en) * | 2018-01-25 | 2018-07-17 | 广东小天才科技有限公司 | It is a kind of to search topic method and smart pen with what projection was combined |
| CN108287895A (en) * | 2018-01-19 | 2018-07-17 | 广东小天才科技有限公司 | It is a kind of to search topic method and system, hand-held photographing device based on what dominant frame was adjusted |
| CN110209762A (en) * | 2018-02-11 | 2019-09-06 | 京东方科技集团股份有限公司 | A kind of reading tables and reading method |
| CN111596807A (en) * | 2020-05-22 | 2020-08-28 | 重庆长教科技有限公司 | Interactive teaching system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101493636A (en) * | 2008-12-22 | 2009-07-29 | 清华大学深圳研究生院 | Interactive projecting system and interactive input method thereof |
| CN102043320A (en) * | 2009-10-21 | 2011-05-04 | 陕西金合泰克信息科技发展有限公司 | Overhead infrared page turning image book and infrared page turning method thereof |
| US20120256824A1 (en) * | 2011-03-30 | 2012-10-11 | Sony Corporation | Projection device, projection method and projection program |
| CN102880360A (en) * | 2012-09-29 | 2013-01-16 | 东北大学 | Infrared multipoint interactive electronic whiteboard system and whiteboard projection calibration method |
-
2014
- 2014-06-04 CN CN201410244485.9A patent/CN105204752B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101493636A (en) * | 2008-12-22 | 2009-07-29 | 清华大学深圳研究生院 | Interactive projecting system and interactive input method thereof |
| CN102043320A (en) * | 2009-10-21 | 2011-05-04 | 陕西金合泰克信息科技发展有限公司 | Overhead infrared page turning image book and infrared page turning method thereof |
| US20120256824A1 (en) * | 2011-03-30 | 2012-10-11 | Sony Corporation | Projection device, projection method and projection program |
| CN102880360A (en) * | 2012-09-29 | 2013-01-16 | 东北大学 | Infrared multipoint interactive electronic whiteboard system and whiteboard projection calibration method |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108287895A (en) * | 2018-01-19 | 2018-07-17 | 广东小天才科技有限公司 | It is a kind of to search topic method and system, hand-held photographing device based on what dominant frame was adjusted |
| CN108287903A (en) * | 2018-01-25 | 2018-07-17 | 广东小天才科技有限公司 | It is a kind of to search topic method and smart pen with what projection was combined |
| CN110209762A (en) * | 2018-02-11 | 2019-09-06 | 京东方科技集团股份有限公司 | A kind of reading tables and reading method |
| CN111596807A (en) * | 2020-05-22 | 2020-08-28 | 重庆长教科技有限公司 | Interactive teaching system |
| CN111596807B (en) * | 2020-05-22 | 2023-09-19 | 重庆长教科技有限公司 | interactive teaching system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105204752B (en) | 2018-08-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102352683B1 (en) | Apparatus and method for inputting note information into an image of a photographed object | |
| JP6007497B2 (en) | Image projection apparatus, image projection control apparatus, and program | |
| CN104021150B (en) | Face recognition with social networks auxiliary | |
| CN101751476B (en) | Method and device for marking electronic bookmarks | |
| Erol et al. | HOTPAPER: multimedia interaction with paper using mobile phones | |
| US20040193697A1 (en) | Accessing a remotely-stored data set and associating notes with that data set | |
| JP6109625B2 (en) | Electronic device and data processing method | |
| US20180276896A1 (en) | System and method for augmented reality annotations | |
| US20110252316A1 (en) | Translating text on a surface computing device | |
| WO2016101717A1 (en) | Touch interaction-based search method and device | |
| US9335838B2 (en) | Tagging of written notes captured by a smart pen | |
| US20170300746A1 (en) | Organizing Written Notes Using Contextual Data | |
| WO2019033658A1 (en) | Method and apparatus for determining associated annotation information, intelligent teaching device, and storage medium | |
| Quack et al. | Object recognition for the internet of things | |
| CN102855298A (en) | Image retrieval method and system | |
| CN105204752A (en) | Method and system for achieving interaction in projection type reading | |
| CN106227461A (en) | A kind of windows switching method and device | |
| CN105631461A (en) | Image recognition system and method | |
| US20160180822A1 (en) | Smart Zooming of Content Captured by a Smart Pen | |
| CN103235836A (en) | Method for inputting information through mobile phone | |
| Lokkondra et al. | ETDR: An Exploratory View of Text Detection and Recognition in Images and Videos. | |
| Uchiyama et al. | On-line document registering and retrieving system for AR annotation overlay | |
| KR20140113780A (en) | Smart glasses and its translation method | |
| Kreuzer et al. | An interactive paper and digital pen interface for query-by-sketch image retrieval | |
| JP6408055B2 (en) | Information processing apparatus, method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180803 Termination date: 20200604 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |