CN103294766A - Associating strokes with documents based on the document image - Google Patents
Associating strokes with documents based on the document image Download PDFInfo
- Publication number
- CN103294766A CN103294766A CN2013100607151A CN201310060715A CN103294766A CN 103294766 A CN103294766 A CN 103294766A CN 2013100607151 A CN2013100607151 A CN 2013100607151A CN 201310060715 A CN201310060715 A CN 201310060715A CN 103294766 A CN103294766 A CN 103294766A
- Authority
- CN
- China
- Prior art keywords
- image block
- picture
- file
- stroke
- stroke data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/14—Image acquisition
- G06V30/1444—Selective acquisition, locating or processing of specific regions, e.g. highlighted text, fiducial marks or predetermined fields
- G06V30/1456—Selective acquisition, locating or processing of specific regions, e.g. highlighted text, fiducial marks or predetermined fields based on user interactions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
- Image Input (AREA)
Abstract
A method and apparatus is disclosed herein for associating strokes with a document image. In one embodiment, the method comprises capturing strokes written on a screen over a first document image while the document image is being displayed, associating captured stroke data of the captured strokes with underlying image patches of the document image being displayed, determining that a second document image is being displayed on the screen, determining whether one or more image patches of the second document image, or parts thereof, had previously been associated with captured stroke data, and drawing one or more previously captured strokes, or portions thereof, on image patches of the second document image based on results of determining whether one or more image patches of the second document image, or parts thereof, had previously been associated with captured stroke data.
Description
Technical field
Embodiments of the invention relate to the file and picture process field; Or rather, embodiments of the invention relate in particular to and use the partial document image to come related stroke, so that shield or otherwise during conversion, stroke is retained in the content of their associated file and pictures when file and picture is moved, rolls up.
Background technology
There are many kinds to use interactive whiteboard to come the method for label information.Plate can the display white background, and this makes the user that it is painted as common blank.As an alternative, personal computer (PC) shows and can be displayed on the background and the user can paint at the image that shows.
Driving and the SMART of use such as SMART scientific ﹠ technical corporation
Technology, the user can show any background, comprises word or file, image, webpage, PowerPoint(PPT) demonstration, video, whole PC show or any other thing almost.When the user from SMART
A pallet (pen tray) in when taking up one's pen, SMART
Driving catches current screen and it is freezed.Any stroke by user writing all is coated on the screen picture that freezes.If PC is connected to SMART notebook TM software, even moving video, when user writing, image is also frozen.In case the user has finished drawing by user interface indication, the screen picture that has a stroke is captured and storage and screen are thawed.
When using Microsoft's Word document work, the user may wish the document that uses stroke marking complete.Volume screen document, mark paragraph, catch screen, thaw that to roll up screen again be very inconvenient to screen then.If stroke can be placed in the document by certain mode, can be convenient.
Owing to for the PC of Mac and Linux platform the application of hundreds thousand of (perhaps may be millions of) is arranged, and a lot of different stroke input technology, therefore with stroke input technology and each program integrated be the difficult problem of complexity.
Needed is the method that the seizure stroke that can be associated with the document that shows at the stroke capture system and not needing is revised the application of display document.Neededly do not need screen to stop to upgrade or freezing and the method for mark computer screen in addition.
Summary of the invention
A kind of method and apparatus is disclosed herein, in order to stroke is associated to file and picture.In one embodiment, this method comprises when the display document image, the stroke on first file and picture on the screen is write in seizure, carry out related with the lower image piecemeal of shown file and picture the stroke data that captures of the stroke that catches, determine that second file and picture is displayed on the screen, whether one or more image blocks or its part of determining second file and picture before be associated to the stroke data that captures, and whether before be associated in one or more image blocks of determining second file and picture or its part on result's the basis of the stroke data that captures, in the image block one or more strokes that before captured of drawing or its part of second file and picture.
Description of drawings
From the accompanying drawing of the following embodiment that provides and different embodiments of the invention, the present invention will be understood more fully, however this should not be used to the present invention is limited to specific embodiment, and should only be used to explanation and understand.
Fig. 1 is the block diagram that stroke and file and picture is partly carried out an embodiment of related system;
Fig. 2 is the process flow diagram that stroke data is handled in expression;
Fig. 3 shows the process in order to the stroke that determines whether to paint again on the display of cover part file and picture;
Fig. 4 A to 4L shows the example of stroke process;
Fig. 5 is the process flow diagram in order to an embodiment of the process that stroke is related with file and picture; And
Fig. 6 is the block diagram of computer system.
Embodiment
Embodiments of the invention allow the user not freeze screen at the image of screen (for example PC screen, blank etc.) drawing and comments document.Just, embodiments of the invention do not need to freeze screen when comments document.This is by the stroke that forms on the file and picture of lower floor and the screen is carried out related the realization.Use described technology in this article, the user can and roll up the different pages or the part of shielding to document subsequently at partial report or text document drawing.After this, the documentation section that the stroke of painting at screen becomes with they are written at first is associated.When moving to the different page, the stroke complete obiteration on the screen, and rolled up screen when some when document, mark also is moved into the documentation section that they are painted at first.If user volume screen to the different pages and mark disappear, then along with being back to the initial page, mark also reappears in their tram (that is, on the position of the initial page that they form).
In one embodiment, on the basis of file and picture, system carries out related with stroke document.This system carries out following operation.At first, system catches active screen.Can be from analog or digital vision cable or the application by similar VNC from long-range shared screen capture active screen.System can accept to be placed on the stroke on the screen.This stroke can be placed with comments document by the user.In one embodiment, stroke can be the stroke write or highlighted stroke.Capture after the stroke, the image block (patch) of stroke and each stroke position lower floor matches in system.In one embodiment, this is to use Ricoh (Ricoh) video search (Ricoh Visual Search (RVS)) to carry out.Just, in one embodiment, Ricoh's video search (RVS) is used to identify the same part shown with document, and when stroke was shown with document, association write on the stroke at document top, need not to know about document anything.RVS is well-known.More information for RVS, be illustrated in the U.S. Patent No. 7 of authorizing on April 20th, 2010,702,673, name is called " in order to produce and to use the system and method (System and methods for creation and use of a mixed media environment) of mixed-media environment ", and the U.S. Patent No. 8 of authorizing on Dec 27th, 2011,086,038, name is called " the invisible connection features (Invisible Junction Features for Patch Recognition) that is used for piecemeal identification ".
Therefore, disappear from screen if having the image block (part) of the document of stroke, then stroke is removed from screen by system.If same image block is transformed, then stroke also is changed and paints on screen.For example, if image block is moved into the different piece of screen, then stroke also is moved on the new position of screen epigraph piecemeal and on its same position in the image block border.
Similarly, if piecemeal is rotated or is scaled, then system rotation and convergent-divergent stroke and in the image block stroke of painting.Thereby, even the content in file and picture scaled and mobile after, stroke also can be moved and convergent-divergent in an identical manner, thus make they be displayed on respect to image block, when being written on the picture screen with stroke on the identical position.Just, stroke is relocated the original position of mating stroke with convergent-divergent.
In addition, initial document can be remake by image block.Just, piecemeal can be used to guide and initial document can be remake based on having the image that captures that has added stroke.
The embodiment of system has one or more in many advantages.The ink marks that advantage is stroke as if with operating system in whole application combine.In addition, screen picture remain live (dynamically) and can be controlled.Just, it is frozen and can be by mobile, volume screen easily etc. image not take place.In addition, the image that captures and stroke can be used to remake document.At last, technology described herein all works to any image.For example, it all works for the image on personal computer (PC) screen or at the camera review that screen shows.
In the following description, a lot of details of detailed ground explain provide the present invention are illustrated more fully.Yet, to those skilled in the art, will it is apparent that the present invention can not need these specific detail and is implemented.In other examples, shown well-known structure and equipment with the form of block diagram, for fear of fuzzy the present invention, rather than adopt the form that shows in detail.
Below the some parts of Xiang Ximiaoshuing is presented on the operation on data bit in the computer memory with algorithm and symbolic formulation.These arthmetic statements and expression are the employed methods of data processing field technician, effectively their work purport is conveyed to other those skilled in the art.Here, as a rule, what algorithm was contemplated that the step that causes desired result is in harmony sequence certainly.Described step is the physical quantity that needs physical manipulation.Though not necessarily, as a rule, these amounts show as can be by storage, transmit, combination, relatively and the electrical or magnetic signal handled of other modes.Main because general reason, facts have proved that it is easily sometimes that these signals are referred to as bit (bits), value (values), unit (elements), symbol (symbols), character (characters), term (terms), number (numbers) etc.
Yet, should be kept in mind that all these and similar term should be associated and only be used in the label easily on this tittle with suitable physical quantity.Unless make especially and the obvious opposite elaboration of following discussion, otherwise should be understood to the institute describe, discuss employed such as " processing " or " calculating " or " calculation " or " determining " or terms such as " demonstrations " in the whole text, refer to processing and the process of computer system or similar electronic computing device, they will show as the data manipulation of physics (electronics) amount and be transformed to other data that similarly show as physical quantity in this information-storing device of computer system memory or registration table or other, transmission or the display device in the registration table of computer system and storer.
The invention still further relates in order to carry out the device of operation herein.This device can be required purpose particular configuration, perhaps can be made of the computer program selectivity triggering of storing in the computing machine or the multi-purpose computer of repacking.This computer program can be stored in the computer readable memory medium, for example but be not restricted to, comprise floppy disk, CD, CD-ROM and magneto-optical disk, ROM (read-only memory) (ROM), random-access memory (RAM), EPROM, EEPROM, magnetic or optical card or be suitable for the store electrons instruction and each is connected to the medium of any kind of computer system bus.
The algorithm that presents herein and demonstration are not associated with any certain computer or other devices inherently.Multiple general-purpose system can be according to herein technology and is used by program, and perhaps can confirming to construct more professional device, to carry out required method step be easily.The required structure of multiple these systems will manifest from following description.In addition, the present invention is not described with reference to any specific programming language.Will be understood that multiple programming language can be used to realize instruction of the present invention as described in this article.
Machine readable media comprises for any mechanism with the storage of the readable form of machine (for example, computing machine) or transmission information.For example, machine readable media comprises ROM (read-only memory) (" ROM "); Random-access memory (" RAM "); Magnetic disk storage medium; Optical storage medium; Flash memory device etc.
1. general introduction
As mentioned above, system of the present invention embodiment makes stroke can be added on the same screen as covering file and picture.These strokes are painted on screen and are had a lot of Points And lines segmentations related with them.Just, segmentation can have live width, color, transparency etc.When stroke was added on the screen, system's intercepting was presented at the specific dimensions zone of the file and picture around the stroke.For example, minimum and maximum x and the y value of stroke can be calculated by system, in order to produce bounding box and use this bounding box as the zone for stroke.This zone is called image block herein, this zone must be enough big to being distinguished.In other words, the size in zone was selected as when future, certain image block and other image blocks compared, and this image block can be distinguished.If the zone can not be distinguished, if for example the zone only is white background and do not have separator, what then the zone was intercepted comprises the enough information that can distinguish mutually with other image blocks of file and picture until it greatlyyer.In one embodiment, system perhaps is stored in one group of feature of calculating and one group of point value in the database in one embodiment subsequently with any image block from image block.Point value indication stroke is with respect to the position of image block.For example, a series of x-y coordinate can represent the different piece of stroke, and each x-y coordinate is formulated with respect to specific (for example, lower left corner etc.) of image block.This material is stored in the database.
System uses the image block of storage and stroke information to identify the image page on the present screen and whether they had before had stroke to appear on them.For example, if file and picture is rolled up screen, make the new images piecemeal be present on the screen, and between image block that screen shows and the image block that in database, finds coupling not, system is removed stroke from screen so.
If file and picture continues to be caused one in the image block to reappear on the screen (as be indicated as the image block that has with this image block coupling in database by the volume screen, this image block has stroke associated with it), system turns back to stroke on the screen so, be positioned at them with respect on the identical position of some points (for example, the lower left corner) of image block.By this way, stroke is relocated to mate their original position with respect to their existing image block.
Fig. 1 is the block diagram in order to an embodiment of the system 100 that the file and picture part is related with stroke.System 100 can comprise a plurality of parts, comprises display surface 102, controller 106 and capture system 108.The parts of the system of describing in Fig. 1 100 are only represented illustration purpose and are not intended to limit by any way the scope of inventive embodiments.Alternative embodiment can have the parts more more or less than the parts shown in Fig. 1.
Display surface 102(for example, flat computer, touch screen computing machine, interactive whiteboard, apple iPad, telestrator system etc.) provide the input and output interface for the user of system 100.As inputting interface, make the user that stroke (be also referred to as write or paint) input can be provided, it is converted into numerical information (being also referred to as the numeral expression of stroke) subsequently.As output interface, the numerical information of Hui Hua stroke or file and picture output can be displayed on the surface 102 by controller 106 again, and the information that makes can be seen by one or more users of system 100.One or more users of system 100 can be by using one or more writing implements to write or the stroke of painting provides input to system 100.For example, as shown in fig. 1, the user can use writing implement writing stroke on surface 102.The input of one or more line segments that can use writing implement to provide, highlighted, character, letter, symbol, word, statement, form, picture, sketch, diagram or any other type can be provided as the term that uses in this application " stroke " (writing or drawing or written information).As another example, write or paint and to comprise hand-written letter, numeral or the symbol of expressing with any language or form.
The writing stroke that the user uses writing implement to form is write capture system 108 seizure and is passed to controller 106, and it determines the numerical information of corresponding stroke.Numerical information can be delivered to display surface 102 subsequently in order to show thereon.In one embodiment, controller 106 passes to projector with these strokes, to be incident upon on the surface 102.
The user of system 100 can use multiple different writing implement to write or provide input.In one embodiment, writing implement can be the physical target that does not stay visable indicia on surface 102.For example, the user can use his finger to come to write on surface 102 as writing implement.Although finger can not stay any visable indicia on surface 102, the movement of finger is captured and is translated into numerical information subsequently, and this numerical information can be displayed on the surface 102 subsequently.As another example, the user can use pointer or stylus as writing implement writing stroke on surface 102, and stylus can not stay any physics visable indicia on surface 102.User's stroke is captured, and be determined corresponding to the numerical information of stroke, and numerical information is displayed on the surface 102 subsequently.
In one embodiment, surface 102 is the active surfaces such as the resistive touch system, and the target location of pressing screen is identified in the change of its measuring resistance.Other examples on active surface comprise the glass plate that is surrounded with infrared LED, its use " be subjected to press down inner total reflection " (FTIR) make camera on can catch surface finger or the position of pen, or be similar to iPad and the iPhone that California Cupertino Apple produces and go up the capacitive touch screen of using.
In an embodiment again, to write capture system 108 and can comprise one or more pressure transducers, this pressure transducer can be contained in the surface 102, makes the 102 pairs of presser sensors in surface.This pressure shines upon many touch-surfaces can make (being similar to the material that can obtain from south, Massachusetts Bostonian TechScan company) by being clipped in power sensitive resistor material between the flexible circuit.In such an embodiment, the surface 102 can provide many touch pressures sensing surface, and this surface is touched the user on the basis on surface 102 can catch stroke information.The information that is captured by pressure transducer can be delivered to controller 106 subsequently in order to further processing.
In an embodiment again, surface 102 can be such as the iPad at apple
TMOr iPhone
TMThe middle capacitive coupling inputting interface of finding.In such an embodiment, surface 102 can provide multi-touch input experience, zooming and panning ability etc.In such an embodiment, the user can use finger or conduction stylus writing stroke and stroke on surface 102 can be delivered to controller 106 subsequently in order to handle and to analyze.
In one embodiment, controller 106 can catch file and picture or its part that is presented on the surface 102.In one embodiment, the file and picture that catches is the image from numeral or analog video input, and this image is captured by controller 106 or under its control.In another embodiment, the application that 102 file and pictures that show come comfortable controller 106 to move on the surface.In this case, the output that will use of controller 106 sends to surface 102 in order to show thereon.In one embodiment, by controller 106, the telecreen shareware that uses similar VNC or Microsoft's remote desktop software catches image and is presented on the surface 102 from remote computer.
In one embodiment, controller 106 is configured to determine the numerical information corresponding with the stroke input information of using writing implement to form.In one embodiment, as the part of this processing, controller 106 can be configured in the numerical information of also determining subsequently from the definite stroke information in the basis of writing capture module 108 information corresponding to stroke information.In one embodiment, stroke can be corresponding to being used the data that (namely in order to write) produces by writing implement from writing implement when writing implement is not used.For example, in one embodiment, stroke can be corresponding to contacting the data that when contact be interrupted or interrupted produced from writing implement with surface 102 by writing implement.Stroke can be considered to use writing implement to import the base unit of information in order to present by the user.Controller 106 can be determined the numerical information corresponding to stroke information subsequently.
In alternative embodiment, write capture system 108 and can self can determine stroke information and stroke information is passed to controller 106.Controller 106 can directly be determined numerical information subsequently from the information of writing capture system 108 receptions.
The numerical information of being determined by controller 106 can be stored locally on nonvolatile memory 122.In one embodiment, also can be stored locally on storer 122 by controller 106 from the information of writing capture system 108 and receiving or the part of this information.
Therefore, controller 106 can receive by the original sensor data of writing capture system 108 seizure and determine stroke information on the basis of raw data subsequently, or can receive the stroke information from writing capture system 108 as an alternative.Controller 106 can be determined the numerical information corresponding with stroke information subsequently.In certain embodiments, numerical information can directly be determined from original sensor data.Controller 106 can pass to the numerical information of determining surface 102 subsequently in order to show.This can be directly to pass through projector, or by other mechanism.In one embodiment, sending to surface 102 numerical information by sensor 106 is view data and the combination that is included in stroke information wherein.
One or more modules that the function that is provided by controller 106 is provided can be provided controller 106.These modules can realize with hardware, software or their combination.For example, in one embodiment, module can realize with software (program, coding, instruction), when module is carried out by the processor of controller 106, provide the function that is provided by controller.In one embodiment, as depicted in figure 1, controller 106 comprises that one or more modules are related with the lower image piecemeal of shown file and picture with the stroke data that will capture, (for example change with the file and picture of determining to be presented on the screen, be moved, the volume screen, convergent-divergent, part is blocked), thereby produce new file and picture, one or more image blocks or its part with the file and picture that determines whether newly to present before be associated to the stroke data that captures, and on the result's that one or more image blocks or its part of the file and picture that determines whether newly to present before had been associated to the stroke data that captures basis, in the image block one or more strokes that before captured of drawing or its part of the file and picture that newly presents.
In one embodiment, controller 106 is determined stroke data and the information of stroke data with the image block of identification stroke data lower floor is stored in the storer (for example, database).In one embodiment, the information of recognition image piecemeal is image block itself.Therefore, in this case, the image block of the stroke lower floor that stroke data is related with it is stored.In another embodiment, the information of recognition image piecemeal is stack features point.It should be noted that in one embodiment, in the time of in being stored in database, the unique point that image block or its are associated does not comprise the stroke data that is included in their inside; In other words, stroke data and the information that is associated with this image block are stored independently.Use database to make when attempting to determine whether that current shown image block is complementary with the image block that before has been identified as having stroke data, can form by controller 106 and inquire about.
In one embodiment, controller 106 file and picture that also is configured to show is divided into image block.This can be used in when file and picture is changed (for example moving, roll up screen, convergent-divergent etc.).Controller 106 uses image block to determine whether to carry out related with the image block of stroke data lower floor stroke data subsequently.For example, when stroke was write on surface 102, controller 106 can be determined the image block around the stroke and after this with stroke data an image block be indexed.
In one embodiment, the image block of the file and picture of 106 pairs of current demonstrations of controller and compare with image block that the stroke data that captures is together stored is to determine whether have coupling or at least part of coupling between the image block that one or more image blocks of the file and picture of current demonstration or its part and stroke data current and that capture are together stored.If there is coupling, then 106 pairs of those image blocks with an at least part of coupling of image block of current demonstration of controller show at least part of stroke data that before had been captured.The part of the stroke data that before had been captured can comprise whole stroke, and wherein the part with the image block of the current demonstration of the image section coupling of storage comprises whole stroke.The previous stroke data part that catches can only comprise a part of stroke data, wherein only comprised the part of the stroke of the image block of storing with the part of the image block of storing of the image block coupling of current demonstration.Thereby controller 106 shows stroke to this degree: comprise the part of the stroke data that captures with the part of the image block of the current demonstration of the file and picture of current demonstration or the image block of storing that its part is complementary.If there is no coupling, controller 106 any stroke that will appear on the screen of image block of second file and picture is all removed so.
In one embodiment, if the image block of the file and picture of controller 106 definite current demonstrations or at least part of coupling of the image block with the stroke data that captures of its part and current storage, and the compatible portion of memory image piecemeal has stroke data, and controller 106 determines whether that also image block or its part of the file and picture of current demonstration are transformed with comparing with the image block of storing with stroke data of its coupling so.This conversion can comprise the convergent-divergent, rotation of translation (translate), the image block of image block, crooked, distortion or three-dimensional conversion.If so, before the stroke data that drawing is transformed on the screen of the matching image piecemeal of current demonstration, the stroke data that 106 pairs of controllers catch is used identical conversion so.
Fig. 4 A shows the stroke 401-403 that paints at file and picture.When file and picture by upwards slightly after the volume screen, reorientate stroke 401-403 mating them with respect to the original position of document Chinese version at display 102, as shown in Fig. 4 B.Fig. 4 C show when system reorientate and convergent-divergent stroke 401 to mate it with respect to the example of the original position of file and picture Chinese version.
Fig. 2 is that expression is in order to handle the process flow diagram of stroke data process.This process is carried out by processing logic, and this processing logic comprises hardware (circuit, special logic etc.), software (such as moving in general-purpose computing system or custom-built machine) or both combinations.In one embodiment, this process is carried out by controller 106.
With reference to Fig. 2, this process is in processing block 201 beginnings, and wherein processing logic tests whether stroke is painted.If not, then process maintains processing block 201 and tests again whether stroke is painted.Afterwards, if stroke is painted, process carries out the transition to processing block 202 so, and its middle controller is indexed to the image block around the stroke.Should be noted in the discussion above that this operation causes image block to be identified.After image block around the stroke indexed, processing logic made the stroke data corresponding to stroke be associated with image block (processing block 203).This association comprises the information of specifying stroke position in image block.After this, comprise that the stroke data of positional information and image block together are stored in memory location (for example, storer 122, database etc.).
As represented in Fig. 2, during the stroke of at every turn painting, the image block around the stroke is indexed and stroke data is associated to piecemeal.In one embodiment, entire image piecemeal and the stroke data of expression stroke are stored in (for example, database) in the storer.Fig. 4 D shows stroke 401 in the bounding box 408 and the image block 406 of its lower floor.A plurality of positions on the controller 106 identification strokes also are expressed as them (x, y) value.It is fixed that value is got with respect to ad-hoc location in the image block.In one embodiment, (0,0) value is represented in the lower left corner of image block.Fig. 4 E shows the stroke 401 in image block 406, and a series of (x, y) position is used for representing this stroke.With reference to Fig. 4 E, stroke from have with respect to the image block lower left corner (0,0) (x, y) (55,69) of position (x, y) position extends to (x, y) position of (65,168).All x-y values along stroke are stored with image block.Fig. 4 F and 4G show another example, have shown the highlighted stroke (Fig. 4 F) of painting in the part of file and picture and (x, y) value (Fig. 4 G) that are associated with this highlighted stroke.
Fig. 3 shows the process in order to the stroke that determines whether to paint again on the display of cover part file and picture.This process is carried out by processing logic, and this processing logic comprises hardware (circuit, special logic etc.), software (such as moving in general-purpose computing system or custom-built machine) or both combinations.In one embodiment, this process is carried out by controller 106.
With reference to Fig. 3, the processing logic that this process starts from the system determines whether that screen changes (for example, file and picture is transformed by volume screen, movement, convergent-divergent or other modes) (processing block 301).In one embodiment, this is determined and can finish in time 1 and shown pixel of times 2 by carrying out direct comparison.If screen does not change, then this process maintains processing block 301 and continues to check whether screen changes.If screen changes, then process carries out the transition to processing block 302, and wherein processing logic is divided into zone (for example, picture piecemeal) with screen.Fig. 4 H shows the example that image on screen is divided into 80 image blocks.
Screen picture is divided into after the image block, processing logic test pattern piecemeal, whether they are complementary with previously stored image block with previous identification of stroke data.For this purpose, whether more processing logic test multizone need be tested, and whether they have the coupling (processing block 303) with the image block with stroke in database.If not, then process carries out the transition to processing block 301 and repeats this process.
If exist to check the more multizone of coupling, then process carries out the transition to processing block 304, and wherein the processing logic in the system is determined to exist between any image block (this image block has the stroke data that is associated with them) in zone and database and mated.Just, system changes over to subsequently with each piecemeal Query Database, at the image block of current demonstration be stored between the image block in the database whether have coupling with stroke data.In one embodiment, some image blocks of current demonstration on screen are left in the basket.This may be because they have seldom or do not distinguish information, and these differentiation information make them can correctly mate in the image block that is stored in the database one.In another embodiment, can accelerate inquiry by checking motion vector when the image modification.In other words, if the user rolls up the part that screen changes shown file and picture in file and picture, then the motion vector that is associated with volume screen operation can be identified, and helps to select more likely and be stored in subclass that piecemeal in the database is complementary, current demonstration piecemeal on screen.The motion vector algorithm in computer vision storehouse can be used to this purpose but the OpenCV of online access increases income.
If find coupling in database, process transits back processing block 303 and process continuation so.If the content in the zone and be stored in and have coupling between the image block in the database, processing logic determines whether that any part of the stroke data of the image block stored appears in the image block part of storage so, the image block part of this storage and the zone of the image block that is matched with storage be complementary (processing block 305).In other words, processing logic determine image block the cover part whether image block tested and storage whether have the stroke data of portion within it.This system that makes can determine stroke should at screen drawing to which kind of degree, and with respect to the image block of the current demonstration position with its drawing.
After this, system is stroke drawing on screen (processing block 306) and transit back processing block 303, in the file and picture of current demonstration, whether exist multizone more need be examined with database in the coupling of image block.
As example, Fig. 4 I shows image block (zone) 410-412 that may (at least part of) be complementary with the image block of storing with stroke data.As shown in Fig. 4 J, the part of the image block 420 of storage that image block 411 is only overlapping and overlapping part do not comprise stroke data.In this case, controller 106 is not in the image block of the current demonstration stroke of painting.In Fig. 4 K, the part of the image block 412 overlapping image blocks of storing 420 and overlapping part comprise stroke data.In this case, on the image block of the controller 106 current demonstration that makes stroke data be affixed to be complementary.In Fig. 4 L, image block 411 has covered the part of the image block of storing that comprises stroke fully.In this case, stroke is painted on its initial position with respect to the image block content of current demonstration on the screen.
In one embodiment, relatively being to use of image block carried out such as those above-mentioned unique points about RVS.In this case, the unique point in stroke and the image block is associated, and is not associated with the integral body of image block self.Therefore, image block needn't be stored in the database, and only is that unique point is stored in the database).For example, if stroke is affixed to display surface, then controller is created in this stroke bounding box and the image (do not comprise stroke) of seizure in bounding box on every side.Use this information, controller is calculated the unique point in this frame and preserve characteristic point information in database from image, and it comprises the geometry of unique point.Subsequently, controller carries out stroke and the set of unique point related, rather than carries out related with image itself.Will the carries out image piecemeal relatively the time when controller, controller is checked image block from the screen that changes, and calculates the unique point that is associated with this image block, and Query Database subsequently.If there is the unique point of coupling, then controller obtains the stroke that is associated with those unique points and stroke is placed on the screen on their correct positions.
In one embodiment, stroke is stored with respect to the relative position of some subclass of the unique point of file and picture or unique point.This is being helpful under following situation: stroke be not arranged in the file and picture content near (that is the position of any unique point during, stroke is in away from file and picture).By station-keeping data can be used, if being identified as the file and picture of current demonstration, controller comprises those unique points, controller can determine that stroke should be by the position of drawing on screen so.
It shall yet further be noted that the use characteristic point can be used for when determining whether that screen has changed.Replacement is image block with screen divider, and controller can be calculated the image-region that has changed, and only calculates proper vector or the unique point of reformed image section, and checks whether these unique points are stored in the database.
Equally, in one embodiment, controller can be calculated unique point and compare both in second time (t2) by being that whole screen produces unique point in the very first time (t1), determines that screen changes.If their difference, then controller knows that screen has changed and comprises new file and picture or its part.
Fig. 5 is the process flow diagram of an embodiment of process that stroke is associated with file and picture.This process is carried out by processing logic, and this processing logic can comprise hardware (circuit, special logic etc.), software (such as moving in general-purpose computing system or custom-built machine) or both combinations.
With reference to Fig. 5, process starts from when file and picture is shown, and processing logic catches and writes on the stroke on first file and picture on the screen (processing block 501).Next, processing logic carries out related (processing block 502) with the stroke data that captures of the stroke that catches with the lower image piecemeal of the file and picture of demonstration.
In response to catching at least one stroke and the related stroke data that captures, for each stroke, processing logic is indexed to an image block of the file and picture around each stroke, and the stroke data of a stroke and an image block or the feature found in this image block are carried out related (processing block 503).
Processing logic for the information of each stroke that captures and expression lower image piecemeal associated with it (for example, image block itself in piecemeal or near the feature of discovery) store data (processing block 504).
Subsequently, processing logic determines that second file and picture is displayed on (processing block 505) on the screen.Second file and picture can comprise the view data from first file and picture.This can occur under the situation of the document of rolling up screen new page negligible amounts.Second file and picture can be the revision of first file and picture.For example, second document can be translation, convergent-divergent or the rotation version of all or part of first file and picture.
Processing logic is divided into a plurality of image blocks (processing logic 506) arbitrarily with new file and picture and determines one or more image blocks of second file and picture or whether its part before had been associated to the stroke data that captures (by comparing with the image block of second file and picture with the image block that the stroke data that captures is stored, determining that whether one or more image blocks of second file and picture or its part are with the current at least part of coupling of image block of storing with the stroke data that captures) (processing block 507).
In one embodiment, processing logic is identified the screen portions that has changed and is not image block with screen divider.In this embodiment, processing logic can be calculated at screen and be changed unique point or proper vector in the part, and identifies in these features which and be associated to stroke data.
Next, whether before be associated to the result of the stroke data that captures based on one or more image blocks of determining second file and picture or its part, processing logic is in the image block one or more strokes that before had been captured of drawing or its part (processing block 508) of second file and picture.
In one embodiment, processing logic is according to the stroke of the one or more previous seizure of following drawing:
If the result of movement images piecemeal is coupling, for the image block (an at least part of coupling of image block of this image block and current demonstration) of each storage, on screen, show at least part of stroke data that had before captured with such degree so: partly comprise the stroke data part that captures with the image block of described each storage of the image block of second file and picture or its part coupling.
If the result of movement images piecemeal is complementary with the previous related parts of images piecemeal of the stroke data that catches and the parts of images piecemeal of second file and picture, make so and such determining: have image block part stroke data, that be complementary with the part of an image block of second file and picture and whether comprise the stroke data that captures, if the stroke data that captures that appears at so in the image block part that the image block with second file and picture is complementary is painted.
If being the parts of images piecemeal of the only previous parts of images piecemeal that had been associated with the stroke data that catches and second file and picture, the result of movement images piecemeal mates, make so and such determining: have image block part stroke data, that partly be complementary with an image block of second file and picture and whether comprise the stroke data that captures, and whether an image block of second file and picture is transformed (for example, reorientate, convergent-divergent etc.); If, appear at the stroke data that captures in the image block part that image block with second file and picture is complementary with the identical mode conversion of that image block conversion of second file and picture so, and the stroke data after the conversion is painted on that image block on the screen; And
If the result of movement images piecemeal does not match, any stroke that appears at so on the image block of second file and picture on the screen all is removed.
There are multiple choices, for example, this carries out related technology with stroke and file and picture and can work with document camera, the document camera is placed on the photo of taking document (the document is positioned at the camera below) and the image that produces the document, and the document is shown on the surface such as whiteboard surface.Therefore, write on text on the blank and can be associated to document by captured by camera.When the someone handled or change the document that is placed on the camera below, stroke should be transformed as movement described above, change, disappearance or other modes.
2, the example of computer system
Fig. 6 is the block diagram in order to the computer system 600 that realizes the embodiment of the invention.In one embodiment, computer system 600 can be used to realize shown in Fig. 1 and controller 106 described above.As shown in Figure 6, computer system 600 comprises processor 602, and this processor is communicated by letter with a plurality of peripheral subsystems by bus sub 604.These peripheral subsystems can comprise that this storage subsystem of storage subsystem 606(comprises memory sub-system 608 and file storage subsystem 610), user interface input device 612, user interface output device 614 and network interface subsystem 616.
User interface input device 612 can comprise keyboard, such as sensing equipment or graphic tablet, scanner, the bar code scanner of mouse, tracking ball, touch pad, synthesize touch screen in display, such as the voice input device of sound recognition system, microphone and the input equipment of other types.Usually, use term " input equipment " to be intended to comprise in order to import equipment and the mechanism of whole possibility types of information to computer system 600.
User interface output device 614 can comprise display subsystem, printer, facsimile recorder or such as non-visual displays of audio output apparatus etc.Display subsystem can be cathode ray tube (CRT), such as flat-panel devices or the device for projecting of LCD (LCD).Usually, use term " output device " to be intended to comprise in order to whole equipment and mechanism that may types from computer system 600 output informations.
Although described the specific embodiment of invention, different improvement, variation, alternative are constructed, are reached equivalent and also be comprised in the scope of invention.Instruction described above can be applied to comprising any system of the processor that can be activated or restart.For example, when embodiment already described above used certain system as example, this is not intended to was determinate.Instruction described above and that enumerate in the claims can also realize by other computing systems, and this computing system makes the stroke on the screen can be accepted, be complementary with the lower image piecemeal of file and picture and be painted again on the basis of whether finding image block in new file and picture subsequently or remove.
Yet after the description of reading preamble, many alternatives of the present invention and improve and will become clear for those of ordinary skills undoubtedly should be understood that, show and any specific embodiment of describing all never is intended to be considered to limit by explanation.Therefore, the details of the different embodiment that relate to is not intended to limit the scope of claim, and these claims itself are only put down in writing those features that are considered to key element of the present invention.
The application is based on the preferential patented claim No.13/411 of the U.S. that submitted on March 2nd, 2012, and 367, its full content is integrated with herein by reference.
Claims (22)
1. method comprises:
When the display document image, catch the stroke of writing on first file and picture on the screen;
Carry out related with the lower image piecemeal of shown file and picture the stroke data that captures of the stroke that catches;
Determine that second file and picture is displayed on the described screen;
Whether one or more image blocks or its part of determining described second file and picture before be associated to the described stroke data that captures; And
Whether before be associated in one or more image blocks of determining described second file and picture or its part on result's the basis of the described stroke data that captures, in the image block one or more strokes that before captured of drawing or its part of described second file and picture.
2. method according to claim 1, wherein, determine whether one or more image blocks of described second file and picture or its part before be associated to the described stroke data that captures and have comprised:
The image block of more described second file and picture and the image block of storing with the stroke data that captures, with one or more image blocks of determining described second file and picture or its part whether with the current at least part of coupling of image block of storing with the described stroke data that captures.
3. method according to claim 2 also comprises:
If the result of movement images piecemeal is coupling, then to the image block of each storage of an image block of the current demonstration of at least part of coupling, on described screen, show at least part of stroke data that had before captured with this degree: comprise the part of the described stroke data that captures with the part of the image block of described each storage of the image block of described second file and picture or its part coupling; And
If the result of movement images piecemeal does not match, any stroke that then will appear on the image block of described second file and picture on the described screen is removed.
4. method according to claim 2 also comprises:
If the part of the part of the image block that the result of movement images piecemeal only is stroke data previous and seizure to be associated and the image block of described second file and picture is complementary, whether the described part of then determining before to be identified as to have the described image block of stroke data associated with it comprises the described stroke data that captures, the described part of the wherein said described image block that before had been identified as having stroke data associated with it and the described part coupling of an image block of described second file and picture; And
If, the stroke data that captures in the part that appears at described image block of then painting, the part of wherein said image block is complementary with the described image block of described second file and picture.
5. method according to claim 2 also comprises:
If only being the part of the image block of the part of the image block that before had been associated with the stroke data that captures and described second file and picture, the result of movement images piecemeal mates, whether the described part of then determining before to be identified as to have the described image block of stroke data associated with it comprises the described stroke data that captures, and whether an image block determining described second file and picture is transformed, the described part of the wherein said described image block that before had been identified as having stroke data associated with it and the described part coupling of an image block of described second file and picture;
If, then appear at the stroke data that captures in the part of described image block with the mode conversion identical with a described image block of described second file and picture, and with the stroke data of conversion drawing on the described image block on the described screen, the described image block coupling of the part of wherein said image block and described second file and picture.
6. method according to claim 5, wherein, the described stroke data that captures of conversion or at least part of described stroke data that captures comprise: reorientate, convergent-divergent, execution be by the general conversion of 3 * 3 matrix multiplication supports, rotation, translation, crooked or carry out three-dimensional conversion.
7. method according to claim 1 also comprises: new file and picture is divided into a plurality of image blocks.
8. method according to claim 1, also comprise: in response to catching at least one stroke, an image block of the described file and picture around the described stroke is indexed and the stroke data of a described stroke is associated to a described image block.
9. method according to claim 1 also is included as each stroke that captures and the information storage data of representing described lower image piecemeal associated with it.
10. method according to claim 9, wherein, the described information of representing described image block comprises described image block itself or the feature that is associated with information in being included in described image block.
11. the system in order to the display document image comprises:
Storer; And
The controller that couples with described storer, in order to:
The stroke data that captures of the stroke that catches is associated to the lower image piecemeal of shown file and picture, and the wherein said stroke that captures is write on first file and picture on the screen;
Determine that second file and picture is displayed on the described screen;
Whether one or more image blocks or its part of determining described second file and picture before be associated to the stroke data that captures; And
Whether before be associated in one or more image blocks of determining described second file and picture or its part on result's the basis of the described stroke data that captures, in stroke or its part of the one or more previous seizure of image block drawing of described second file and picture.
12. system according to claim 11, wherein, the feature of the image block by more described second file and picture and the image block of storing with the stroke data that captures, with the one or more described image block of determining described second file and picture or its part whether with the current at least part of coupling of image block of storing with the described stroke data that captures, described controller determines whether one or more image blocks of described second file and picture or its part before be associated to the described stroke data that captures.
13. system according to claim 12, its middle controller be exercisable so that:
If the result of movement images piecemeal is coupling, then to the image block of each storage of an image block of the current demonstration of at least part of coupling, on described screen, show at least part of stroke data that had before captured with this degree: comprise the part of the described stroke data that captures with the part of the image block of described each storage of the image block of described second file and picture or its part coupling; And
If the result of movement images piecemeal does not match, any stroke that then will appear on the image block of described second file and picture on the described screen is removed.
14. system according to claim 12, wherein, controller be exercisable so that:
If the part of the part of the image block that the result of movement images piecemeal only is stroke data previous and seizure to be associated and the image block of described second file and picture is complementary, whether the described part of then determining before to be identified as to have the described image block of stroke data associated with it comprises the described stroke data that captures, the described part of the wherein said described image block that before had been identified as having stroke data associated with it and the described part coupling of an image block of described second file and picture; And
If, the stroke data that captures in the part that appears at described image block of then painting, the part of wherein said image block is complementary with the described image block of described second file and picture.
15. system according to claim 12, wherein, controller is manipulable also feasible:
If only being the part of the image block of the part of the image block that before had been associated with the stroke data that captures and described second file and picture, the result of movement images piecemeal mates, whether the described part of then determining before to be identified as to have the described image block of stroke data associated with it comprises the described stroke data that captures, and whether an image block determining described second file and picture is transformed, the described part of the wherein said described image block that before had been identified as having stroke data associated with it and the described part coupling of an image block of described second file and picture; And
If, then appear at the stroke data that captures in the part of described image block with the mode conversion identical with a described image block of described second file and picture, and with the stroke data of conversion drawing on the described image block on the described screen, the described image block coupling of the part of wherein said image block and described second file and picture.
16. system according to claim 15, wherein, if the described stroke data that captures has been relocated or convergent-divergent, rotation, translation, crooked, three-dimensional conversion or use 3 * 3 matrix multiplications to be transformed, then described second file and picture image block is transformed.
17. system according to claim 11, wherein, controller can be operated to: be each stroke that captures and lower image piecemeal associated with it or the characteristic storage data that are associated with information in described lower image piecemeal.
18. the product with one or more computer-readable mediums stores instruction at described computer-readable medium, when described instruction is carried out by system, makes described system carry out the method that may further comprise the steps:
When the display document image, catch the stroke of writing on first file and picture on the screen;
Carry out related with the lower image piecemeal of shown file and picture the stroke data that captures of the stroke that catches;
Determine that second file and picture is displayed on the described screen;
Whether one or more image blocks or its part of determining described second file and picture before be associated to the described stroke data that captures; And
Whether before be associated on the basis as a result of the described stroke data that captures in one or more image blocks or its part of determining second file and picture, in the image block of described second file and picture paint stroke or its part of one or more previous seizure.
19. product according to claim 18, wherein, determine whether one or more image blocks of described second file and picture or its part before be associated to the described stroke data that captures and have comprised: the image block of more described second file and picture and the image block of storing with the stroke data that captures, with one or more image blocks of definite described second file and picture or its part whether with the current at least part of coupling of image block of storing with the described stroke data that captures.
20. product according to claim 19, wherein, this method also comprises:
If the result of movement images piecemeal is coupling, then to the image block of each storage of an image block of the current demonstration of at least part of coupling, on described screen, show at least part of stroke data that had before captured with this degree: comprise the part of the described stroke data that captures with the part of the image block of described each storage of the image block of described second file and picture or its part coupling; And
If the result of movement images piecemeal does not match, any stroke that then will appear on the image block of described second file and picture on the described screen is removed.
21. product according to claim 19, wherein, this method also comprises:
If the part of the part of the image block that the result of movement images piecemeal only is stroke data previous and seizure to be associated and the image block of described second file and picture is complementary, whether the described part of then determining before to be identified as to have the described image block of stroke data associated with it comprises the described stroke data that captures, the described part of the wherein said described image block that before had been identified as having stroke data associated with it and the described part coupling of an image block of described second file and picture; And
If, the stroke data that captures in the part that appears at described image block of then painting, the part of wherein said image block is complementary with the described image block of described second file and picture.
22. product according to claim 19, wherein, this method also comprises:
If only being the part of the image block of the part of the image block that before had been associated with the stroke data that captures and described second file and picture, the result of movement images piecemeal mates, whether the described part of then determining before to be identified as to have the described image block of stroke data associated with it comprises the stroke data that captures, and whether an image block determining described second file and picture is transformed, the described part of the wherein said described image block that before had been identified as having stroke data associated with it and the described part coupling of an image block of described second file and picture; And
If, then appear at the stroke data that captures in the part of described image block with the mode conversion identical with a described image block of described second file and picture, and with the stroke data of conversion drawing on the described image block on the described screen, the described image block coupling of the part of wherein said image block and described second file and picture.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US13/411,367 | 2012-03-02 | ||
| US13/411,367 US9013454B2 (en) | 2012-03-02 | 2012-03-02 | Associating strokes with documents based on the document image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103294766A true CN103294766A (en) | 2013-09-11 |
| CN103294766B CN103294766B (en) | 2017-04-12 |
Family
ID=47900500
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310060715.1A Expired - Fee Related CN103294766B (en) | 2012-03-02 | 2013-02-27 | Associating strokes with documents based on the document image |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US9013454B2 (en) |
| EP (1) | EP2634686A3 (en) |
| JP (1) | JP6089793B2 (en) |
| CN (1) | CN103294766B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105468206A (en) * | 2014-09-04 | 2016-04-06 | 华为技术有限公司 | Interactive presentation method and device |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120284426A1 (en) * | 2012-07-19 | 2012-11-08 | Jigsaw Informatics, Inc. | Method and system for playing a datapod that consists of synchronized, associated media and data |
| US20120290907A1 (en) * | 2012-07-19 | 2012-11-15 | Jigsaw Informatics, Inc. | Method and system for associating synchronized media by creating a datapod |
| US10691878B2 (en) * | 2014-02-28 | 2020-06-23 | Ricoh Co., Ltd. | Presenting associations of strokes with content |
| US10372318B2 (en) * | 2014-02-28 | 2019-08-06 | Ricoh Co., Ltd. | Associating strokes with content |
| US9304618B2 (en) * | 2014-02-28 | 2016-04-05 | Ricoh Co., Ltd. | Creating a summary of content and stroke association |
| EP3079052A4 (en) * | 2014-12-18 | 2017-08-16 | Wacom Co., Ltd. | Digital ink generating device, digital ink generating method, and digital ink reproduction device |
| JP6728993B2 (en) * | 2016-05-31 | 2020-07-22 | 富士ゼロックス株式会社 | Writing system, information processing device, program |
| US10387747B2 (en) * | 2017-06-26 | 2019-08-20 | Huddly As | Intelligent whiteboard collaboratio systems and methods |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1016983A2 (en) * | 1998-12-30 | 2000-07-05 | Xerox Corporation | Method and system for maintaining freeform ink annotations on changing views |
| US20050183004A1 (en) * | 2004-02-13 | 2005-08-18 | Microsoft Corporation | Clipping view |
| CN1933391A (en) * | 2005-09-16 | 2007-03-21 | 北京书生国际信息技术有限公司 | Hidden code inserting and detecting method |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4186465B2 (en) | 2000-05-31 | 2008-11-26 | セイコーエプソン株式会社 | projector |
| JP2004094679A (en) * | 2002-08-30 | 2004-03-25 | Ricoh Co Ltd | Display controller, display device with touch panel, and controlling method and control program for display device with touch panel |
| US7260278B2 (en) | 2003-11-18 | 2007-08-21 | Microsoft Corp. | System and method for real-time whiteboard capture and processing |
| US8201079B2 (en) * | 2004-01-15 | 2012-06-12 | International Business Machines Corporation | Maintaining annotations for distributed and versioned files |
| US7702673B2 (en) | 2004-10-01 | 2010-04-20 | Ricoh Co., Ltd. | System and methods for creation and use of a mixed media environment |
| US8086038B2 (en) | 2007-07-11 | 2011-12-27 | Ricoh Co., Ltd. | Invisible junction features for patch recognition |
| US7865815B2 (en) * | 2004-12-28 | 2011-01-04 | International Business Machines Corporation | Integration and presentation of current and historic versions of document and annotations thereon |
| US8805929B2 (en) | 2005-06-20 | 2014-08-12 | Ricoh Company, Ltd. | Event-driven annotation techniques |
| US7526129B2 (en) * | 2005-06-23 | 2009-04-28 | Microsoft Corporation | Lifting ink annotations from paper |
| US7547048B2 (en) * | 2005-12-09 | 2009-06-16 | Itt Manufacturing Enterprises, Inc. | Fluid quick connector with integral pivotal retainer |
| US7880719B2 (en) | 2006-03-23 | 2011-02-01 | International Business Machines Corporation | Recognition and capture of whiteboard markups in relation to a projected image |
| JP5525923B2 (en) * | 2010-06-09 | 2014-06-18 | 任天堂株式会社 | Image processing program, image processing apparatus, image processing system, and image processing method |
-
2012
- 2012-03-02 US US13/411,367 patent/US9013454B2/en active Active
-
2013
- 2013-02-08 EP EP20130154558 patent/EP2634686A3/en not_active Ceased
- 2013-02-27 CN CN201310060715.1A patent/CN103294766B/en not_active Expired - Fee Related
- 2013-03-01 JP JP2013041210A patent/JP6089793B2/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1016983A2 (en) * | 1998-12-30 | 2000-07-05 | Xerox Corporation | Method and system for maintaining freeform ink annotations on changing views |
| US20050183004A1 (en) * | 2004-02-13 | 2005-08-18 | Microsoft Corporation | Clipping view |
| CN1933391A (en) * | 2005-09-16 | 2007-03-21 | 北京书生国际信息技术有限公司 | Hidden code inserting and detecting method |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105468206A (en) * | 2014-09-04 | 2016-04-06 | 华为技术有限公司 | Interactive presentation method and device |
| CN105468206B (en) * | 2014-09-04 | 2022-04-22 | 华为技术有限公司 | Interactive demonstration method and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| US20130229332A1 (en) | 2013-09-05 |
| CN103294766B (en) | 2017-04-12 |
| JP6089793B2 (en) | 2017-03-08 |
| EP2634686A2 (en) | 2013-09-04 |
| US9013454B2 (en) | 2015-04-21 |
| EP2634686A3 (en) | 2015-05-20 |
| JP2013182625A (en) | 2013-09-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103294766A (en) | Associating strokes with documents based on the document image | |
| CN105493023B (en) | Manipulation to the content on surface | |
| US9378427B2 (en) | Displaying handwritten strokes on a device according to a determined stroke direction matching the present direction of inclination of the device | |
| US20140300542A1 (en) | Portable device and method for providing non-contact interface | |
| JP5270018B1 (en) | System and handwritten document management method | |
| US20140304586A1 (en) | Electronic device and data processing method | |
| US9025878B2 (en) | Electronic apparatus and handwritten document processing method | |
| US20170285932A1 (en) | Ink Input for Browser Navigation | |
| US8989496B2 (en) | Electronic apparatus and handwritten document processing method | |
| JP6877446B2 (en) | Systems and methods for recognizing multiple object structures | |
| US20150347000A1 (en) | Electronic device and handwriting-data processing method | |
| CN113934297B (en) | Interaction method and device based on augmented reality, electronic equipment and medium | |
| US20070177806A1 (en) | System, device, method and computer program product for using a mobile camera for controlling a computer | |
| US9183276B2 (en) | Electronic device and method for searching handwritten document | |
| JP6100013B2 (en) | Electronic device and handwritten document processing method | |
| KR20040043454A (en) | Pen input method and apparatus in pen computing system | |
| US20140247209A1 (en) | Method, system, and apparatus for image projection | |
| US20150138077A1 (en) | Display system and display controll device | |
| US9304618B2 (en) | Creating a summary of content and stroke association | |
| US10860120B2 (en) | Method and system to automatically map physical objects into input devices in real time | |
| JP5330576B1 (en) | Information processing apparatus and handwriting search method | |
| KR102213861B1 (en) | Sketch retrieval system, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor | |
| US20150139549A1 (en) | Electronic apparatus and method for processing document | |
| US10070066B2 (en) | Coordinate calculator and coordinate calculation system | |
| US8629846B2 (en) | Information processing apparatus and information processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170412 Termination date: 20200227 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |