CN101657826A

CN101657826A - Note capture device

Info

Publication number: CN101657826A
Application number: CN200880012130.XA
Authority: CN
Inventors: S·卡尔
Original assignee: Individual
Current assignee: Individual
Priority date: 2007-02-15
Filing date: 2008-02-15
Publication date: 2010-02-24
Anticipated expiration: 2028-02-15
Also published as: JP5470051B2; TW200849109A; HK1141607A1; JP2010519622A; WO2008101224A3; WO2008101224A2; CN101657826B; TWI372358B

Abstract

Various exemplary embodiments provide note capture device, this note capture device comprises writing surface, is mounted in order to check the camera of this writing surface, and in order to the electronic circuit of the image of catching described surface, or various alternative surface, comprise for example business card surface.Catch notes when writing when determining to finish notes, and with its storage or be forwarded to external device (ED), or with its storage and be forwarded to external device (ED).Provide handwriting recognition software to strengthen the search capability of the notes of being caught.The application software that realizes on various devices provides and has checked, browsed, shared, the ability of search and editing captured notes and the data that are associated.

Description

Note capture device

The cross reference of related application

[0001] the application's name of requiring to submit on February 15th, 2007 is called the rights and interests that " Note CaptureDevice ", application number are 60/890180 U.S. Provisional Patent Application, and it is contained in this by reference.

Technical field

[0002] exemplary embodiment disclosed herein belongs to the digital electronic device that is used for capturing information.More specifically, exemplary embodiment disclosed herein belongs to the device that is used to catch hand-written with relevant metadata.

Background technology

[0003] as a kind of easy way in order to recorded information, hand-written notes run through whole log history and are used.Though be used to produce paper these years and such as the technology of the writing implement of pen and pencil some changes taking place, for thousands of years, the practical methods that is used for hand-written notes in fact changes.This fact is the convenience of this kind form recorded information and the proof of validity.

[0004] along with the appearance of robot calculator, various trials have been made for improving hand-written notes.Famously, developing " personal digital assistant " (PDA) is used to catch handwritten content and various organization service is provided with " pen computer ".

[0005] in PDA and pen computer, often provide handwriting recognition to obtain to search for the advantage with edit file.

[0006] handwriting recognition is the ability that computing machine receives intelligible handwriting input.By optical scanning (optical character recognition), can be from paper the image of " off-line " perception text writing.Alternatively, for example by based on the computer screen surface of pen, motion that can " online " perception nib.

[0007] suffers from the problem of discerning accuracy in the trial of handwriting recognition in early days.Usually can be understood as the linguistic context understanding that recognizer does not have the reader, and therefore be difficult to catch hand-written information.Even sometimes the people also has any problem when understanding person's handwriting.

[0008] PalmOne (Palm) has successfully been released a series of based on Graffiti The PDA of recognition system.Graffiti

Improve availability by limit one group of stroke for each character.Really prolonged user's learning curve although remember this stroke pattern, this diminishes the possibility of wrong input.

[0009] in recent years, also done multiple trial and comprised the writing brush of digital element, so that people can write on paper and the text that produced of storage digitally with production.The success of these products still will be determined so far.

[0010] become and be clearly: when the user takes notes (just when he is absorbed in the content of its notes), person's handwriting identification in real time allows this user bear undue burden, and it is required and corrects identification error or handle such as Graffiti

New written form disturb.

[0011] when using typical PDA or pen computer, also reduced the sense of touch of on paper, writing.Be not on the filling page or leaf of the notepad of being familiar with and be familiar with in order to stable pulling of implementing to write, but on the surface that has firmly and obviously than less friction, present.The user is forced through oneself stable pen and compensates.When the content of writing about particular note, this unfamiliar write mode is also forced at user's thinking processes.

[0012] Notepaper (Post-it note) by 3M invention and manufacturing is a kind of paper that has the repeated bonding strip of cementing agent overleaf, and it is designed for notes are attached to file, graphoscope etc. provisionally.Although available wide ranges on present color, the shape and size, the most common of Notepaper is of a size of 3 square inches, and the sign color is faint yellow.

[0013] Notepaper has presented the convenient medium as the unofficial notes that are used to write down prompting, telephone number, phone information etc.They are feature with low-viscosity bonding strip, and this bonding strip makes each notes adhere to like a cork and to take off and not leave a trace or residue.The use of Notepaper is ubiquitous.When taking notes, this notes show very high-level convenience.The user can write on notepad simply, takes off this notes, and subsequently these notes is placed on remarkable position as prompting, or places it on the file as note etc.

[0014] electronic installation of the prior art convenience level in taking notes that can't realize when writing Notepaper being realized.Needed is a kind of equipment that the convenience of Notepaper is combined with the advantage of the electron capture that is used for can transmitting, retrieve and editing.Unfortunately, the limitation of prior art is that it fails to provide any such solution.

[0015] for the ordinary skill in the art, by reading following description and studying a plurality of accompanying drawings, these and other restrictions of prior art will become obvious.

Summary of the invention

[0016] some unrestriced exemplary embodiments provide note capture device, this note capture device comprises writing surface, is fixed in order to check the camera of this writing surface, and in order to the electronic circuit of the image of catching described surface, or various alternative surface, comprise for example business card surface.Be appreciated that various image transitions, for example this image transitions can be revised the camera angle about the inclination on surface.Also be appreciated that readability, or add other conversions of mark, sign etc. in order to the reinforcement image.

[0017] some exemplary embodiments provide and finish the automatic detection of writing notes, and when detecting, cause catching these notes of finishing.Some embodiment adopt different sensors to detect and write finishing of notes.Other embodiment carry out this detection by using button to knock.Other embodiment carries out this detection by graphical analysis again.The various combinations of these embodiment are understandable.

[0018] in some exemplary embodiments and combination, image storage inside, the electronics of catching sent to such as external device (ED)s such as personal computer, cell phone, servers.Communication pattern between note capture device and external device (ED) can comprise the cable of direct or indirect these devices of coupling or the wireless connections of these devices that directly or indirectly are coupled.Can further understand, this communication can take place by adopting the removable medium such as magnetic medium, flash memory devices and other Nonvolatile memory devices and medium.Other universal methods that data are transferred to another from a device also are understandable.

[0019] in certain embodiments, deliver to the purpose on various objectives ground for the notes that will catch, provide screen to allow the mutual and guiding different communication modes of user and note capture device, as an example, such different agreement includes but not limited to SMTP, FTP, SFTP, HTTP, HTTPS, by the file sharing protocol that the business-like operating system of difference is provided, described operating system comprises Windows such as those, Mac OS, Linux, CE Mobile, Palm OS, Symbian, Java based OSes etc.

[0020] under different operational modes, can adopt handwriting recognition software to produce in whole or in part the text of the notes that expression caught.The text that identifies like this can be attended by the image information that is associated with notes or substitute described image information and be used.

[0021] image information that this can be associated with notes is changed by different way, comprises being converted into stroke information or compressing etc.

[0022] some other exemplary embodiments can comprise the plane picture acquisition equipment, and this plane picture acquisition equipment comprises holder surface that limits basic picture plane and the solid-state camera that limits optical axis, and this inclined light shaft is in described basic picture plane.As used herein, solid state camera usually refers to the camera made by semiconductor fabrication, and therefore not necessarily comprises one or more lens.Yet other dissimilar cameras also may be used in combination with desired embodiment.

[0023] another exemplary embodiment comprises the plane picture capture systems with plane picture acquisition equipment.This plane picture acquisition equipment has holder surface that limits basic picture plane and the solid-state camera that limits optical axis, this inclined light shaft is in described basic picture plane, described photographic means has fixing optical focus, and its depth of field is extended approximately at least 2.5 inches but be no more than about 7.5 inches from described solid-state camera.In addition, this system comprises the calculation element that is coupled in this plane picture acquisition equipment, and this calculation element can receive the image information from this acquisition equipment at least.

[0024] another exemplary embodiment is provided for providing the method for image information again.This method comprises that aiming has and favours substantially as the optical axis on plane and have the solid-state camera of fixing focus, and its depth of field is extended approximately at least 2.5 inches but be no more than about 7.5 inches from described solid-state camera.This method also comprises and adopts described solid-state camera to catch view data and store described view data at least in part in number storage.

[0025] another exemplary embodiment provides the computing machine available media of the instruction with storage embodied on computer readable thereon, and this instruction is used for being carried out with manner of execution by processor.This method comprises that aiming has and favours substantially as the optical axis on plane and have the solid-state camera of fixing focus, its depth of field is extended approximately at least 2.5 inches but be no more than about 7.5 inches from described solid-state camera, adopts described solid-state camera to catch view data and stores described view data at least in part in number storage.

[0026] another exemplary embodiment provides image capturing and the transmitting system that comprises network and plane image capture apparatus again.This plane picture acquisition equipment comprises the holder surface that limits basic picture plane, limit the solid-state camera of optical axis, this inclined light shaft is in described basic picture plane, described solid-state camera has fixing optical focus, its depth of field is extended approximately at least 2.5 inches but be no more than about 7.5 inches from described solid-state camera, with with the integrated calculation element of described plane picture acquisition equipment, this calculation element can receive the image information from described acquisition equipment at least.This described plane picture acquisition equipment is coupled in described network and arrives another device for exercisable in order to send described image information by described network.

[0027] for the person of ordinary skill of the art, by reading following description and studying a plurality of accompanying drawings, these and other embodiment disclosed herein and advantage and other features will become obvious.

[0028] some aspects of different exemplary embodiments provide software with check, browse, share, search and editing captured notes, its related metadata, recognition result etc.This difference exemplary embodiment comprises " desktop " or the human interface software of different application form that is associated with the user.

Description of drawings

[0029] a plurality of exemplary embodiments have been described with reference to the drawings, wherein same parts is prescribed with same reference numbers.These exemplary embodiments are intended to explanation and unrestricted the present invention.Comprise the following drawings:

[0030] Fig. 1 is the high-level diagram that note capture device 2 and different other devices that communicate with are shown;

[0031] Fig. 2 illustrates the note capture device 2 of Fig. 1 more particularly;

[0032] Fig. 3 A to Fig. 3 B still illustrates the note capture device 2 of Fig. 1 and Fig. 2 more particularly;

[0033] Fig. 4 illustrates the camera 32 of Fig. 2 and Fig. 3 more particularly;

[0034] Fig. 5 illustrates the note capture device 2 with another sensor mechanism again that is used to detect different operation modes;

[0035] Fig. 6 illustrates the visual field of camera 32 more particularly;

[0036] Fig. 7 illustrates reproduction button 24 more particularly;

[0037] Fig. 8 illustrates the note capture device 2 that comprises radio communication subsystem 12 in the exemplary embodiment;

[0038] Fig. 9 illustrates the exemplary embodiment of note capture device 2, and wherein the specially appointed zone of writing surface has certain sense according to the configuration of notes;

[0039] Figure 10 illustrates the exemplary embodiment of the note capture device 2 that comprises LCD display 60, and this LCD display 60 can be used in conjunction with acquisition procedure to help to guarantee to obtain distinct image;

[0040] Figure 11 is the block diagram of the circuit of realization on the printed circuit board (PCB) 38 of Fig. 3, Fig. 5, Fig. 6 and Fig. 7;

[0041] Figure 12 is the process flow diagram that is depicted in the prize procedure of operation on the note capture device 2;

[0042] Figure 13, Figure 14 and Figure 15 illustrate the part of time shaft, and it has described some aspects of some embodiment of the operation of Figure 12 more particularly;

[0043] Figure 16 handles from the data of camera sensor so that realize the figure of the alternate embodiment of high level " image time shaft " for employings " data extract " technology is shown;

[0044] Figure 17 has described to combine with the notes of being caught by note capture device 2 process flow diagram of operation of the application software used;

[0045] Figure 18 is for having described the process flow diagram of the exemplary operation event loop operation 290 of Figure 17 in more detail;

[0046] Figure 19 is for having described the process flow diagram of the exemplary process event action 298 of Figure 18 in more detail;

[0047] Figure 20 is the figure that the exemplary embodiment of the graphic user interface (GUI) that is used for application software is shown;

[0048] Figure 21 is the figure that the example images and the Performance Characteristics of application software are shown;

[0049] Figure 22 is the figure of depicted example metadata demonstration/editor GUI; With

[0050] Figure 23 is the figure of the exemplary embodiment of the business card scan describing to substitute.

Embodiment

[0051] Fig. 1 is the high-level diagram that note capture device 2 and different other devices that communicate with are shown.For example, in the exemplary embodiment, note capture device 2 can be communicated by letter with personal computer 4 through USB cable 6.Be further appreciated that note capture device 2 can pass through other equipment and communicate by letter with personal computer 4.In the exemplary embodiment, note capture device 2 can be by battery 8 power supply or by such as powering from for example moving other equipment that last 110 volts AC wall socket obtains power supply adaptor 10 (not shown) of electric power.In different exemplary embodiments, note capture device 2 use radio communication subsystem 12 with various wireless device such as personal computer 4, wireless Internet router one 4, laptop computer 16 and cell phone 17.These different devices of communicating by letter with note capture device 2 are coupled in internet 18 alternatively.The purpose of note capture device 2 provides a kind of intuitive method that is used for catching such as the hand-written information that is included in Notepaper.Subsequently the hand-written information of being caught is sent to one of various devices of communicating by letter, comprise personal computer 4, wireless Internet router one 4, laptop computer 16 or cell phone 17 with note capture device 2.In some exemplary embodiments, the information stores of being caught 18 can be forwarded to the different electronic installations that are connected in internet 18 on described device or through the internet, for example server 20 (not shown) or other personal computers 4 etc.

[0052] Fig. 2 illustrates the note capture device 2 of Fig. 1 more particularly.Note capture device 2 comprises that palmrest 22 (also being referred to as the holder surface), reproduction button 24, its top page or leaf are the notepad 26 of removable writing surface, function lamp 28, camera frame 30 and camera 32.Palmrest 22 is for continuous basically, at the relative area of the palm and palmrest 22 contact positions basically less than total square area of palmrest 22.In some exemplary embodiments, although have miscellaneous part in inside, these parts are as the man-machine interface for note capture device 2 in different subclass, superset and combination.Need different sensors and electronic mechanism (not shown) that the functional of note capture device 2 is provided, and will discuss in more detail below.When using note capture device 2, the user only holds such as the writing implement of pen or pencil and on this notepad and writes.In the exemplary embodiment, press reproduction button 24 by the user or be emitted in by other manual or automatic trigger mechanisms and write the signal of finishing on the notepad 26 and indicate described finishing of writing.To send to external device (ED) through USB cable 6, radio communication subsystem 12 or by other equipment at the image on the top note of notepad 26 subsequently.Should be noted that the image that is sent this moment was hunted down before pressing reproduction button 24.In other words, reproduction button 24 press that this image of indication should be sent out and can as or can be not should not start and obtain the prompting of image as indication camera 32.Camera 32 can start with start-up mode with continuous mode or with the click that combines with reproduction button 24.In addition, reference marker 23 big volume descriptions the elongation basic assembly.

[0053] in certain embodiments, notepad 26 can be such type: wherein each page paper maintains another page or leaf by soft, reusable binder compound.

[0054] in an embodiment as non-limiting example, the plane picture acquisition equipment comprises qualification basic holder surface and the solid-state camera that limits the optical axis that favours described basic picture plane as the plane.This solid state camera also has from this solid state camera and extends approximately at least 2.5 inches but be no more than about 7.5 inches depth of field.Generally speaking, the depth of field is for being located substantially on the distance of focus when lip-deep image when photographic means is checked.Still generally speaking, when assembling view as acquisition equipment the time calibration depth of field to fixing scope.

[0055] Fig. 3 illustrates the note capture device 2 of Fig. 1 and Fig. 2 again more particularly.Notepad 26 is placed on the notepad rest 34 and writing surface for the user is provided.Provide reproduction button 24 to finish notes to allow user's indication.Copy button microswitch 36 under reproduction button 24 is converted to electric signal finishing in order to the indication notes in order to the action with reproduction button 24.In one embodiment, copy button microswitch 36 is installed on the printed circuit board (PCB) 38.In an exemplary embodiment, palmrest 22 contacts with palmrest microswitch 40 on being installed in printed circuit board (PCB) 38.Processor 42 is installed on the printed circuit board (PCB) 38 and provides computing power to realize the various functions of note capture device 2.Camera 32 is installed on the structural support elements 30 and through camera cable 44 and is electrically connected to printed circuit board (PCB) 38.This structural support elements 30 be can limit and frame or display are.In a unrestriced exemplary embodiment, provide page removal detector 46 to help to detect removing of notes.This detection can also be realized by analyzing the imaging that is obtained by camera 32 by inactive component.In the different embodiment of note capture device 2, can make very big change to the quantity and the type of sensor.In one exemplary embodiment, page removal detector 46 is loaded by elasticity, so it has kept contacting with the constant physics of the top note of notepad 26.When page removal detector 46 detects the action that indication notes remove, produce electric signal and also be sent on the printed circuit board (PCB) 38.This signal and all use together to help to determine when notes are finished and should be hunted down from the unlike signal of the different sensors that comprises palmrest microswitch 40, copy button microswitch 36, page removal detector 46 and by the imaging that camera 32 is obtained.When catching when notes, the signal that will comprise the image of notes sends to the external device (ED) such as personal computer 4, wireless Internet router one 4, laptop computer 16 or cell phone 17.The transmission of image can take place by different way, comprises that the equipment of this physical connection for example is connected to the USB cable 6 of printed circuit board (PCB) 38 through USB connector 48 through the radio communication of radio communication subsystem 12 (not shown) or the equipment by physical connection.USB cable 6 is a kind of in many possible physical connections.Substitute comprises Ethernet cable etc.

[0056] Fig. 2 and other accompanying drawings have also been described the basic picture plane 27 that comprises smooth basically surface.Should note substantially can and need not to continuously for the different shape except that the cardinal principle square shape of notepad 26 as plane 27.In addition, as shown in Fig. 3 B, Z-axis 29 is limited by basic picture plane 27.As used herein, limit " the vertical depth of field " for being arranged essentially parallel to the depth of field of Z-axis 29, the image that is detected by camera 32 in this depth of field can fully be resolved with used by system, for example, image has enough focusing and/or resolution for the identification of system and/or other purposes.

[0057] Fig. 4 illustrates the camera 32 of Fig. 2 and Fig. 3 more particularly.In one exemplary embodiment, camera 32 comprises camera printed circuit board 50, camera assembly 52 and LED 54.Camera assembly 52 comprises lens and camera sensor mechanism, this camera sensor mechanism can will send to miscellaneous part by camera cable 44 from a series of images that camera sensor obtained, and particularly is installed in the processor 42 on the printed circuit board (PCB) 38.LED 54 provides light, so that under different illumination conditions, illuminates note capture device 2, more specifically, illuminates the writing surface of notepad 26.The structure of the camera 32 shown in Fig. 4 only is an exemplary embodiment and should explains in unrestriced mode.

[0058] Fig. 5 illustrates the note capture device 2 with another sensor mechanism again that is used to detect different operation modes.Especially, in this embodiment, notepad rest 34 will produce electric signal for pressure-sensitive so that apply pressure to notepad 26, and this electric signal is sent to processor 42 through printed circuit board (PCB) 38, and activity is write in indication.Also comprise proximity transducer 54, so that provide the indication physics of selling to be present in signal on the notepad 26.This proximity transducer 54 is sent to processor 42 with electric signal through printed circuit board (PCB) 38 similarly.As discussing the preceding, palmrest 22 is pressure-sensitive, so that the signal of writing operation is provided to processor 42.With the output of different sensors described herein and the image information combination that obtains from camera 32, this image has the visual field of the writing surface that covering provides by notepad 26.Because camera 32 is not just above notepad 26, the visual field that should note camera 32 is for tilting.The height of structural support elements 30 only needs enough high so that enough visuals field of notepad 26 to be provided, so that the view data that is obtained can be modified to the suitable images of notes.

[0059] Fig. 6 illustrates the visual field of camera 32 more particularly.As shown in exemplary, unrestriced embodiment herein, the central authorities of the writing surface of camera 32 aiming notepads 26.The part that more approaches the notepad 26 of palmrest 22 is occurring than distant location, and therefore uses lower resolution than the image section about notepad 26 central authorities in final image.Similarly, approach the image section use higher resolution of the image section of camera in the image most than the central authorities that are associated with notepad 26.

[0060] Fig. 7 illustrates reproduction button 24 more particularly.In the exemplary embodiment, in the surface of reproduction button 24, provide recess, so that pen, pencil or other writing implements can be in order to push this button like a cork, and not from reproduction button 24 landings, this reproduction button 24 contacts with copy button microswitch 36 direct physical on being installed in printed circuit board (PCB) 38.

[0061] Fig. 8 illustrates the note capture device 2 that comprises radio communication subsystem 12 in the exemplary embodiment.Arrange radio communication subsystem 12 parts as antenna, this antenna can with the inside or the outside of the note capture device 2 that is installed in the combination of circuits on printed circuit board (PCB) 38 (not shown).Different communication protocol can with radio communication subsystem 12 logotypes.Such as agreements such as bluetooth, WLAN (wireless local area network) (LAN) agreement, cellular telephony protocols is that those of ordinary skill in the art is known.The different embodiment that substitute comprise IR etc.In addition, also provide the mechanism that is used to receive gps signal.This GPS mechanism can be used for determining the position of note capture device 2 and therefore this positional information and image information are stored together as with the related metadata of image.This can help the back to attempt to locate the user of particular note.Under the situation that need not to require great effort, the user is easy to remember by the light of nature their whereabouts, when they write notes and to the guestimate on date.Should be noted that in the claim scope note capture device disclosed herein can great changes have taken place dimensionally to adapt to greater or lesser technology application disclosed herein.

[0062] Fig. 9 illustrates the exemplary embodiment of note capture device 2, and wherein the specially appointed zone of writing surface has certain sense according to the configuration of notes.In this example, provide

specific region

56 and 58 when user's use is pushed this zone such as writing implements such as pen, pencils, to carry out the function that the user limits.Should note can be by the imaging that obtains by camera 32 graphical analysis or by in specific region 56 with provide for 58 times such as the various sensors of microswitch and carry out pen down to the detection in specific region 56 or 58.Except these embodiment, can adopt various other detection technologies such as light beam that is blocked etc.

Specific region

56 and 58 layout are possible for exemplary and many other structures only.The semanteme that exists with ...

specific region

56 and 58 be user-programmable and can comprise multiple function, for example give the electronic letter of notes specific, that the predetermined user transmission is caught, these notes are posted to the atlas on the webpage that is located in server 20 (not shown) for example, send fax etc. for predetermined fax number.

[0063] Figure 10 illustrates the exemplary embodiment of the note capture device 2 that comprises LCD display 60, and this LCD display 60 can be used in conjunction with acquisition procedure to help to guarantee to obtain distinct image.LCD display 60 is in order to provide feedback so that the user can see the notes that will catch when pushing reproduction button 24 to the user.LCD display 60 also is used as for the man-machine interface of note capture device 2 and can comprises touch screen capability in addition, so that use pen or finger to interact with the operation of realization note capture device 2 and the distribution of any notes of being caught with different soft keys.In this exemplary embodiment, structural support elements 30 is broadened to hold LCD display 60 and camera 32 is installed on the top of this structural support elements of widening 30.In this embodiment, the part of radio communication subsystem 12 is accommodated in the structural support elements 30, as in other embodiments.In some embodiments, structural support elements 30 can also comprise by element 30 support can projected image the luminophor element.In another embodiment, can in this note capture device 2, carry out Flame Image Process.

[0064] with reference to figure 3, Fig. 5, Fig. 6 and Fig. 7, Figure 11 is the block diagram of the circuit of realization on the printed circuit board (PCB) 38 of Fig. 3, Fig. 5, Fig. 6 and Fig. 7.The various parts of printed circuit board (PCB) 38 are bus 62, processor 42, volatile storage 64, Nonvolatile memory devices 66, ROM (read-only memory) 68, camera I/O (I/O) 70 and other I/O 72.In the structure of Figure 11, can also comprise number storage.Other I/O 72 can comprise operationally in order to will be sent to the communication port of external device (ED) or network from the data of number storage and other storeies and memory storage.This communication port can be for wired or wireless.Notes are caught, user interface and the various functions of communicating by letter to provide as the computing machine that embeds in note capture device 2 with these various electronic units of printed circuit board (PCB) 38.Processor 42 is coupled to bus 62 and primary computational capability for the various functions of note capture device 2 is provided.Volatile storage 64 is used in combination with processor 42 so that the interim storage for the various processing that realize in processor 42 to be provided.Nonvolatile memory devices 66 can comprise the various storage subsystems such as flash memory or hard disk.Alternate embodiment comprises various removable mediums, for example CD-ROM, flash card etc.In other words, be appreciated that and adopt the known various non-volatile memories subsystems of those of ordinary skill in the art to increase Nonvolatile memory devices 66 or to substitute it.In some unrestriced exemplary embodiments, one or more notes of being caught by note capture device 2 can be stored in the Nonvolatile memory devices 66, and be uploaded to the various devices that connect subsequently.Provide ROM (read-only memory) 68 to be used for the OS level instruction that processor 42 starts to comprise, and be provided for the various built-in functions of processor 42, this built-in function be included in operation on the note capture device 2 the execution user interface, catch and the program in whole or in part of communicating by letter.Notice that ROM (read-only memory) 68 can be for programmable.In one exemplary embodiment, camera I/O70 can comprise the electronic unit that the camera that is for example provided is provided in cell phone.Various alternate embodiments can comprise the ability of this LED 54 being controlled according to the light output of the LED 54 in camera, or start and close the ability of LED 54.Other embodiment can comprise in order to the servo-drive system of the angle that changes camera so that its camera can for example be taken room or other environment to carry out security function etc.Therefore, use camera I/O 70 not only to obtain imagings also in order to the different aspect of the operation of control camera 32 from camera 32.Zoom and focusing and image resolution ratio etc. are controlled potentially by camera I/O 70.Other I/O 72 provide to the various sensors that are associated with note capture device 2 and the I/O of microswitch.In addition, other I/O 72 can provide to for example keyboard or fixed-point apparatus (pointing device) or such as the I/O of the output unit of LCD display 60.Other exemplary embodiments provide the I/O that is associated with LCD display 60 in its touch screen embodiment.Other I/O 72 can also be in order to the various LED of control such as function lamp 28, and it is in order to show for example running status, communications status and the trapped state of note capture device 2.Other I/O 72 can in order to microphone or GPS mechanism interface.Similarly, the exemplary embodiment of other I/O 72 provides communicating by letter through radio communication subsystem 12, USB connector 48 and other communication patterns.

[0065] in one embodiment, by carry out, help the inverse taper Flame Image Process of the image that obtains such as the storer of ROM 68.

[0066] Figure 12 is for being depicted on the note capture device 2, and more specifically, on the different parts of printed circuit board (PCB) 38, and the process flow diagram of operation prize procedure on processor 42 and the associated storer particularly.This is a kind of example of operational mode, and the mode by example provides and non-limiting.The code that is used for moving Figure 12 can be realized in ROM (read-only memory) 68 or Nonvolatile memory devices 66, or can download from following external source in some instances, for example personal computer 4, laptop computer 16 or various other devices that can communicate by letter with note capture device 2, the server on cell phone or the internet 18 for example, for example server 20.This operates in and begins in the operation 74 and proceed to operate 76, is operating in 76 program initialization.This moment, various needs were used for monitoring the impact damper of the imaging that obtains from camera 32 and the various sensors of note capture device 2 carry out initialization.At this some place, control goes to operation 78, reads various inputs in this operation 78.In certain embodiments, on ongoing basis, obtain imagings and in other embodiments,, just obtain data from camera 32 up to being asked especially by present procedure from camera 32.If obtain imaging on ongoing basis, it can be in order to help the frame of the definite imaging that should catch.In one embodiment, when record, only obtain imaging and need not other sensor inputs to come which frame of the definite imaging that should catch.At this some place, operation 80 determines whether catch image.This is by for example checking such as finishing by the various sensor inputs of copy button microswitch 36 signal that other various sensors obtained in addition with by the imaging that camera 32 is obtained.At one cheaply among the embodiment, except the camera input,, can analyze this camera input to determine to catch the time of image without any need for sensor.Should catch if determine image in operation 80, then control goes to operation 82, catches single image in operation 82.The mode of catching can be to obtain single image from camera 32 or from the frame buffer of storing before.In the one situation, the image that will catch sends to external device (ED) such as personal computer 4, laptop computer 16, cell phone or server 20 by one of the aforementioned means of communicating by letter with note capture device 2.Wireless Internet router one 4 can also be in order to the various devices on internet 18 of contact such as server 20, so that catch image.When complete operation 82, control is passed to operation 84, this operation 84 has determined whether to finish the operation of Figure 12.If in operation 80, determine also to be less than the time of catching image, similarly control is passed to operation 84, this operation 84 has determined whether to finish the operation of Figure 12.If determine to have finished the operation of Figure 12 in operation 84, then control is passed to its operation 86 that finishes operation.Should be noted that in note capture device 2 operation of carrying out Figure 12 alternative be to send telemetry intelligence (TELINT) such as image and sensor input simply to external device (ED) such as personal computer 4, and in described external device (ED), carry out the operation of Figure 12 subsequently.Further may control the different hardware element by beaming back message to note capture device 2 from this external device (ED).In other words, distinct program described herein can be realized on different device.In one exemplary embodiment, note capture device can realize in having cell phone built-in or subsidiary camera, or with have cell phone built-in or subsidiary camera and combine and realize.

[0067] Figure 13, Figure 14 and Figure 15 illustrate the part of time shaft, and it has described some aspects of some embodiment of the operation of Figure 12 more particularly.Although in some exemplary embodiments, determine whether to catch and push the reproduction button 24 simply as detecting the user, other exemplary embodiment comprises monitors different sensors as described in Figure 12.4 moment in Figure 13 express time and the input of various sensor, and some information that from those inputs, obtain.First frame of time shaft is represented blank image.At this moment, palm rest sensor, proximity transducer and page remove sensor all do not detect any situation.Because this image is first image and does not have comparable object, images match is for negative.Similarly, image corresponds to negative.Image blank is for just, and this is because detect image easily for blank; Do not have ink to exist and user's hand and pen not in the visual field.Pen down sensor is also indicated current any activity of writing that do not exist.Frame 2 indication blank image are as just now in frame 1.Also do not have User Activity, and all be negative therefore such as palmrest, various sensors approaching and that the page removes.Yet because this image is identical with before image, images match and image correspondence just are.Image blank is for just, and the image of indication frame 2 be blank, and starts to write to negative, indicates the user not write on notepad 26 at present.In frame 3, the user has begun to use on notepad 26 and has write such as the writing implement of pen or pencil.As writing implement self, the completed written portion in frame 3 is visible.Start the palm rest sensor that is associated with palmrest 22, the pressure that indication palmrest microswitch 40 has detected on palmrest 22.Proximity transducer 54 has detected approaching such as the object of hand or writing implement, and therefore this approaching indication also for just.Page remove sensor does not detect removing of the page.Because the frame 3 of present image does not mate the previous image in the frame 2, so images match is defined as bearing, as Image blank, similarly, image corresponds to negative.Because some occurring writes, so image no longer is blank.Starting to write just is designated as, and the pressure of stylus has started pen down sensor.Now, in the frame 4 of time shaft,, the user occurred more writing when this writes operation when continuing to carry out.The palm rest sensor that is associated with palmrest 22 and palmrest microswitch 40 indicates user's the palm to touch on the palmrest 22 for just.Similarly, proximity transducer 54 detects the existence of user's hand or writing implement.Page remove sensor does not detect removing of the page.Images match and image correspond to negative, indicate this image to be different from image before.Image blank indicates this image for blank for negative, this be because its write and the part of writing implement in the visual field.Starting to write just is designated as, and indication is exerted pressure to notepad 26, and therefore is applied to notepad rest 34, and notepad rest 34 comprises pressure transducer in this embodiment.

[0068] now go to Figure 14, frame 5 illustrates and comprises any part that some notes of writing do not comprise writing implement or user's hand.This palmrest is designated as negative, indicates the current pressure that is not applied to palmrest 22, and therefore palmrest microswitch 40 for mourning in silence.Although proximity transducer illustrates user's hand and do not contact with notepad, it enough approaches notepad 26 and continues to detect it to cause proximity transducer.Page remove sensor 46 is for negative, and the indication user does not also attempt will taking down notes from notepad 26 removing.Images match is for negative, indicates the image of this image before being not similar in given tolerance limit.The meticulous variation that is used in specific tolerance limit image relatively is that those of ordinary skill in the art is known with the method for differentiating the enough similar image that mates with indication.The image correspondence is designated as negative, indicates this image not correspond to any image before.Image blank is designated as negative, and this is because this image is not blank and has some to write thereon.Starting to write, it is negative to be designated as, and indicates the current pressure that is not applied on the notepad 26, and does not therefore detect pressure on notepad rest 34, and notepad rest 34 comprises pressure transducer in this embodiment.Frame 6 illustrates the image of substantially the same image in before.Notice since the variation of lighting condition and collect photon in the camera sensor intrinsic flaw, that is for example realized in the camera 32 is the sort of, has some meticulous variations.Near just being designated as, indication user's hand is near note capture device 2 in frame 6, and the while palmrest is designated as negative, the current palm rest sensor 22 that do not touch of hand of indicating him, and therefore palmrest microswitch 40 does not detect pressure.In this example, the page remove be designated as negative.Images match is being for just, and it indicates the image of this image before enough approaching to be designated as coupling.Image just corresponds to, and all parts of writing in the image 5 before indication is present in all are present in the image 6.If the ink that adds in image 6 as seen, the image correspondence is still for just.Therefore, the difference between images match and the image correspondence is that images match is to can't stand of ink of the interpolation in image afterwards and image can be tolerated the ink of the interpolation of reply in image afterwards.Image blank is for negative in this example, and indicating image is not blank and comprises some and write.Starting to write, it is negative to be designated as, and indicates current any pressure that is applied to notepad 26 that do not exist, and therefore in this exemplary embodiment, does not have any pressure that is applied to the notepad rest 34 that comprises pressure transducer.

[0069] frame 7 writing of adding is shown and in this image writing implement part is as seen once more.This palmrest just is designated as, and indication user's palm is applying pressure to palm rest sensor 22 at present, and therefore starts palmrest microswitch 40.Proximity transducer 54 detects the existence of the user's hand that approaches note capture device 2.Page remove sensor 46 is for mourning in silence, and the indication user does not attempt to remove the page.Image match indicator is for negative in this example, and this is because writing of having added and writing implement is current is the visible fact in image, but writing implement is invisible in image before.Similarly, image corresponds to negative, and this is because writing implement is current in image.Image blank is for negative in this example, and this is because writing implement is write current all on image with some.Starting to write just is designated as, and the current employing writing implement of indication user is applied to notepad 26 with pressure, and therefore in this exemplary embodiment, pressure is applied to the notepad rest 34 that comprises pressure transducer.Frame 8 illustrates writing of being added when writing implement is removed from image.Palmrest is designated as negative because the current pressure that is not applied to palmrest 22, and therefore palmrest microswitch 40 for mourning in silence.Similarly, proximity transducer 54 does not detect the existence of user's hand.Page remove sensor 46 is for mourning in silence, thus the page remove be designated as negative.Images match is for negative in this example, and this is not have in present image because have writing implement in image before.Image just corresponds in this example, and this is because this image comprises all inks of existence in frame 5 and the frame 6 and the ink of some interpolations.Because this image comprises some inks, so that Image blank is designated as is negative.In this example, start to write to negative the current notepad 26 that do not apply pressure to of indication user.

[0070] Figure 15 has described frame 9, wherein frame 8 finish be written as visible and do not have writing implement.Palmrest is designated as negative, and indication user's hand does not apply pressure to palmrest 22, and therefore palmrest microswitch 40 for mourning in silence.Near just being designated as, indication user's hand is near note capture device 2, as indicated by proximity transducer 54.Page remove sensor indication user does not attempt to remove notes from notepad 26, and therefore the page remove be designated as negative.Images match just is designated as, and indicates the image of this image before mating in tolerance limit.The image correspondence is being also for just, and the image of indication frame 9 is corresponding to the image of frame 5, frame 6 and frame 8 before.Image blank is designated as negative, and this is because image 9 comprises some inks really.Starting to write, it is negative to be designated as, and the indication user is current not to write on notepad 26, and does not therefore cause to the pressure of notepad rest 34.Frame 10 illustrates to follow and writes user's opposing thumb and be present in the image.Palmrest just is designated as, and indication active user's hand is applying pressure to palmrest 22, and therefore starts palmrest microswitch 40.Near just being designated as, indication user's brothers enough approach proximity transducer 54 and sense user's hand to cause proximity transducer 54.The page remove be designated as negative, this be because the user do not attempt as yet to remove notes from notepad 26.Because user's opposing thumb enters this frame, images match is for negative, and similar map looks like to correspond to negative, and this is because not corresponding to the image before this width of cloth image.Image blank is for negative, and this is because this frame comprises a part of writing with user's thumb.Start to write to negative, this is because the current pressure that is not applied to notepad 26.Frame 11 illustrates the user from notepad 26 notes of tearing.Palmrest is designated as negative, indicates the current pressure that is not applied to palmrest 22.Proximity transducer 54 detects the existence of user's hand, and therefore should be near just being designated as.Page remove sensor is being for just, and the user is current removes notes from notepad 26 in indication.It is very important that the page removes the existence of indication, because its indication user has finished any operation in notes.In this frame, images match is designated as negative, because as seen and user's opposing thumb for tearing notes in this image.Similarly, the image correspondence is designated as negative.Because as seen the edge of user's hand and notes is, Image blank is for negative.Start to write to negative, indicate the current pressure that is not applied to notepad 26.Frame 12 comprises blank image.Palmrest is designated as negative, and current its hand that do not use of indication user is exerted pressure to palmrest 22.Negative near being designated as, the 54 current existence that do not detect user's hand of indication proximity transducer.Page remove sensor is for negative, and the indication user is current not to remove notes.Images match is designated as negative, indicate this image do not match from photographed since page or leaf removes any before image.Similarly, image corresponds to negative, and this is because do not had image before since the last page or leaf removes.Image blank indicates this image for blank for just.Start to write to negative, indicate the current pressure that is not applied to notepad 26.

[0071] with reference to Figure 12, Figure 13, Figure 14 and Figure 15, the operation of Figure 12 can be adopted different embodiment, wherein some is described as an example herein.Should explain these examples in unrestriced mode.For example, from 1 to 12 of Figure 13, Figure 14 and Figure 15 different frame can be the example of in time considering, the wherein various inputs of operation 78 samplings of Figure 12.Subsequently should various input-buffers so that in operation 80, analyze them and in operation 82, handle further.By for example triggering the operation 80 of determining to catch image at just indicating of page remove sensor.It must be emphasized that to have only a kind of mode that is determined to capture time.Other exemplary embodiments comprise pushing the detection of catching press-button 24, and in replacement scheme, embodiment does not require sensor or the button except that imaging itself.Also can adopt the various combination of different sensors, button and imaging.When the operation 80 of Figure 12 had been determined to capture time, control went to the operation 82 of Figure 12, and this operation will be caught image and for example be exported to external device (ED) as personal computer 4, laptop computer 16, cell phone 17 or server 20.Alternatively, with the image buffer storage of being caught in non-volatile memories medium, subsequently it is uploaded to external device (ED) or by using removable medium physics to be written into external device (ED) such as flash memory.Should be appreciated that, operation 82 carries out image of Figure 12 capture external device (ED) or Nonvolatile memory devices, but the nearest image that the image of being caught was not necessarily photographed by camera 32, but nearest stabilized image.In certain embodiments, requiring image is the existence of stablizing and do not detect such as the various sensors of starting to write writing implement.This has for example prevented from the accident of the image of stable and a part that comprise writing implement again or other foreign bodies that are not moved is caught.In certain embodiments, nearest stabilized image in a period of time corresponding to before various images.In the embodiment that substitutes, the nearest image that obtains from camera was only photographed in the operation 82 of Figure 12.When the user for example knocked reproduction button 24, this catching was suitable.In certain embodiments, adopt encryption to protect note data and related metadata.In one embodiment, can adopt asymmetrical encryption algorithm to come enciphered data so that have only when it is handled by the service of authorizing or other recipients with corresponding suitable individual cryptographic key, these data just can be used.This method has easily manufactured advantage, and this is to need not to customize each device because the public key key can be built in each note capture device.This is convenient to the distribution of the controlled service in center with control content, and this is because data are impenetrable when in transmission, can use the device of private key key with its deciphering up to its arrival server or other.In certain embodiments, the public key key can be updated periodically to note capture device.Other encryption technologies can allow each note capture device to use unique cryptographic key.It is also understood that the employing symmetric encipherment algorithm.In certain embodiments, encrypt not acceptor center control, but allow each user to produce or obtain to be used for protecting the needed cryptographic key of safety of its notes based on the individual.For example the user can have a plurality of cryptographic key, and manually or automatically selects from these cryptographic key to carry out encryption and decryption.

[0072] Figure 16 handles from the data of camera sensor so that realize the figure of the alternate embodiment of high-rise " image time shaft " for employings " data extract " technology is shown, and can use this high level " image time shaft " where to determine to catch (a bit) width of cloth figure in conjunction with the process of Figure 12 by high-level software.Known as those of ordinary skill in the art, data extract relates to " view " image stream of camera (for example from) of the conversion that produces data set.Follow-up conversion can be produced as higher level " view ", and each higher level " view " adopts lower level " view " so that the functional of lower level to be provided.

[0073] is appreciated that in certain embodiments, thinks under the situation of newer part vacating space image stream cycle consumption page buffer zone abandoning older unwanted part.

[0074] although many for the person of ordinary skill of the art combinations are significantly, the example of such data abstraction techniques has been shown among Figure 16.At the lowermost layer place, the original image that image sequence 200 expressions obtain from sensor.In certain embodiments, this image seems to favour the observer, this be because according to camera and writing surface and put and can change camera angle.The image sequence 220 of conversion provides the image sequence of the conversion of carrying out Geometric corrections, so that can check the image of image sequence 200 as a series of perpendicular line.The image of the identical perpendicular line that is provided by the image sequence of changing 220 for example can be provided the image sequence 240 that filters, but has removed any image that comprises the material that will abandon.Being used to classify, great changes have taken place according to application-specific for standard as the image that comprises the material of not expecting.In some unrestriced exemplary embodiments, those images that comprise except background color and ink color will be classified as comprising the imaging of not expecting.Determining of ink color can be to obtaining the stable pixel of non-background color.Other are possible such as the method that detects and get rid of the image that comprises the colour of skin, as many about the method for identification mobile object etc.These embodiment provide by way of example, and should not explain in the mode of restriction.In this example, image time shaft 260 provides the view that can pass through the image sequence of time index access filtering.This is many in may examples one.When finding blank image, can adopt the image time shaft to select the image of for example nearest stable non-blank-white.In this unrestriced exemplary embodiment, the image that can select this nearest stable non-blank-white subsequently is as the image that will catch.

[0075] Figure 17 is a process flow diagram of having described the operation of the application software used of combining with the notes of being caught by note capture device 2.Should be appreciated that this application software can realize with multi-form, comprises that for example personal computer, cell phone, server, laptop and note capture device 2 are own on different device.

[0076] this operation distributes and the initialization buffer zone in operation 282 from operating 280 beginnings and proceeding to operation 282, and will represent application, user interface element and comprise the object-instantiated of the database of the notes of catching etc.Subsequently in operation 284, at the notes Query Database that will show.Carry out the geometric layout of notes in the preparation operation 286 that is used for its demonstration.In operation 288, show notes subsequently to the user.Subsequently event loop operation 290 enter event circle with handle about User Activity and with the incident of other operational communications, described operation is the operation of Figure 12 for example.When finishing event circle 290, in operation 292, finish operation.

[0077] Figure 18 is the process flow diagram of the exemplary operation of the event loop operation 290 of having described Figure 17 in more detail.This operates in beginning in the operation 294, and lasts till this operation 296 determines whether there is available incident in event queue in the operation 296.This decision operation is illustrated as with good conditionsily herein, but the operation that also can be used as drives interrupts realizes that the operation of this drives interrupts stops that the execution of current thread is till incident can be used.The implementation of many variations is tangible for the person of ordinary skill of the art.If determine that incident is available, then this incident is handled in processing events operation 298.In case this incident is processed, then control is gone to decision operation 300.If it is available determining not have incident in operation 296, then control is gone to decision operation 300.Operation 300 determines whether to finish event loop operation 290.Whether for example, it can check and start power operation whether, or started to use by the customer incident of handling before and withdraw from operation.If in operation 300, determine to finish event loop operation 290, then control is gone to the operation 302 that finishes operation.On the other hand, if decision operation 300 is determined not finish event loop operation 290, then control is gone to the operation 296 that continues this operation.

[0078] Figure 19 operates 298 process flow diagram for the processing events of having described exemplary Figure 18 in more detail.This operates in beginning in the operation 304, and lasts till that incident is obtained in this operation 306 in the operation 306 from event queue.

[0079] whether subsequently in decision operation 308, making about incident is determining of mouse event.If determining this incident is mouse event, control goes to operation 310, and this operation 310 is handled this mouse event by this mouse event of further assignment to its object instance of current designated reception.This finishes to the GUI object that occupies these coordinates by the coordinate of definite this mouse event and by assigning it basically.This assignment is tangible for the person of ordinary skill of the art.In handling this incident, this object can revise instance variable, buffer zone etc. and to the signal of other objects with execution about handling the different task of this incident.When complete operation 310, control goes to operation 324, its end operation 298.On the other hand, if determine that in operation 308 incident is not a mouse event, then goes to control operation 312.

[0080] whether subsequently in decision operation 312, making about incident is determining of communication event.If determining this incident is communication event, control goes to operation 314, and this operation 314 designated is handled this communication event with the object instance that receives it by this communication event of further assignment to current.This is usually by checking this communication event, and it is assigned and carries out addressing and finish being included in information in incident or the related communication buffer based on the type of communication.This assignment is known for the person of ordinary skill of the art.The example of a communication event is to receive the notes of having been caught by note capture device.In order to handle such incident, in Nonvolatile memory devices, receive and compile this notes, and subsequently in one exemplary embodiment, carry out database and insert operation.Alternatively, as a kind of mode of these notes of location in the database of many notes, adopt identification software from the notes image, to obtain text so that search for the text later on.

[0081] in handling communication event, object can be revised instance variable, buffer zone etc. and send signals to other objects to carry out about handling the various subtasks of this incident.In addition, the processing of communication event often comprises initialization or communicates by letter with the execution thread that exists, particularly for time-consuming task, for example handwriting recognition.When complete operation 314, control goes to the operation 324 of end operation 298.On the other hand, if determine that in operation 312 incident is not a communication event, then goes to control operation 316.

[0082] whether subsequently in decision operation 316, making about incident is determining of cipher key event.If determining this incident is cipher key event, control goes to operation 318, and this operation 318 designated is handled this cipher key event with the object instance that receives it by this cipher key event of further assignment to current.By which determining the GUI object is current that having " focus " finishes, this focus is one and often is associated with recently by the indication of the object of " click " basically for this.This assignment is known for the person of ordinary skill of the art.In this incident of processing, object can be revised instance variable, buffer zone etc. and send signals to other objects to carry out about handling the various tasks of this incident.When complete operation 318, control goes to the operation 324 of end operation 298.On the other hand, if determine that in operation 316 incident is not a cipher key event, then goes to control operation 320.

[0083] whether subsequently in decision operation 320, making about incident is determining of other incidents.If determining this incident is other incidents, control goes to operation 322, and this operation 322 designated is handled this other incidents with the object instance that receives it by these other incidents of further assignment to current.For example, this incident comprises a medium is inserted into the peripheral unit that comprises the notes that will fetch.Various for the person of ordinary skill of the art combinations will be tangible.In this incident of processing, object can be revised instance variable, buffer zone etc. and send signals to other objects to carry out about handling the various tasks of this incident.When complete operation 322, control goes to the operation 324 of end operation 298.On the other hand, if determine that in operation 322 incident is not another incident, then goes to control operation 324.

[0084] some unrestriced exemplary embodiments provide note capture device, this note capture device comprises writing surface, is mounted in order to check the camera of writing surface, and in order to the electronic circuit of the image of catching described surface, or various alternative surface, comprise for example business card surface.Be appreciated that various image transitions, for example this image transitions can be revised the camera angle about the inclination on surface.Also be appreciated that in order to the reinforcement image, or add other conversions of mark, sign etc.Can also be with other associating informations in view data, for example when proposing by the specific user in order to digital signature of verification msg etc.

[0085] Figure 20 is the figure that the exemplary embodiment GUI that is used for application software is shown.Although have the embodiment of many variations, some exemplary embodiments provide the scroll list of the thumbnail image that obtains from comprise the database that is associated with the notes that this application software catches.With mouse move on to notes go up or knock notes will for example " selection " it, and so its represent to the user significantly, and will provide further reciprocation, comprise checking and editing of metadata.The different menu function can be used for providing feature, takes down notes another user or online monograph such as sending this, and the search notes are based on the notes of classification demonstrations such as time, catch position.

[0086] Figure 22 is the figure that the example images and the performance characteristic of application software are shown.This view has provided detailed mutual with particular note, for example checks and editing meta-data, comprises handwriting recognition results in certain embodiments.Be appreciated that and edit in this mode that will to obtain appropriate databases thus mutual, include but not limited to query manipulation, insert operation, deletion action and renewal operation.In alternate embodiment, use hierarchical file system surrogate data method storehouse.

[0087] some exemplary embodiments provide and finish the automatic detection of writing notes, and when detecting, cause catching these notes of finishing.Some embodiment adopt different sensors to detect and write finishing of notes.Other embodiment carry out this detection by using button to knock.Other embodiment carries out this detection by graphical analysis again.The various combinations of these embodiment are understandable.

[0088] in some exemplary embodiments and combination, image storage inside, the electronics of catching sent to external device (ED) such as personal computer, cell phone, server etc.Communication pattern between note capture device and external device (ED) can comprise the cable of direct or indirect these devices of coupling or the wireless connections of these devices that directly or indirectly are coupled.Can further understand, this communication can take place by adopting removable medium.Other universal methods that data are transferred to another from a device also are understandable.

[0089] in certain embodiments, for the notes that will catch purpose, provide screen to allow the mutual and guiding different communication modes of user and note capture device with being sent to various objectives, as an example, such different agreement includes but not limited to SMTP, FTP, SFTP, HTTP, HTTPS, by the file sharing protocol that the commercial obtainable operating system of difference is provided, described operating system comprises Windows such as those, Mac OS, Linux etc.

[0090] under different operational modes, can adopt handwriting recognition software to produce in whole or in part the text of the notes that expression caught.The text that identifies like this can produce or substitute described image information with the image information that is associated with notes simultaneously and be used.

[0091] image information that this can be associated with notes is changed by different way, comprises being converted into stroke information or compressing etc.

[0092] Figure 23 has described the exemplary embodiment that substitutes, and wherein can catch business card 400.When manually digging fixture 402, in software, view is done suitable adjustment by the user.This fixture 402 comprises the electrical switch that is coupled to printed circuit board (PCB) 38, and this printed circuit board (PCB) 38 produces can detected electrical signal by the processor 42 of final this optional acquisition mode of startup.In this pattern, catch this card and handle this related image according to the view of revising.

[0093] for the person of ordinary skill of the art, by reading following description and studying a plurality of accompanying drawings, these and other embodiment disclosed herein and advantage and other features will become obvious.

[0094] some aspects of different exemplary embodiments provide software with check, browse, share, search and editing captured notes, its related metadata, recognition result etc.This difference exemplary embodiment comprises " desktop " or the human interface software of different application form that is associated with the user.Further, be appreciated that this application software can originally realize in different replacement device that comprise personal computer, server, cell phone, laptop computer, PDA or note capture device on one's body.

[0095] although use specific term with unit describe different embodiment, such description is the purpose of property presented for purpose of illustration only.Employed statement only is the nonrestrictive statement of description.Be appreciated that those of ordinary skill in the art can make any modifications and variations, and do not break away from the spirit or scope of the present invention that in following claim, is proposed.In addition, should be appreciated that, the aspect of various other embodiment can be exchanged in whole or in part.Therefore, be intended to explain this claim according to true spirit of the present invention and scope, and unrestricted or forbid.

Claims

1. plane picture acquisition equipment, this device comprises:

Limit the holder surface on basic picture plane; With

Limit the solid-state camera of optical axis, this inclined light shaft is in described basic picture plane.

2. plane picture acquisition equipment according to claim 1, wherein said solid-state camera have from described solid-state camera and extend approximately at least 2.5 inches but be no more than about 7.5 inches depth of field.

3. plane picture acquisition equipment according to claim 1, wherein said holder surface is smooth basically.

4. plane picture acquisition equipment according to claim 3, wherein said holder surface is continuous basically.

5. plane picture acquisition equipment according to claim 4, wherein said holder surface is pressure-sensitive.

6. plane picture acquisition equipment according to claim 3, wherein said holder surface forms the part of the matrix component of elongation.

7. plane picture acquisition equipment according to claim 6, wherein said matrix component comprise near the palmrest of first end and described holder surface near the second end.

8. plane picture acquisition equipment according to claim 7, wherein said matrix component also is furnished with proximity transducer.

9. plane picture acquisition equipment according to claim 7, wherein said matrix component also are furnished with the page remove sensor near described the second end.

10. plane picture acquisition equipment according to claim 7, wherein said matrix component also is furnished with catching press-button.

11. plane picture acquisition equipment according to claim 7 also comprises structural support elements, this structural support elements is being attached to the described matrix component that approaches described holder surface and is being attached to described photographic means at the higher end place than the end portion place.

12. plane picture acquisition equipment according to claim 11 also comprises the light-emitting component by described the support that approaches described photographic means.

13. plane picture acquisition equipment according to claim 7 comprises that also at least one is configured in order to detect the palm rest sensor of the pressure on described palmrest.

14. plane picture acquisition equipment according to claim 1 also comprises the removable writing surface with described holder surface engagement.

15. plane picture acquisition equipment according to claim 14, wherein said removable writing surface are the top page or leaf with the writing pad of described holder surface engagement.

16. plane picture acquisition equipment according to claim 15, wherein said writing pad are to comprise type soft, reusable binder compound.

17. plane picture acquisition equipment according to claim 1 also comprises being configured in order to store the number storage from the data of parts of images at least of described photographic means at least provisionally.

18. plane picture acquisition equipment according to claim 17 also comprises and can transmit the communication interface of data from described number storage to external device (ED) at least.

19. plane picture acquisition equipment according to claim 18, wherein said communication interface are at least one in wired communication interface and the wireless communication interface.

20. plane picture acquisition equipment according to claim 1 also comprises display screen, this display screen is configured at least a portion image of catching by described photographic means in order to show at least in part.

21. plane picture acquisition equipment according to claim 1 also comprises being coupled in described photographic means and receiving digital processing apparatus from the image information of described photographic means at least.

22. plane picture acquisition equipment according to claim 21, wherein said digital processing apparatus is configured in order to carry out the Flame Image Process of described image information.

23. plane picture acquisition equipment according to claim 1 also comprises being configured in order to keep business card to approach the business card retainer of described photographic means.

24. a plane picture capture systems, this system comprises:

The plane picture acquisition equipment, this device comprises:

Limit the holder surface on basic picture plane; With

Limit the solid-state camera of optical axis, this inclined light shaft is in described basic picture plane; With

Be coupled in the calculation element of described plane picture acquisition equipment, this calculation element can receive the image information from described acquisition equipment at least.

25. plane picture capture systems according to claim 24, wherein said solid-state camera has fixing optical focus, and this fixing optical focus has from described solid-state camera and extends approximately at least 2.5 inches but be no more than about 7.5 inches depth of field.

26. plane picture capture systems according to claim 24 also be included at least one surperficial notes of described holder, and wherein said calculation element comprises the display that is configured in order to the description that shows described at least one notes.

27. plane picture capture systems according to claim 26, wherein said display also are configured to comprise in order to demonstration a plurality of notes of described at least one notes.

28. plane picture capture systems according to claim 27, at least one notes of wherein said a plurality of notes show as the thumbnail image of described notes.

29. plane picture capture systems according to claim 28, wherein the described a plurality of notes except that movable notes show as the thumbnail image of described notes.

30. plane picture capture systems according to claim 26, wherein said at least one notes are associated with metadata.

31. a method that is used to provide image information, this method comprises:

Aiming has the solid-state camera of the optical axis that favours basic picture plane;

Adopt described solid-state camera to catch view data; And

Store described view data at least in part in number storage.

32. the method that is used to provide image information according to claim 31, wherein said solid-state camera has fixing focus, and its depth of field is extended approximately at least 2.5 inches but be no more than about 7.5 inches from described solid-state camera.

33. the method that is used to provide image information according to claim 31 also comprises and handles described view data to create image information.

34. the method that is used to provide image information according to claim 33, wherein said processing comprises the algorithm of revising keystone distortion.

35. the method that is used to provide image information according to claim 33, wherein said processing occurs in this solid-state camera.

36. the method that is used to provide image information according to claim 33, wherein said processing comprise in converted image sequence and the filtering image sequence at least one.

37. an equipment, this equipment comprises:

Storer;

One or more processors;

The logic of encoding in one or more physical medium that is used for carrying out, and when carrying out, cause that operationally these one or more processors carry out:

Adopt described solid-state camera to catch view data; And

Store described view data at least in part in number storage.

38. according to the described equipment of claim 37, wherein said solid-state camera has fixing focus, its depth of field is extended approximately at least 2.5 inches but be no more than about 7.5 inches from described solid-state camera.

39., also comprise causing that operationally the described view data of these one or more processor processing is to create the logic of image information according to the described equipment of claim 37.

40. according to the described equipment of claim 39, the described view data of wherein said processing comprises the algorithm of revising keystone distortion.

41. according to the described equipment of claim 39, the described view data of wherein said processing comprises at least one in converted image sequence and the filtering image sequence.

42. a computing machine available media has storage computer-readable instruction fetch thereon, this instruction is used for being carried out with manner of execution by processor, and this method comprises:

Adopt described solid-state camera to catch view data; And

Store described view data at least in part in number storage.

43. according to the described computing machine available media of claim 42, wherein said solid-state camera has fixing focus, its depth of field is extended approximately at least 2.5 inches but be no more than about 7.5 inches from described solid-state camera.

44., also comprise causing that operationally the described view data of these one or more processor processing is to create the logic of image information according to the described computing machine available media of claim 42.

45. according to the described computing machine available media of claim 44, the described view data of wherein said processing comprises the algorithm of revising keystone distortion.

46. according to the described computing machine available media of claim 44, the described view data of wherein said processing comprises at least one in converted image sequence and the filtering image sequence.

47. according to the described computing machine available media of claim 44, the described view data of wherein said processing comprises the thumbnail that produces this image of catching.

48. according to the described computing machine available media of claim 44, wherein said thumbnail is displayed on the screen.

49. according to the described computing machine available media of claim 44, the described view data of wherein said processing comprises pattern-recognition.

50. image capturing and transmitting system, this system comprises:

Network;

The plane picture acquisition equipment, this device comprises:

Limit the holder surface on basic picture plane; With

With the integrated calculation element of described plane picture acquisition equipment, this calculation element can receive the image information from described acquisition equipment at least; And

Wherein said plane picture acquisition equipment is coupled in described network and sends described image information to other devices by described network when operation.

51. according to described image capturing of claim 50 and transmitting system, wherein said solid-state camera has fixing focus, its depth of field is extended approximately at least 2.5 inches but be no more than about 7.5 inches from described solid-state camera.

52. according to described image capturing of claim 50 and transmitting system, wherein said calculation element is coupled in described plane picture acquisition equipment.

53. according to described image capturing of claim 52 and transmitting system, wherein said calculation element is coupled in described network and sends described image information to described remote-control device by described network when operation.

54. according to described image capturing of claim 50 and transmitting system, wherein said network is the internet.