CN101657826B

CN101657826B - Note capture device

Info

Publication number: CN101657826B
Application number: CN200880012130.XA
Authority: CN
Inventors: S·卡尔
Original assignee: Individual
Current assignee: Individual
Priority date: 2007-02-15
Filing date: 2008-02-15
Publication date: 2013-05-29
Anticipated expiration: 2028-02-15
Also published as: TW200849109A; JP5470051B2; WO2008101224A3; TWI372358B; JP2010519622A; HK1141607A1; WO2008101224A2; CN101657826A

Abstract

Various exemplary embodiments provide a note capture device comprising a writing surface, a camera mounted to view the writing surface, and electronic circuitry to capture images of said surface, or various alternative surfaces, including for example, a business card surface. Notes are captured upon a determination of completion of the note writing, and either stored or forwarded to an external device, or both. Handwriting recognition software is provided to enhance searchability of captured notes. Application software embodied on various devices provides the ability to view, browse, share, search and edit captured notes and associated data.

Description

Note capture device

The cross reference of related application

The name that the application requires to submit on February 15th, 2007 is called the rights and interests that " Note CaptureDevice ", application number are 60/890180 U.S. Provisional Patent Application, and it is contained in this by reference.

Technical field

Exemplary embodiment disclosed herein belongs to the digital electronic device for capturing information.More specifically, exemplary embodiment disclosed herein belongs to be used to the device of catching hand-written with relevant metadata.

Background technology

As a kind of easy way in order to recorded information, hand-written notes run through whole log history and are used.Although for the production of paper with such as the technology of the writing implement of pen and pencil some changes are occuring these years, for thousands of years, the practical methods that is used for hand-written notes in fact changes.This fact is the convenience of this kind form recorded information and the proof of validity.

Along with the appearance of robot calculator, various trials have been made for improving hand-written notes.Famously, developing " personal digital assistant " (PDA) is used for catching handwritten content and various organization service being provided with " pen computer ".

In PDA and pen computer, often provide handwriting recognition to obtain to search for the advantage with edit file.

Handwriting recognition is the ability that computing machine receives intelligible handwriting input.By optical scanning (optical character recognition), can be from paper the image of " off-line " perception text writing.Alternatively, for example by based on the computer screen surface of pen, motion that can " online " perception nib.

Suffer from early days the problem of identification accuracy in the trial of handwriting recognition.Usually can be understood as the linguistic context understanding that recognizer does not have the reader, and therefore be difficult to catch hand-written information.Even sometimes the people also has any problem when understanding person's handwriting.

PalmOne (Palm) successfully released a series of based on

The PDA of recognition system.

Improve availability by limit one group of stroke for each character.Really prolonged user's learning curve although remember this stroke pattern, this diminishes the possibility of wrong input.

People in recent years, also done multiple trial and comprised the writing brush of digital element with production, so that can write and the text that produces of storage digitally at paper.The success of these products still will be determined so far.

Become and be clearly: when the user takes notes (just when he is absorbed in the content of its notes), in real time person's handwriting identification allows this user bear undue burden, its be required correct identification error or process such as

New written form disturb.

When using typical PDA or pen computer, also reduced the sense of touch of writing at paper.Be not on the filling page or leaf of the notepad of being familiar with and be familiar with in order to pulling that steady implementation is write, but present on the surface that firmly and obviously has than less friction.The user is forced through oneself stable pen and compensates.When the content of writing about particular note, this unfamiliar write mode is also forced at user's thinking processes.

Notepaper (Post-it note) by 3M invention and manufacturing is a kind of paper that has overleaf the repeated bonding strip of cementing agent, and it is designed for notes are attached to file, graphoscope etc. provisionally.Although available wide ranges on present color, the shape and size, the most common of Notepaper is of a size of 3 square inches, and the sign color is faint yellow.

Notepaper has presented the convenient medium as the unofficial notes that are used for record prompting, telephone number, phone information etc.They are take low-viscosity bonding strip as feature, and this bonding strip makes each notes adhere to like a cork and to take off and not leave a trace or residue.The use of Notepaper is ubiquitous.When taking notes, this notes show very high-level convenience.The user can write at notepad simply, takes off this notes, and subsequently these notes is placed on remarkable position as prompting, or places it on the file as note etc.

The electronic installation of prior art can't be realized the convenience level in taking notes that realizes when writing Notepaper.Needed is a kind of equipment that the convenience of Notepaper is combined with the advantage of the electron capture that is used for can transmitting, retrieve and editing.Unfortunately, the limitation of prior art is that it fails to provide any such solution.

For the ordinary skill in the art, by reading following description and studying a plurality of accompanying drawings, these and other restrictions of prior art will become obvious.

Summary of the invention

Some unrestriced exemplary embodiments provide note capture device, this note capture device comprises writing surface, is fixed to check the camera of this writing surface, and in order to the electronic circuit of the image of catching described surface, or various alternative surface, comprise for example business card surface.Be appreciated that various image transitions, for example this image transitions can be revised the camera angle about the inclination on surface.Also be appreciated that to strengthen the readability of image, or add other conversions of mark, sign etc.

Some exemplary embodiments provide finishes the automatic detection of writing notes, and when detecting, causes catching these notes of finishing.Some embodiment adopt different sensors to detect and write finishing of notes.Other embodiment are by knocking to carry out this detection with button.Other embodiment carries out this detection by graphical analysis again.The various combinations of these embodiment are understandable.

In some exemplary embodiments and combination, image storage inside, the electronics of catching sent to external device (ED)s such as personal computer, cell phone, server.Communication pattern between note capture device and external device (ED) can comprise the cable of direct or indirect these devices of coupling or the wireless connections of these devices that directly or indirectly are coupled.Can further understand, this communication can occur by adopting the removable medium such as magnetic medium, flash memory devices and other Nonvolatile memory devices and medium.Other universal methods that data are transferred to another from a device also are understandable.

In certain embodiments, deliver to the purpose of different destinations for the notes that will catch, provide screen to allow the mutual and guiding different communication modes of user and note capture device, as an example, such different agreement includes but not limited to SMTP, FTP, SFTP, HTTP, HTTPS, by the file sharing protocol that the business-like operating system of difference provides, described operating system comprises Windows such as those, Mac OS, Linux, CE Mobile, Palm OS, Symbian, Java based OSes etc.

Under different operational modes, can adopt handwriting recognition software to produce in whole or in part the text of the notes that expression catches.The text that identifies like this can be attended by the image information that is associated with notes or substitute described image information and be used.

The image information that this can be associated with notes is changed by different way, comprises being converted into stroke information or compressing etc.

Some other exemplary embodiments can comprise the plane picture acquisition equipment, and this plane picture acquisition equipment comprises the holder surface that limits basic picture plane and the solid-state camera that limits optical axis, and this inclined light shaft is in described basic picture plane.As used herein, solid state camera usually refers to the camera made by semiconductor fabrication, and therefore not necessarily comprises one or more lens.Yet other dissimilar cameras also may be combined with desired embodiment.

Another exemplary embodiment comprises the plane picture capture systems with plane picture acquisition equipment.This plane picture acquisition equipment has the holder surface that limits basic picture plane and the solid-state camera that limits optical axis, this inclined light shaft is in described basic picture plane, described photographic means has fixing optical focus, and its depth of field is extended approximately at least 2.5 inches but be no more than about 7.5 inches from described solid-state camera.In addition, this system comprises the calculation element that is coupled in this plane picture acquisition equipment, and this calculation element can receive the image information from this acquisition equipment at least.

Another exemplary embodiment is provided for providing the method for image information again.The method comprises that aiming has and favours substantially as the optical axis on plane and have the solid-state camera of fixing focus, and its depth of field is extended approximately at least 2.5 inches but be no more than about 7.5 inches from described solid-state camera.The method also comprises and adopts described solid-state camera to catch view data and store at least in part described view data in number storage.

Another exemplary embodiment provides the computing machine available media of the instruction with embodied on computer readable stored thereon, and this instruction is used for being carried out with manner of execution by processor.The method comprises that aiming has the solid-state camera that favours basic optical axis as the plane and have fixing focus, its depth of field is extended approximately at least 2.5 inches but be no more than about 7.5 inches from described solid-state camera, adopts described solid-state camera to catch view data and stores at least in part described view data in number storage.

Another exemplary embodiment provides image capture and the transmitting system that comprises network and plane image capture apparatus again.This plane picture acquisition equipment comprises the holder surface that limits basic picture plane, limit the solid-state camera of optical axis, this inclined light shaft is in described basic picture plane, described solid-state camera has fixing optical focus, its depth of field is extended approximately at least 2.5 inches but be no more than about 7.5 inches from described solid-state camera, with with the integrated calculation element of described plane picture acquisition equipment, this calculation element can receive the image information from described acquisition equipment at least.This described plane picture acquisition equipment is coupled in described network and arrives another device for exercisable in order to send described image information by described network.

For the person of ordinary skill of the art, by reading following description and studying a plurality of accompanying drawings, these and other embodiment disclosed herein and advantage and other features will become obvious.

Some aspects of different exemplary embodiments provide software with check, browse, share, search and editing captured notes, its related metadata, recognition result etc.This difference exemplary embodiment comprises " desktop " or the human interface software of different application form that is associated with the user.

Description of drawings

A plurality of exemplary embodiments have been described with reference to the drawings, and wherein same parts is prescribed with same reference numbers.These exemplary embodiments are intended to explanation and unrestricted the present invention.Comprise the following drawings:

Fig. 1 is the high-level diagram that note capture device 2 and different other devices that communicate with are shown;

Fig. 2 illustrates the note capture device 2 of Fig. 1 more particularly;

Fig. 3 A to Fig. 3 B still illustrates the note capture device 2 of Fig. 1 and Fig. 2 more particularly;

Fig. 4 illustrates the camera 32 of Fig. 2 and Fig. 3 more particularly;

Fig. 5 illustrates the note capture device 2 that has for detection of again another sensor mechanism of different operation modes;

Fig. 6 illustrates the visual field of camera 32 more particularly;

Fig. 7 illustrates reproduction button 24 more particularly;

Fig. 8 illustrates the note capture device 2 that comprises in the exemplary embodiment radio communication subsystem 12;

Fig. 9 illustrates the exemplary embodiment of note capture device 2, and wherein the specially appointed zone of writing surface has certain sense according to the configuration of notes;

Figure 10 illustrates the exemplary embodiment of the note capture device 2 that comprises LCD display 60, and this LCD display 60 can be used in conjunction with acquisition procedure to help to guarantee to obtain clearly image;

Figure 11 is the block diagram at the circuit of printed circuit board (PCB) 38 realizations of Fig. 3, Fig. 5, Fig. 6 and Fig. 7;

Figure 12 is the process flow diagram that is depicted in the prize procedure of operation on the note capture device 2;

Figure 13, Figure 14 and Figure 15 illustrate the part of time shaft, and it has described some aspects of some embodiment of the operation of Figure 12 more particularly;

Figure 16 processes from the data of camera sensor in order to realize the figure of the alternate embodiment of high-rise " image time shaft " for employing " data extraction " technology is shown;

Figure 17 has described to combine with the notes of being caught by note capture device 2 process flow diagram of operation of the application software used;

Figure 18 is for having described in more detail the process flow diagram of the exemplary operation event loop operation 290 of Figure 17;

Figure 19 is for having described in more detail the process flow diagram of the exemplary process event action 298 of Figure 18;

Figure 20 is the figure that the exemplary embodiment of the graphic user interface (GUI) for application software is shown;

Figure 21 is the figure that example images and the Performance Characteristics of application software are shown;

Figure 22 is the figure that the depicted example metadata shows/edit GUI; With

Figure 23 is the figure of the exemplary embodiment of the business card scan describing to substitute.

Embodiment

Fig. 1 is the high-level diagram that note capture device 2 and different other devices that communicate with are shown.For example, in the exemplary embodiment, note capture device 2 can be communicated by letter with personal computer 4 through USB cable 6.Be further appreciated that note capture device 2 can pass through other equipment and communicate by letter with personal computer 4.In the exemplary embodiment, note capture device 2 can be by battery 8 power supplies or by powering such as other equipment that obtain power supply adaptor 10 (not shown) of electric power from for example moving upper 110 volts AC wall socket.In different exemplary embodiments, note capture device 2 use radio communication subsystem 12 with various wireless device such as personal computer 4, wireless Internet router one 4, laptop computer 16 and cell phone 17.These different devices of communicating by letter with note capture device 2 are coupled in internet 18 alternatively.The purpose of note capture device 2 provides a kind of intuitive method for catching such as the hand-written information that is included in Notepaper.Subsequently the hand-written information of catching is sent to one of various devices of communicating by letter with note capture device 2, comprise personal computer 4, wireless Internet router one 4, laptop computer 16 or cell phone 17.In some exemplary embodiments, the information of catching can be stored on the described device or 18 be forwarded to the different electronic installations that are connected in internet 18, such as server 20 (not shown) or other personal computers 4 etc. through the internet.

Fig. 2 illustrates the note capture device 2 of Fig. 1 more particularly.Note capture device 2 comprises that palmrest 22 (also being referred to as the holder surface), reproduction button 24, its top page or leaf are the notepad 26 of removable writing surface, functional lamp 28, camera frame 30 and camera 32.Palmrest 22 is for basically continuous, at the relative area of the palm and palmrest 22 contact positions basically less than total square area of palmrest 22.In some exemplary embodiments, although have miscellaneous part in inside, these parts are as the man-machine interface for note capture device 2 in different subsets, superset and combination.Need different sensors and electronic mechanism (not shown) that the functional of note capture device 2 is provided, and will discuss in more detail below.When using note capture device 2, the user only holds such as the writing implement of pen or pencil and at this notepad and writes.In the exemplary embodiment, by the user press reproduction button 24 or by other manually or automatically trigger mechanism be emitted in notepad 26 and submit a written statement to a higher authority and write the signal of finishing and indicate described finishing of writing.Subsequently the image on the top note of notepad 26 is sent to external device (ED) through USB cable 6, radio communication subsystem 12 or by other equipment.Should be noted that the image that sends this moment was hunted down before pressing reproduction button 24.In other words, reproduction button 24 press that this image of indication should be sent out and can be as the prompting that maybe can be not used as indication camera 32 and should start and obtain image.Camera 32 can start with start-up mode with continuous mode or with the click with reproduction button 24 combinations.In addition, reference marker 23 large volume descriptions the elongation basic assembly.

In certain embodiments, notepad 26 can be such type: wherein every one-page maintains another page or leaf by soft, reusable binder compound.

In an embodiment as non-limiting example, the plane picture acquisition equipment comprises the solid-state camera that limits basic holder surface as the plane and limit the optical axis that favours described basic picture plane.This solid state camera also has from this solid state camera and extends approximately at least 2.5 inches but be no more than about 7.5 inches depth of field.Generally speaking, the depth of field is located substantially on the distance of focus for lip-deep image when checking from photographic means.Still generally speaking, when assembling view as acquisition equipment the time calibration depth of field to fixing scope.

Fig. 3 illustrates again the note capture device 2 of Fig. 1 and Fig. 2 more particularly.Notepad 26 is placed on the notepad rest 34 and writing surface for the user is provided.Provide reproduction button 24 to allow user's indication to finish notes.Copy button microswitch 36 under reproduction button 24 is converted to electric signal finishing in order to the indication notes in order to the action with reproduction button 24.In one embodiment, copy button microswitch 36 is installed on the printed circuit board (PCB) 38.In an exemplary embodiment, palmrest 22 contacts with palmrest microswitch 40 on being installed in printed circuit board (PCB) 38.Processor 42 is installed on the printed circuit board (PCB) 38 and provides computing power to realize the various functions of note capture device 2.Camera 32 is installed on the structural support elements 30 and through camera cable 44 and is electrically connected to printed circuit board (PCB) 38.This structural support elements 30 be can limit and frame or display are.In a unrestriced exemplary embodiment, provide page removal detector 46 to help to detect removing of notes.This detection can also be realized by analyzing the imaging that is obtained by camera 32 by inactive component.In the different embodiment of note capture device 2, can make very large change to quantity and the type of sensor.In one exemplary embodiment, page removal detector 46 is loaded by elasticity, so it has kept the physical contact constant with the top note of notepad 26.When page removal detector 46 detects the action that indication notes remove, produce electric signal and also be sent on the printed circuit board (PCB) 38.This signal and use together all to help to determine from the unlike signal of the different sensors that comprises palmrest microswitch 40, copy button microswitch 36, page removal detector 46 and by the imaging that camera 32 obtains when notes are finished and should be hunted down.When catching when notes, the signal that will comprise the image of notes sends to the external device (ED) such as personal computer 4, wireless Internet router one 4, laptop computer 16 or cell phone 17.The transmission of image can occur by different way, comprises that the equipment of this physical connection for example is connected to the USB cable 6 of printed circuit board (PCB) 38 through USB connector 48 through the radio communication of radio communication subsystem 12 (not shown) or the equipment by physical connection.USB cable 6 is a kind of in many possible physical connections.Substitute comprises Ethernet cable etc.

Fig. 2 and other accompanying drawings have also been described the basic picture plane 27 that comprises basically smooth surface.Should note substantially can and need not as continuously for the various shapes except the cardinal principle square shape of notepad 26 as plane 27.In addition, as shown in Fig. 3 B, Z-axis 29 is limited by basic picture plane 27.As used herein, limit " the vertical depth of field " for being arranged essentially parallel to the depth of field of Z-axis 29, the image that is detected by camera 32 in this depth of field can fully be resolved with used by system, for example, image has enough focusing and/or resolution for the identification of system and/or other purposes.

Fig. 4 illustrates the camera 32 of Fig. 2 and Fig. 3 more particularly.In one exemplary embodiment, camera 32 comprises camera printed circuit board 50, camera assembly 52 and LED 54.Camera assembly 52 comprises lens and camera sensor mechanism, this camera sensor mechanism can send to miscellaneous part by camera cable 44 with a series of images that obtains from camera sensor, particularly is installed in the processor 42 on the printed circuit board (PCB) 38.LED 54 provides light, so that under different illumination conditions, illuminates note capture device 2, more specifically, illuminates the writing surface of notepad 26.The structure of the camera 32 shown in Fig. 4 only is an exemplary embodiment and should explains in unrestriced mode.

Fig. 5 illustrates the note capture device 2 that has for detection of again another sensor mechanism of different operation modes.Especially, in this embodiment, notepad rest 34 will produce electric signal for pressure-sensitive in order to apply pressure to notepad 26, and this electric signal is sent to processor 42 through printed circuit board (PCB) 38, and activity is write in indication.Also comprise proximity transducer 54, in order to provide the indication physics of selling to be present in signal on the notepad 26.This proximity transducer 54 is sent to processor 42 with electric signal through printed circuit board (PCB) 38 similarly.As discussing the preceding, palmrest 22 is pressure-sensitive, in order to the signal of writing operation is provided to processor 42.With the output of different sensors described herein and the image information combination that obtains from camera 32, this image has the visual field that the writing surface that is provided by notepad 26 is provided.Because camera 32 is not just above notepad 26, the visual field that should note camera 32 is for tilting.The height of structural support elements 30 only needs enough high so that enough visuals field of notepad 26 to be provided, in order to the view data that obtains can be modified to the suitable images of notes.

Fig. 6 illustrates the visual field of camera 32 more particularly.As shown in exemplary, unrestriced embodiment herein, the central authorities of the writing surface of camera 32 aiming notepads 26.Part closer to the notepad 26 of palmrest 22 is occurring than distant location, and therefore uses lower resolution than the image section about notepad 26 central authorities in final image.Similarly, use higher resolution close to the image section of camera than the image section of the central authorities that are associated with notepad 26 in the image.

Fig. 7 illustrates reproduction button 24 more particularly.In the exemplary embodiment, in the surface of reproduction button 24, provide recess, so that pen, pencil or other writing implements can be in order to press this button like a cork, and not from reproduction button 24 landings, this reproduction button 24 contacts with copy button microswitch 36 direct physical on being installed in printed circuit board (PCB) 38.

Fig. 8 illustrates the note capture device 2 that comprises in the exemplary embodiment radio communication subsystem 12.Arrange radio communication subsystem 12 parts as antenna, this antenna can with inside or the outside of the note capture device 2 that is installed in the circuit combination on printed circuit board (PCB) 38 (not shown).Different communication protocol can be used in conjunction with radio communication subsystem 12.Agreements such as bluetooth, WLAN (wireless local area network) (LAN) agreement, cellular telephony protocol is that those of ordinary skill in the art is known.The different embodiment that substitute comprise IR etc.In addition, also provide the mechanism that is used for receiving gps signal.This GPS mechanism can be used for determining the position of note capture device 2 and therefore this positional information and image information are stored together as with the related metadata of image.This can help the back to attempt to locate the user of particular note.In the situation that need not to require great effort, the user is easy to remember by the light of nature their whereabouts, when they write notes and to the guestimate on date.Should be noted that in the claim scope note capture device disclosed herein can great changes have taken place dimensionally to adapt to greater or lesser technology application disclosed herein.

Fig. 9 illustrates the exemplary embodiment of note capture device 2, and wherein the specially appointed zone of writing surface has certain sense according to the configuration of notes.In this example, provide

specific region

56 and 58 when writing implements such as pen, pencil of user's use is pressed this zone, to carry out the function that the user limits.Should note can be by the imaging that obtained by camera 32 graphical analysis or by in specific region 56 with provide for 58 times such as the various sensors of microswitch and carry out pen down to the detection in specific region 56 or 58.Except these embodiment, can adopt various other detection technologies such as light beam that is blocked etc.

Specific region

56 and 58 layout are possible for exemplary and many other structures only.The semanteme that exists with ...

specific region

56 and 58 be user-programmable and can comprise several functions, send the electronic letter of the notes of catching for example for specific, predetermined user, these notes are posted to the atlas on the webpage that is located in server 20 (not shown) for example, send fax etc. for predetermined fax number.

Figure 10 illustrates the exemplary embodiment of the note capture device 2 that comprises LCD display 60, and this LCD display 60 can be used in conjunction with acquisition procedure to help to guarantee to obtain clearly image.LCD display 60 is in order to provide feedback so that the user can see the notes that will catch when pressing reproduction button 24 to the user.LCD display 60 also also can comprise touch screen capability in addition as the man-machine interface for note capture device 2, in order to use pen or finger to interact to realize the operation of note capture device 2 and the distribution of any notes of catching from different soft keys.In this exemplary embodiment, structural support elements 30 is broadened to hold LCD display 60, and camera 32 is installed on the top of this structural support elements of widening 30.In this embodiment, the part of radio communication subsystem 12 is accommodated in the structural support elements 30, as in other embodiments.In some embodiments, structural support elements 30 can also comprise by element 30 support can projected image the luminophor element.In another embodiment, can carry out image in this note capture device 2 processes.

With reference to figure 3, Fig. 5, Fig. 6 and Fig. 7, Figure 11 is the block diagram at the circuit of printed circuit board (PCB) 38 realizations of Fig. 3, Fig. 5, Fig. 6 and Fig. 7.The various parts of printed circuit board (PCB) 38 are bus 62, processor 42, volatile storage 64, Nonvolatile memory devices 66, ROM (read-only memory) 68, Camiera input/output (I/O) 70 and other I/O 72.In the structure of Figure 11, can also comprise number storage.Other I/O 72 can comprise operationally in order to will be sent to from the data of number storage and other storeies and memory storage the communication port of external device (ED) or network.This communication port can be for wired or wireless.Notes are caught, user interface and the various functions of communicating by letter to provide as the computing machine that embeds in note capture device 2 with these various electronic units of printed circuit board (PCB) 38.Processor 42 is coupled to bus 62 and primary computational capability for the various functions of note capture device 2 is provided.Be combined with to provide interim storage for the various processing that in processor 42, realize with processor 42 with volatile storage 64.Nonvolatile memory devices 66 can comprise the various storage subsystems such as flash memory or hard disk.Alternate embodiment comprises various removable mediums, such as CD-ROM, flash card etc.In other words, be appreciated that and adopt the known various non-volatile memories subsystems of those of ordinary skill in the art to increase Nonvolatile memory devices 66 or to substitute it.In some unrestriced exemplary embodiments, one or more notes of being caught by note capture device 2 can be stored in the Nonvolatile memory devices 66, and be uploaded to subsequently the various devices that connect.Provide ROM (read-only memory) 68 to comprise the OS level instruction that starts for the treatment of device 42, and be provided for the various built-in functions of processor 42, this built-in function be included in operation on the note capture device 2 the execution user interface, catch and the in whole or in part program of communicating by letter.Notice that ROM (read-only memory) 68 can be for programmable.In one exemplary embodiment, camera I/O70 can comprise the electronic unit that the camera that for example provides is provided in cell phone.Various alternate embodiments can comprise the ability of this LED 54 being controlled according to the light output of the LED 54 in camera, or start and close the ability of LED 54.Other embodiment can comprise changing the servo-drive system of angle of camera so that its camera can be such as taking room or other environment to carry out security function etc.Therefore, use camera I/O 70 not only to obtain imagings also in order to the different aspect of the operation of controlling camera 32 from camera 32.Zoom and focusing and image resolution ratio etc. are controlled potentially by camera I/O 70.Other I/O 72 provide to the various sensors that are associated with note capture device 2 and the I/O of microswitch.In addition, other I/O 72 can provide to for example keyboard or fixed-point apparatus (pointing device) or such as the I/O of the output unit of LCD display 60.Other exemplary embodiments provide the I/O that is associated with LCD display 60 in its touch screen embodiment.Other I/O 72 can also be in order to the various LED of control such as functional lamp 28, and it is in order to running status, communications status and the trapped state of display case such as note capture device 2.Other I/O 72 can in order to microphone or GPS mechanism interface.Similarly, the exemplary embodiment of other I/O 72 provides communicating by letter through radio communication subsystem 12, USB connector 48 and other communication patterns.

In one embodiment, process by the inverse taper image of carrying out, helping the image that obtains such as the storer of ROM 68.

Figure 12 is for being depicted on the note capture device 2, and more specifically, on the different parts of printed circuit board (PCB) 38, and the process flow diagram of operation prize procedure on processor 42 and the associated storer particularly.This is a kind of example of operational mode, and provides by way of example and non-limiting.The code that is used for operation Figure 12 can be realized in ROM (read-only memory) 68 or Nonvolatile memory devices 66, or can download from following external source in some instances, for example personal computer 4, laptop computer 16 or various other devices that can communicate by letter with note capture device 2, the server on cell phone or the internet 18 for example, for example server 20.This operates in and begins in the operation 74 and proceed to operate 76, is operating in 76 program initialization.This moment, various needs were used for monitoring the impact damper of the imaging that obtains from camera 32 and the various sensors of note capture device 2 carry out initialization.At this some place, control goes to operation 78, reads various inputs in this operation 78.In certain embodiments, on ongoing basis, obtain imaging from camera 32, and in other embodiments, until asked especially by present procedure, just obtain data from camera 32.If obtain imaging on ongoing basis, it can be in order to help the frame of the definite imaging that should catch.In one embodiment, when record, only obtain imaging and need not which frame that other sensor inputs come the definite imaging that should catch.At this some place, operation 80 determines whether catch image.This is by for example checking such as by the in addition various sensors inputs of the signal that obtains of other various sensors of copy button microswitch 36, and is finished by the imaging that camera 32 obtains.At one cheaply among the embodiment, except Camiera input, without any need for sensor, can analyze this Camiera input to determine to catch the time of image.Should catch if determine image in operation 80, then control goes to operation 82, catches single image in operation 82.The mode of catching can be to obtain single image from camera 32 or from the frame buffer of storing before.In the one situation, the image that will catch sends to external device (ED) such as personal computer 4, laptop computer 16, cell phone or server 20 by one of the aforementioned means of communicating by letter with note capture device 2.Wireless Internet router one 4 can also be in order to the various devices on internet 18 of contact such as server 20, in order to catch image.When complete operation 82, control is passed to operation 84, this operation 84 has determined whether to finish the operation of Figure 12.If in operation 80, determine also to be less than the time of catching image, similarly control is passed to operation 84, this operation 84 has determined whether to finish the operation of Figure 12.If determine to have finished the operation of Figure 12 in operation 84, then control is passed to its operation 86 that finishes operation.Should be noted that in note capture device 2 operation of carrying out Figure 12 alternative be to send simply telemetry intelligence (TELINT) such as image and sensor input to the external device (ED) such as personal computer 4, and in described external device (ED), carry out subsequently the operation of Figure 12.Further may be by 2 beaming back message and control the different hardware element from this external device (ED) to note capture device.In other words, distinct program described herein can be realized at different device.In one exemplary embodiment, note capture device can realize in having cell phone built-in or having camera, or with have cell phone built-in or having camera and be combined to realize.

Figure 13, Figure 14 and Figure 15 illustrate the part of time shaft, and it has described some aspects of some embodiment of the operation of Figure 12 more particularly.Although in some exemplary embodiments, determine whether to catch and press the reproduction button 24 simply as detecting the user, other exemplary embodiment comprises monitors as described in Figure 12 different sensors.Figure 13 represents 4 moment and the input of various sensor in the time, and some information that obtain from those inputs.The first frame of time shaft represents blank image.At this moment, palm rest sensor, proximity transducer and page remove sensor all do not detect any situation.Because this image is the first image and does not have comparable object, images match is for negative.Similarly, image corresponds to negative.Image blank is for just, and this is because detect easily image for blank; Do not have ink to exist and user's hand and pen not in the visual field.Pen down sensor is also indicated current any activity of writing that do not exist.Frame 2 indication blank image are as just now in frame 1.Also do not have User Activity, and all be negative such as palmrest, various sensors approaching and that the page removes therefore.Yet because this image is identical with before image, images match and image correspondence just are.Image blank is for just, and the image of indication frame 2 be blank, and starts to write as bearing, and indicating user is not write at notepad 26 at present.In frame 3, the user has begun to write such as the writing implement of pen or pencil in notepad 26 uses.Such as writing implement self, the completed written portion in frame 3 is visible.Start the palm rest sensor that is associated with palmrest 22, the pressure that indication palmrest microswitch 40 has detected on palmrest 22.Proximity transducer 54 has detected such as the approaching of the object of hand or writing implement, and the indication that therefore should approach is also for just.Page remove sensor does not detect removing of the page.Because the frame 3 of present image does not mate the previous image in the frame 2, so images match is defined as bearing, such as Image blank, similarly, image corresponds to negative.Because some occurring writes, so image no longer is blank.Starting to write just is designated as, and the pressure of stylus has started pen down sensor.Now, in the frame 4 of time shaft, when continuing to carry out, the user occurred more writing when this writes operation.The palm rest sensor that is associated with palmrest 22 and palmrest microswitch 40 is for just, and the palm of indicating user touches on the palmrest 22.Similarly, proximity transducer 54 detects the existence of user's hand or writing implement.Page remove sensor does not detect removing of the page.Images match and image correspond to negative, indicate this image to be different from image before.Image blank indicates this image for blank for negative, this be because its write and the part of writing implement in the visual field.Starting to write just is designated as, and indication is exerted pressure to notepad 26, and therefore is applied to notepad rest 34, and notepad rest 34 comprises pressure transducer in this embodiment.

Now go to Figure 14, frame 5 illustrates and comprises any part that some notes of writing do not comprise writing implement or user's hand.This palmrest is designated as negative, indicates the current pressure that is not applied to palmrest 22, and therefore palmrest microswitch 40 for mourning in silence.Although proximity transducer illustrates user's hand and do not contact with notepad, it enough continues to detect it close to notepad 26 to cause proximity transducer.Page remove sensor 46 is for negative, and indicating user is not also attempted will taking down notes from notepad 26 removing.Images match is for negative, indicates the image of this image before being not similar in given tolerance limit.Be used in specific tolerance limit the relatively meticulous variation of image and the method for differentiating enough similar images that mates take indication as those of ordinary skill in the art known.The image correspondence is designated as negative, indicates this image not correspond to any image before.Image blank is designated as negative, and this is because this image is not blank and has some to write thereon.Starting to write, it is negative to be designated as, and indicates the current pressure that is not applied on the notepad 26, and does not therefore detect pressure on notepad rest 34, and notepad rest 34 comprises pressure transducer in this embodiment.Frame 6 illustrates the image of substantially the same image in before.Notice that because the intrinsic flaw of photon in the variation of lighting condition and the collection camera sensor, that for example realizes in the camera 32 is the sort of, has some meticulous variations.Approaching just being designated as in frame 6, the hand of indicating user are near note capture device 2, and the while palmrest is designated as negative, the current palm rest sensor 22 that do not touch of hand of indicating him, and therefore palmrest microswitch 40 does not detect pressure.In this example, the page remove be designated as negative.Images match is being for just, its indicate this image enough close to before image to be designated as coupling.Image just corresponds to, and all parts of writing in the image 5 before indication is present in all are present in the image 6.If the ink that adds in image 6 as seen, the image correspondence is still for just.Therefore, the difference between images match and the image correspondence is images match to can't stand of ink of the interpolation in image afterwards and image can be tolerated the ink of the interpolation of reply in image afterwards.Image blank is for negative in this example, and indicating image is not blank and comprises some and write.Starting to write, it is negative to be designated as, and indicates current any pressure that is applied to notepad 26 that do not exist, and therefore in this exemplary embodiment, does not have any pressure that is applied to the notepad rest 34 that comprises pressure transducer.

Frame 7 writing of adding is shown and in this image writing implement part is as seen again.This palmrest just is designated as, and the palm of indicating user is applying pressure to palm rest sensor 22 at present, and therefore starts palmrest microswitch 40.Proximity transducer 54 detects the existence close to user's hand of note capture device 2.Page remove sensor 46 is for mourning in silence, and indicating user does not attempt to remove the page.Image match indicator is for negative in this example, and this is because writing of having added and writing implement is current is the visible fact in image, but writing implement is invisible in image before.Similarly, image corresponds to negative, and this is because writing implement is current in image.Image blank is for negative in this example, and this is because writing implement is write current all on image with some.Starting to write just is designated as, and the current employing writing implement of indicating user is applied to notepad 26 with pressure, and therefore in this exemplary embodiment, pressure is applied to the notepad rest 34 that comprises pressure transducer.Frame 8 illustrates writing of adding when writing implement is removed from image.Palmrest is designated as negative because the current pressure that is not applied to palmrest 22, and therefore palmrest microswitch 40 for mourning in silence.Similarly, proximity transducer 54 does not detect the existence of user's hand.Page remove sensor 46 is for mourning in silence, thus the page remove be designated as negative.Images match is for negative in this example, and this is not have in present image because have writing implement in image before.Image just corresponds in this example, and this is because this image comprises all inks of existence in frame 5 and the frame 6 and the ink of some interpolations.Because this image comprises some inks, so that Image blank is designated as is negative.In this example, start to write as negative the current notepad 26 that do not apply pressure to of indicating user.

Figure 15 has described frame 9, wherein frame 8 finish be written as visible and do not have writing implement.Palmrest is designated as negative, and the hand of indicating user does not apply pressure to palmrest 22, and therefore palmrest microswitch 40 for mourning in silence.Approaching just being designated as, the hand of indicating user are near note capture device 2, as indicated by proximity transducer 54.The page remove sensor indicating user is not attempted to remove notes from notepad 26, and therefore the page remove be designated as negative.Images match just is designated as, and indicates the image of this image before mating in tolerance limit.The image correspondence is being also for just, and the image of indication frame 9 is corresponding to the image of frame 5, frame 6 and frame 8 before.Image blank is designated as negative, and this is because image 9 comprises some inks really.Starting to write, it is negative to be designated as, and indicating user is current not to be write at notepad 26, and does not therefore cause to the pressure of notepad rest 34.Frame 10 illustrates follows the thumb of writing the user to be present in the image.Palmrest just is designated as, and indication active user's hand is applying pressure to palmrest 22, and therefore starts palmrest microswitch 40.Approaching just being designated as, the brothers of indicating user are enough to sense user's hand close to proximity transducer 54 to cause proximity transducer 54.The page remove be designated as negative, this be because the user not yet attempt to remove notes from notepad 26.Because user's thumb enters this frame, images match is for negative, and similar map looks like to correspond to negative, and this is because not corresponding to the image before this width of cloth image.Image blank is for negative, and this is because this frame comprises a part of writing with user's thumb.Start to write as negative, this is because the current pressure that is not applied to notepad 26.Frame 11 illustrates the user from notepad 26 notes of tearing.Palmrest is designated as negative, indicates the current pressure that is not applied to palmrest 22.Proximity transducer 54 detects the existence of user's hand, and therefore should approaching just be designated as.Page remove sensor is for just, and indicating user is current removes notes from notepad 26.It is very important that the page removes the existence of indication, because its indicating user has been finished any operation in notes.In this frame, images match is designated as negative, because as seen and user's thumb for tearing notes in this image.Similarly, the image correspondence is designated as negative.Because as seen the edge of user's hand and notes is, Image blank is for negative.Start to write as negative, indicate the current pressure that is not applied to notepad 26.Frame 12 comprises blank image.Palmrest is designated as negative, and current its hand that do not use of indicating user is exerted pressure to palmrest 22.Approach be designated as negative, the 54 current existence that do not detect user's hand of indication proximity transducer.Page remove sensor is for negative, and indicating user is current not to remove notes.Images match is designated as negative, indicate this image do not match from photographed since page or leaf removes any before image.Similarly, image corresponds to negative, and this is because do not had image before since the last page or leaf removes.Image blank indicates this image for blank for just.Start to write as negative, indicate the current pressure that is not applied to notepad 26.

With reference to Figure 12, Figure 13, Figure 14 and Figure 15, the operation of Figure 12 can be adopted different embodiment, wherein some is described as an example herein.Should explain these examples in unrestriced mode.For example, from 1 to 12 of Figure 13, Figure 14 and Figure 15 different frame can be the example of in time considering, the wherein various inputs of operation 78 samplings of Figure 12.Subsequently should various input-buffers in order in operation 80, analyze them and in operation 82, process further.By for example just indicating to trigger the operation 80 of determining to catch image for page remove sensor.It must be emphasized that to only have a kind of mode of determining to capture time.Other exemplary embodiments comprise pressing the detection of catching press-button 24, and in replacement scheme, embodiment does not require sensor or the button except imaging itself.Also can adopt the various combination of different sensors, button and imaging.When capture time had been determined in the operation 80 of Figure 12, control went to the operation 82 of Figure 12, and this operation will be caught image and for example be exported to external device (ED) as personal computer 4, laptop computer 16, cell phone 17 or server 20.Alternatively, with the image buffer storage of catching in the non-volatile memories medium such as flash memory, subsequently it is uploaded to external device (ED) or by using removable medium physics to be written into external device (ED).Should be appreciated that, operation 82 carries out image of Figure 12 capture external device (ED) or Nonvolatile memory devices, but the nearest image that the image of catching not necessarily photographed by camera 32, but nearest stabilized image.In certain embodiments, requiring image is the existence of stablizing and do not detect such as the various sensors of starting to write writing implement.This has for example prevented from the accident of the image of a part stable and that comprise again writing implement or other foreign bodies that are not moved is caught.In certain embodiments, nearest stabilized image within a period of time corresponding to before various images.In the embodiment that substitutes, the nearest image that obtains from camera was only photographed in the operation 82 of Figure 12.When the user for example knocked reproduction button 24, this catching was suitable.In certain embodiments, adopt encryption to protect note data and related metadata.In one embodiment, can adopt asymmetrical encryption algorithm to come enciphered data in order to only have when it is processed by the service of authorizing or other recipients with corresponding suitable individual cryptographic key, these data just can be used.The method has easily manufactured advantage, and this is to need not to customize each device because the public key key can be built in each note capture device.This is convenient to the controlled service in center with the distribution of Control the content, and this is because data are impenetrable when in transmission, until its arrival server or other can use the private key key with the device of its deciphering.In certain embodiments, the public key key can be updated periodically to note capture device.Other encryption technologies can allow each note capture device to use unique cryptographic key.It is also understood that the employing symmetric encipherment algorithm.In certain embodiments, encrypt not acceptor center control, but allow each user to produce or obtain to be used for protecting based on the individual the needed cryptographic key of safety of its notes.For example the user can have a plurality of cryptographic key, and selects to carry out encryption and decryption manually or automatically from these cryptographic key.

Figure 16 processes from the data of camera sensor in order to realize the figure of the alternate embodiment of high-rise " image time shaft " for employing " data extraction " technology is shown, and can use this high level " image time shaft " to determine to catch which (a bit) width of cloth figure in conjunction with the process of Figure 12 by high-level software.Known such as those of ordinary skill in the art, data are extracted " view " relate to the conversion that the produces data set image stream of camera (for example from).Follow-up conversion can be produced as higher level " view ", and each higher level " view " adopts lower level " view " so that the functional of lower level to be provided.

Be appreciated that in certain embodiments, think in the situation of newer part vacating space image stream cycle consumption page buffer zone abandoning older unwanted part.

Although many for the person of ordinary skill of the art combinations are significantly, the example of such data abstraction techniques has been shown among Figure 16.At the lowermost layer place, the original image that image sequence 200 expressions obtain from sensor.In certain embodiments, this image seems to favour the observer, and this is can change camera angle because of the juxtaposition according to camera and writing surface.The image sequence 220 of conversion provides the image sequence of the conversion of carrying out Geometric corrections, in order to can check that image sequence 200 is as the image of a series of perpendicular line.The image of the identical perpendicular line that is provided by the image sequence 220 of changing for example can be provided the image sequence 240 that filters, but has removed any image that comprises the material that will abandon.Great changes have taken place according to application-specific as the standard of the image that comprises the material of not expecting to be used for classification.In some unrestriced exemplary embodiments, those images that comprise except background color and ink color will be classified as comprising the imaging of not expecting.Determining of ink color can be to obtaining the stable pixel of non-background color.Other are possible such as the method that detects and get rid of the image that comprises the colour of skin, as many about the method for identification mobile object etc.These embodiment provide by way of example, and should not explain in the mode of restriction.In this example, image time shaft 260 provides the view that can pass through the image sequence of time index access filtering.This is many in may examples one.When finding blank image, can adopt the image time shaft to select for example image of nearest stable non-blank-white.In this unrestriced exemplary embodiment, can select subsequently the image of this nearest stable non-blank-white as the image that will catch.

Figure 17 is the process flow diagram of having described the operation of the application software used of combining with the notes of being caught by note capture device 2.Should be appreciated that this application software can realize with multi-form, comprises that for example personal computer, cell phone, server, laptop and note capture device 2 are own on different device.

This operation distributes and the initialization buffer zone in operation 282 from operating 280 beginnings and proceeding to operation 282, and will represent application, user interface element and comprise the object-instantiated of the database of the notes of catching etc.Subsequently in operation 284, for the notes Query Database that will show.Carry out the geometric layout of notes in the preparation operation 286 that is used for its demonstration.In operation 288, show notes to the user subsequently.Subsequently event loop operation 290 enter event circle with process about User Activity and with the event of other operational communications, described operation is the operation of Figure 12 for example.When finishing event circle 290, in operation 292, finish operation.

Figure 18 is the process flow diagram of the exemplary operation of the event loop operation 290 of having described in more detail Figure 17.This operates in beginning in the operation 294, and lasts till this operation 296 determines whether there is available event in event queue in the operation 296.This decision operation is illustrated as with good conditionsily herein, but the operation that also can be used as drives interrupts realizes, the operation of this drives interrupts stop current thread execution until event can use.Being permitted diverse implementation is obvious for the person of ordinary skill of the art.If determine that event is available, then process event action 298 and process this event.In case this event is processed, then control is gone to decision operation 300.If it is available determining not have event in operation 296, then control is gone to decision operation 300.Operation 300 determines whether to finish event loop operation 290.Whether for example, it can check and whether start power operation, or started to use by the customer incident of processing before and withdraw from operation.If in operation 300, determine to finish event loop operation 290, then control is gone to the operation 302 that finishes operation.On the other hand, if decision operation 300 is determined not finish event loop operation 290, then control is gone to the operation 296 that continues this operation.

Figure 19 is for having described in more detail the process flow diagram of the processing event action 298 of exemplary Figure 18.This operates in beginning in the operation 304, and lasts till that event is obtained in this operation 306 in the operation 306 from event queue.

Whether in decision operation 308, making about event is determining of mouse event subsequently.If determining this event is mouse event, control goes to operation 310, and this operation 310 is processed this mouse event by this mouse event of further assignment to its object instance of current designated reception.This finishes to the GUI object that occupies these coordinates by the coordinate of definite this mouse event and by assigning it basically.This assignment is obvious for the person of ordinary skill of the art.In processing this event, this object can revise instance variable, buffer zone etc. and to the signal of other objects with execution about processing the different task of this event.When complete operation 310, control goes to operation 324, its end operation 298.On the other hand, if determine that in operation 308 event is not mouse event, then goes to control operation 312.

Whether in decision operation 312, making about event is determining of communication event subsequently.If determining this event is communication event, control goes to operation 314, and this operation 314 designated is processed this communication event with the object instance that receives it by this communication event of further assignment to current.This is usually by checking this communication event, and it is assigned and carries out addressing and finish being included in information in event or the related communication buffer based on the type of communication.This assignment is known for the person of ordinary skill of the art.The example of a communication event is to receive the notes of having been caught by note capture device.In order to process such event, in Nonvolatile memory devices, receive and compile this notes, and subsequently in one exemplary embodiment, the performing database update.Alternatively, as a kind of mode of these notes of location in the database of many notes, adopt identification software from the notes image, to obtain text in order to search for later on the text.

In processing communication event, object can be revised instance variable, buffer zone etc. and send signals to other objects to carry out about processing the various subtasks of this event.In addition, the processing of communication event often comprises initialization or communicates by letter with the execution thread that exists, particularly for time-consuming task, for example handwriting recognition.When complete operation 314, control goes to the operation 324 of end operation 298.On the other hand, if determine that in operation 312 event is not communication event, then goes to control operation 316.

Whether in decision operation 316, making about event is determining of cipher key event subsequently.If determining this event is cipher key event, control goes to operation 318, and this operation 318 designated is processed this cipher key event with the object instance that receives it by this cipher key event of further assignment to current.By which determining the GUI object is current that having " focus " finishes, this focus is one and often is associated with recently by the indication of the object of " click " basically for this.This assignment is known for the person of ordinary skill of the art.In this event of processing, object can be revised instance variable, buffer zone etc. and send signals to other objects to carry out about processing the various tasks of this event.When complete operation 318, control goes to the operation 324 of end operation 298.On the other hand, if determine that in operation 316 event is not cipher key event, then goes to control operation 320.

Whether in decision operation 320, making about event is determining of other events subsequently.If determining this event is other events, control goes to operation 322, and this operation 322 designated is processed this other events with the object instance that receives it by these other events of further assignment to current.For example, this event comprises a medium is inserted into the peripheral unit that comprises the notes that will fetch.Various for the person of ordinary skill of the art combinations will be obvious.In this event of processing, object can be revised instance variable, buffer zone etc. and send signals to other objects to carry out about processing the various tasks of this event.When complete operation 322, control goes to the operation 324 of end operation 298.On the other hand, if determine that in operation 322 event is not another event, then goes to control operation 324.

Some unrestriced exemplary embodiments provide note capture device, this note capture device comprises writing surface, is mounted to check the camera of writing surface, and in order to the electronic circuit of the image of catching described surface, or various alternative surface, comprise for example business card surface.Be appreciated that various image transitions, for example this image transitions can be revised the camera angle about the inclination on surface.Also be appreciated that to strengthen image, or add other conversions of mark, sign etc.Can also be with other information associations in view data, such as when being proposed by the specific user in order to digital signature of verification msg etc.

Figure 20 is the figure that illustrates for the exemplary embodiment GUI of application software.Although may be permitted diverse embodiment, some exemplary embodiments provide the scroll list of the thumbnail image that obtains from comprise the database that is associated with the notes that this application software catches.With mouse move on to notes upper or knock notes will for example " selection " it, and so its represent to the user significantly, and will provide further reciprocation, comprise checking and editing of metadata.The different menu function can be used for providing feature, such as sending these notes to another user or online monograph, search notes, the notes that the classification such as time-based, catch position shows.

Figure 22 is the figure that example images and the performance characteristic of application software are shown.This view has provided detailed mutual with particular note, for example checks and editing meta-data, comprises in certain embodiments handwriting recognition results.Be appreciated that and edit in this mode that will to obtain thus suitable database mutual, include but not limited to query manipulation, update, deletion action and renewal operation.In alternate embodiment, use hierarchical file system to replace database.

In some exemplary embodiments and combination, image storage inside, the electronics of catching sent to external device (ED) such as personal computer, cell phone, server etc.Communication pattern between note capture device and external device (ED) can comprise the cable of direct or indirect these devices of coupling or the wireless connections of these devices that directly or indirectly are coupled.Can further understand, this communication can occur by adopting removable medium.Other universal methods that data are transferred to another from a device also are understandable.

In certain embodiments, be sent to the purpose of different destinations for the notes that will catch, provide screen to allow user and note capture device mutual and guide different communication modes, as an example, such different agreement includes but not limited to SMTP, FTP, SFTP, HTTP, HTTPS, by the file sharing protocol that the commercial obtainable operating system of difference provides, described operating system comprises Windows such as those, Mac OS, Linux etc.

Under different operational modes, can adopt handwriting recognition software to produce in whole or in part the text of the notes that expression catches.The text that identifies like this can produce simultaneously with the image information that is associated with notes or substitute described image information and be used.

Figure 23 has described the exemplary embodiment that substitutes, and wherein can catch business card 400.When manually digging fixture 402 by the user, in software, view is done suitable adjustment.This fixture 402 comprises the electrical switch that is coupled to printed circuit board (PCB) 38, and this printed circuit board (PCB) 38 produces the electrical signal that the processor 42 by final this optional acquisition mode of startup can detect.In this pattern, catch this card and process this related image according to the view of revising.

Some aspects of different exemplary embodiments provide software with check, browse, share, search and editing captured notes, its related metadata, recognition result etc.This difference exemplary embodiment comprises " desktop " or the human interface software of different application form that is associated with the user.Further, be appreciated that this application software can originally realize in the different replacement device that comprise personal computer, server, cell phone, laptop computer, PDA or note capture device with it.

Although use specific term with unit describe different embodiment, such description is the purpose of property presented for purpose of illustration only.Employed statement only is the nonrestrictive statement of description.Be appreciated that those of ordinary skill in the art can make any modifications and variations, and do not break away from the spirit or scope of the present invention that in following claim, proposes.In addition, should be appreciated that, the aspect of various other embodiment can be exchanged in whole or in part.Therefore, be intended to explain this claim according to true spirit of the present invention and scope, and unrestricted or forbid.

Claims

1. plane picture acquisition equipment, this device comprises:

The matrix component of the elongation of supporting writing surface;

Have the frame than end portion and higher end, wherein said be attached to described matrix component than end portion;

In the solid-state camera of close described higher end by described supporting, described solid-state camera has the visual field that covers writing surface and limits fixing optical axis, and this inclined light shaft is in described writing surface and towards described writing surface;

Trigger mechanism, be used to indicate on described writing surface write finish;

Display screen;

The digital processing apparatus is coupled to described trigger mechanism, described display screen and described solid-state camera, and described digital processing apparatus receives image information and is configured to that described image information is carried out the inverse taper image from described solid-state camera and processes; And

Be coupled to the wired communication interface of described digital processing apparatus and at least one in the wireless communication interface.

2. plane picture acquisition equipment according to claim 1, wherein said solid-state camera has the depth of field between 2.5 inches to 7.5 inches.

3. plane picture acquisition equipment according to claim 1, the part of the matrix component of wherein said elongation form the holder surface, and described writing surface engages removedly with described holder surface.

4. plane picture acquisition equipment according to claim 3, wherein said holder surface is basically smooth.

5. plane picture acquisition equipment according to claim 4, wherein said holder surface is basically continuous.

6. plane picture acquisition equipment according to claim 5, wherein said holder surface is pressure-sensitive.

7. plane picture acquisition equipment according to claim 3, wherein said matrix component comprise near the palmrest of first end and near the described holder surface of the second end.

8. plane picture acquisition equipment according to claim 7, wherein said matrix component also is furnished with proximity transducer.

9. plane picture acquisition equipment according to claim 7, wherein said matrix component also is furnished with the page remove sensor near described the second end.

10. plane picture acquisition equipment according to claim 7, wherein said matrix component also is furnished with catching press-button.

11. plane picture acquisition equipment according to claim 1 also comprises by the light-emitting component close to described support of described photographic means.

12. plane picture acquisition equipment according to claim 7 comprises that also at least one is configured in order to detect the palm rest sensor of the pressure on described palmrest.

13. plane picture acquisition equipment according to claim 3, wherein said removable writing surface are the top page or leaf with the writing pad of described holder surface engagement.

14. plane picture acquisition equipment according to claim 13, wherein said writing pad are to comprise type soft, reusable binder compound.

15. plane picture acquisition equipment according to claim 1 also comprises being configured in order to store at least provisionally the number storage from least part of view data of described photographic means.

16. plane picture acquisition equipment according to claim 1 also comprises being configured to keep business card close to the business card retainer of described photographic means.

17. a method that is used for providing image information, the method comprises:

Solid-state camera is arranged on the fixing frame so that this distance is substantially as at least 2.5 inches on plane but be no more than 7.5 inches, and not with respect to this substantially as planar movement, the inclined light shaft of described solid-state camera is in basic picture plane;

Adopt described solid-state camera to catch view data;

Store described view data in number storage,

Described view data is carried out the inverse taper image to be processed; And

The described data of being processed by the inverse taper image are sent to personal computer.

18. the method be used to image information is provided according to claim 17, wherein said processing occurs in this solid-state camera.

19. the method be used to image information is provided according to claim 17, wherein said processing comprise in converted image sequence and the filtering image sequence at least one.

20. a device that is used for providing image information comprises:

Be used for solid-state camera is arranged on device on the fixing frame so that this distance is substantially as at least 2.5 inches on plane but be no more than 7.5 inches, and not with respect to this substantially as planar movement, the inclined light shaft of described solid-state camera is in basic picture plane;

Be used for adopting described solid-state camera to catch the device of view data;

Be used for storing described view data at the device of number storage,

Be used for described view data is carried out the device that the inverse taper image is processed; And

Be used for the described data of being processed by the inverse taper image are sent to the device of personal computer.

21. equipment according to claim 20 also comprises causing that operationally one or more processors process described view data to create the logic of image information.

22. equipment according to claim 21, the described view data of wherein said processing comprises at least one in converted image sequence and the filtering image sequence.

23. an image capture and transmitting system, this system comprises:

Network; And

Plane picture acquisition equipment as claimed in claim 1;

Wherein said plane picture acquisition equipment is coupled in described network and sends described image information to other devices by described network when operation.

24. image capture according to claim 23 and transmitting system, wherein said solid-state camera has fixing focus, and its depth of field is extended at least 2.5 inches but be no more than 7.5 inches from described solid-state camera.

25. image capture according to claim 23 and transmitting system, wherein said calculation element are coupled in described plane picture acquisition equipment.

26. image capture according to claim 25 and transmitting system, wherein said calculation element are coupled in described network and send described image information to described remote-control device by described network when operations.

27. image capture according to claim 23 and transmitting system, wherein said network are the internet.