Classifications

• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
  • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
  • G06F1/16—Constructional details or arrangements
  • G06F1/1613—Constructional details or arrangements for portable computers
  • G06F1/1615—Constructional details or arrangements for portable computers with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function
  • G06F1/1616—Constructional details or arrangements for portable computers with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
  • G06F1/16—Constructional details or arrangements
  • G06F1/1613—Constructional details or arrangements for portable computers
  • G06F1/1615—Constructional details or arrangements for portable computers with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function
  • G06F1/1624—Constructional details or arrangements for portable computers with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function with sliding enclosures, e.g. sliding keyboard or display
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
  • G06F1/16—Constructional details or arrangements
  • G06F1/1613—Constructional details or arrangements for portable computers
  • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
  • G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
  • G06F1/1643—Details related to the display arrangement, including those related to the mounting of the display in the housing the display being associated to a digitizer, e.g. laptops that can be used as penpads
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
  • G06F1/16—Constructional details or arrangements
  • G06F1/1613—Constructional details or arrangements for portable computers
  • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
  • G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
  • G06F1/1647—Details related to the display arrangement, including those related to the mounting of the display in the housing including at least an additional display
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
  • G06F1/16—Constructional details or arrangements
  • G06F1/1613—Constructional details or arrangements for portable computers
  • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
  • G06F1/1662—Details related to the integrated keyboard
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
  • G06F1/16—Constructional details or arrangements
  • G06F1/1613—Constructional details or arrangements for portable computers
  • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
  • G06F1/1662—Details related to the integrated keyboard
  • G06F1/1669—Detachable keyboards
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
  • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
  • G06F3/039—Accessories therefor, e.g. mouse pads
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
  • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

• the present invention generally relates to improve the input function of the current computer keyboard, which is used for PC, laptop and tablet.
• the existing keyboard people use key or combined keys to input character by character.
• a touch screen is added to the new keyboard so people can use handwriting as the input.
• the touch screen can support digital pen or finger or both as the input tool.
• An optional fingerprint sensor also could be added to the keyboard for security application, e.g., user log in.
• the touch screen can work in three modes.
• the touch screen catches what is written on the screen. This function is similar to writing a paper note or drawing a graph.
• the touch screen is used as soft keyboard that can translate handwriting character to formal character. This function is very useful for non-English language.
• the touch screen is implemented by software as an onscreen keyboard.
• the keyboard When the keyboard has a touch screen for input, the contents of the document can be displayed on the regular screen. In this case, a small size touch screen is good enough, but the user needs the mouse to locate the position of the input and choose font kind of input from the software application. For drawing, erasing or highlighting kind of paper work, it is more convenient to write or draw directly on the file displayed on the touch screen. In this case, a large size touch screen is needed. It works as a tablet and is very efficient for heavy handwriting work.
• touch screen technology is developed to a stage that can catch the handwriting input very accurately.
• New technology is developed to translate handwriting character to formal character. Those new technology help people to input contents to the computer with handwriting instead of key only.
• Fingerprint provides more secure and convenient way than signature or regular password for security application.
• the new keyboard can make a PC / laptop as a PC / laptop and tablet simultaneously with improved input methodology.
• User can pre-build and save contents like fingerprint or icons, which are used in the document with high frequency. Then he can output the built-in contents very efficiently with a couple of buttons pressing.
• the object of the present invention is to combine the advantage of key and touch screen input together.
• a virtual digital pen, eraser and content select rectangle implemented by software are the primary tools for input and editing on the touch screen.
• An optional fingerprint provides more secure and convenient way for security application.
• the software application to support the new keyboard needs to be an image file. User can input content to any location of the software user interface. Any point of cursor with a mouse click will be the start point of the new input, whether the input is from the hardware key or handwrite or draw. The last known cursor point will map to the coordinator origin on the touch screen.
• a small size touch screen can work in three modes.
• the contents of the document are displayed on the regular display screen.
• the user needs to use mouse to choose location, color, line thickness, font type, etc., from the software application.
• the user can use the regular hardware keys or onscreen softkeys for input.
• the touch screen catches what is written on the screen. It is named note or N-Mode.
• N-Mode To make it easy controlling all activities of writing, erasing, etc., a soft digital pen with a pen icon is implemented by software. The user needs to use a digital pen or a finger to press at said pen icon before writing. The touch screen will catch the touch press at each point and interpret the continuous movement of the digital pen or finger between two points as a line or curve until the touch press is released. User can write or draw something in the area already displaying some contents, it will overwrite the data for each point touched.
• the touch screen driver will free the memory, if not shared with the software application, and clear the display on touch screen (4) if the user presses the clear button, click the mouse on the software application, or the current active program displayed on the regular screen (9) or (10) is switched to another software application.
• Each continuous line or curve will be split to a set of point with the coordinator (x, y).
• the input will be transformed to a set of data with coordinator (x, y) for a single point and / or continuous points for a straight line or a curve.
• the data could be stored with xml or html or other similar format with tags, e.g., point and line. This function is similar to writing a paper note or drawing a graph.
• This function is similar to writing a paper note or drawing a graph.
• the data for points or lines are coordinator (x, y) relative to an origin point that is the intersection of the line at left and top in the user interface that has icons for a digital pen and an eraser.
• the touch screen driver will send the transformed data to one or separate message queue accessed by the software application and touch screen driver for display.
• the display on the touch screen should appear before the display in the software application.
• the contents input from the touch screen are displayed on the software application, starting from the flashing cursor that maps to the coordinator origin on the touch screen.
• the first mode if user writes something wrongly, he can erase part of what is displayed on the touch screen.
• a soft eraser is implemented with a small size of square.
• the user presses the eraser icon with a digital pen or finger.
• the erasing area is the square size of the eraser with the touch pressing point as the center of the square, either a single touch press or continuous touch movement.
• the erased contents will be displayed as empty space without points being touched.
• the data of erasing size and location will be sent to the message queue.
• the touch screen driver for display will clear the display for erased area and update the data.
• the software application will clear the same display size of area touched by the eraser with the cursor coordinator mapping to the coordinator origin on the touch screen, and update the data.
• a soft contents selection tool with a rectangle icon is implemented with an adjustable rectangle.
• a user can choose rectangle area of contents for editing, using a digital pen or a finger, after pressing the rectangle icon, drawing a diagnose line of the rectangle.
• the size of the rectangle is decided by the starting point as top left and releasing point as bottom right.
• the four sides of the rectangle are displayed after the touch pressing press is released. If the user wants to edit the contents currently displayed on the touch screen, he can choose the editing area then drag the display location by a digital pen or a finger, or adjust the display size by finger pinch. If the user wants to edit the contents already entered, he should press a soft edit button first. Then a new interface, with icons of a pen, eraser and rectangle, are displayed on the touch screen.
• the user needs a mouse click at the software user interface first, then pressing at the rectangle icon then drawing a diagnose line on the touch screen, a rectangle size on the touch screen is decided by the starting and ending pressing point as the top left and bottom right.
• the editing area has the same size of said rectangle and the location is decided with the cursor on the regular screen mapping to the coordinator origin on the touch screen.
• Four sides of the rectangle for editing area are displayed on the software application and the touch screen.
• the software application will send the selected contents to the touch screen driver for display, and the contents of selected area are also displayed on the touch screen.
• the display location can be adjusted on touch screen by dragging with a digital pen or a finger, or with more accuracy by location adjust keys of soft up key, down key, left key and right key for selected contents.
• the display size can be adjusted by finger pinch, or with more accuracy by soft up arrow and down arrow to increase or decrease the scale ratio.
• the user interface is shown in 9, but not limited to fig. 9.
• the user also can input some new contents after pressing the pen icon, or erase some contents after pressing the eraser icon then moving the eraser with the digital pen or finger. If the selected contents are moved to a new location, it will overwrite the original contents displayed in this area.
• the touch screen driver will send the transformed data to the software application, which will update the data and display, and send the updated data to the touch screen driver for display. It would be more efficient that the software application shares the memory with the touch screen driver for display, for the selected contents.
• the touch screen driver will switch back to the previous user interface.
• the touch screen can convert what is handwritten or drawn to formal text. It is named convert or C-Mode.
• the touch screen drive software will instantly interpret the touch press or movement to the target object, e.g., a list of Chinese character or word, which is displayed on the touch screen immediately. The user chooses the correct object by touching that object.
• the data will be stored as Unicode. This function is very useful for non-English language.
• the touch screen can provide pre-built contents or onscreen keyboards with proper user interface. User also can build contents, e.g., fingerprint or icons under third mode. It is named build-in mode or B-Mode. .7
• the contents from the touch screen could be a single character, one line or multiple lines of character, a curve or a graph, etc.
• touch screen driver for display will free the temporary storage, or update the memory address if it shares the data with the software application.
• Said edit, clear and finish button could be implemented as software or hardware button, preferring software.
• the software button is used. For drawing, erasing or highlighting with different color kind of paper work, it is more convenient to display the software application on the touch screen directly so the user can use the digital pen or finger for writing, drawing, locating the position, choosing color, line thickness, font type, etc. In this case, a large size touch screen is needed to display the contents of the software application.
• the large size touch screen can work in three modes: PC / laptop mode, tablet mode and PC / tablet simultaneous mode.
• the operating system should provide the APIs for software application to use the interfaces for touch screen as onscreen touch screen and build the function of pen, eraser, edit area selection rectangle., etc., on the software application and its user interface. .1
• the large size touch screen works with a PC / laptop that supports the new keyboard as a PC / laptop.
• PC / laptop mode the software application is opened on the regular screen.
• the software application can call the system API to get the onscreen touch screen with the same functionality and user interfaces of the small size touch screen, but the user interfaces for the onscreen touch screen displayed on the large size touch screen could have a larger user interface than the touch screen of small size has. .2
• the large size touch screen works with a PC / laptop that supports said new keyboard as a tablet. In this mode, all file icons displayed on the regular screen will also be displayed on the touch screen. Pressing the file icon on said touch screen will lunch the software application that is displayed on the touch screen.
• a user can write or draw or edit on the software application directly on the touch screen with said icons of pen, eraser, rectangle, etc., which is implemented and displayed on the user interface of the software application.
• the software application can also use the onscreen touch screen provided by the system with the same functionality of the small size touch screen. Under tablet mode, user can also use the hardware keyboard, onscreen keyboard and mouse as input. .3 When two different software applications are lunched on the regular screen and touch screen with large size at the same time, the software application opened on the regular screen can use the onscreen touch screen, hardware keys and mouse as input device, and the software application opened on the tablet can use the input from hardware keys, mouse, or directly from the touch screen. .4 For the third mode, one software application is lunched on the regular screen and the same software application is lunched on touch screen with large size at the same time.
• the software application opened on the regular screen will work at said PC / laptop mode described in 6.1
• the software application opened on the touch screen will work at tablet mode described in 6.2. It provides the best user experience with input from hardware keys and mouse to the file displayed on the regular screen and handwriting input directly from touch screen to the file displayed on the touch screen.
• the operating system needs to synchronize the output and input for the software application on said two screens.
• the input data needs to be displayed on both screen before next input.
• the software application also needs to support the new input technology.
• the touch screen could be designed as a slidable part attached to the bottom of the keyboard so the user would be more comfortable to carry the keyboard and write on the screen. When the touch screen is moved out, it trigs a trigger power switch and turn on the power for the touch screen.
• the power for the screen is turned off after it trigs the trigger power switch.
• an optional fingerprint sensor can provide more secure and convenient way for security application. 10.
• it is needed to modify the input / output, GPU, operating system and software application, etc., to support the function of the new keyboard.
• Fig. 1 provides the primary vertical view from the top when the new keyboard is put on the desk.
• a small size touch screen is put at the right bottom comer of the keyboard.
• Fig. 2 provides the primary vertical view from the top when the new keyboard is put on the desk. A large size touch screen is put at the right part of the keyboard.
• Fig. 3 provides the primary vertical view from the top when the new keyboard is put on the desk.
• a slidable touch screen with large size is pulled out at the right part of the keyboard.
• Fig. 4 provides a 3-D view of a laptop with the new keyboard. A mouse and a digital pen are sitting beside the laptop.
• Fig. 5 provides a 3-D view of a PC with a regular display screen and a new keyboard.
• a mouse and a digital pen are sitting beside the new keyboard.
• the components for mouse pad and hardware keys are not changed with a separate cable connecting the hardware keys and mouse pad to the PC.
• Fig. 6 provides the mode transition between note mode, convert mode and built-in mode of the small size touch screen.
• Fig. 7 provides the initial user interface for a small size touch screen. Lines with size indicator guides the area for writing and drawing. The user can use a digital pen or a finger to write or draw inside the rectangle. Pressing the N-Mode button, the user interface will switch to the UI for convert mode or C-Mode in fig. 8. Pressing edit button can choose the editing area on the software application for editing. Pressing the clear button will clear the buffer and display on the touch screen.
• Fig. 8 provides the user interface for a small size touch screen under convert mode or C-Mode. Lines guides the rectangle area for writing or drawing. Pressing the lang button, a list of language is displayed on the touch screen. Eiser can choose one language by pressing the displayed item. Then user can handwrite on the touch screen. What is written is instantaneously displayed on the touch screen and interpreted by the driver software to a few possible formal texts, which are displayed on top of the touch screen. User can choose the correct text by pressing it or delete it using the virtual eraser. Pressing the clear button will clear the display on the touch screen. Pressing the C-Mode button will switch to B-Mode.
• Fig. 9 provides the user interface for editing contents of software application with a small size touch screen under note mode, or N-Mode.
• User can choose the editing area using a digital pen or finger to draw a diagnose line that decides the top left point and bottom right point of the rectangle.
• the location of the chosen area is based on the cursor coordinator mapping to the coordinator origin on the touch screen.
• the contents chosen area on software application are also displayed on the touch screen.
• the display size can be changed by a scale ratio that is controlled by a soft up arrow and down arrow to increase or decrease its value.
• Contents can be added or removed in the selected area using a digital pen or a finger after pressing the virtual pen or eraser icon.
• Fig. 10 provides the user interface for a small size touch screen under build-in mode or B-Mode. Pressing the sign button, a list of signatures will be displayed on the touch screen. Pressing on the object, the selected signature will be output to the software application. Pressing the finger button, a list of fingerprints will be displayed on the touch screen. Pressing on the object, selected fingerprint will be output to the software application. Pressing on the icons button, a list of pre-built icons is displayed on the touch screen. Pressing on the object, selected icon will be output to the software application. Pressing the build button will switch to interface in fig. 11, 12 or 13, depending on the item selected by the user.
• Fig. 11 provides the user interface for a small size touch screen to build signatures.
• the build button in user interface in fig. 10 After user presses the build button in user interface in fig. 10, several items are displayed on the touch screen. By choosing the signature item, touch screen displays user interface in fig. 11.
• User uses a digital pen (13) to sign on the touch screen. Then he presses the soft save button to save the signature, or pressing the soft clear button to clear the buffer and sign again.
• a list of signatures is displayed on the touch screen when soft sign button is pressed. Pressing one signature then pressing clear button will delete this saved signature. Pressing the B-Mode button, the user interface will switch back to that in fig. 10.
• Fig. 12 provides the user interface for a small size touch screen to build fingerprint.
• touch screen displays user interface in fig. 12 with remind text for user to put the right thumb on the fingerprint sensor.
• User puts his right thumb on the fingerprint sensor.
• a ready text with the fingerprint is displayed on the touch screen.
• the soft save button to save the fingerprint, or pressing the soft clear button to clear the buffer and try again.
• a list of fingerprints is displayed on the touch screen when soft finger button is pressed. Pressing one fingerprint then pressing clear button will delete this saved signature. Pressing the B-Mode button, the user interface will switch back to UI in fig. 10
• Fig. 13 provides partial user interface for a small size touch screen to build icons. After user presses the build button in user interface in fig. 10, several items are displayed on the touch screen. There should be more button for color or line thickness, etc., this invention will not go further.
• touch screen displays user interface in fig. 13.
• User uses a digital pen (13) to draw an icon on the touch screen. Then he presses the soft save button to save the icon, or pressing the soft clear button to clear the buffer and draw again.
• a list of icons is displayed on the touch screen when soft icons button is pressed. Pressing one icon then pressing clear button will delete this saved icon. Pressing the B-Mode button, the user interface will switch back to that in fig. 10.
• Hardware keys same as those on the regular hardware keyboard. Attached figures only show a few keys.
• the regular keyboard has an area with duplicated keys.
• the new keyboard prefers removing those duplicated keys when a big size touch screen is put on the right part of the keyboard.
• a touch screen with small size This screen is built at the right bottom corner of the new keyboard. This screen could be built at other part of the new keyboard.
• a new fingerprint sensor It is optional.
• a touch screen with large size This screen is built on right part of the keyboard. All file icons appeared on the regular screen are also displayed on this large size screen. Pressing the icon will lunch the software application. User can use touch screen, hardware keyboard and mouse as input for the software application opened on this large size touch screen.
• An onscreen touch screen displayed on the large size touch screen The function of this onscreen touch screen is similar to function of said small size touch screen. User can use this onscreen touch screen as input for the current active software application opened either on the regular screen or on the large size touch screen.
• a slidable touch screen with large size This touch screen is attached at the bottom of the hardware keyboard. When the touch screen is moved out, it trigs a power trigger switch and the power for the touch screen is turned on. When the touch screen is moved in, the power for the screen is turned off after it trigs a power trigger switch.
• a text box that controls the display size of selected contents on software application.
• a soft build button Pressing this button will display a list of items to be built, e.g., icons, signature, etc. Pressing the signature item will go to interface in fig. 11. Pressing the fingerprint item will go to interface in fig. 12. Pressing the icons item will go to interface in fig. 13.
• a soft sign button In the user interface in fig. 10 and 11, pressing this button will provides a list of signatures. In the user interface in fig. 10, pressing the displayed signature will output it to the software application. In the user interface in fig. 11, pressing the selected signature than pressing the clear button will delete this signature.
• a soft fingerprint button In the user interface in fig. 10 and 11, pressing this button will provide a list of fingerprints. In the user interface in fig. 10, the selected fingerprint will be output to the software application by pressing at that fingerprint. In the user interface in fig. 11, the selected fingerprint will be deleted after pressing at the displayed fingerprint then pressing clear button.
• a soft icons button In the user interface in fig. 10 and 11, pressing this button will provide a list of icons. In the user interface in fig. 10, the selected icon will be output to the software application by pressing at that icon. In the user interface in fig. 11, the selected icon will be deleted after pressing at the displayed icon then pressing clear button.
• a soft pen icon User can handwrite or draw on the touch screen after pressing this icon with a digital pen or a finger.
• a soft rectangle icon User can draw a rectangle by drawing a diagnose line of the rectangle on the touch screen with a digital pen or a finger after pressing at the rectangle icon in the user interface 9.
• the editing area on the software application has the same size of the rectangle on the touch screen with the cursor coordinator mapping to the coordinator origin of the touch screen.
• a coordinator origin on the touch screen It is the cross point of the left line and top line on the touch screen.
• the touch screen (4) is almost full of display, he presses the soft clear button (20) and the touch screen driver clears display on the touch screen (4).
• User A feels that the display of some contents in software application on the regular screen (8) or (12) need to be adjusted. He presses the soft edit button (22) and it switches to the user interface in fig 9. First, he presses the rectangle icon (42) on top of the touch screen with a digital pen (13).
• he draws a diagnose line that decides the size of a rectangle on the touch screen (4).
• the same size of rectangle is selected in the software application displayed on the regular screen (9) or (12).
• the location of the rectangle is based on the cursor coordinator mapping to the coordinator origin on the touch screen.
• the selected contents are also displayed on the touch screen (4).
• he can adjust the size of the display for selected contents by finger pinch or by pressing the soft up arrow (30) or down arrow (31) with more accuracy, and adjust location of the display for selected contents by dragging or by pressing the soft up key (25), down key (26), left key (27) and right key (28) with more accuracy.
• the finish button (29) After he finishes editing, he presses the finish button (29) then the user interface switches back to fig. 7 for input.
• User A wants the handwritten part with blue color, then he uses the mouse (10) moving the cursor to the color icons at the top of the note application and chooses the blue color. He starts handwriting again and the contents are displayed with blue color. Finally, he finishes the note, sign it with a signature.
• the most efficient way is to input built-in contents, e.g., fingerprint or signature.
• User C presses the N-Mode (19) button twice and it appears as B-Mode (34) at user interface in fig. 10. He presses the build button (35), a list of items appears and he selects fingerprint item. A new interface in fig. 12 appears with a text "put your thumb at top of fingerprint sensor”. After he puts the thumb at the fingerprint sensor (5) for a while, a fingerprint appears at the touch screen (4) and a text of "ready”. Pressing the save button will save the fingerprint and go back to previous user interface. Pressing the clear button will start over for fingerprint input.
• User C presses the build button (35) at user interface in fig.
• the touch screen (4) displays a new user interface in fig. 12. There is a button with text "import from file”. Pressing this button, user can import an image file. After the image is displayed on the touch screen (4), user can save it by pressing the save button. He also can draw an icon on touch screen (4) and save it by pressing the save button (39). After the icon is saved, the user interface on touch screen switches back to the previous user interface.
• IB For a large size touch screen (6) working at tablet mode, it is more efficient for drawing graph or painting or heavy handwriting work.
• User D is designing a component for a car. He has a new keyboard (1) with a slidable large size touch screen (8) attached to the bottom of the keyboard (1). First, he pulled the touch screen (8) out and the power for the touch screen (8) is turned on after it trigs a power switch. The touch screen (8) starts with all file icons displayed. He then presses the icon for the painting software with a finger on said large size touch screen (8). The painting software is started and a blank field is displayed on said slidable touch screen (8), with pen icon (40), eraser icon (41) and rectangle icon (42) on top of the user interface for the painting software.
• User D uses the hardware keys (2) to input the name of the car component.at the top of the blank field. Then he starts drawing with a digital pen (13) directly on the screen (8). He can use the digital pen (13) or the mouse (10) to choose the color or the thickness of the line at the interface of the painting software. He can remove the contents by the virtual eraser (41), or drag the selected contents by a virtual rectangle (42), on the painting software user interface directly. After he finishes the design graph, he saves the document. Then he pushed the slidable touch screen (8) into the keyboard and the power for the touch screen (8) is turned off.
• an onscreen touch screen (7) that includes the same functionality as said small size touch screen (4) has, is displayed on said touch screen (6) or (8). It is more efficient for document with lots of input for formal text input and some light handwriting and drawing work.
• User E is working for a document with Chinese character. He opens a word application by clicking the word icon (15) on the regular display screen (12). The onscreen touch screen on said touch screen (6) or (8) is popped up. He then uses hardware keys (2) to input the Chinese character using Pingyin, but he could not find some Chinese character by Pingyin. User E presses the N-Mode soft button (19) on the onscreen touchscreen (7) and it switches to convert mode or C-Mode.
• the touch screen driver sends this character as Unicode to the word application.
• Onscreen touch screen (7) displays an interface same as fig. 7 shows. Then he draws a few lines and curves on area (18). Next input are a few curves with red color.
• the curves are displayed with red color in the painting software.
• the touch screen driver sends the comments to the book software, which displays the comments with yellow color at the empty space near the last cursor point on the book interface.
• the book software displays the comments with yellow color at the empty space near the last cursor point on the book interface.
• one document is opened on the regular screen (9) or (12) and the same document is opened on touch screen (6) or (8).
• Two processes use the same data in shared memory.
• User E clicks the document interface on the regular screen (12) and starts typing text with the hardware keys (2).
• the entered contents are displayed on both the regular screen (12) and the touch screen (8).
• He needs to draw a graph on the document.
• the touch screen can be designed as a detachable part.
• the touch screen should be on the left side of the keyboard for left-handed user.
• the layout of the touch screen or fingerprint can be different from Fig.1 or Fig.2.
• the layout of the touchscreen (4) user interface can be different from Fig. 7.
• the present invention generally relates to improve the input function of the current computer keyboard, which is used for PC, laptop and tablet.
• the existing keyboard people use key or combined keys to input character by character.
• a touch screen is added to the the new keyboard so people can use handwriting as the input.
• the touch screen can support pencil or finger or both as the input tool.
• An optional fingerprint sensor also could be added to the keyboard for security application, e.g., user log in.
• the touch screen can work as two modes. For the first mode, the touch screen catches what is written on the screen. This function is similar to writing a paper notes. For the second mode, the touch screen is used as soft keyboard that can translate handwritting character to formal character. This function is very useful for non english language.
• the keyboard When the keyboard has a touch screen for input, the contents of the document can be displayed on the regular screen. In this case, a small size touch screen is good enough. For drawing, erasing or highlighting kind of paper work, it is more convenient to display the contents on the touch screen. In this case, a large size touch screen is needed.
• touch screen technology is developed to a stage that can catch the handwriting input very accurately.
• New technology is developed to translate handwritting character to formal character. Those new technology help people to input contents to the computer with handwritting instead of key only.
• Fingerprint provides more secure and convinient way than signature or regular password for security application.
• the object of the present invention is to combine the advantage of key and handwritting input together.
• An optional fingerprint provides more secure and convinient way for security application.
• the touch screen can work as two modes.
• the touch screen can work as two modes.
• the touch screen catches what is written on the screen. This function is similar to writing a paper note.
• the touch screen is used as a soft keyboard that can translate handwritting character to formal character. This function is very useful for non english language.
• this new keyboard can help people writting regular notes with a computer.
• the contents of the document can be displayed on the regular screen.
• a small size touch screen is good enough.
• an optional fingerprint sensor can provide more secure and convinient way for security application.
• Fig. 1 provides the primary vertical view from the top when the new keyboard is put on the desk. A small size touch screen is put at the right bottom corner of the keyboard.
• Fig. 2 provides the primary vertical view from the top when the new keyboard is put on the desk. A large size touch screen is put at the right part of the keyboard.
• the area with regular keys has an area with duplicated keys.
• the new keyboard prefers removing those duplicated keys when a big size touch screen is put on the right part of the keyboard.
• the user can use the fingerprint (4) to log in.
• the user can use the touch screen (3) to input the handwritting character or drawing with a pencil or finger. That function provides the user to write notes in traditional way. If the contents are displayed on the regular screen, a small size screen is good enough. For drawing, erasing or highlighting kind of paper work, it is more convenient to display the contents on the touch screen. In this case, a large touch screen is needed.
• the touch screen (3) works as a soft pad that translates handwritting character into formal character. For instance, when the user opens a word processor to write a Chinese document, the user can use the touch screen (3) to input a formal Chinese character by handwritting translation instead of Chinese Pinying. For the large touch screen, a small part of the screen can be implemented as the handwritting translator.
• the touch screen can be designed as sa liding part at the bottom of the keyboard.
• the touch screen can be designed as a detachable part.
• the touch screen should be on the left side of the keyboard for left handed user.
• the position of the touch screen or fingerprint can be different from fig.1 or fig.2.
• the present invention generally relates to improve the input function of the current computer keyboard, which is used for PC, laptop and tablet.
• the existing keyboard are made of plastic or other material. People press one key or combined keys to input character or other function.
• the new keyboard uses the touch screen as the input.
• the touch screen has two working modes.
• the touch screen is implemented as a regular keyboard. Users touch the soft key instead of press the physical key.
• the touch screen works as a tablet acreen. It displays the contents of the document. The user can use the pencil for handwritting, drawing, erasing or highlighting, etc.
• the touch screen also allows the finger as a touch controller.
• the switch between three wroking mode can be implemented as a hardware or software button.
• An optional fmgerpint sensor can be added to the touch screen for security application with more secure and convenient way.
• touch screen technology is developed to a stage that the screen can catch the handwriting input very accurately.
• New technology is developed to translate handwritting character to formal character. Those new technology help people to input contents to the computer with handwritting instead of key only.
• the software technology also can implement a virtual keybaord on a touch screen.
• Fingerprint provides more secure and convenient way than signature or regular password for security application.
• the object of the present invention is to combine the advantage of key and handwritting input together.
• a virtual keyboard is implemented on the touch screen.
• An optional fingerprint provides more secure and convenient way for security application.
• the new keyboard uses the touch screen as the
• the touch screen has two working modes. For the first mode, the touch screen is implemented as a regular keyboards. For the second mode, the touch screen works as a tablet. It displays the contents and the user can use the pencil for handwritting, drawing, erasing or highlighting, etc.
• the touch screen also allows the finger as a touch controller.
• the switch between two wroking mode can be implemented as a hardware or software button.
• the virtual keyboard will provide a better experience since the user only needs touching the soft key instead of pressing the physical key.
• an optional fingerprint sensor can provide more secure and convenient way for security application.
• Fig. 1 provides the primary vertical view from the top when the new keyboard is put on the desk.
• the touch screen that is implmented as a regular keyboard.
• the regular keyboard has a mouse pad. It is optional to implement this mouse pad.
• a new fingerprint sensor It is optional.
• the touch screen (1) works as a keyboard.
• the user can use the fingerprint (3) to log in.
• the user can touch the soft key as the input. It has a better experience than pressing the physical key. If the mouse pad is not implemented, a regular mouse can be used.
• the touch screen (1) works as a tablet screen that displays the contents of a document. Users can use a pencil for writting, drawing, erasing and highlighting, etc. Users can also use the finger as the input controller.
• the touch screen When the user presses the switch button (2), the touch screen will switch from the keyboard to a tablet screen to third mode and vice versa.
• the touch screen can be implemented as a combination of keyboard and tablet screen.
• the position of the switch button (2) or fingerprint (3) can be different from fig.l.

Landscapes

• Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• General Engineering & Computer Science (AREA)
• Physics & Mathematics (AREA)
• Computer Hardware Design (AREA)
• Human Computer Interaction (AREA)
• General Physics & Mathematics (AREA)
• Mathematical Physics (AREA)
• User Interface Of Digital Computer (AREA)
• Position Input By Displaying (AREA)
• Input From Keyboards Or The Like (AREA)

Priority Applications (1)

Applications Claiming Priority (6)

Publications (2)

Family

ID=78745745

Family Applications (1)

Country Status (2)

Family Cites Families (2)

• 2021
  • 2021-05-23 CN CN202180038726.2A patent/CN116438509A/zh active Pending
  • 2021-05-23 WO PCT/US2021/033802 patent/WO2021242651A2/en active Application Filing

Also Published As

Similar Documents

Legal Events