TW201349042A - Electronic device and operation method based on graphical input - Google Patents

Abstract

An electronic device and an operation method based on a graphical input are provided. The method includes selecting an input field within an operating screen according to a selecting signal generated by a touch interface of the electronic device. The method also includes determining whether the touch interface detects a graphical input within a predetermined time period. If yes, the method further includes executing a function related to the input field in accordance with the graphical input. Consequently, the user may call a demanded function by drawing on the touch interface, the convenience of performing an operation on the input field is improved.

Description

Electronic device and operation method based on graphic input

The present invention relates to an operation method of an electronic device, and more particularly to a method for performing a corresponding operation based on a graphic input and an electronic device using the same.

Traditional computer system input devices include a mouse and a keyboard. The user can move the cursor to determine the location of the data input by operating the mouse, or scroll the screen to view different content. In addition, the user can input text, symbols, and various commands through the keyboard to interact with the electronic device. For example, in the operating environment of the Windows operating system, the user can use the mouse to drag and select operations, and directly input the keyboard when needed.

However, with the evolution of technology, portable electronic devices that are easy to carry are increasingly valued by modern people. In general, in order to reduce the size for portability, the portable electronic device is combined with a touch operation interface to allow the user to interact with the device. In other words, in an environment that does not support the traditional mouse and keyboard, the user's behavior of operating the electronic device must also be changed.

Further, when the user needs to input data in a portable electronic device such as a smart phone or a tablet, since the device does not have an input tool such as a physical keyboard or a mouse, the user needs to perform an additional multi-program search input. Edited picture. Since the user cannot easily and quickly edit or select materials, it is easy to feel inconvenient in operation.

In view of this, the present invention provides an operation method and an electronic device based on graphic input, so that a user can conveniently edit and select data in a touch operation environment.

The invention provides an electronic device with a touch interface, which comprises selecting an input field displayed in an operation screen of the electronic device according to the selected signal generated by the touch interface. Determine whether the touch interface detects the graphic input within the preset time. If so, the function related to the input field is executed according to the graphic input.

In an embodiment of the invention, the step of performing a function associated with the input field based on the graphical input includes identifying an appearance feature of the graphical input and displaying a virtual input element associated with the appearance feature.

In an embodiment of the invention, the step of displaying the virtual input element associated with the appearance feature includes displaying a Software Input Panel (SIP) or a text handwriting input recognition area when the appearance feature of the graphic input conforms to a rectangle.

In an embodiment of the invention, the step of displaying the virtual input element associated with the appearance feature includes displaying the virtual mouse when the appearance of the graphical input conforms to the shape of the mouse.

In an embodiment of the invention, the step of displaying the virtual input element associated with the appearance feature includes displaying the pattern hand-drawn input recognition area when the appearance characteristic of the graphic input conforms to the curve.

In an embodiment of the invention, the step of performing a function associated with the input field based on the graphical input includes identifying an appearance characteristic of the graphical input, And editing the input field according to the appearance characteristics.

In an embodiment of the invention, the step of performing an editing operation on the input field according to the appearance feature includes canceling the data input to the input field when the appearance characteristic of the graphic input is at least one oblique line conforming to the preset number.

In an embodiment of the invention, the selected signal is generated by a touch gesture applied to the input field through the touch interface.

In an embodiment of the invention, wherein the touch gesture comprises a tap, a double tap, or a long tap.

From another point of view, the present invention provides an electronic device including a display interface, a touch interface, and a processing unit. The display interface is used to display an operation screen. The touch interface is coupled to the display interface for generating a selection signal. The processing unit is coupled to the display interface and the touch interface. The processing unit selects an input field displayed in the operation screen according to the selected signal, and determines whether the touch interface detects the graphic input within a preset time. If so, the processing unit performs functions related to the input field based on the graphical input.

Based on the above, after the user selects an input field in the operation screen through the touch interface, the user calls the corresponding function according to the graphic that the user then draws on the touch interface. In this way, even if the electronic device only supports the touch operation environment, the user can edit or select the operation screen more intuitively and conveniently.

The above described features and advantages of the present invention will be more apparent from the following description.

1 is a block diagram of an electronic device in accordance with an embodiment of the present invention. Referring to FIG. 1 , the electronic device 100 includes a display interface 110 , a touch interface 120 , and a processing unit 130 . In this embodiment, the electronic device 100 may be a smart phone, a personal digital assistant, or a tablet computer, but the invention is not limited thereto.

The display interface 110 is used to display various operation screens of the electronic device 100. For example, the operation screen is, for example, a home screen or a user interface of various applications installed in the electronic device 100.

The touch interface 120 is configured to receive a touch operation of the user and generate a corresponding signal. The touch interface 120 is, for example, a resistive touch panel, a capacitive touch panel, an acoustic wave touch panel, an infrared touch panel, or an electromagnetic induction touch panel, and is not limited herein. The touch interface 120 and the display interface 110 are coupled to each other, and the operation area of the touch interface 120 and the display area of the display interface 110 correspond to each other. In this embodiment, the touch interface 120 and the display interface 110 are the same module to form the touch screen 140, and are used as the input and output interfaces of the electronic device 100 at the same time. In another embodiment, the touch interface 120 and the display interface 110 can also be two independent but coupled modules.

The processing unit 130 is coupled to the display interface 110 and the touch interface 120. The processing unit 130 can be a central processing unit, a keyboard controller, a micro-controller, or a control chipset. The invention is not limited thereto. The processing unit 130 is configured to control the display interface of the display interface 110 and perform functions according to the signals generated by the touch interface 120. Further, the processing unit 130 The graphic input-based operation method according to the embodiment is further used according to the graphic call related function drawn by the user on the touch interface 120.

In order to further explain the operation of the electronic device 100, the present invention will be described below in conjunction with another embodiment. 2 is a flow chart of a method for operating based on a graphic input according to an embodiment of the present invention. Please refer to FIG. 1 and FIG. 2 at the same time.

First, as shown in step S210, the display interface 110 displays an operation screen of the electronic device 100. The operation screen is, for example, a web browsing window of a browser application, an email editing screen of an email application, a chat room screen of an instant messaging application, or a schedule editing screen of a calendar application, etc., but the present invention is not limited to Above.

Then, in step S220, the processing unit 130 selects an input field in the operation screen according to the selection signal generated by the touch interface 120. In this embodiment, the selection signal is generated by a touch gesture applied to the input field through the touch interface 120. The touch gesture can be various gestures such as tap, double tap, or long tap. Taking the double-clicking as an example, when the user clicks twice in a specific position on the touch interface 120, and the specific position corresponds to the display position of an input field on the display interface 110, the touch interface 120 generates an input. The selection signal for the field.

The processing unit 130 may also highlight the input field after the input field is selected to prompt the user. Next, as shown in step S230, the processing unit 130 repeatedly determines whether the touch interface 120 detects a graphic input within a preset time. The graphic input is a hand-drawn input pattern for the user, and its appearance is not limited here. The preset time is, for example, 1 second, but the invention is not limited. herein.

If the touch interface 120 detects the graphic input within the preset time, the processing unit 130 performs a function related to the input field according to the graphic input, as shown in step S240. For example, the storage unit (not shown) of the electronic device 100 has a correspondence table, and records the correspondence between various graphic inputs and functions. After identifying the type of the graphic input, the processing unit 130 can obtain the corresponding correspondence table. Related functions that should be performed.

In an embodiment, the processing unit 130 first recognizes the appearance characteristics of the graphic input, such as analyzing the starting point of the graphic input and the track of the touched drag to confirm the type of the graphic input. The virtual input component related to the appearance feature is then displayed on the display interface 110 by looking up the correspondence table according to the type of the graphic input. For example, processing unit 130 selects the virtual input element displayed on display interface 110 to have an appearance that approximates the graphical input. Alternatively, the virtual input element selected by the processing unit 130 to be displayed is an operation action that the user will make a trajectory similar to the graphic input when the user operates. After the virtual input component is displayed, the user can input data to the currently selected input field through the virtual input component.

In another embodiment, after recognizing the appearance feature of the graphic input, the processing unit 130 directly operates the operation screen according to the appearance feature. For example, various editing actions are performed on the input field currently selected, data in the input field is selected, or the operation screen is moved up and down to allow the user to browse and the like.

In addition, the processing unit 130 may also call the corresponding system command according to the appearance feature of the graphic input to control the electronic device 100 to perform the corresponding work. can. The invention does not limit the type of function.

3A to 3H are schematic diagrams showing a method of operating based on a graphic input according to an embodiment of the invention. 3A to 3C, how to call the electronic device 100 to perform a corresponding function based on the graphical input drawn by the user will be described. In the following embodiments, it is assumed that the display interface 110 of the electronic device 100 and the touch interface 120 are the same module to form the touch screen 140, and the touch screen 140 currently displays the schedule editing screen of the calendar application.

First, as shown in FIG. 3A, when the user double-clicks the specific input field 320 in the schedule editing screen 300 with the finger 31, the touch screen 140 generates a corresponding selection signal, and the processing unit 130 selects the specific input field 320 accordingly. And the specific input field 320 is highlighted to facilitate user viewing.

Next, as shown in FIG. 3B, the touch screen 140 detects the graphic input 330 drawn by the user on the touch screen 140 with the finger 31 within a preset time. After analyzing the appearance feature of the graphic input 330, the processing unit 130 determines that the appearance feature of the graphic input 330 matches the rectangle. Therefore, as shown in FIG. 3C, the processing unit 130 displays a software input panel (SIP) 340 on the touch screen. 140. In the present embodiment, the display position of the software keyboard 340 is close to the lower edge 3e of the touch screen 140. However, the present invention does not limit the display position of the software keyboard 340. In another embodiment, the software keyboard 340 is rendered translucent to facilitate viewing by the user of the portion of the calendar edit screen 300 that overlaps the software keyboard 340. In yet another embodiment, the processing unit 130 displays a text handwriting input recognition area in place of the software keyboard 340 shown in FIG. 3C.

In the above embodiment, when the processing unit 130 determines that the appearance feature of the graphic input 330 drawn by the user matches the rectangle, the software keyboard 340 or the text handwriting input recognition area is displayed to allow the user to input characters, numbers or symbols to the user. A specific input field 320.

In the embodiment shown in FIG. 3D, the touch screen 140 detects the graphic input 350 drawn by the user on the touch screen 140 with the finger 31 within a preset time, and the processing unit 130 analyzes the graphic input 350. After the appearance feature, it is determined that the appearance feature of the graphic input 350 conforms to the mouse shape, and then, as shown in FIG. 3E, the processing unit 130 displays the virtual mouse 360 on the touch screen 140. In the present embodiment, the virtual mouse 360 includes at least three operation areas 360_a, 360_b, and 360_c. The user can control the up and down position of the virtual mouse 360 with the index finger in the operation area 360_a, and control the left and right positions of the virtual mouse 360 with the thumb. The operation areas 360_b and 360_c respectively correspond to the left and right keys of the traditional mouse, respectively. When the user makes a click gesture, for example, in the operation area 360_b or 360_c, the processing unit 130 controls the electronic device 100 to execute the corresponding left mouse button or Right click operation.

In the embodiment shown in FIG. 3F, if the touch screen 140 detects that the user draws the graphic input 370 on the touch screen 140 with the finger 31 within a preset time, the processing unit 130 analyzes the appearance of the graphic input 370. After the feature is judged to be in accordance with the curve, the processing unit 130 displays the pattern hand-drawn input recognition area 380 on the touch screen 140 as shown in FIG. 3G. Thereafter, the user can click on the drawing tool in the toolbar 380_a to arbitrarily input the hand-drawn pattern in the pattern hand-drawn input recognition area 380.

In other embodiments, when the processing unit 130 performs an editing operation on the input field according to the appearance feature of the graphic input, if the processing unit 130 determines that the appearance feature of the graphic input is a predetermined number of oblique lines, the processing unit 130 cancels The data that has been entered into the input field. For example, as shown in FIG. 3H, assuming that the preset number is 3, if the touch screen 140 detects that the user draws the graphic input 390 on the touch screen 140 with the finger 31 within the preset time, the processing unit 130 will not store the data that has been input to the input field 320. In other embodiments, if the processing unit 130 determines that the appearance feature of the graphic input conforms to the tick line, the data that has been input into the input field 320 is stored.

In summary, the electronic device of the present invention and the operation method based on the graphic input are used after the user selects the input field through the touch interface, and further calls according to the graphic input hand-drawn by the user on the touch interface. Corresponding function. According to this, the user can directly call out the corresponding virtual input component by performing a simple graphic, or perform data editing or selection operations. Providing the user with an intuitive call function by means of supporting graphic input can not only increase the convenience during operation, but also make it easier for the user to edit on the operation screen when the screen display area of the electronic device is limited. Select and other operations.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the invention, and any one of ordinary skill in the art can make some modifications and refinements without departing from the spirit and scope of the invention. The scope of the invention is defined by the scope of the appended claims.

100‧‧‧Electronic devices

110‧‧‧Display interface

120‧‧‧Touch interface

130‧‧‧Processing unit

140‧‧‧ touch screen

S210~S240‧‧‧ steps of a graphical input-based operation method according to an embodiment of the present invention

300‧‧‧Schedule editing screen

31‧‧‧ fingers

320‧‧‧Specified input fields

330, 350, 370, 390‧‧‧ graphic input

340‧‧‧Soft keyboard

360‧‧‧Virtual Mouse

360_a, 360_b, 360_c‧‧‧ operating area

380‧‧‧pattern hand-drawn input identification area

380_a‧‧‧Tools

1 is a block diagram of an electronic device in accordance with an embodiment of the present invention.

2 is a flow chart of a method for operating based on graphics input according to an embodiment of the invention.

3A to 3H are schematic diagrams showing a method of operating based on a graphic input according to an embodiment of the invention.

S210~S240‧‧‧ steps of a graphical input-based operation method according to an embodiment of the present invention

Claims (10)

An operation method based on a graphic input for an electronic device having a touch interface, the method comprising: selecting an input field displayed in an operation screen of the electronic device according to a selected signal generated by the touch interface Determining whether the touch interface detects a graphic input within a preset time; and if so, performing a function related to the input field according to the graphic input. The method according to claim 1, wherein the step of performing the function related to the input field according to the graphic input comprises: identifying an appearance feature of the graphic input; and displaying and displaying the appearance A virtual input element associated with the feature. The method according to claim 2, wherein the step of displaying the virtual input element associated with the appearance feature comprises: displaying a software keyboard when the appearance feature of the graphic input conforms to a rectangle ( Software Input Panel (SIP) or a text handwriting input recognition area. The method according to claim 2, wherein the step of displaying the virtual input element associated with the appearance feature comprises: displaying the appearance feature of the graphic input in accordance with a mouse shape, Virtual mouse. The method according to claim 2, wherein the step of displaying the virtual input element associated with the appearance feature comprises: displaying a pattern of hand-drawn input when the appearance feature of the graphic input conforms to a curve Identify the area. The method according to claim 1, wherein the step of performing the function related to the input field according to the graphic input comprises: identifying an appearance feature of the graphic input; and according to the appearance feature Perform an edit operation on the input field. The method according to claim 6, wherein the step of performing the editing operation on the input field according to the appearance feature comprises: when the appearance characteristic of the graphic input is in accordance with a preset number When at least one slash is used, the data that has been input to the input field is canceled. The method of operating a graphics input method according to claim 1, wherein the selection signal is generated by a touch gesture applied to the input field through the touch interface. The method according to claim 8, wherein the touch gesture comprises a tap, a double tap or a long tap. An electronic device comprising: a display interface to display an operation screen; a touch interface coupled to the display interface to generate a selection signal; and a processing unit coupled to the display interface and the touch interface, wherein the processing unit selects one displayed in the operation screen according to the selected signal The field is input, and it is determined whether the touch interface detects a graphic input within a preset time. If yes, the processing unit performs a function related to the input field according to the graphic input.