JP2007272708A - Portable device, and input support method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow a user to recognize input contents without confirming the input contents on a display screen. <P>SOLUTION: This portable device is provided with an input processing means 15 for detecting an input track inputted by a pointing device 6, converting the input track into position data (input track data) on X and Y coordinates, transferring and storing the position data to/in a RAM 11, operating each time X and Y coordinates inputted by the pointing device 6 are changed and converting data (gesture) inputted by the pointing device 6 into input track data by additionally using time information showing an operating time, a processing content determination processing means 16 for collating the input track data with input track data of correspondence information 161 stored beforehand in a ROM 10 or the RAM 11 to determine associated processing, and a character processing means 17 for performing processing, such as copying, clearing and cutting corresponding to the input track data on the basis of a determination result notified from the processing content determination processing means 16. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a portable device capable of executing a predetermined function by a predetermined input, an input support method, and a program.

Conventionally, as disclosed in Japanese Patent Application Laid-Open No. 2006-048722 (Patent Document 1), a cellular phone, a PHS (Personal Handyphone System), a PDA (Personal Data Assistance, Personal
Many portable terminal devices such as Digital Assistans (personal portable information communication devices) can edit characters, images, and moving images.

  For various input operations in a conventional portable terminal device, a method using a function key, a numeric keypad, or a cross key is generally used. For example, in text editing work, an editing key is pressed, and editing contents are selected and edited from a menu. The text is edited by an input operation such as range selection or pressing the enter button.

In addition, a conventional mobile terminal device such as a mobile phone can make a call by a specific operation method. Specifically, it is possible to talk by bringing the microphone of the mobile terminal device close to the ear and bringing the speaker close to the mouth.
JP 2006-048722 A

  However, the conventional portable terminal device has the following problems.

  The first problem is that it takes time in editing and the like, and the input efficiency is not good.

  The reason is that it is necessary to press a large number of keys in operations such as editing.

  The second problem is that it is inconvenient because it is necessary to interrupt the conversation and look at the display when performing key input during a call.

  The reason for this is that editing or the like needs to be performed while confirming the input contents by the key operation on the display screen, but the user cannot see the display unit during a call.

  A third problem is that it is difficult for a visually impaired user to confirm the input content by key operation.

  The reason for this is that editing needs to be performed while confirming the input contents by key operation on the display screen, but the keys to be input are composed of almost the same shape and material, so look at the display section. This is because it is difficult for a user who is unable to check what the content input by the key operation is.

(the purpose)
An object of the present invention is to solve the above-described problems and provide a portable device, an input support method, and an input input support program that can recognize input contents without a user confirming on a display screen.

  The portable device of the present invention is determined in a portable device having an executable processing function, an input means capable of detecting a movement of a predetermined position in an arbitrary direction, and a determination means for determining a trajectory shape of the moved position. And executing means for executing processing contents associated with each locus shape.

(Function)
The present invention executes the processing contents associated with each input trajectory shape by the above configuration.

  The present invention has the following effects.

  First, since the processing content associated with each input trajectory shape is executed, the processing can be executed based on the gesture of the user of the mobile device, and the operation efficiency of the mobile device is improved. .

  Secondly, since the process can be executed based on the gesture of the user of the portable device, the user can operate without checking the display screen of the portable device.

(First embodiment)
A mobile phone according to a first embodiment of the present invention will be described with reference to FIGS.

(Configuration of the first embodiment)
First, an overall configuration that specifically represents the mobile phone according to the first embodiment of the present invention will be described, and a detailed configuration of the components will be described using a block diagram.

  FIG. 1 is a perspective view showing an appearance of a mobile phone according to the first embodiment of the present invention.

  Referring to FIG. 1, a mobile phone 1 includes a speaker 2 having a function of converting a sound signal and outputting a sound, a microphone 3 having a function of converting a sound into a sound signal and inputting the sound, a text, a moving image, and a still image. A display screen 4 having a function of displaying an image, a numeric keypad 5 having a function of changing an operation mode, inputting characters, and the like, and a pointing device 6 are provided.

  The pointing device 6 has a function of moving an operation target on the display screen 4 freely in any direction in 360 degrees, and accepts an input of a gesture input by a user operation.

  Note that the pointing device 6 may be, for example, a touch panel, a touch board, a track ball, a track point, or the like.

  FIG. 2 is a block diagram showing a main part of a circuit configuration of a mobile phone which is an example of the mobile terminal device according to the present embodiment.

  Referring to FIG. 2, the mobile phone according to the present embodiment includes a transmission / reception unit 8, a ROM (Read Only Memory) 10, a RAM (Random Access Memory) 11, an input unit 12, and a display unit via a bus 9. 13 is mounted.

  The transmission / reception unit 8 includes an antenna 7 that transmits and receives radio waves for communication. The transmission / reception function transmits / receives mail and attached files using a mail function, a voice signal, image data, and the like, and image data and the like using a browser function It has a communication function to communicate.

  The ROM 10 has a function of storing various control programs to be executed by the control unit 14.

  Further, general shape determination data (not shown) used in the ROM 10 in advance for determining what shape the input locus data (described later) sent from the input processing means 15 (described later) of the control unit 14 is. Corresponding information 161 for associating a predetermined shape indicated by the input trajectory data with processing, such as a copy process for the shape of a circle, a clear process for a zigzag shape, or a cut process for a square shape, is stored. .

  FIG. 3 is a diagram showing the configuration of the correspondence information 161. Referring to FIG. 3, the correspondence information 161 is configured as follows.

(Processing type: Processing content: Shape input by user (gesture))
Copy: Specify a part of the text or image displayed on the screen and copy that part: Draw a circle Paste: Paste the copied part: Draw a mountain Clear: Displayed on the screen Specify a part of a character string or image and delete that part: Draw a zigzag Cut: Specify a part of the character string or image displayed on the screen, delete that part, and copy: Draw a square Undo: Go back to the previous stage where you perform an operation: Draw the letter U Call: Make a call: Draw the letter C Mail: Start mail: Draw the letter M
i-mode (registered trademark): Connect to the Web: Draw the alphabet W Pie menu notation: Edit from the pie menu: Press and hold the pointing device

  FIG. 4 is a diagram showing a pie menu. The pie menu 26 displays the pop-up menus shown at the tip of the cursor 27 in a sector area 28 in a circle instead of a rectangle.

  Therefore, it takes time to select a menu in order from the rectangular menu display by button operation, but when selecting a menu with the cursor 26 from the pie menu, the sector area 27 indicating each menu is the pie menu. Since they are arranged at the same distance from the center, each menu can be easily selected.

  Note that the pie menu is an example of a menu display, and may be a menu notation including a polygon instead of a circle.

  The RAM 11 has a function of a working memory that stores data temporarily required for the control unit 14 to execute the program. Further, input trajectory data (described later) sent from the input processing means 15 (described later) of the control unit 14 is also stored in a predetermined area of the RAM 11.

  The input unit 12 is an input circuit that receives key inputs from the numeric keypad 5, the pointing device 6, function keys, and the like. For example, the input unit 12 receives an input of a gesture input by a user operation.

  The display unit 13 is composed of a monochrome or color liquid crystal panel or an organic EL (electrofluorescence), and has a function of displaying text, moving images, still images, etc., so that characters input from the input unit 12 are displayed. Is also displayed.

  The control unit 14 includes an input processing unit 15, a processing content determination processing unit 16, and a character processing unit 17, and controls the operation of the mobile phone according to the present embodiment by controlling these components and each of the above components. It has a function to do.

  The input processing unit 15 has a function of sending data input by the input unit 12 to the RAM 11, the processing content determination processing unit 16, and the character processing unit 17.

  In particular, the input processing means 15 detects a gesture trajectory input by the pointing device 6 and converts it into position data (input trajectory data) on the X and Y coordinates, and processing contents determination processing means for the input trajectory data. 16 is provided.

  More specifically, the input processing means 15 detects the input trajectory input by the input unit 12 (pointing device 6), converts it into position data (input trajectory data) on the X and Y coordinates, and stores it in the RAM 11. Transfers, stores, operates every time the X and Y coordinates input by the pointing device 6 are changed, and uses the time information indicating the operating time together to input data input by the pointing device 6 The data is converted into trajectory data, and the input trajectory data is sent to the processing content determination processing means 16.

  When the processing content determination processing unit 16 receives the input trajectory data from the input processing unit 15, the received input trajectory data is associated with the processing stored in advance in the ROM 10 or the RAM 11 based on the correspondence information 161 in the ROM 10. A function for determining whether or not the input trajectory data indicates a predetermined shape, and a function for notifying the character processing means 17 of processing corresponding to the received input trajectory data as a determination result are provided.

  For example, the processing content determination processing unit 16 determines whether or not the input trajectory data received from the input processing unit 15 is input trajectory data associated with processing such as copy, paste, and cut stored in advance in the ROM 10 or the RAM 11. The character processing unit 17 is notified of processing such as copying, pasting, and cutting as a result of the determination.

  The character processing unit 17 has a function of processing the character string data to be processed based on the data received from the input processing unit 15. This process is, for example, a process in which a character input with the numeric keypad 5 or the like is added to a character string that has already been registered or input and notified to the display unit 13.

  Further, the character processing unit 17 performs processing such as copying, clearing, and cutting corresponding to the input trajectory data based on the determination result notified from the processing content determination processing unit 16.

  Note that although a mobile phone is described as an example in this embodiment, the present invention is not limited to this as long as the apparatus includes the pointing device 6, and a PDA, a small machine, a mobile machine, a notebook personal computer, or the like may be used.

  Here, the hardware configuration of the mobile phone will be described.

  FIG. 5 is a block diagram showing a hardware configuration of mobile phone 1 according to the present embodiment.

  Referring to FIG. 5, the mobile phone 1 according to the present invention can be realized by a hardware configuration similar to that of a general computer processing device, and includes a CPU (Central Processing Unit) 501 (control unit 14), a RAM (Random Access). A main memory unit 502 (RAM 11) used for a data work area and a temporary data save area, a communication control unit 503 (transmission / reception unit 8) for transmitting and receiving data via the Internet, and a liquid crystal A display unit 504 (display unit 13) such as a display and a speaker, an input unit 505 (input unit 12) such as a keyboard and a mouse, an interface unit 506 that transmits and receives data by connecting to peripheral devices, a ROM (Read Only Memory), Magnetic disk, semiconductor memo A hard disk device formed of a non-volatile memory is an auxiliary storage unit 507 etc. (ROM 10), and a system bus 508 (bus 8) for connecting the above components of the information processing apparatus to each other.

  The cellular phone 1 according to the present invention is implemented by mounting circuit components composed of hardware components such as LSI (Large Scale Integration) in which a program for realizing such functions is incorporated in the cellular phone 1. As a matter of course, it can be realized in software by executing a program for providing each function of each component described above by the CPU 501 on the computer processing apparatus.

  That is, the CPU 501 loads the program stored in the auxiliary storage unit 507 to the main storage unit 502 and executes it, and controls the operation of the mobile phone 1 to realize each function described above in software.

(Operation of the first embodiment)
Next, the operation of the mobile phone according to the first embodiment of the present invention will be described with reference to FIGS.

  Here, FIG. 6 is a flowchart showing a control procedure when a predetermined process is performed by an input from the pointing device of the mobile phone according to the first embodiment.

  A user (not shown) of the mobile phone can start an application such as mail input, telephone call, and memo pad creation, and perform an input operation using the pointing device 6 of the input unit 12.

  The input processing means 15 detects the locus of the input inputted by the pointing device 6, converts it into position data (input locus data) on the X and Y coordinates, transfers it to the RAM 11, stores it, and inputs it by the pointing device 6. Each time the X and Y coordinates are changed, the time information indicating the operating time is used together with the time information to convert the data (gesture) input by the pointing device 6 into input trajectory data (step S601). (Input processing)).

  Next, the processing content determination processing means 16 collates the input trajectory data with the input trajectory data of the correspondence information 161 stored in advance in the ROM 10 or the RAM 11, and determines the associated processing (Step S602 (Processing) Content determination processing)).

  More specifically, in step S602, the processing content determination processing unit 16 determines whether the process corresponding to the input trajectory data notified from the input processing unit 15 represents copying, clearing, or cutting. By determining, the process requested by the user operation is determined.

  The character processing unit 17 performs processing such as copying, clearing, cutting, etc. corresponding to the input trajectory data based on the determination result notified from the processing content determination processing unit 16 (step S603 (character processing)).

  FIG. 7 is a flowchart showing processing for determining the shape of an input locus when performing predetermined processing by input from a pointing device, and a control procedure when performing predetermined processing corresponding to the input locus. Step S602 (processing content determination processing) and step S603 (character processing) in FIG. 6 are described in detail.

  First, the processing content determination processing unit 16 performs pattern matching as an example of determination (shape recognition) indicating what shape the input trajectory data received from the input processing unit 15 represents, and the input received from the input processing unit 15 The X and Y coordinates of the trajectory data are collated with the X and Y coordinates of the input trajectory data stored in advance (step S701).

  More specifically, the processing content determination processing unit 16 determines (shape recognition) the shape most similar to the input trajectory data received from the input processing unit 15 as the shape input by the user in this shape recognition.

  For example, when the user operates the pointing device 6 in the shape of a circle in order to request a copy process, the input processing means 15 detects the locus input by the pointing device 6 and detects position data (X, Y coordinates) When the input trajectory data is converted to input trajectory data and sent to the processing content determination processing means 16, the processing content determination processing means 16 determines what shape the input trajectory data is in step S701, Recognize the shape of a circle.

  In step S701, the processing content determination processing unit 16 proceeds to step S702 if the collation is successful, and returns to the beginning if the collation is not possible.

  Next, the processing content determination processing unit 16 determines processing requested by the user's operation based on the input trajectory data whose shape has been recognized and the correspondence information 161 (step S702).

  In step S702, the process content determination processing unit 16 proceeds to step S703 when it can determine the process associated in advance based on the correspondence information 161, and starts when the process associated with the process cannot be determined in advance. Return to.

  Next, the processing content determination processing means 16 notifies the character processing means 17 of processing corresponding to the shape determined based on the correspondence information 161 (step S703).

  For example, when the copy information is associated with the input trajectory data indicating the shape of the circle in the correspondence information 161, the processing content determination processing unit 16 copies the requested processing when determining that the shape is a circular shape in the shape recognition. The processing is notified to the character processing means 17.

  The character processing unit 17 receives the input trajectory data (X and Y coordinate data of the gesture input by the user) in the input processing (step S601 in FIG. 6) from the input processing unit 15, and performs processing from the processing content determination processing unit 16. The processing content instruction in the content determination processing (step S602 in FIG. 6) is received, and processing corresponding to the input trajectory data and the processing content instruction is executed (step S704).

  For example, when the instruction received from the processing content determination processing unit 16 is a copy instruction, the character processing unit 17 determines the enclosed portion of the character based on the X and Y coordinates of the input trajectory data received from the input processing unit 15. Copy and save in RAM 11.

  That is, in this case, since the character processing unit 17 has received an instruction to copy and a range to be copied, the character processing unit 17 executes copying based on these.

  Next, it is determined whether or not the activated application has been terminated (step S705). If the application has ended, the process ends. If the application has not ended, the process returns to the beginning.

  Here, although the character string data is given as an example of the processing target, the processing target can be similarly processed as image data, audio data, and moving image data by associating the input trajectory data with the processing.

  Here, with reference to FIG. 8, a user operation example for the mobile terminal device 100 according to the present embodiment and an operation example of the mobile terminal device 100 according to the present embodiment corresponding to the operation will be described.

  FIG. 8 is a diagram showing a display screen 4 (display unit 13) for explaining characteristic processing in the mobile terminal device 100 according to the present embodiment.

  It is assumed that the mobile phone 1 has already been inputted with characters by the user, and therefore a certain amount of character data is stored in the RAM 11, and the character data is displayed on the display unit 13 (display screen 4).

  Displayed when the mobile phone 1 is inputted with the characters “Tomorrow is sunny” 22 by the user from the input unit 12 (Tenki 5, pointing device 6), and “Tomorrow is sunny” 22 is displayed on the display unit 13. An example of copying the character “Tomorrow” in “Tomorrow is sunny” 22 will be described.

  First, by operating the cursor 19 from the input unit 12, a gesture 20 that surrounds the character of “tomorrow” in the shape of a circle among the characters “Tomorrow is sunny” 22 displayed on the display unit 13. When input, the control unit 14 stores the input trajectory (circle shape) by the input gesture 20 in the RAM 11, and the input processing means 15 detects the input trajectory (circle shape) from the RAM 11 and inputs it. After converting to locus data, the processing content determination processing means 16 analyzes what shape the input locus data indicates, and corresponds to a predetermined shape (circle shape) indicated by the input locus data based on the correspondence information 161. The attached process (copy) is determined.

  Here, the operation of the cursor 19 performed from the input unit 12 is preferably performed by the pointing device 6. In the gesture input, it is preferable to input the gesture by a circle shape or zigzag shape that can be traced on the pointing device 6 with a single stroke. However, with a normal cross key, a curve shape such as a circle or zigzag This is because the shape and the like cannot be input quickly.

  The character processing unit 17 performs processing corresponding to the gesture 20 input from the input unit 12 based on the processing instruction determined by the processing content determination unit 16.

  In the correspondence information 161 according to the present embodiment, the process corresponding to the gesture that encloses the character in a circle shape is a copy. Therefore, the character “tomorrow” surrounded by the circle shape by the gesture 20 is copied.

  Note that the display unit 13 according to the present embodiment displays an icon 21 indicating the type of processing corresponding to the gesture input by the user. Thus, the user can easily visually confirm what kind of processing the input gesture is.

  Next, when an input for specifying a predetermined position on the display unit 13 is made and a gesture 23 corresponding to the paste process is input, an icon 25 indicating the paste process is displayed on the display unit 13, and the specified predetermined The character “Tomorrow” 24 is pasted at the position.

  When copying the characters displayed on the display screen by the operation of the conventional button keys, it takes 4 strokes of pressing the edit key, selecting the editing content from the menu, selecting the editing range, pressing the enter button. The present invention, on the other hand, includes the pointing device 6 according to the present embodiment, processing for determining the shape of the input trajectory input by the pointing device 6, and correspondence information 161 that associates the processing with the shape of the input trajectory. By using, the user can make a copy with one stroke that encloses the character in a circle, thereby improving the efficiency of the input operation.

(Effects of the first embodiment)
As described above, the present embodiment has the following effects.

  The first effect is that the processing requested by the user can be executed efficiently.

  The reason is that the process of copying characters on the display screen 4 is associated with the shape of a circle that is a predetermined gesture and is set in the correspondence information 161, and the shape of the circle is simply input to the user as the predetermined gesture. Based on the determination result notified from the processing content determination processing unit 16 and the correspondence information 161, the terminal control unit 28 performs a process (on the display screen 4) corresponding to a predetermined gesture (circle shape) input to the user. This is because the user's operation procedure can be omitted because the process of copying characters) is performed.

  The second effect is that the user can cause the mobile phone to execute a predetermined process without looking at the display screen of the mobile phone even during a call.

  The reason is that the process requested by the user is executed only by inputting a predetermined gesture, and therefore, a screen related to execution of the predetermined process requested by the user is displayed on the display screen 4 and then the details of the user request are displayed. It is because it is not necessary to accept.

(Second Embodiment)
The basic configuration and operation of the second embodiment of the present invention are the same as those of the first embodiment, but the setting of the shape corresponding to the predetermined processing is further devised in the setting of the correspondence information 161. I am doing.

  For example, in the setting of the correspondence information 161, the call origination processing for the telephone number displayed on the display screen 4 (display unit 14) is associated with the gesture for drawing “C”.

(Effect of the second embodiment)
In the setting of the correspondence information 161, when the call origination process for the telephone number displayed on the display screen 4 (display unit 14) is associated with the gesture for drawing “C”, the user can display the display screen 4 (display unit 14). ) When a phone number is indicated in the text of (), if a gesture “C” is input from the pointing device 6, it is possible to make a call directly to the phone number, so that the operation of making a call can be omitted. .

  Further, for example, in the setting of the correspondence information 161, in addition to associating the call origination process for the telephone number displayed on the display screen 4 (display unit 14) with the gesture for drawing “C”, the mail application for the gesture for drawing “M” Or a connection process for connecting to a network may be associated with a gesture for drawing “W”.

(Third embodiment)
The basic configuration and operation of the third embodiment of the present invention are the same as those of the first embodiment, but the device of the mobile phone is further devised.

(Configuration of the third embodiment)
FIG. 9 is a block diagram showing the configuration of the mobile phone according to the present embodiment. Referring to FIG. 9, the mobile phone according to the present embodiment is the RAM 11 of the mobile phone according to the first embodiment shown in FIG. Stores the call time data, and the character processing means 17 is changed to the terminal control means 29.

Since the call time data is general data indicating the call time during which the mobile phone is executing the call function, description thereof is omitted.
In addition, the correspondence information 161 is set so that a predetermined gesture is associated with a process for examining the call time.

  The terminal control unit 29 has a function of performing processing corresponding to a predetermined gesture based on the determination result notified from the processing content determination processing unit 16.

(Operation of the third embodiment)
The difference from the operation of the mobile phone according to the first embodiment will be mainly described with reference to FIG.

  FIG. 10 is a flowchart showing a control procedure when a predetermined process is performed by an input from the pointing device of the mobile phone according to the third embodiment.

  An example of the operation of the mobile phone according to the present embodiment will be described by taking as an example a method in which the user confirms the call time while continuing the call when the user is making a call using the mobile phone 1.

  First, when a gesture for checking a call duration is input from the input unit 12 (pointing device 6), the input processing means 15 converts the input gesture into input trajectory data and sends it to the processing content determination processing means 16 (step) S1001).

  The processing content determination processing means 16 collates the input trajectory data with a shape registered in the ROM 10 in advance, determines processing corresponding to the input trajectory data, and performs processing such as examining the call time as a determination result. 29 is instructed (step S1002).

  Based on the instruction from the processing content determination processing unit 16, the terminal control unit 29 reads out the call time data (call time data) from the RAM 11 after the user started the call, and after the user starts the call The process of notifying the user of the call time by voice during the call is performed (step S1003 (terminal control process)).

(Effect of the third embodiment)
As described above, in one example of the present embodiment, the user can confirm the call time after starting the call without looking at the display screen 4 during the call and without interrupting the call. it can.

  The reason is that the processing for checking the call time is associated with a predetermined gesture and set in the correspondence information 161, and the terminal control unit 29 is based on the determination result and the correspondence information 161 notified from the processing content determination processing unit 16. Since it has a function to perform processing corresponding to a predetermined gesture, by inputting the predetermined gesture, it is possible to inform the user of the call time after the user starts the call by voice during the user's call Because.

  In addition, in one example of the present embodiment, it is possible to prevent a screen for confirming the call time from being displayed. Therefore, the screen displayed by executing the application in the mobile phone during the call confirms the call time. Therefore, it is possible to prevent the screen from becoming invisible.

  In other words, it is possible to prevent the screen displayed by executing the application from becoming invisible by executing the predetermined process requested by the user.

  The reason is that a predetermined process requested by the user can be performed because the user can be informed of the call time after the user started the call by voice during the user's call simply by inputting a predetermined gesture. This is because it is not necessary to receive the details of the user request after displaying the screen relating to the execution of the above on the display screen 4.

  Conventionally, when a general headphone with a microphone is used for a mobile phone, the user can perform an operation to request a predetermined process while looking at the display screen of the mobile phone even during a call as in the present embodiment. It was. However, in this case, there is a problem that the screen due to the execution of the application becomes invisible because the screen related to the execution of the predetermined process requested by the user during the execution of the application in the mobile phone is displayed on the display screen. As described above, the mobile phone according to the present embodiment can solve such a problem.

  In another example of the present embodiment, a process for checking the remaining battery level is associated with a predetermined gesture and set in the correspondence information 161, so that the user views the display screen 4 during a call. The remaining battery level can be confirmed without interruption, without interrupting the call, and without displaying a screen related to the process for checking the remaining battery level.

  In another example of the present embodiment, a process for examining the radio wave condition is associated with a predetermined gesture and set in the correspondence information 161, so that the user does not see the display screen 4 during a call. In addition, the radio wave condition can be confirmed without interrupting the call and without displaying a screen related to the process for checking the radio wave condition.

  In another example of the present embodiment, a process of stopping radio waves or the like is associated with a predetermined gesture and set in the correspondence information 161, so that the user views the display screen 4 during a call. In addition, it is possible to execute processing such as stopping radio waves without interrupting a call and without displaying a screen relating to processing such as stopping radio waves.

(Fourth embodiment)
The basic configuration and operation of the fourth embodiment of the present invention are the same as those of the third embodiment, but a gyro mechanism (acceleration sensor) is provided in the mobile phone 1 instead of the pointing device 6. When the position of the mobile phone 1 itself is moved, the gyro mechanism (acceleration sensor) inputs the movement locus of the position as a gesture, and the input processing means 15 converts the input gesture into input locus data. The processing content determination processing unit 16 determines the processing content based on the input trajectory data, and the terminal control unit 28 performs processing corresponding to a predetermined gesture based on the determination result notified from the processing content determination processing unit 16. I do.

(Effect of the fourth embodiment)
According to the present embodiment, since the predetermined processing of the mobile phone 1 can be associated with the gesture configured by three dimensions, in addition to the effect of the third embodiment, setting of a gesture having a higher degree of freedom. In addition, it is possible to perform association with a predetermined process.

  Although the present invention has been described with reference to the preferred embodiments, the present invention is not necessarily limited to the above embodiments, and various modifications can be made within the scope of the technical idea. .

  For example, for the correspondence information 161 according to the present invention, it is desirable to register in advance a gesture that can be traced on the pointing device 6 or the like with one stroke so that the user can easily input the gesture.

  The reason is that a user can easily input with one stroke without looking at the display screen 4 during a call.

  In addition, for example, when the user performs a process of erasing characters written on paper, the gesture registered in the correspondence information 161 is actually written by the user so that the character is written and erased from above the characters with a writing tool or the like. It is desirable to correspond to the operation in the processing to be performed.

  Alternatively, for example, “CO” when the user performs copying, and “CU” when the user performs cutting, such as “CU”, the initial name of the processing name actually performed by the user is used as the gesture in the correspondence information 161. You may register.

  The reason is that even when the operation in the process differs among users, the process name can be set the same between users, so that the user can easily learn a gesture without being confused.

Mobile phone, PHS (Personal Handyphone
System) and PDA (Personal Data Assistance, Personal Digital Assistans) and the like, which can be applied to devices equipped with pointing devices and acceleration sensors.

It is a perspective view which shows the external appearance of the mobile telephone by the 1st Embodiment of this invention. It is a block diagram which shows the principal part of the circuit structure of the mobile telephone which is an example of the portable terminal device by 1st Embodiment. It is a figure which shows the structure of the correspondence information 161 by 1st Embodiment. It is a figure for demonstrating the pie menu by 1st Embodiment. It is a block diagram which shows the hardware constitutions of the portable terminal device by 1st Embodiment. It is a flowchart showing the control procedure at the time of performing a predetermined | prescribed process by the input from the pointing device of the mobile telephone by 1st Embodiment. A process for determining the shape of an input locus when performing a predetermined process by an input from a pointing device of the mobile phone according to the first embodiment and a control procedure when performing a predetermined process corresponding to the input locus It is a flowchart showing. It is a figure which shows the display screen 4 (display part 13) for demonstrating the characteristic process in the portable terminal device 100 by 1st Embodiment. It is a block diagram which shows the structure of the mobile telephone by 3rd Embodiment. It is a flowchart showing the control procedure at the time of performing a predetermined | prescribed process by the input from the pointing device of the mobile telephone by 3rd Embodiment.

Explanation of symbols

1: Mobile phone 2: Microphone 3: Speaker 4: Display screen 5: Numeric keypad 6: Pointing device 7: Antenna 8: Transmitter / receiver 9: Bus 10: ROM
11: RAM
12: Input unit 13: Display unit 14: Control unit 15: Input processing unit 16: Processing content determination processing unit 17: Character processing unit 19: Cursor 20, 23: Gesture 21, 25: Icon 26: Pie menu 27: Cursor 28 : Fan-shaped area 29: Terminal control means 501: CPU
502: Main storage unit 503: Communication control unit 504: Presentation unit 505: Input unit 506: Interface unit 507: Auxiliary storage unit 508: System bus

Claims (31)

In a portable device having an executable processing function,
Input means capable of detecting movement of a predetermined position in an arbitrary direction;
Determining means for determining a trajectory shape of the moved position;
A portable device comprising: execution means for executing processing contents associated with each determined trajectory shape. A table in which the trajectory shape and the processing content are defined in association with each other;
The portable device according to claim 1, wherein the execution unit executes the processing content set in the table corresponding to the determined locus shape. The portable device according to claim 1, wherein the locus shape is associated with a character string input editing process. The portable device according to claim 3, wherein the input editing process of a character string includes at least one of a copy process, a cut process, and a delete process. The input means includes pointing means capable of moving the pointer in an arbitrary direction on the screen,
The determination means determines a trajectory shape of the pointer,
5. The mobile device according to claim 1, wherein the execution unit executes processing contents associated with each determined locus shape of the pointer. The table is defined by associating the locus shape of the pointer with the processing content,
The portable device according to claim 5, wherein the execution unit executes the processing content set in the table corresponding to the determined locus shape of the pointer. The portable device according to claim 5 or 6, wherein the processing content is set in association with a position of a locus of the pointer on the screen and a shape of the locus. The portable device according to any one of claims 5 to 7, wherein a trajectory shape of the pointer surrounding the character string is associated with copy processing or cut processing of the enclosed character string. . Display a circular or polygonal menu on the screen according to the pointer trajectory shape,
The portable device according to any one of claims 5 to 8, wherein processing contents executed by positioning the pointer are associated for each range of the predetermined angle of the menu. The input means includes a gyro mechanism using an acceleration sensor capable of detecting movement in an arbitrary direction of the position of itself,
The table is defined by associating the trajectory shape of the position of the self with the processing content,
5. The method according to claim 1, wherein the execution unit executes the processing content set in the table in correspondence with the determined locus shape of the position of itself. The portable device described. 11. A mobile phone device to which the mobile device according to claim 1 is applied. An input support method for a portable device having an executable processing function,
An input step capable of detecting movement in an arbitrary direction of a predetermined position;
A determination step of determining a trajectory shape of the moved position;
And an execution step of executing processing contents associated with each of the determined trajectory shapes. The said execution step performs the said process content corresponding to the said locus | trajectory shape determined by the said determination step based on the table which matched and defined the said locus | trajectory shape and the said process content. 12. The input support method according to 12. The input support method according to claim 12 or 13, wherein the locus shape is associated with input editing processing of a character string. The input support method according to claim 14, wherein the input editing process of a character string includes at least one of a copy process, a cut process, and a delete process. In the input step, the pointing step of detecting movement of the pointer in any direction on the screen,
In the determination step, the locus shape of the pointer is determined,
The input support method according to any one of claims 12 to 15, wherein in the execution step, processing contents associated with each determined trajectory shape of the pointer are executed. In the execution step, the processing content corresponding to the trajectory shape of the pointer determined in the determination step is executed based on a table defined in association with the trajectory shape of the pointer and the processing content. The input support method according to claim 16. 18. The input support method according to claim 16, wherein the processing content is set in association with a position of the pointer locus on the screen and a shape of the locus. The input support according to any one of claims 16 to 18, wherein a trajectory shape of the pointer surrounding the character string is associated with copy processing or cut processing of the enclosed character string. Method. Display a circular or polygonal menu on the screen according to the pointer trajectory shape,
20. The input support method according to claim 16, wherein processing contents to be executed by positioning the pointer are associated with each predetermined angle range of the menu. In the input step, the movement of the position of the portable device is detected by a gyro mechanism using an acceleration sensor capable of detecting the movement of the position of the portable device in an arbitrary direction;
In the execution step, the processing content corresponding to the trajectory shape of the mobile device determined in the determination step is executed based on a table defined by associating the trajectory shape of the mobile device with the processing content. 16. The input support method according to any one of claims 12 to 15, wherein: An input support program in a portable device having an executable processing function, the computer constituting the portable device,
An input function capable of detecting movement of a predetermined position in an arbitrary direction;
A determination function for determining a trajectory shape of the moved position;
An input support program for executing an execution function for executing processing contents associated with each determined trajectory shape. The execution function executes the processing content corresponding to the trajectory shape determined by the determination function based on a table that defines the trajectory shape and the processing content in association with each other. The input support program according to 22. The input support program according to claim 22 or 23, wherein the locus shape is associated with an input editing process of a character string. The input support program according to claim 24, wherein the input editing process of a character string includes at least one of a copy process, a cut process, and a delete process. In the input function, a pointing function for detecting movement of the pointer in any direction on the screen is provided,
In the determination function, the trajectory shape of the pointer is determined,
The input support program according to any one of claims 22 to 25, wherein the execution function executes processing contents associated with each determined locus shape of the pointer. In the execution function, the processing content corresponding to the trajectory shape of the pointer determined by the determination function is executed based on a table defined by associating the trajectory shape of the pointer with the processing content. An input support program according to claim 26. 28. The input support program according to claim 26, wherein the processing content is set in association with a position of the pointer locus on the screen and a shape of the locus. The input support according to any one of claims 26 to 28, wherein a trajectory shape of the pointer surrounding the character string is associated with copy processing or cut processing of the enclosed character string. program. Display a circular or polygonal menu on the screen according to the pointer trajectory shape,
30. The input support program according to claim 26, wherein processing contents executed by positioning the pointer are associated with each predetermined angle range of the menu. In the input function, the movement of the position of the portable device is detected by a gyro mechanism using an acceleration sensor capable of detecting the movement of the position of the portable device in an arbitrary direction;
In the execution function, the processing content corresponding to the trajectory shape of the mobile device determined in the determination step is executed based on a table defined by associating the trajectory shape of the mobile device with the processing content. The input support method according to any one of claims 22 to 25, wherein:

Images