JP6291785B2 - Information processing apparatus, program, and operation processing method of information processing apparatus - Google Patents

Description

  The present invention relates to an information processing device, a program, and an operation processing method for the information processing device.

  An example of a touch screen display including a touch screen is described in Patent Document 1. The smartphone described in this document has a touch screen display on the front face, and determines a gesture that moves while the operator's finger is in contact with the touch screen as a swipe. Furthermore, on the lock screen of the smartphone, the object including the operation route and the operation point is displayed, and in the display area according to the movement distance, duration, or direction of the swipe when the operator's finger swipes on the operation route Switch the displayed image to another image.

  Moreover, the character input device described in Patent Literature 2 is based on a character string input by a user, and a plurality of candidate character strings estimated as candidates for a confirmed character string are obtained from a plurality of candidate character strings. Is displayed in a selectable manner. Then, a closed curve locus input operation performed by the user on the input surface is detected, and a plurality of candidate character strings to be displayed in the input sentence determination area are sequentially switched in conjunction with the detected input operation. The candidate character string of is displayed. The rotation direction (clockwise / counterclockwise) and speed (change amount of position information per unit time) of the rotation operation on the input unit are detected. Then, in conjunction with the rotation operation, the selection interface for presenting a list of candidate character strings in a circle is rotated.

  The user interface described in Patent Document 3 displays a scroll wheel as a GUI (Graphical User Interface) element on a touch panel. The user can perform a scroll operation of the screen by operating the scroll wheel.

  Further, in Patent Document 4, recognition target image data is extracted by surrounding a recognition target image region including a recognition target character in a displayed image with an amorphous closed curve using a pen, and the extracted recognition target A character recognition device for recognizing characters in image data and displaying the recognized character string is described.

JP 2013-134695 A JP2013-3803A US Pat. No. 8,239,748 JP-A-6-131111

The technology described in each of the above-described documents is based on a rotation operation GUI (an image of an operation path, a rotating plate or a wheel image) that is rotated or swiped on the touch panel, thereby switching an image or a candidate character string or performing a screen scrolling operation. Etc. to perform a predetermined operation.
By the way, touch panels, such as a smart phone and a tablet terminal, are small in size, and there are restrictions on display and operation areas. The idea of causing the processing associated with each of the attributes of the number of copies of the closed curve operation to be performed by an operation of drawing a simple closed curve trajectory instead of displaying the GUI for the rotation operation under the above-described restrictions is described above. There was no technique described in each document.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an information processing apparatus, a program, and an operation process of the information processing apparatus that are capable of executing predetermined processing contents by a closed curve operation. It is to provide a method.

The first information processing apparatus of the present invention
An operation detecting means for detecting a closed curve operation capable of indicating a simple closed curve trajectory and acquiring the attribute;
Holding means for holding rule information in which each of the plurality of attributes related to the closed curve operation is associated with at least one of a plurality of operation processing contents for the operation target;
Determining means for determining at least one operation processing content corresponding to an attribute of the closed curve operation detected by the operation detecting means based on the rule information held in the holding means;
With
The operation detecting means includes
A curve discriminating unit that discriminates whether or not the operation indicating the intermediate trajectory before the simple closed curve trajectory is completely drawn can be a closed curve operation indicating the simple closed curve trajectory;
The operation detecting means includes
The operation indicating the intermediate trajectory determined to be the closed curve operation by the curve determination unit is detected as the closed curve operation, the simple closed curve trajectory corresponding to the intermediate trajectory is estimated, and the estimated simple closed curve trajectory To obtain the attribute of the closed curve operation from
further,
Before executing the operation processing content determined by the determining unit, a notification unit is provided for notifying an operator of information indicating a state before and after the execution.
The second information processing apparatus of the present invention
An operation detecting means for detecting a closed curve operation capable of indicating a simple closed curve trajectory and acquiring the attribute;
Holding means for holding rule information in which each of the plurality of attributes related to the closed curve operation is associated with at least one of a plurality of operation processing contents for the operation target;
Determining means for determining at least one operation processing content corresponding to an attribute of the closed curve operation detected by the operation detecting means based on the rule information held in the holding means;
With
The operation target has a hierarchical structure or is classified into a category,
further,
The rule information includes a correspondence between a reference value of the length of time required for a closed curve operation that can indicate the simple closed curve trajectory as an attribute related to the closed curve operation, and the order of movement of a hierarchy or category as the operation processing content for the operation target Including
The operation detecting means includes
As a closed curve operation attribute that can indicate the simple closed curve trajectory, further includes a time acquisition unit that acquires a length of time required for the detected closed curve operation,
The determining means, based on the rule information held in the holding means, when the length of time required for the closed curve operation acquired by the time acquisition unit is equal to or greater than the reference value, The order of movement is determined as the content of the operation processing, and when the length of time required for the closed curve operation acquired by the time acquisition unit is less than the reference value, based on the rule information held in the holding unit An information processing apparatus that determines at least one operation processing content corresponding to the attribute of the closed curve operation detected by the operation detection means.

The first computer program of the present invention is:
In the computer for realizing the information processing device,
A procedure for holding rule information in which each of a plurality of attributes related to a closed curve operation that can indicate a simple closed curve trajectory is associated with at least one of a plurality of operation processing contents for an operation target;
Procedure to detect closed curve operation and get its attributes,
A procedure for determining at least one operation processing content corresponding to the attribute of the detected closed curve operation based on the stored rule information;
In addition,
A procedure for determining whether an operation indicating an intermediate trajectory before the simple closed curve trajectory is completely drawn can be a closed curve operation indicating the simple closed curve trajectory;
The operation indicating the intermediate trajectory determined to be the closed curve operation by the determining procedure is detected as the closed curve operation, the simple closed curve trajectory corresponding to the intermediate trajectory is estimated, and the estimated simple closed curve trajectory Obtaining the attribute of the closed curve operation from
It is a program for executing a procedure for notifying an operator of information indicating both the pre-execution state and the post-execution state before executing the operation processing content determined by the determining procedure.
The second computing program of the present invention is:
In the computer for realizing the information processing device,
A procedure for holding rule information in which each of a plurality of attributes related to a closed curve operation that can indicate a simple closed curve trajectory is associated with at least one of a plurality of operation processing contents for an operation target;
Procedure to detect closed curve operation and get its attributes,
A procedure for determining at least one operation processing content corresponding to the attribute of the detected closed curve operation based on the stored rule information;
The operation target has a hierarchical structure or is classified into a category,
The rule information includes a correspondence between a reference value of the length of time required for a closed curve operation that can indicate the simple closed curve trajectory as an attribute related to the closed curve operation, and the order of movement of a hierarchy or category as the operation processing content for the operation target Including
In addition,
A procedure for obtaining a length of time required for the detected closed curve operation as an attribute of the closed curve operation that can indicate the simple closed curve trajectory;
Based on the stored rule information, when the time taken for the closed curve operation to be acquired is equal to or greater than the reference value, the order of movement of the hierarchy or the category is determined as the operation processing content, and acquired. When the length of time taken for the closed curve operation to be performed is less than the reference value, at least one operation corresponding to the attribute of the closed curve operation detected by the procedure for acquiring the attribute based on the stored rule information This is a program for executing a procedure for determining processing contents.

An operation processing method of the first information processing apparatus according to the present invention includes:
Information processing device
A storage unit that holds rule information in which each of a plurality of attributes related to a closed curve operation that can indicate a simple closed curve trajectory is associated with at least one of a plurality of operation processing contents for an operation target;
The information processing apparatus is
Detect closed curve operation, get its attributes,
Based on the rule information held, at least one operation processing content corresponding to the detected closed curve operation attribute is determined,
Determining whether an operation indicating an intermediate trajectory before the simple closed curve trajectory is completely drawn can be a closed curve operation indicating the simple closed curve trajectory;
The operation indicating the intermediate trajectory determined to be the closed curve operation is detected as the closed curve operation, the simple closed curve trajectory corresponding to the intermediate trajectory is estimated, and the closed curve operation is estimated from the estimated simple closed curve trajectory. Get attributes,
Before executing the determined operation processing content, the operator is notified of information indicating both the pre-execution state and the post-execution state.
The second information processing apparatus operation processing method of the present invention comprises:
Information processing device
A storage unit that holds rule information in which each of a plurality of attributes related to a closed curve operation that can indicate a simple closed curve trajectory is associated with at least one of a plurality of operation processing contents for an operation target;
The information processing apparatus is
Detect closed curve operation, get its attributes,
Based on the rule information held, at least one operation processing content corresponding to the detected closed curve operation attribute is determined,
The operation target has a hierarchical structure or is classified into a category,
The rule information includes a correspondence between a reference value of the length of time required for a closed curve operation that can indicate the simple closed curve trajectory as an attribute related to the closed curve operation, and the order of movement of a hierarchy or category as the operation processing content for the operation target Including
Further, the information processing apparatus
As a closed curve operation attribute that can indicate the simple closed curve trajectory, to obtain the length of time required for the detected closed curve operation,
Based on the stored rule information, when the time taken for the closed curve operation to be acquired is equal to or greater than the reference value, the order of movement of the hierarchy or the category is determined as the operation processing content, and acquired. If the length of time required for the closed curve operation to be performed is less than the reference value, at least one operation processing content corresponding to the detected closed curve operation attribute is determined based on the stored rule information.

  It should be noted that any combination of the above-described constituent elements and a conversion of the expression of the present invention between a method, an apparatus, a system, a recording medium, a computer program, etc. are also effective as an aspect of the present invention.

  The various components of the present invention do not necessarily have to be independent of each other. A plurality of components are formed as a single member, and a single component is formed of a plurality of members. It may be that a certain component is a part of another component, a part of a certain component overlaps with a part of another component, or the like.

  In addition, although a plurality of procedures are described in order in the operation processing method and the computer program of the present invention, the described order does not limit the order in which the plurality of procedures are executed. For this reason, when implementing the operation processing method and computer program of this invention, the order of the several procedure can be changed in the range which does not have trouble in content.

  Furthermore, the plurality of procedures of the operation processing method and the computer program of the present invention are not limited to being executed at different timings. For this reason, another procedure may occur during the execution of a certain procedure, or some or all of the execution timing of a certain procedure and the execution timing of another procedure may overlap.

  According to the present invention, there are provided an information processing apparatus, a program, and an operation processing method for the information processing apparatus that can execute predetermined processing contents by a closed curve operation and have good operability.

It is a functional block diagram which shows the logical structure of the information processing apparatus which concerns on embodiment of this invention. It is a figure for demonstrating the closed curve operation which shows the simple closed curve track | orbit in this invention. It is a block diagram which shows the structural example of the computer which implement | achieves the information processing apparatus which concerns on embodiment of this invention. It is a flowchart which shows an example of operation | movement of the information processing apparatus which concerns on embodiment of this invention. It is a functional block diagram which shows the logical structure of the information processing apparatus which concerns on embodiment of this invention. It is a figure for demonstrating the example of the rule information which concerns on embodiment of this invention. It is a figure for demonstrating closed curve operation and operation | movement in the information processing apparatus which concerns on embodiment of this invention. It is a figure for demonstrating closed curve operation and operation | movement in the information processing apparatus which concerns on embodiment of this invention. It is a block diagram which shows the structure of the smart phone which implement | achieves the information processing apparatus which concerns on embodiment of this invention. It is a flowchart which shows an example of operation | movement of the information processing apparatus which concerns on embodiment of this invention. It is a functional block diagram which shows the logical structure of the information processing apparatus which concerns on embodiment of this invention. It is a flowchart which shows an example of operation | movement of the information processing apparatus which concerns on embodiment of this invention. It is a figure for demonstrating closed curve operation and operation | movement in the information processing apparatus which concerns on embodiment of this invention. It is a functional block diagram which shows the principal part of the other logical structure of the information processing apparatus which concerns on embodiment of this invention. It is a figure for demonstrating closed curve operation and operation | movement in the information processing apparatus which concerns on embodiment of this invention. It is a functional block diagram which shows the principal part of the logical structure of the information processing apparatus which concerns on embodiment of this invention. It is a figure for demonstrating closed curve operation and operation | movement in the information processing apparatus which concerns on embodiment of this invention. It is a figure for demonstrating closed curve operation and operation | movement in the information processing apparatus which concerns on embodiment of this invention. It is a figure for demonstrating closed curve operation and operation | movement in the information processing apparatus which concerns on embodiment of this invention. It is a figure for demonstrating closed curve operation and operation | movement in the information processing apparatus which concerns on embodiment of this invention. It is a figure for demonstrating closed curve operation and operation | movement in the information processing apparatus which concerns on embodiment of this invention. It is a figure for demonstrating the Example of the rule information of this invention. It is a figure for demonstrating closed curve operation and operation | movement in the information processing apparatus of the Example of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same reference numerals are given to the same components, and the description will be omitted as appropriate.

(First embodiment)
FIG. 1 is a functional block diagram showing a logical configuration of the information processing apparatus 100 according to the embodiment of the present invention.
The information processing apparatus 100 according to the embodiment of the present invention detects a closed curve operation that can indicate a simple closed curve trajectory, acquires an attribute of the operation detection unit 102, each of a plurality of attributes related to the closed curve operation, and an operation target Based on the rule information holding unit 106 that holds rule information associated with at least one of a plurality of operation processing contents and the rule information held in the rule information holding unit 106, the operation detection unit 102 detects the rule information. A determination unit 104 that determines at least one operation processing content corresponding to the attribute of the closed curve operation.

FIG. 2 is a diagram for explaining a closed curve operation indicating a simple closed curve trajectory in the present invention.
As shown in FIG. 2A, the closed curve operation is an operation indicating a trajectory that draws a circle or an arc such that the end point P2 of the trajectory R1 returns to the start point P1 of the trajectory R1.
In the present invention, an operation of drawing a simple closed curve trajectory (circle) is called a closed curve operation. The operation of drawing the intermediate trajectory (arc) before completely drawing the simple closed curve trajectory can be a closed curve operation indicating a simple closed curve trajectory when it is determined that the intermediate trajectory can be a simple closed curve trajectory, as will be described later. Be recognized. In addition, the start point and end point of the circular or arc trajectory indicated by the operation do not necessarily have to be the same position, and the end point does not have to reach the start point as in the case of an arc, and intersects near the start point and end point of the arc. The end point of the circle may exceed the start point.
In the closed curve operation, when the operation is repeated, the start point P3 of the next operation (shown by a broken line) after one operation (shown by a solid line) may be set to the same position as the end point P2 of the previous operation (shown by a solid line). Therefore, the operator can start the next operation continuously after one operation without interruption.

In other operations where the end point P12 of the trajectory R11 does not return to the start point P11, as in the flick shown in FIG. 2B, the start position ( An operation for returning to the starting point P13) is required.
Since the information processing apparatus 100 according to the embodiment of the present invention is configured to recognize a closed curve operation that can indicate a simple closed curve trajectory and perform processing corresponding to the operation, the operator is required for an operation such as a flick. It is not necessary to perform an operation of returning to the operation start position for the next operation after one operation, and the operation can be repeated continuously by performing a gesture for drawing a simple closed curved track when coming to the same place.

  Although FIG. 2 illustrates an example of a touch operation with a finger on the touch panel 76, the closed curve operation of the present invention is limited to a touch operation using a finger, a touch pen, or the like on a touch panel or a touch screen. It is not a thing. The closed curve operation includes a hover operation that is not in contact with the touch panel 76. Furthermore, in addition to the touch operation, an operation performed by moving a caret, a pointer, or the like displayed on the display using a pointing device such as a touch pad, a track pad, a mouse, a touch pen, or a track ball can be included.

  The operation detection unit 102 receives an input signal from a pointing device such as a touch panel, a touch screen, a touch pad, a track pad, a mouse, a touch pen, or a track ball, or operation information received by the application program from the pointing device from the application program. Acquire and detect a closed curve operation based on the acquired signal or information.

  In the present invention, the attributes relating to the closed curve operation include, for example, the length of the simple closed curve trajectory (or the size (diameter or radius) of the arc), the turning direction, the time taken to draw the simple closed curve trajectory, and the simple closed curve trajectory. And / or a change in speed (acceleration) at the end point of the end point, or a combination thereof. Details will be described in an embodiment described later. Note that the attributes relating to the closed curve operation of the present invention are not limited to these, and can include various attributes such as a ratio of drawing a simple closed curve trajectory. For example, different processing contents can be associated when the ratio of drawing a simple closed curve trajectory is drawn up to the former half-circle portion and when the latter half-circle portion is drawn.

FIG. 3 is a block diagram illustrating a configuration example of the computer 60 that implements the information processing apparatus 100 according to the embodiment of the present invention.
A computer 60 that implements the information processing apparatus 100 includes, for example, a CPU (Central Processing Unit) 62, a ROM (Read Only Memory) 64, a RAM (Random Access Memory) 66, an I / O, as shown in FIG. (Input / Output) 68.

  The CPU 62 is connected to each element of the computer 60 via the bus 69 and controls the entire computer 60 together with each element. The ROM 64 stores programs for operating the computer 60, various application programs, various setting data used when these programs operate, and various user data. The RAM 66 has an area for temporarily storing data, such as a work area for operating the program. The I / O 68 controls input / output of data or control signals to the computer 60.

  The ROM 64 and the RAM 66 described above may be other devices having a function for storing application programs and setting data for operating the programs, temporary storage data, user data, and the like, such as a flash memory and a disk drive. Good.

  The computer 60 includes, for example, an operation input device 74 such as a keyboard and a mouse, a display device 72 such as a display, a touch panel 76 (FIG. 2) in which the input device and the display device are integrated, and a voice input / output device such as a microphone and a speaker ( (Not shown), or a personal computer connected to an output device (not shown) such as a printer, a server computer, or a computer corresponding thereto. Alternatively, in an embodiment described later, the information processing apparatus is, for example, a smartphone, a tablet terminal, a mobile phone, a PDA (Personal Digital Assistants), a game machine, an acoustic electronic device, a digital camera, an image display device, or other electronic devices. Can also be realized.

Each component of the information processing apparatus 100 shown in FIG. 1 stores a CPU 62, a memory (RAM 66), a program (70) that realizes the components shown in FIG. This is realized by an arbitrary combination of hardware and software of an arbitrary computer 60 having a storage unit (ROM 64) such as a hard disk and a network connection interface (I / O 68). It will be understood by those skilled in the art that there are various modifications to the implementation method and apparatus. FIG. 1 shows a block of logical functional units, not a configuration of hardware units.
In the following drawings, the configuration of parts not related to the essence of the present invention is omitted and is not shown.

  The computer program according to the present embodiment causes the computer 60 for realizing the information processing apparatus 100 to at least one of a plurality of attributes related to a closed curve operation that can indicate a simple closed curve trajectory and a plurality of operation processing contents for an operation target. The rule information holding unit 106 stores rule information in the rule information holding unit 106, the procedure for detecting a closed curve operation and acquiring the attribute, the closed curve detected based on the rule information held in the rule information holding unit 106 It is described to execute a procedure for determining at least one operation processing content corresponding to an operation attribute.

  The rule information of the present invention can be held in various formats, for example, at least one of a table, a program, a sequence, a flowchart, and a text, or a combination thereof. Alternatively, the information processing apparatus may include the procedure for causing the information processing apparatus to perform an operation based on the rule information, and cause the information processing apparatus to execute the program based on the rule information. Good.

The computer program 70 of this embodiment may be recorded on a recording medium readable by the computer 60. The recording medium is not particularly limited, and various forms can be considered. The program 70 may be loaded from a recording medium into the memory of the computer 60, or may be downloaded to the computer 60 through a network and loaded into the memory.
The computer program 70 of this embodiment can be installed in the information processing apparatus 100 as a program (or a chip having a function) such as an application plug-in, library, OS (Operating System), and driver.

  In the configuration as described above, an operation processing method of the information processing apparatus 100 according to the present embodiment will be described below. FIG. 4 is a flowchart illustrating an example of the operation of the information processing apparatus 100 according to the present embodiment.

  In the operation processing method of the information processing apparatus 100 according to the present embodiment, the information processing apparatus 100 has at least one of a plurality of attributes related to a closed curve operation that can indicate a simple closed curve trajectory and a plurality of operation processing contents for an operation target. Is stored in the rule information holding unit 106 (step S101), a closed curve operation that can indicate a simple closed curve trajectory is detected, its attribute is acquired (step S103), and the rule information holding unit 106 holds the rule information. Based on the rule information, at least one operation processing content corresponding to the detected closed curve operation attribute is determined (step S105).

  Specifically, in the information processing apparatus 100 according to the present embodiment, the rule information holding unit 106 includes at least one of a plurality of attributes related to a closed curve operation that can indicate a simple closed curve trajectory and a plurality of operation processing contents for an operation target. The rule information in which one is associated is held (step S101). In the present embodiment, for example, in a program (for example, a carousel panel or the like) in which a plurality of image files arranged sequentially can be browsed sequentially, the image files are sequentially switched in the arrangement order each time the user performs a closed curve operation. It is assumed that the process to be displayed is associated with the rule information. This step S101 may be determined in advance in the program 70, may be performed in advance as an initial setting, or may be performed when the rule information is updated at an arbitrary timing.

  When the operator performs a closed curve operation, the operation detection unit 102 detects the closed curve operation and acquires its attribute (step S103). Based on the rule information held in the rule information holding unit 106, the determination unit 104 sets the image file to be viewed as the next image file as at least one operation processing content corresponding to the detected closed curve operation attribute. The process to switch to and display is determined (step S105).

  Note that while the closed curve operation is being performed, for example, while an input signal from the pointing device is being input, the information processing apparatus 100 repeatedly executes the processes of step S103 and step S105. Each time the operator repeatedly performs a closed curve operation, the process of sequentially switching and displaying the image files to be browsed is repeatedly executed.

  As described above, according to the information processing apparatus 100 according to the embodiment of the present invention, a closed curve operation that can indicate a simple closed curve trajectory is detected, and a plurality of attributes (for example, direction and curve length) of the closed curve operation are detected. ) Because the processing content can be determined every time, unlike the operation that does not return the trajectory such as other flicks, the operation to return to the operation start position for the next operation after one operation is unnecessary. The continuous operation can be repeated and the operability is good. It can be operated repeatedly when coming and going in the same place. In particular, the effect becomes more remarkable in a touch operation environment in which the screen area and the operation area are restricted.

(Second Embodiment)
FIG. 5 is a functional block diagram showing a logical configuration of the information processing apparatus 200 according to the embodiment of the present invention.
The information processing apparatus 200 according to the embodiment of the present invention, as an example of the simple closed curve trajectory attribute and the processing content of the above embodiment, processes the processing content according to a rule that associates the length of the simple closed curve trajectory with the operation processing amount. It is characterized by having a configuration to be determined. Furthermore, the information processing apparatus 200 according to the embodiment of the present invention can accept an operation even if the gesture is not completed by estimating the simple closed curve trajectory from the intermediate trajectory before the simple closed curve trajectory is completely drawn. It is characterized by having a configuration that can be made.

The information processing apparatus 200 according to the embodiment of the present invention detects a closed curve operation that can indicate a simple closed curve trajectory, acquires an attribute of the operation detection unit 202, each of a plurality of attributes related to the closed curve operation, and an operation target Based on the rule information holding unit 206 that holds rule information associated with at least one of a plurality of operation processing contents, and the rule information held in the rule information holding unit 206, the operation detection unit 202 detects the rule information. And a determination unit 204 that determines at least one operation processing content corresponding to the attribute of the closed curve operation. Further, in the information processing apparatus 200, the rule information includes a correspondence between the length of the simple closed curve trajectory as an attribute related to the closed curve operation and the operation processing amount as the operation processing content for the operation target.
The operation detection unit 202 includes a length acquisition unit 212 that acquires the length of the simple closed curve trajectory of the detected closed curve operation as an attribute of the closed curve operation that can indicate the simple closed curve trajectory.
Based on the rule information held in the rule information holding unit 206, the determination unit 204 sets the operation processing amount corresponding to the length of the simple closed curve trajectory of the closed curve operation acquired by the length acquisition unit 212. Determine as.

In the information processing apparatus 200 according to the embodiment of the present invention, the operation detection unit 202 determines whether the operation indicating the intermediate trajectory before the simple closed curve trajectory is completely drawn can be the closed curve operation indicating the simple closed curve trajectory. A curve discriminating unit 210 for discriminating is further included.
Furthermore, the operation detection unit 202 detects an operation indicating an intermediate trajectory determined by the curve determination unit 210 as a closed curve operation as a closed curve operation, estimates a simple closed curve trajectory corresponding to the intermediate trajectory, and determines the estimated simple Gets the closed curve operation attribute from the closed curve trajectory.

In the present invention, the simple closed curve trajectory can be detected by the operation detection unit, for example, by the following procedure (step S1 to step S4), but is not limited thereto. Here, it is detected whether or not the swipe operation on the touch panel indicates a simple closed curve trajectory.
(S1) A swipe start point is acquired.
(S2) The latest three points on the trajectory of the swipe operation are taken, and the angle formed by the two straight lines connecting the three points in order is calculated.
(S3) Step S2 is repeated, and it is determined whether or not the positive and negative angles match.
(S4) If all the determinations in step S3 are the same and the swipe trajectory enters the simple closed curve region (the length is arbitrary) centered on the start point of step S1, it is regarded as a simple closed curve trajectory.

As described above, the operation detection unit of the present invention can estimate the simple closed curve trajectory corresponding to the intermediate trajectory even when the intermediate trajectory indicates the intermediate trajectory before the closed curve operation goes around. Then, the operation detection unit acquires an attribute of the closed curve operation from the estimated simple closed curve trajectory.
In the present embodiment, the rule information held in the rule information holding unit 206 includes, as shown in FIG. 6, the length of the simple closed curve trajectory as an attribute related to the closed curve operation, and the operation processing amount as the operation processing content for the operation target. Includes a mapping.

FIG. 6 is a diagram for explaining an example of rule information according to the embodiment of the present invention.
For example, in the example of rule information in FIG. 6A, the movement amount (number of records) of the browsing data to be operated is associated with the length of the simple closed curve trajectory as the operation processing amount. If this rule is followed, for example, as shown in FIG. 7A, when the length of the simple closed curve trajectory is short, that is, if the circle to be drawn is made smaller, the browsing data is shown one record at a time (indicated by a broken line in the figure). Can be moved. On the other hand, as shown in FIG. 7 (b), as the length of the simple closed curve trajectory increases, that is, as the circle to be drawn increases, browsing data (indicated by broken lines in the figure) is recorded in several to several tens of records ( In FIG. 7B, it can be moved by 3 records).

In the example of rule information in FIG. 6B, the movement unit (unit of day, week, month, year, etc.) of the browsing data to be operated is associated with the length of the simple closed curve trajectory as the operation processing amount. It has been. According to this rule, for example, as shown in FIG. 8, when the length of the simple closed curve trajectory R21 is short, that is, if the circle to be drawn is made small, the browsing data can be moved in units of one day (the solid line in the figure). As the length of the simple closed curve trajectories R22 and R23 becomes longer, that is, as the circle to be drawn becomes larger, the browsing data is expressed in units of one week (indicated by a one-dot chain line in the figure), in units of one month (in the figure, It can be moved in longer units, such as a year (not shown).
In FIG. 8, the rule is such that the processing amount increases as the length of the curve increases. However, the rule is not limited to this, and the rule may be such that the processing amount decreases as the curve length increases. . Appropriate rules may be determined according to the operation target and processing content.

In the present invention, the closed curve operation can be applied to various operation processes for various operation objects. Hereinafter, although illustrated, it is not limited to these.
(A1) Movement of focus item in list, carousel panel, etc. The present invention can be applied to movement or switching operation of an item focused on a list including a plurality of items, carousel panel, or the like. When a plurality of items have a hierarchical structure or are categorized by category, it can also be applied to movement operations between hierarchies and categories. Items are data, files, sheets, columns, rows, cells, menu lists, tabs, and the like. As will be described later, the operator can change the attribute of the closed curve operation by changing the method of the closed curve operation, and the item to be moved can be changed from the sheet unit to the row unit, and further to the cell unit. .

(A2) Page (Sheet) Switching in Document and Card Type Details In a document having a plurality of pages, it can be applied to a browsing page turning operation. When a document has a structure such as a chapter, section, or paragraph, the viewing location may be moved in units of chapters, sections, or paragraphs, or in a predetermined unit such as a sentence, clause, word, or link. it can. As will be described later, the operator can change the closed-curve operation attributes by changing the way the closed-curve operation is performed, change the unit of operation, execute animation display when turning pages, or stop. Can be.

(A3) Operation history operation The present invention can be applied to repetition or redoing of past operations included in the operation history.
(A4) Switching of music or moving image file The present invention can be applied to an operation of switching a file to be selected for reproduction or editing among a plurality of music or moving image files included in a list or the like. When a plurality of music or moving image files have a hierarchical structure or are categorized by category, the present invention can also be applied to movement operations between layers or categories.
(A5) Reproduction speed (reproduction direction) or volume adjustment It can be applied to a reproduction speed or volume adjustment operation of music or video being reproduced.

(A6) Application switching For example, the present invention can be applied to an operation of switching an application to be displayed in the foreground from a plurality of activated applications.
(A7) Selection Area Enlargement / Reduction Operation This can be applied to the selection area enlargement / reduction operation in various applications.
(A8) Display Image Enlargement / Reduction Operation This can be applied to an enlargement / reduction operation of a displayed map, photograph, character (font), or the like.
(A9) GUI operation The present invention can be applied to operation of operation buttons, icons, menus and the like using the GUI.

FIG. 9 is a block diagram showing a configuration of the smartphone 10 that implements the information processing apparatus 200 according to the embodiment of the present invention.
In addition, although this embodiment demonstrates the example in which the information processing apparatus 200 is implement | achieved by the smart phone 10, it is not limited to this. The information processing apparatus 200 may be, for example, a mobile phone, a PDA (Personal Digital Assistants), a tablet terminal, a personal computer, a game machine, an acoustic electronic device, a digital camera, an image display device, or other electronic devices in addition to a smartphone. Applicable.

  As illustrated in FIG. 9, the smartphone 10 according to the present embodiment includes a CPU 12, a memory 14, an I / O (Input / Output) 16, a communication control unit 18, an operation unit 22, an operation reception unit 24, A display unit 26, a display control unit 28, a speaker 32, a microphone 34, and an audio control unit 36 are provided.

  The CPU 12 is connected to each element of the smartphone 10 via the bus 40 and controls the entire smartphone 10 together with each element. The memory 14 stores user data including a program for operating the smartphone 10 and various setting data and application data used when the program operates, and a temporary work area such as a work area for the program to operate. Has an area for storing data. The I / O 16 controls input / output between the CPU 12 of the smartphone 10 and each element via the bus 40.

  In the present embodiment, the smartphone 10 performs communication control for performing wireless LAN communication with another communication apparatus capable of wireless LAN communication (so-called Wi-Fi) compliant with the IEEE802.11 series via the antenna 19 as a communication unit. The unit 18 is provided. Or the smart phone 10 may communicate with another communication apparatus via a relay station (not shown). The smartphone 10 may also include other communication means, for example, communication means (not shown) for data communication via a mobile phone network, communication means (not shown) such as Bluetooth (registered trademark) or infrared communication. .

  The operation unit 22 includes operation keys, operation buttons, switches, a jog dial, a touch pad, a touch panel, and the like. The operation reception unit 24 receives an operation of the operation unit 22 by the user and notifies the CPU 12 of the operation. The display unit 26 includes an LED (Light Emitting Diode) display, a liquid crystal display, an organic EL (ElectroLuminescence) display, and the like. The display control unit 28 displays various screens on the display unit 26 in accordance with instructions from the CPU 12.

In the case of the smartphone 10, at least a part of the operation unit 22 is configured by the touch panel unit 30 integrally with the display unit 26.
Examples of the touch panel unit 30 of the smartphone 10 include a touch panel and a touch pad. The operation receiving unit 24 receives an operation by the operator on the display unit 26 (touch panel) of the touch panel unit 30 and an operation of the operator on the operation unit 22 such as operation keys.

  The voice control unit 36 controls voice input / output with the speaker 32 or the microphone 34 or an external acoustic device in accordance with an instruction from the CPU 12.

  Each component of the information processing apparatus 200 in FIG. 5 described above includes a CPU 12 of the smartphone 10, a memory 14, a program 42 that implements the components in FIG. 5 loaded in the memory 14, and a network connection interface (I / O 16). This is realized by an arbitrary combination of hardware and software of an arbitrary computer (smart phone 10) provided. It will be understood by those skilled in the art that there are various modifications to the implementation method and apparatus. FIG. 5 shows a block of logical functional units, not a configuration of hardware units.

  Each component of the information processing apparatus 200 in FIG. 5 includes at least one software such as an operating system, a driver, and an application executed by the smartphone 10 that controls the smartphone 10 according to the present embodiment, or hardware that configures the smartphone 10. It can be realized by cooperation between the software and the software.

  In the information processing apparatus 200 according to the present embodiment, the CPU 12 of the smartphone 10 executes various processing operations corresponding to the computer program 42 according to the embodiment of the present invention, so that the various units as described above have various functions. Realized.

The computer (smartphone 10) that executes the computer program 42 according to the embodiment of the present invention associates each of a plurality of attributes related to a closed curve operation with at least one of a plurality of operation processing contents for an operation target. A rule information holding unit 206 that holds information is provided. The rule information includes a correspondence between the length of the simple closed curve trajectory as an attribute related to the closed curve operation and the operation processing amount as the operation processing content for the operation target.
The computer program 42 according to the embodiment of the present invention detects a closed curve operation that can indicate a simple closed curve trajectory, acquires its attributes, and the operation detection unit based on the rule information held in the rule information holding unit 206. It is described that the computer (the CPU 12 of the smartphone 10) executes a procedure for determining at least one operation processing content corresponding to the attribute of the closed curve operation detected by 202. Furthermore, the computer program 42 according to the embodiment of the present invention uses the length of the simple closed curve trajectory of the detected closed curve operation as an attribute of the closed curve operation that can indicate the simple closed curve trajectory in the procedure of acquiring the attribute of the closed curve operation. In the procedure of causing the computer (CPU 12 of the smartphone 10) to execute the acquisition procedure and determining the operation processing content, the length of the simple closed curve trajectory of the closed curve operation is acquired based on the rule information held in the rule information holding unit 206. It is described that the computer (the CPU 12 of the smartphone 10) executes a procedure for determining the operation processing amount corresponding to the length of the simple closed curve trajectory of the closed curve operation acquired by the procedure to be performed as the operation processing content.

  In the computer program 42 according to the embodiment of the present invention, in the procedure for acquiring the attribute of the closed curve operation, the operation indicating the intermediate trajectory before the simple closed curve trajectory is completely drawn becomes the closed curve operation indicating the simple closed curve trajectory. A procedure for determining whether or not to obtain, an operation indicating an intermediate trajectory determined to be a closed curve operation in the determining procedure is detected as a closed curve operation, a simple closed curve trajectory corresponding to the intermediate trajectory is estimated, and the estimated simple The procedure for acquiring the attribute of the closed curve operation from the closed curve trajectory is described so as to be executed by the computer (CPU 12 of the smartphone 10).

The computer program 42 of the present embodiment may be recorded on a recording medium readable by a computer (smart phone 10). The recording medium is not particularly limited, and various forms can be considered. The program 42 may be loaded from the recording medium into the memory of the computer (smart phone 10), or downloaded to the computer (smart phone 10) through the network and loaded into the memory.
The computer program 42 of this embodiment can be installed in the information processing apparatus 200 (smart phone 10) as a program (or a chip having a function) such as an application plug-in, library, OS (Operating System), and driver.

  In the configuration as described above, an operation processing method of the information processing apparatus 200 according to the present embodiment will be described below. FIG. 10 is a flowchart illustrating an example of the operation of the information processing apparatus 200 according to the present embodiment.

In the operation processing method of the information processing apparatus 200 according to the present embodiment, the information processing apparatus 200 associates each of a plurality of attributes related to the closed curve operation with at least one of a plurality of operation processing contents for the operation target. Is held in the rule information holding unit 206 (step S201). Note that the rule information held in the rule information holding unit 206 includes a correspondence between the length of the simple closed curve trajectory as an attribute related to the closed curve operation and the operation processing amount as the operation processing content for the operation target.
In the operation processing method of the information processing apparatus 200 according to the present embodiment, the information processing apparatus 200 detects a closed curve operation that can indicate a simple closed curve trajectory, and is detected as an attribute of the closed curve operation that indicates the simple closed curve trajectory. Is obtained (step S207), and based on the rule information held in the rule information holding unit 206, an operation process corresponding to the length of the simple closed curve orbit of the closed curve operation obtained in step S207. The amount is determined as the operation processing content (step S209).

  Furthermore, according to the operation processing method of the information processing apparatus 200 of the present embodiment, the information processing apparatus 200 can determine whether the operation indicating the intermediate trajectory before the simple closed curve trajectory is completely drawn can be the closed curve operation indicating the simple closed curve trajectory. (Step S203), an operation indicating an intermediate trajectory determined to be a closed curve operation in step S203 is detected as a closed curve operation, and a simple closed curve trajectory corresponding to the intermediate trajectory is estimated (step S205). The attribute of the closed curve operation is acquired from the simple closed curve trajectory (step S207).

  More specifically, in the information processing apparatus 200, first, rule information including an association between the length of a simple closed curve trajectory as an attribute related to a closed curve operation and an operation processing amount as an operation processing content for the operation target is displayed as a rule information holding unit. 206 (step S201). In this embodiment, for example, as shown in FIG. 6B, rule information that associates the length of the trajectory of the closed curve operation with the unit of movement of the browsing data is held in the rule information holding unit 206. . This step S201 may be determined in advance in the program 42, may be performed in advance as an initial setting, or may be performed when the rule information is updated at an arbitrary timing.

  When the operator performs a closed curve operation, the curve determination unit 210 of the information processing device 200 can determine whether the operation indicating the intermediate trajectory before the simple closed curve trajectory is completely drawn can be the closed curve operation indicating the simple closed curve trajectory. Is determined (step S203). The operation detection unit 202 detects an operation indicating an intermediate trajectory determined to be a closed curve operation in step S203 as a closed curve operation, and estimates a simple closed curve trajectory corresponding to the intermediate trajectory (step S205). Then, the operation detection unit 202 acquires a closed curve operation attribute from the estimated simple closed curve trajectory (step S207).

  Then, based on the rule information stored in the rule information storage unit 206, the determination unit 204 uses the operation processing amount corresponding to the length of the simple closed curve trajectory of the closed curve operation acquired in step S207 as the operation processing content. Determination is made (step S209).

  Note that while the closed curve operation is performed, for example, while an input signal from the pointing device is input, the information processing apparatus 200 repeatedly executes the processes of steps S203 to S209. Each time the operator repeatedly performs a closed curve operation, the process of switching and displaying the browsing data is repeatedly executed with a movement amount corresponding to the length of the trajectory of the closed curve operation.

  For example, as shown in FIG. 6B, in the example using rule information in which the length of the trajectory of the closed curve operation is associated with the movement unit of the browsing data, the operation detection unit 202 detects the closed curve operation, and the trajectory thereof. Is acquired (step S207). For example, as illustrated in FIG. 8, when the operation detection unit 202 detects a closed curve operation indicated by the simple closed curve trajectory R21, for example, the determination unit 204 performs a process of moving and displaying the browsing data in units of one day. Determination is made (step S209). Then, the determined process is performed by a data browsing application or the like, and data of the next day is displayed on the display unit 26 of the smartphone 10. When the operator repeats the closed curve operation indicated by the simple closed curve trajectory R21, the browsing data can be sequentially moved and displayed one day at a time.

  Further, when the operator performs a closed curve operation indicated by a larger simple closed curve trajectory R22 or R23, the operation detection unit 202 detects the closed curve operation indicated by the simple closed curve trajectory R22 or R23, and acquires its attribute. (Step S207). Then, in accordance with the rule information, the determination unit 204 determines processing for moving the browsing data in units of one week or one month (step S209). Then, the determined process is performed by the data browsing application or the like, and the data for the next week or the next month is displayed on the display unit 26 of the smartphone 10. When the operator repeats the closed curve operation indicated by the simple closed curve trajectory R23, the browsing data can be sequentially moved and displayed in units of one week or one month.

In addition, in this invention, the timing which a determination part determines a process according to closed curve operation can consider variously so that it may illustrate below.
(1) When the curve discriminating unit 210 determines that the trajectory indicated by the intermediate trajectory is a closed curve operation even before the simple closed curve trajectory is completely drawn.
(2) When the end point of the closed curve operation returns to substantially the same position as the start point (when the simple closed curve trajectory is completely drawn).
(3) When it is determined that the operation is a closed curve operation, and the simple closed curve trajectory of the closed curve operation becomes a predetermined length or more.

  In the present embodiment, the process determined by the closed curve operation is described as being executed immediately, but the present invention is not limited to this. The timing for executing the process determined by the closed curve operation is controlled by the program executing the process. Further, the determined process may be configured to inquire the operator whether or not to execute the process before executing the process, and to be executed after accepting the confirmation operation by the operator.

  As described above, according to the information processing apparatus 200 according to the embodiment of the present invention, the same effect as described above can be obtained, and the operator can change the curve length (arc size) of the simple closed curve trajectory. Since the amount of operation processing can be changed simply by gesturing, the operation can be performed with an intuitive operational feeling.

(Third embodiment)
FIG. 11 is a functional block diagram showing a logical configuration of the information processing apparatus 300 according to the embodiment of the present invention.
The information processing apparatus 300 according to the embodiment of the present invention is different from the above-described embodiment in that the processing content is determined according to a rule that associates the turning direction of the simple closed curve trajectory of the closed curve operation with the operation direction.

  The information processing apparatus 300 according to the present embodiment includes an operation detection unit 302, a determination unit 304, and a rule information holding unit 306. The operation detection unit 302 includes a curve determination unit 210 similar to the operation detection unit 202 of the information processing apparatus 200 of the above-described embodiment of FIG. 5, and further includes a direction acquisition unit 312.

In the information processing apparatus 300 according to the embodiment of the present invention, the rule information includes a correspondence between the turning direction of the simple closed curve trajectory as an attribute related to the closed curve operation and the operation processing direction as the operation processing content for the operation target.
The operation detection unit 302 further includes a direction acquisition unit 312 that acquires the turning direction of the simple closed curve trajectory of the detected closed curve operation as an attribute of the closed curve operation that can indicate the simple closed curve trajectory.
Based on the rule information held in the rule information holding unit 306, the determination unit 304 uses the operation processing direction corresponding to the turning direction of the simple closed curve trajectory of the closed curve operation acquired by the direction acquisition unit 312 as the operation processing content. decide.

In the present embodiment, by including the curve discriminating unit 210, it is possible to estimate the simple closed curve trajectory corresponding to the intermediate trajectory even at the point in time indicating the intermediate trajectory before the closed curve operation goes around.
For example, in the present embodiment, in the rule information held in the rule information holding unit 306, when the turning direction of the simple closed curve trajectory of the closed curve operation is clockwise, the browsing data is moved forward and displayed one record at a time. It is assumed that when the turning direction of the simple closed curve trajectory of the closed curve operation is counterclockwise, the browsing data is moved and displayed in the reverse direction one record at a time.

The operation of the information processing apparatus 300 of the present embodiment configured as described above will be described below.
FIG. 12 is a flowchart illustrating an example of the operation of the information processing apparatus 300 according to the present embodiment.
As shown in FIG. 12, the processing procedure of the information processing apparatus 300 of this embodiment includes steps S203 and S205 similar to the processing procedure of the information processing apparatus 200 of the above embodiment of FIG. S301, step S307, and step S309 are included.

Step S301 in FIG. 12 of the present embodiment is different from step S201 in FIG. 10 of the above embodiment in that the rule information includes the turning direction of the simple closed curve trajectory as an attribute related to the closed curve operation and the operation processing content for the operation target. It differs in that it includes an association with a direction.
Step S307 in FIG. 12 is the same as step S207 in FIG. 10 in the above embodiment, but the direction acquisition unit 312 of the operation detection unit 302 detects the simple closed curve of the closed curve operation detected as an attribute of the closed curve operation that can indicate the simple closed curve trajectory. It differs in that it acquires the turning direction of the orbit.
Step S309 in FIG. 12 differs from step S207 in FIG. 10 in the above embodiment in that the determination unit 304 turns the simple closed curve trajectory of the closed curve operation detected based on the rule information held in the rule information holding unit 306. The difference is that the operation direction corresponding to the direction is determined as the operation processing content.

  As described above, the information processing apparatus 300 according to the present embodiment is the same as the above embodiment except that the type of attribute of the simple closed curve trajectory of the closed curve operation is different from the associated operation processing content. I do. Also in other embodiments described later, the same processing as in the above embodiment is performed except that the type of attribute of the simple closed curve trajectory of the closed curve operation and the combination of the associated operation processing contents are different.

  In the present embodiment, as shown in FIG. 13, when the operator performs a clockwise closed curve operation as in the simple closed curve trajectory R31, the direction acquisition unit 312 of the operation detection unit 302 moves in the turning direction (clockwise simple (Closed curve trajectory R31) is acquired (step S307), and the determination unit 304 determines to perform the process of moving the browsing data in the forward direction one record at a time according to the rule information (step S309). ). When the operator performs a closed curve operation counterclockwise like the simple closed curve trajectory R32, the direction acquisition unit 312 of the operation detection unit 302 acquires the turning direction (counterclockwise simple closed curve trajectory R32) (step S31). In step S307, the determination unit 304 determines to perform display processing by moving the browsing data in the reverse direction one record at a time, as in B, according to the rule information (step S309).

Note that the information processing apparatus 300 may include the operation detection unit 322 illustrated in FIG. 14 instead of the operation detection unit 302 of the present embodiment. In addition to the curve determination unit 210 and the direction acquisition unit 312 of the operation detection unit 302, the operation detection unit 322 further includes a length acquisition unit 212 similar to the operation detection unit 202 of the information processing apparatus 200 of the above-described embodiment of FIG. Including.
In this example, the rule information includes, in addition to the correspondence between the length of the simple closed curve trajectory of the closed curve operation and the movement amount of the browsing data, and further, the correspondence between the turning direction of the simple closed curve trajectory of the closed curve operation and the movement direction of the browsing data. .

  In this configuration, in step S301 in the flowchart of FIG. 12, the length of the simple closed curve trajectory of the closed curve operation and the movement amount of the browsing data are associated with each other, and the turning direction of the simple closed curve trajectory of the closed curve operation and the movement direction of the browsing data are also determined. The rule information including the association is held in the rule information holding unit 306. In step S307 of FIG. 12, the length acquisition unit 212 of the operation detection unit 322 acquires the length of the simple closed curved track, and the direction acquisition unit 312 acquires the turning direction. Then, in step S309 in FIG. 12, the determination unit 304 determines the operation processing amount and the operation processing direction according to the length of the simple closed curved track acquired in step S307 and the turning direction according to the rule information.

  As shown in FIG. 15, when the operator performs a closed curve operation indicating the simple closed curve path R33, the operation detection unit 322 acquires the length (for example, 40 pixels) and the turning direction (clockwise) of the simple closed curve path R33. Then, the determination unit 304 determines a process for moving the browsing data in the forward direction and displaying it according to the rule information (step S309). When the operator performs a closed curve operation indicating the simple closed curve path R34, the operation detection unit 322 acquires the length (for example, 40 pixels) and the turning direction (counterclockwise) of the simple closed curve path R34 (step S307). The determination unit 304 determines processing for moving the browsing data in the reverse direction and displaying it in accordance with the rule information (step S309).

  Further, when the operator performs a closed curve operation indicating the simple closed curve path R35, the operation detection unit 322 acquires the length (for example, 140 pixels) and the turning direction (clockwise) of the simple closed curve path R35 (step S307). Then, the determination unit 304 determines the process of moving and displaying the browsing data by three records in the forward direction according to the rule information (step S309). When the operator performs a closed curve operation indicating the simple closed curve path R36, the operation detection unit 322 acquires the length (for example, 140 pixels) and the turning direction (counterclockwise) of the simple closed curve path R36 (step S307). The determination unit 304 determines a process for displaying the browsing data by moving it in the reverse direction by three records according to the rule information (step S309).

  In this example, the operation processing content is determined by combining both the length of the simple closed curve trajectory of the closed curve operation of the above embodiment and the turning direction. As described above, the present invention may include a configuration in which the rule information includes only the association between the turning direction of the simple closed curve trajectory of the closed curve operation and the operation direction. Further, as described later, a plurality of attributes of the closed curve operation are included. The structure which combined variously can be included, and the combination method is also considered variously.

  As described above, according to the information processing apparatus 300 according to the embodiment of the present invention, the same effect as that of the above embodiment can be obtained, and the operation can be performed only by making a gesture for changing the turning direction of the simple closed curved track. The processing direction can be changed. For example, page forward and backward can be realized by clockwise operation and counterclockwise operation, so that the operation processing can be performed with an operation intuitively understandable for the operator. it can.

As mentioned above, although embodiment of this invention was described with reference to drawings, these are the illustrations of this invention, Various structures other than the above are also employable.
(Visual display of operation track)
FIG. 16 is a functional block diagram illustrating a main configuration of an information processing apparatus 400 according to another embodiment.
In an information processing apparatus 400 according to another embodiment, in addition to the configuration of any of the information processing apparatuses according to any of the above embodiments, the operation detection unit 402 includes a curve determination unit 210, and further includes a trajectory display unit 420. In this configuration, the operator can be notified that the operation has been accepted by visually displaying the trajectory of the closed curve operation drawn by the operator. Note that the information processing apparatus 400 includes the determination unit 104 (the determination unit 204 or the determination unit 304), the rule information holding unit 106 (the rule information holding unit 206 or the rule information holding unit 306), or the length of the operation detection unit 202. Although it may include at least one of the length acquisition unit 212 and the direction acquisition unit 312 of the operation detection unit 302, it is not shown here.

In the information processing apparatus 400, the operation detection unit 402 determines whether or not the operation indicating the intermediate trajectory before the simple closed curve trajectory is completely drawn can be the closed curve operation indicating the simple closed curve trajectory, as in the above embodiment. At least a curve discriminating unit 210. Further, an operation indicating an intermediate trajectory determined to be a closed curve operation by the curve discriminating unit 210 is detected as a closed curve operation, a simple closed curve trajectory corresponding to the intermediate trajectory is estimated, and the closed curve operation is estimated from the estimated simple closed curve trajectory. Get attribute.
The information processing apparatus 400 includes a trajectory display unit 420 that superimposes and displays a simple closed curve trajectory image obtained (estimated) by the operation detection unit 402.

  As shown in FIG. 17, when the operator draws a trajectory R41, the curve discriminating unit 210 discriminates whether or not the trajectory can be a closed curve operation indicating a simple closed curve trajectory. The operation detection unit 402 detects an operation indicating an intermediate trajectory that is determined to be a closed curve operation by the curve determination unit 210 as a closed curve operation, estimates a simple closed curve trajectory corresponding to the intermediate trajectory, and the estimated simple closed curve trajectory Get attribute of closed curve operation from. Then, the trajectory display unit 420 superimposes the image R42 of the simple closed curve trajectory obtained (estimated) by the operation detection unit 402 and displays it on the screen.

Note that the image of the simple closed curve trajectory may be substantially the same size as the trajectory drawn by the operator, but is not limited thereto. It may be larger or smaller than the trajectory drawn by the operator. Further, an image of an intermediate trajectory in the middle of an operator's drawing of the trajectory may be superimposed and displayed on the screen.
The image displayed by the trajectory display unit 420 is, for example, drawn in a light-colored color such as monochrome during the image of the intermediate trajectory, and the dark-colored system when the end point of the closed curve operation returns to the same position as the start point. May be drawn in a superimposed color (highlighted display, blink display, etc.). The operator may be made aware that the operation has been accepted by changing the display color or the like.

Various image display timings by the trajectory display unit 420 are conceivable as illustrated below.
(1) An image of an intermediate trajectory in the middle of drawing the trajectory by the operator is displayed in a superimposed manner. (Whether the curve discriminating unit 210 discriminates the closed curve operation or not may be either.)
(2) The simple closed curve estimated by the operation detection unit 402 when the curve determination unit 210 determines that the trajectory indicated by the intermediate trajectory is a closed curve operation, even before the simple closed curve trajectory is completely drawn. A trajectory image is superimposed and displayed.
(3) When the end point of the closed curve operation returns to substantially the same position as the start point, an image of the simple closed curve trajectory obtained by the operation detection unit 402 is superimposed and displayed.
(4) When a process based on a closed curve operation is determined by the determining unit, an image of an arbitrary simple closed curve trajectory is superimposed and displayed. (The image may be an image of a simple closed curve trajectory obtained by the operation detection unit 402.)
The above (1) to (4) may be appropriately combined within a consistent range.

Various timings for erasing the simple closed curve trajectory image can be considered as exemplified below.
(1) After a predetermined time has elapsed.
(2) When it is detected that the operator's finger has left the screen or image.
(3) When no operation on the screen or image is detected for a predetermined time or longer.
(4) When an operation unit (operation button, menu, icon, etc.) for receiving an image deletion instruction is provided separately and the operation unit receives an image deletion instruction.
(5) When a predetermined operation such as a double tap is accepted as an image erasure instruction.
The above (1) to (5) may be appropriately combined within a consistent range.

  Further, after one operation, while the next closed curve operation is being performed, the image of the simple closed curve trajectory displayed at the time of one operation may be continuously displayed. The operator can repeat the operation with the correct gesture by tracing the displayed trajectory.

  According to this configuration, it is possible to notify the operator whether or not the system has correctly accepted the gesture.

(Notification of details of decision processing)
Furthermore, in another embodiment, the information processing apparatus may further include a processing content notification unit (not shown) that notifies the operator of the operation processing content determined by the determination unit.

For example, even when the operation indicating the intermediate trajectory before the simple closed curve trajectory is completely drawn is determined as the closed curve operation by the curve determination unit 210, the processing content notification unit determines the operation processing content determined by the determination unit as follows: The operator may be notified.
In addition, the notification is performed by displaying information indicating the operation processing content, for example, the file name of the switching destination, the page number after switching, or the like on at least one of the inside, the vicinity, and the predetermined position of the closed curve operation trajectory. The operator can be notified of the operation processing content. Further, the processing content notification unit may notify the operation processing content by voice.

Various notification timings of information indicating the processing content by the processing content notification unit can be considered as exemplified below.
(1) When the curve discriminating unit 210 determines that the trajectory indicated by the intermediate trajectory is a closed curve operation, a notice is given even before the simple closed curve trajectory is completely drawn.
(2) Notify when the end point of the closed curve operation returns to a position substantially the same as the start point.
(3) Notify when processing based on closed curve operation is determined by the determination unit.
The above (1) to (3) may be appropriately combined within a consistent range.

Also, various timings for stopping the notification of the information indicating the processing content by the processing content notification unit can be considered as exemplified below.
(1) After a predetermined time has elapsed.
(2) When it is detected that the operator's finger has left the screen or image.
(3) When no operation on the screen is detected for a predetermined time or more.
(4) When a separate operation unit (operation button, menu, icon, etc.) for receiving a notification deletion (stop) instruction is provided and the operation unit receives a notification deletion (stop) instruction.
(5) When a predetermined operation, such as a double tap, is accepted as a notification erasure (stop) instruction.
The above (1) to (5) may be appropriately combined within a consistent range.

FIG. 18 is a diagram illustrating an example of a method for notifying the operator of the operation processing content in the information processing apparatus according to another embodiment of the present invention.
In the example of FIG. 18A, the operator is notified that the browsing page moves to the next page by the closed curve operation. In the example of FIG. 18B, the operator is notified that the file with the file name “check form.xls” is displayed by the closed curve operation. In the example of FIGS. 18A and 18B, the operation processing content is presented inside the trajectory R51. In the example of FIG. 18C, the operator is notified that the viewing page is moved to the fifth page of the 40-page data by the closed curve operation. In this example, unlike FIG. 18 (a) and FIG. 18 (b), the contents of the operation process are not displayed inside the trajectory R51 of the closed curve operation, but the balloon 500 arranged in another region near the trajectory R51. Presented within. In this example, the pointing position 502 of the balloon 500 is arranged in the vicinity of the operation position of the operator, so that the operator can easily be notified that the process is executed by his / her own operation.

  According to this configuration, the operator can know what kind of processing is performed by the operation he / she is performing. If the configuration is such that notification can be performed in the middle of the operation, the operator can confirm what kind of processing is executed by the operation during the operation, so that operation errors can be reduced. Alternatively, in the case of a configuration that notifies the process determined when the curve is drawn to the end, the operator can check the process executed by the accepted operation. After notifying the operator of the determined process, the operator is further requested to execute the process execution instruction, and the process determined after the execution instruction operation is confirmed is accepted, while the operator cancels the execution. It is good also as a structure which can also be. Or it is good also as a structure which notifies the performed process to an operator, without performing confirmation to the operator before execution.

(Display of wheel image for operation)
Furthermore, in another embodiment, the information processing apparatus further superimposes and displays an operation wheel image corresponding to the simple closed curve trajectory obtained by the operation detection unit, and performs an operation on the wheel image of the operator by the closed curve. You may provide the wheel user interface part (not shown) received as operation.

As shown in FIG. 19, when the operator performs a closed curve operation and the curve determination unit 210 determines that the trajectory R61 is a closed curve operation, the operation detection unit obtains a simple closed curve trajectory corresponding to the trajectory R61. The wheel user interface unit superimposes and displays an operation wheel image 600 corresponding to the simple closed curve trajectory obtained (estimated) by the operation detection unit, and accepts an operation on the wheel image of the operator as a closed curve operation. .
The operator can perform a rotation operation on the wheel image 600, and the wheel user interface unit accepts an operation (R63, R65, R66, etc.) on the wheel image 600 by the operator as a closed curve operation. Specifically, the attribute values such as the rotation amount, rotation direction, and rotation speed of the wheel image 600 by the operation on the wheel image 600 are converted into attribute values such as the length of the closed curve operation, the turning direction, the drawing time, or the acceleration at the end point. Thus, the operation detection unit can acquire the attribute of the closed curve operation.

  The operator's operation on the wheel may be an operation of tracing the entire circumference of the wheel (indicated by a broken line R63 in the drawing), or an operation of rotating a part of the wheel little by little (indicated by solid lines R65 and R66 in the drawing). . In the case of the operation of tracing the entire circumference of the wheel, a correct gesture can be transmitted to the operator, so that operation errors and misrecognitions can be reduced. In the case of the operation of rotating a part of the wheel little by little, it becomes possible to deal with fine operations, and the application range of the operation processing contents is expanded. For example, the volume can be adjusted little by little, for example, when the volume is adjusted by a closed curve operation.

Various display timings of the wheel image 600 are conceivable as illustrated below.
(1) When the curve discriminating unit 210 determines that the trajectory indicated by the intermediate trajectory is a closed curve operation, the simple closed curve estimated by the operation detecting unit 402 even before the simple closed curve trajectory is completely drawn A wheel image corresponding to the trajectory is superimposed and displayed.
(2) When the end point of the closed curve operation returns to substantially the same position as the start point, a wheel image corresponding to the simple closed curve trajectory obtained by the operation detection unit 402 is superimposed and displayed.
(3) After it is determined that the operation is a closed curve operation, when the closed curve operation trajectory exceeds a predetermined length (enters a predetermined region), even before the simple closed curve trajectory is completely drawn, A wheel image corresponding to the simple closed curve trajectory estimated by the operation detection unit 402 is superimposed and displayed.

Various timings for erasing the wheel image 600 are conceivable as exemplified below.
(1) When it is detected that the finger of the operator has left the screen or wheel image for a predetermined time or more.
(2) When no operation on the screen or wheel image is detected for a predetermined time or longer.
(3) When an operation unit (operation button, menu, icon, etc.) provided separately for receiving a wheel deletion instruction receives a wheel deletion instruction.
(4) When a predetermined operation such as a double tap is accepted as a wheel image erasure instruction.
The above (1) to (4) may be appropriately combined within a consistent range.

  Further, the wheel image may be a multiple wheel and held in rule information to which different functions are assigned for each wheel. For example, in the case of catalog page turning processing, different functions may be assigned, such as accepting a page turning operation with the inner wheel and accepting a category switching operation with the outer wheel.

  According to this configuration, since the correct trajectory of the gesture can be transmitted to the operator, operation mistakes and erroneous recognition can be reduced.

(GUI operation)
Furthermore, in another embodiment, the information processing apparatus can be applied to operations of operation buttons, icons, menus, and the like using a GUI (Graphical User Interface). For example, as shown in FIG. 20A, the screen 710 is provided with a return icon 712 for returning the browse page and a forward icon 714 for moving the browse page backward. The operator can perform an operation instruction using the return icon 712 and the forward icon 714 by the closed curve operation of the present invention instead of clicking the icon to specify. For example, as described above, according to a rule based on an attribute such as the length of a simple closed curve trajectory, processing contents such as the number of pages and a hierarchy change can be determined according to each attribute. Therefore, the operator can change the number of pages to be sent, chapters, categories, and the like by changing the attributes such as the length of the operation curve for each icon and drawing a simple closed curve trajectory.

  Furthermore, as shown in FIG. 20B, the screen 720 is provided with four regions 722a, 722b, 722c, and 722d, and accepts different operation processes. For example, the first area 722a is an area for accepting an operation for returning the browse page to the front, and the second area 722b is an area for accepting an operation for moving the browse page backward. Furthermore, the third area 722c is an area for accepting an operation for returning the latest operation process in the operation history, and the fourth area 722d is an area for accepting an operation for repeating the latest operation process in the operation history.

  For example, when the simple closed curve trajectory R73 of the closed curve operation is drawn by the operator, the operation detection unit acquires the attribute of the detected simple closed curve trajectory and obtains the center coordinates (center of gravity position) C73 of the trajectory. And the center coordinate C73 discriminate | determines the area | region which exists (it discriminate | determines from the 4th area | region 722d here). Then, the determination unit 104 determines the operation repeat process assigned to the fourth area 722d as the operation process content. Also in the present embodiment, according to the rules based on the attributes such as the length of the simple closed curve trajectory as described above, and according to each attribute, the number of pages, the hierarchy change, or the number of history operations (return two, repeat twice, etc.) ) Processing contents such as changes can be determined. Therefore, the operator can change the number of pages to be sent, the chapter, the category, the number of history operations, and the like by changing attributes such as the length of the operation curve for each icon and drawing a simple closed curve trajectory.

(Superimposed display of information before and after switching)
Furthermore, in another embodiment, the information processing apparatus includes a curve determination unit 210 that determines whether an operation indicating an intermediate trajectory before a simple closed curve trajectory is completely drawn can be a closed curve operation indicating a simple closed curve trajectory. In addition.
The operation detection unit detects an operation indicating an intermediate trajectory determined to be a closed curve operation by the curve discriminating unit 210 as a closed curve operation, estimates a simple closed curve trajectory corresponding to the intermediate trajectory, and determines from the estimated simple closed curve trajectory Get the attribute of closed curve operation.
The information processing mounting further includes a notification unit (not shown) for notifying the operator of information indicating both the pre-execution state and the post-execution state before executing the operation processing content determined by the determination unit.

  As shown in FIG. 21, first, it is assumed that the work history information on December 1 is displayed on the screen 810. It is assumed that the operator starts a closed curve operation on the screen. At this time, it is detected that the trajectory R81 that can be a closed curve operation is counterclockwise. Thereby, a determination part determines performing the process which displays the work history information of November 12 in the past from December 1st. At this time, on the screen 820, the work history information of November 12 past December 1 is displayed superimposed on the work history information of December 1. When the closed curve operation R83 is completely drawn, only the work history information for November 12 is displayed on the screen 830.

There are various timings for canceling the operation after the operator confirms the information on November 12 displayed by drawing the trajectory R81 that can be a closed curve operation, as exemplified below.
(1) When an operation on the screen is not detected during the operation and a predetermined time has elapsed.
(2) When an operation to reverse the closed curve operation is detected.
(3) When a predetermined operation such as a double tap is accepted as an operation cancellation instruction.
(4) When a separate operation unit (operation button, menu, icon, etc.) for receiving an operation cancellation instruction receives an operation cancellation instruction.
The above (1) to (4) may be appropriately combined within a consistent range.

Various conditions can be considered for determining whether or not the closed curve operation is confirmed, as exemplified below.
(1) It is determined whether or not the closed curve operation has reached an arbitrary simple closed curve region. When the operation exceeds an arbitrary region, it is determined that the closed curve operation is confirmed. If the closed curve operation is confirmed, the process determined by the closed curve operation may be executed even when the finger leaves the screen and the operation is not detected during the closed curve operation.
(2) It is determined based on whether or not the end point of the closed curve operation has returned to the same position as the start point. When returning to almost the same position, it is determined that the closed curve operation is confirmed.
(3) Even when an operation confirmation instruction (operation button, menu, icon, etc.) provided separately is received, even before the closed curve operation is completely drawn.
(4) When a predetermined operation such as a double tap is accepted as an operation confirmation instruction even before the closed curve operation is completely drawn.
The above (1) to (4) may be appropriately combined within a consistent range.

  When performing superimposed display, the information before execution and the information after execution should be visually distinguishable by changing the color (or shading, etc.) or changing the character size. desirable. In addition, information before execution may be faded out with animation, and information after execution may be faded in with animation.

  The notification unit is not limited to display, and may be notified by voice or the like.

  As described above, according to the information processing apparatus of the present embodiment, even during the operation, the operator is notified of information indicating the state before and after the process executed by the operation, so that the operator can perform before and after the execution. Since the information indicating the status can be confirmed during the operation, the operation can be confirmed after confirming the information indicating the post-execution status, so that operation errors can be reduced and work efficiency can be improved.

In the rule information of the present invention, as shown in FIG. 22, various operation processing contents can be associated with various attributes of the simple closed curve trajectory of the closed curve operation.
Various operation processing contents can be considered depending on the operation target.

(A) Turning direction and moving direction When the closed curve operation is applied to an application for browsing sequential information, the closed curve operation can be used for the operation of sequentially switching and displaying the browsing information.
Here, the sequential information is information having a predetermined arrangement structure. For example, a plurality of image files included in an arbitrary folder are arranged in a predetermined order, for example, ascending order or descending order according to shooting date / time or file name. Information. Alternatively, it includes information such as document data having a plurality of pages arranged in the order of pages, chapters, sections, paragraphs, sentences, etc. in the document.
As already described in the above embodiment, the association between the turning direction of the simple closed curve trajectory of the closed curve operation and the switching movement direction of the browsing information can be included in the rule information. When the turning direction is clockwise, the browsing information can be switched to the forward direction, and the information lined up behind can be displayed. On the other hand, when the turning direction is counterclockwise, the browsing information can be switched in the reverse direction, and the information arranged in front can be displayed.

Furthermore, as shown in FIG. 23, a closed curve operation may be used for the operation history repeat (REDO) and redo (UNDO) operations.
When operated clockwise, the latest operation in the operation history is repeated for each operation, and when operated counterclockwise, the past operation can be redone in order from the latest operation in the operation history.

(B) Length and Amount of Movement As already described in the above embodiment, the rule information can include the correspondence between the length of the simple closed curve trajectory of the closed curve operation and the amount of movement when the browsing information is switched.
Even in this example, the closed curve operation can be applied to an application for browsing sequential information.
When the length of the simple closed curve trajectory of the closed curve operation is 200 to 300 pixels, the movement amount is set to 3 records, and information arranged behind the 3 records can be displayed by the closed curve operation. When (a) and (b) are combined and the length of the simple closed curve trajectory of the counterclockwise closed curve operation is 200 to 300 pixels, the information arranged three records before can be displayed by the closed curve operation.

(C) Time and Hierarchy The rule information may include a correspondence between the time taken to draw a simple closed curve trajectory of the closed curve operation and a process of changing the hierarchy or category of the browsing information.
The rule information includes a correspondence between a length of time required for a closed curve operation that can indicate a simple closed curve trajectory as an attribute related to the closed curve operation and an operation processing amount as an operation processing content for the operation target.
The operation detection unit (not shown) further includes a time acquisition unit (not shown) that acquires the length of time required for the detected closed curve operation as an attribute of the closed curve operation that can indicate a simple closed curve trajectory.
The determination unit (not shown), based on the rule information held in the rule information holding unit (not shown), calculates the operation processing amount corresponding to the length of time required for the closed curve operation acquired by the time acquisition unit. Determined as operation processing contents.
For example, when the time taken to draw the simple closed curve trajectory of the closed curve operation is longer than a predetermined time (for example, 3 seconds or more), the closed curve operation causes one higher (or lower) hierarchy to which the browsing information belongs or another Information can be displayed by moving to a category (ascending / descending order of names, or a predetermined order).
The length of time taken to draw the simple closed curve trajectory may be the speed at which the simple closed curve trajectory is drawn.

  For example, when the operation target is a report, the browsing information has a hierarchical structure such as daily reports, weekly reports, monthly reports, and the like, and it is possible to move between hierarchical levels of daily reports, weekly reports, and monthly reports by a closed curve operation. And, while browsing each level, for example, monthly report, by applying a combination of the rules (a) and (b) above, changing the length and direction of the simple closed curve trajectory, The monthly report month can be moved forward or backward for several months. If the trajectory of the closed curve operation is drawn over 3 seconds while watching the monthly report, the hierarchy can be moved to the weekly report or daily report, and the browsing information can be switched and displayed.

(D) Acceleration and processing function The rule information may include an association between the acceleration at the end point of the simple closed curve trajectory of the closed curve operation and the processing function to be switched.
The rule information includes an association between an acceleration at the end point of a closed curve operation that can indicate a simple closed curve trajectory as an attribute related to the closed curve operation, and a processing function that switches between positive and negative accelerations as the operation processing content for the operation target.
The operation detection unit (not shown) further includes an acceleration acquisition unit (not shown) that acquires the acceleration at the end point of the detected closed curve operation as an attribute of the closed curve operation that can indicate a simple closed curve trajectory.
Based on the rule information held in the rule information holding unit (not shown), the determination unit (not shown) performs processing functions corresponding to the positive / negative acceleration of the end point of the closed curve operation acquired by the acceleration acquisition unit. Determined as processing content.

  For example, when the operation target is an electronic catalog, page turning of browsing information can be performed by a closed curve operation. When the operator repeats the closed curve operation, the pages of the electronic catalog are turned one after another. At this time, if the operator slowly moves the end point of the closed curve operation (acceleration is negative), an animation of turning the page of the electronic catalog is displayed. On the other hand, when the operator quickly moves the end point of the closed curve operation (acceleration is positive), the animation of turning the page of the electronic catalog is stopped.

(E) Position and processing As described in the GUI operation of the above embodiment, the position of the center of gravity on the screen where the closed curve operation is detected, and the function associated with the arrangement of the GUI (or area) provided on the screen May be included in the rule information.
The rule information includes a correspondence between the position of the center of gravity of the closed curve operation that can indicate a simple closed curve trajectory as an attribute related to the closed curve operation, and the function associated with the arrangement of the GUI (or region) as the operation processing content for the operation target. .
The operation detection unit (not shown) further includes a centroid position acquisition unit (not shown) that acquires the position of the centroid on the screen of the detected closed curve operation as an attribute of the closed curve operation that can indicate a simple closed curve trajectory.
The determining unit (not shown) is arranged at the position of the center of gravity of the closed curve operation acquired by the center of gravity position acquiring unit based on the rule information held in the rule information holding unit (not shown). Is determined as the operation processing content.

  While the present invention has been described with reference to the embodiments and examples, the present invention is not limited to the above embodiments and examples. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

Hereinafter, examples of the reference form will be added.
1. In the computer for realizing the information processing device,
A procedure for holding rule information in which each of a plurality of attributes related to a closed curve operation that can indicate a simple closed curve trajectory is associated with at least one of a plurality of operation processing contents for an operation target;
Procedure to detect closed curve operation and get its attributes,
A program for executing a procedure for determining at least one operation processing content corresponding to an attribute of a detected closed curve operation based on retained rule information.
2. 1. In the program described in
The rule information includes a correspondence between the length of the simple closed curve trajectory as an attribute related to the closed curve operation and an operation processing amount as an operation processing content for the operation target,
In the procedure of detecting the closed curve operation and acquiring the attribute,
Causing the computer to further execute a procedure for obtaining the length of the simple closed curve trajectory of the detected closed curve operation as an attribute of the closed curve operation capable of indicating the simple closed curve trajectory;
In the determining procedure, an operation corresponding to the length of the simple closed curve trajectory of the closed curve operation acquired by the procedure of acquiring the length of the simple closed curve trajectory of the closed curve operation based on the rule information held. A program for causing a computer to execute a procedure for determining a processing amount as the operation processing content.
3. 1. Or 2. In the program described in
In the procedure of detecting the closed curve operation and acquiring the attribute,
Causing the computer to further execute a procedure for determining whether an operation indicating the intermediate trajectory before the simple closed curve trajectory is completely drawn can be a closed curve operation indicating the simple closed curve trajectory;
In the procedure for detecting the closed curve operation and acquiring the attribute thereof, the operation indicating the intermediate trajectory determined to be the closed curve operation in the determining procedure is detected as the closed curve operation, and corresponds to the intermediate trajectory. A program for causing a computer to execute a procedure for estimating the simple closed curve trajectory and acquiring the attribute of the closed curve operation from the estimated simple closed curve trajectory.
4). 1. To 3. In any program,
The rule information includes a correspondence between a turning direction of the simple closed curve trajectory as an attribute related to the closed curve operation and an operation processing direction as operation processing content for the operation target,
In the procedure of detecting the closed curve operation and acquiring the attribute,
Causing the computer to further execute a procedure for obtaining a turning direction of the simple closed curve trajectory of the detected closed curve operation as an attribute of the closed curve operation capable of indicating the simple closed curve trajectory;
In the determining procedure, the operation processing direction corresponding to the turning direction of the simple closed curve trajectory of the closed curve operation acquired in the procedure of acquiring the turning direction based on the rule information held is the operation processing content. A program for causing a computer to execute the procedure to be determined.
5. 1. To 4. In any program,
further,
The rule information includes a correspondence between a length of time required for a closed curve operation that can indicate the simple closed curve trajectory as an attribute related to the closed curve operation and an operation processing amount as an operation processing content for the operation target,
In the procedure of detecting the closed curve operation and acquiring the attribute,
As a closed-curve operation attribute that can indicate the simple closed-curve trajectory, the computer is further caused to execute a procedure for obtaining a length of time required for the detected closed-curve operation,
In the determining step, an operation processing amount corresponding to the length of time required for the closed curve operation acquired in the procedure of acquiring the length of time required for the closed curve operation based on the rule information held. A program for causing a computer to execute a procedure determined as the operation processing content.
6). 1. To 5. In any program,
further,
The rule information associates an acceleration at an end point of a closed curve operation that can indicate the simple closed curve trajectory as an attribute related to the closed curve operation and a processing function that switches between positive and negative of the acceleration as an operation processing content for the operation target. Including
In the procedure of detecting the closed curve operation and acquiring the attribute,
As a closed curve operation attribute that can indicate the simple closed curve trajectory, further causing the computer to execute a procedure for obtaining an acceleration of the end point of the detected closed curve operation,
In the determining procedure, based on the rule information held, the processing function corresponding to the sign of the end point acceleration of the closed curve operation acquired in the procedure for acquiring the acceleration is determined as the operation processing content. A program that causes a computer to execute procedures.
7). 1. To 6. In any program,
In the procedure of detecting the closed curve operation and acquiring the attribute,
Causing the computer to further execute a procedure for determining whether an operation indicating the intermediate trajectory before the simple closed curve trajectory is completely drawn can be a closed curve operation indicating the simple closed curve trajectory;
In the procedure of detecting the closed curve operation and acquiring the attribute,
The operation indicating the intermediate trajectory determined to be the closed curve operation in the determining procedure is detected as the closed curve operation, the simple closed curve trajectory corresponding to the intermediate trajectory is estimated, and the estimated simple closed curve trajectory The computer is caused to execute a procedure for obtaining the attribute of the closed curve operation from
further,
A program for causing a computer to execute a procedure for superimposing an image of the simple closed curve trajectory obtained by a procedure for detecting the closed curve operation and acquiring its attribute.
8). 7). In the program described in
further,
An operation wheel image corresponding to the simple closed curve trajectory obtained by the procedure of detecting the closed curve operation and acquiring the attribute is superimposed and displayed, and an operation on the wheel image by the operator is defined as the closed curve operation. A program that causes a computer to execute the accepted procedure.
9. 1. To 8. In any program,
A program for causing a computer to execute a procedure for notifying an operator of the operation processing content determined in the determining procedure.
10. 1. Thru 9. In any program,
In the procedure of detecting the closed curve operation and acquiring the attribute,
Causing the computer to further execute a procedure for determining whether an operation indicating the intermediate trajectory before the simple closed curve trajectory is completely drawn can be a closed curve operation indicating the simple closed curve trajectory;
In the procedure of detecting the closed curve operation and acquiring the attribute,
The operation indicating the intermediate trajectory determined to be the closed curve operation in the determining procedure is detected as the closed curve operation, the simple closed curve trajectory corresponding to the intermediate trajectory is estimated, and the estimated simple closed curve trajectory The computer is caused to execute a procedure for obtaining the attribute of the closed curve operation from
A program for causing a computer to execute a procedure for notifying an operator of information indicating both a pre-execution state and a post-execution state before executing the operation processing content determined in the determining procedure.

11. Information processing device
A storage unit that holds rule information in which each of a plurality of attributes related to a closed curve operation that can indicate a simple closed curve trajectory is associated with at least one of a plurality of operation processing contents for an operation target;
The information processing apparatus is
Detect closed curve operation, get its attributes,
Holding rule information in which each of the plurality of attributes related to the closed curve operation is associated with at least one of a plurality of operation processing contents for the operation target;
An operation processing method for an information processing apparatus, which determines at least one operation processing content corresponding to an attribute of a detected closed curve operation based on the stored rule information.
12 11. In the operation processing method of the information processing apparatus described in
The rule information includes a correspondence between the length of the simple closed curve trajectory as an attribute related to the closed curve operation and an operation processing amount as an operation processing content for the operation target,
The information processing apparatus is
Obtaining the length of the simple closed curve trajectory of the detected closed curve operation as an attribute of the closed curve operation that can indicate the simple closed curve trajectory;
An operation processing method for an information processing apparatus, wherein an operation processing amount corresponding to a length of the simple closed curve trajectory of the acquired closed curve operation is determined as the operation processing content based on the stored rule information.
13. 11. Or 12. In the operation processing method of the information processing apparatus described in
The information processing apparatus is
Determining whether an operation indicating an intermediate trajectory before the simple closed curve trajectory is completely drawn can be a closed curve operation indicating the simple closed curve trajectory;
The operation indicating the intermediate trajectory determined to be the closed curve operation is detected as the closed curve operation, the simple closed curve trajectory corresponding to the intermediate trajectory is estimated, and the closed curve operation is estimated from the estimated simple closed curve trajectory. An information processing apparatus operation processing method for acquiring an attribute.
14 11. Thru 13. In the operation processing method of the information processing apparatus according to any one of the above,
The rule information includes a correspondence between a turning direction of the simple closed curve trajectory as an attribute related to the closed curve operation and an operation processing direction as operation processing content for the operation target,
The information processing apparatus is
As a closed curve operation attribute that can indicate the simple closed curve trajectory, to obtain the turning direction of the simple closed curve trajectory of the detected closed curve operation,
An operation processing method for an information processing apparatus, wherein an operation processing direction corresponding to a turning direction of the simple closed curve trajectory of the acquired closed curve operation is determined as the operation processing content based on the rule information held.
15. 11. To 14. In the operation processing method of the information processing apparatus according to any one of the above,
further,
The rule information includes a correspondence between a length of time required for a closed curve operation that can indicate the simple closed curve trajectory as an attribute related to the closed curve operation and an operation processing amount as an operation processing content for the operation target,
The information processing apparatus is
As a closed curve operation attribute that can indicate the simple closed curve trajectory, to obtain the length of time required for the detected closed curve operation,
An operation processing method for an information processing apparatus, wherein an operation processing amount corresponding to a length of time required for the acquired closed curve operation is determined as the operation processing content based on the stored rule information.
16. 11. To 15. In the operation processing method of the information processing apparatus according to any one of the above,
further,
The rule information associates an acceleration at an end point of a closed curve operation that can indicate the simple closed curve trajectory as an attribute related to the closed curve operation and a processing function that switches between positive and negative of the acceleration as an operation processing content for the operation target. Including
The information processing apparatus is
As an attribute of the closed curve operation that can indicate the simple closed curve trajectory, the acceleration of the end point of the detected closed curve operation is acquired,
An operation processing method for an information processing apparatus, which determines, as the operation processing content, a processing function corresponding to the sign of acceleration of the end point of the acquired closed curve operation based on the stored rule information.
17. 11. To 16. In the operation processing method of the information processing apparatus according to any one of the above,
The information processing apparatus is
Determining whether an operation indicating an intermediate trajectory before the simple closed curve trajectory is completely drawn can be a closed curve operation indicating the simple closed curve trajectory;
The operation indicating the intermediate trajectory determined to be the closed curve operation is detected as the closed curve operation, the simple closed curve trajectory corresponding to the intermediate trajectory is estimated, and the closed curve operation is estimated from the estimated simple closed curve trajectory. Get attributes,
further,
An operation processing method for an information processing apparatus, wherein an image of the obtained simple closed curve trajectory is superimposed and displayed on a screen.
18. 17. In the operation processing method of the information processing apparatus described in
The information processing apparatus further includes:
An operation processing method for an information processing apparatus, wherein an operation wheel image corresponding to the obtained simple closed curve trajectory is superimposed and displayed, and an operation on the wheel image by an operator is accepted as the closed curve operation.
19. 11. To 18. In the operation processing method of the information processing apparatus according to any one of the above,
The information processing apparatus is
An operation processing method of an information processing apparatus for notifying an operator of the determined operation processing content.
20. 11. Thru 19. In the operation processing method of the information processing apparatus according to any one of the above,
The information processing apparatus is
Determining whether an operation indicating an intermediate trajectory before the simple closed curve trajectory is completely drawn can be a closed curve operation indicating the simple closed curve trajectory;
The operation indicating the intermediate trajectory determined to be the closed curve operation is detected as the closed curve operation, the simple closed curve trajectory corresponding to the intermediate trajectory is estimated, and the closed curve operation is estimated from the estimated simple closed curve trajectory. Get attributes,
An operation processing method for an information processing apparatus that notifies an operator of information indicating both states before and after execution before executing the determined operation processing content.
21. An operation detecting means for detecting a closed curve operation capable of indicating a simple closed curve trajectory and acquiring the attribute;
Holding means for holding rule information in which each of the plurality of attributes related to the closed curve operation is associated with at least one of a plurality of operation processing contents for the operation target;
Determining means for determining at least one operation processing content corresponding to an attribute of the closed curve operation detected by the operation detecting means based on the rule information held in the holding means;
An information processing apparatus comprising:
22. 21. In the information processing apparatus described in
The rule information includes a correspondence between the length of the simple closed curve trajectory as an attribute related to the closed curve operation and an operation processing amount as an operation processing content for the operation target,
The operation detecting means includes
As an attribute of a closed curve operation that can indicate the simple closed curve trajectory, further includes a length acquisition unit that acquires a length of the simple closed curve trajectory of the detected closed curve operation,
The determining means determines the operation processing amount corresponding to the length of the simple closed curve trajectory of the closed curve operation acquired by the length acquisition unit based on the rule information held in the holding means. Information processing device determined as content.
23. 21. Or 22. In the information processing apparatus described in
The operation detecting means includes
A curve discriminating unit that discriminates whether or not the operation indicating the intermediate trajectory before the simple closed curve trajectory is completely drawn can be a closed curve operation indicating the simple closed curve trajectory;
The operation detection means detects the operation indicating the intermediate trajectory determined by the curve discriminating unit as the closed curve operation as the closed curve operation, estimates the simple closed curve trajectory corresponding to the intermediate trajectory, An information processing apparatus that acquires an attribute of the closed curve operation from an estimated simple closed curve trajectory.
24. 21. Thru 23. In the information processing apparatus according to any one of
The rule information includes a correspondence between a turning direction of the simple closed curve trajectory as an attribute related to the closed curve operation and an operation processing direction as operation processing content for the operation target,
The operation detecting means includes
A direction acquisition unit that acquires a turning direction of the simple closed curve trajectory of the detected closed curve operation as an attribute of the closed curve operation that can indicate the simple closed curve trajectory;
The determination means determines the operation processing direction corresponding to the turning direction of the simple closed curve trajectory of the closed curve operation acquired by the direction acquisition unit based on the rule information held in the holding means. Information processing apparatus determined as
25. 21. To 24. In the information processing apparatus according to any one of
further,
The rule information includes a correspondence between a length of time required for a closed curve operation that can indicate the simple closed curve trajectory as an attribute related to the closed curve operation and an operation processing amount as an operation processing content for the operation target,
The operation detecting means includes
As a closed curve operation attribute that can indicate the simple closed curve trajectory, further includes a time acquisition unit that acquires a length of time required for the detected closed curve operation,
The determination unit determines an operation processing amount corresponding to a length of time required for the closed curve operation acquired by the time acquisition unit as the operation processing content based on the rule information held in the holding unit. Information processing apparatus.
26. 21. To 25. In the information processing apparatus according to any one of
further,
The rule information associates an acceleration at an end point of a closed curve operation that can indicate the simple closed curve trajectory as an attribute related to the closed curve operation and a processing function that switches between positive and negative of the acceleration as an operation processing content for the operation target. Including
The operation detecting means includes
As an attribute of a closed curve operation that can indicate the simple closed curve trajectory, further includes an acceleration acquisition unit that acquires acceleration of the end point of the detected closed curve operation,
The determining unit determines, as the operation processing content, a processing function corresponding to the positive / negative of the acceleration at the end point of the closed curve operation acquired by the acceleration acquisition unit based on the rule information held in the holding unit. Information processing apparatus.
27. 21. Thru 26. In the information processing apparatus according to any one of
The operation detecting means includes
A curve discriminating unit that discriminates whether or not the operation indicating the intermediate trajectory before the simple closed curve trajectory is completely drawn can be a closed curve operation indicating the simple closed curve trajectory;
The operation detecting means includes
The operation indicating the intermediate trajectory determined to be the closed curve operation by the curve determination unit is detected as the closed curve operation, the simple closed curve trajectory corresponding to the intermediate trajectory is estimated, and the estimated simple closed curve trajectory To obtain the attribute of the closed curve operation from
further,
An information processing apparatus comprising trajectory display means that superimposes and displays the image of the simple closed curve trajectory obtained by the operation detection means.
28. 27. In the information processing apparatus described in
further,
Information processing comprising wheel user interface means for superimposing and displaying an operation wheel image corresponding to the simple closed curve trajectory obtained by the operation detection means and receiving an operation on the wheel image by the operator as the closed curve operation apparatus.
29. 21. Thru 28. In the information processing apparatus according to any one of
An information processing apparatus further comprising processing content notification means for notifying an operator of the operation processing content determined by the determination means.
30. 21. Thru 29. In the information processing apparatus according to any one of
The operation detecting means includes
A curve discriminating unit that discriminates whether or not the operation indicating the intermediate trajectory before the simple closed curve trajectory is completely drawn can be a closed curve operation indicating the simple closed curve trajectory;
The operation detecting means includes
The operation indicating the intermediate trajectory determined to be the closed curve operation by the curve determination unit is detected as the closed curve operation, the simple closed curve trajectory corresponding to the intermediate trajectory is estimated, and the estimated simple closed curve trajectory To obtain the attribute of the closed curve operation from
An information processing apparatus further comprising notification means for notifying an operator of information indicating a state before and after execution before executing the operation processing content determined by the determination means.

10 Smartphone 12 CPU
14 memory 18 communication control unit 19 antenna 22 operation unit 24 operation reception unit 26 display unit 28 display control unit 30 touch panel unit 32 speaker 34 microphone 36 voice control unit 40 bus 42 program 60 computer 62 CPU
64 ROM
66 RAM
68 I / O
69 Bus 70 Program 72 Display device 74 Operation input device 76 Touch panel 100 Information processing device 102 Operation detection unit 102 Operation detection unit 104 Determination unit 106 Rule information holding unit 200 Information processing device 202 Operation detection unit 204 Determination unit 206 Rule information storage unit 210 Curve determination unit 212 Acquisition unit 300 Information processing device 302 Operation detection unit 304 Determination unit 306 Rule information holding unit 312 Direction acquisition unit 322 Operation detection unit 400 Information processing device 402 Operation detection unit 412 Track acquisition unit 420 Track display unit 502 Position 600 Wheel Image 710 Screen 712, 714 Icon 720 Screen 722a, 722b, 722c, 722d Area 810, 820, 830 screen

Claims (9)

An operation detecting means for detecting a closed curve operation capable of indicating a simple closed curve trajectory and acquiring the attribute;
Holding means for holding rule information in which each of the plurality of attributes related to the closed curve operation is associated with at least one of a plurality of operation processing contents for the operation target;
Determining means for determining at least one operation processing content corresponding to an attribute of the closed curve operation detected by the operation detecting means based on the rule information held in the holding means;
With
The operation detecting means includes
A curve discriminating unit that discriminates whether or not the operation indicating the intermediate trajectory before the simple closed curve trajectory is completely drawn can be a closed curve operation indicating the simple closed curve trajectory;
The operation detecting means includes
The operation indicating the intermediate trajectory determined to be the closed curve operation by the curve determination unit is detected as the closed curve operation, the simple closed curve trajectory corresponding to the intermediate trajectory is estimated, and the estimated simple closed curve trajectory To obtain the attribute of the closed curve operation from
further,
An information processing apparatus comprising notification means for notifying an operator of information indicating a state before and after execution before executing the operation processing content determined by the determination means. An operation detecting means for detecting a closed curve operation capable of indicating a simple closed curve trajectory and acquiring the attribute;
Holding means for holding rule information in which each of the plurality of attributes related to the closed curve operation is associated with at least one of a plurality of operation processing contents for the operation target;
Determining means for determining at least one operation processing content corresponding to an attribute of the closed curve operation detected by the operation detecting means based on the rule information held in the holding means;
With
The operation target has a hierarchical structure or is classified into a category,
further,
The rule information includes a correspondence between a reference value of the length of time required for a closed curve operation that can indicate the simple closed curve trajectory as an attribute related to the closed curve operation, and the order of movement of a hierarchy or category as the operation processing content for the operation target Including
The operation detecting means includes
As a closed curve operation attribute that can indicate the simple closed curve trajectory, further includes a time acquisition unit that acquires a length of time required for the detected closed curve operation,
The determining means, based on the rule information held in the holding means, when the length of time required for the closed curve operation acquired by the time acquisition unit is equal to or greater than the reference value, The order of movement is determined as the content of the operation processing, and when the length of time required for the closed curve operation acquired by the time acquisition unit is less than the reference value, based on the rule information held in the holding unit An information processing apparatus that determines at least one operation processing content corresponding to the attribute of the closed curve operation detected by the operation detection means. The information processing apparatus according to claim 1 or 2 ,
The operation detecting means includes
A curve discriminating unit that discriminates whether or not the operation indicating the intermediate trajectory before the simple closed curve trajectory is completely drawn can be a closed curve operation indicating the simple closed curve trajectory;
The operation detecting means includes
The operation indicating the intermediate trajectory determined to be the closed curve operation by the curve determination unit is detected as the closed curve operation, the simple closed curve trajectory corresponding to the intermediate trajectory is estimated, and the estimated simple closed curve trajectory To obtain the attribute of the closed curve operation from
further,
A trajectory display means for superimposing an image of the simple closed curve trajectory obtained by the operation detection means and displaying it on a screen;
A wheel user interface unit that superimposes and displays an operation wheel image corresponding to the simple closed curve trajectory obtained by the operation detection unit and receives an operation of the operator on the wheel image as the closed curve operation. ,
The operation detecting means is configured to obtain an attribute value including a rotation amount, a rotation direction, and a rotation speed of the wheel image due to an operation of the operator on the wheel image by the length of the closed curve operation, a turning direction, a drawing time, or an end point. An information processing apparatus that converts the attribute value including acceleration and acquires the attribute of the closed curve operation. The information processing apparatus according to any one of claims 1 to 3 ,
The rule information includes a correspondence between a turning direction of the simple closed curve trajectory as an attribute related to the closed curve operation and an operation processing direction as operation processing content for the operation target,
The operation detecting means includes
A direction acquisition unit that acquires a turning direction of the simple closed curve trajectory of the detected closed curve operation as an attribute of the closed curve operation that can indicate the simple closed curve trajectory;
The determination means determines the operation processing direction corresponding to the turning direction of the simple closed curve trajectory of the closed curve operation acquired by the direction acquisition unit based on the rule information held in the holding means. Information processing apparatus determined as The information processing apparatus according to any one of claims 1 to 4 ,
further,
The rule information associates an acceleration at an end point of a closed curve operation that can indicate the simple closed curve trajectory as an attribute related to the closed curve operation and a processing function that switches between positive and negative of the acceleration as an operation processing content for the operation target. Including
The operation detecting means includes
As an attribute of a closed curve operation that can indicate the simple closed curve trajectory, further includes an acceleration acquisition unit that acquires acceleration of the end point of the detected closed curve operation,
The determining unit determines, as the operation processing content, a processing function corresponding to the positive / negative of the acceleration at the end point of the closed curve operation acquired by the acceleration acquisition unit based on the rule information held in the holding unit. Information processing apparatus. In the computer for realizing the information processing device,
A procedure for holding rule information in which each of a plurality of attributes related to a closed curve operation that can indicate a simple closed curve trajectory is associated with at least one of a plurality of operation processing contents for an operation target;
Procedure to detect closed curve operation and get its attributes,
A procedure for determining at least one operation processing content corresponding to the attribute of the detected closed curve operation based on the stored rule information;
In addition,
A procedure for determining whether an operation indicating an intermediate trajectory before the simple closed curve trajectory is completely drawn can be a closed curve operation indicating the simple closed curve trajectory;
The operation indicating the intermediate trajectory determined to be the closed curve operation by the determining procedure is detected as the closed curve operation, the simple closed curve trajectory corresponding to the intermediate trajectory is estimated, and the estimated simple closed curve trajectory Obtaining the attribute of the closed curve operation from
A program for executing a procedure for notifying an operator of information indicating both a pre-execution state and a post-execution state before executing the operation processing content determined by the determining procedure. In the computer for realizing the information processing device,
A procedure for holding rule information in which each of a plurality of attributes related to a closed curve operation that can indicate a simple closed curve trajectory is associated with at least one of a plurality of operation processing contents for an operation target;
Procedure to detect closed curve operation and get its attributes,
A procedure for determining at least one operation processing content corresponding to the attribute of the detected closed curve operation based on the stored rule information;
The operation target has a hierarchical structure or is classified into a category,
The rule information includes a correspondence between a reference value of the length of time required for a closed curve operation that can indicate the simple closed curve trajectory as an attribute related to the closed curve operation, and the order of movement of a hierarchy or category as the operation processing content for the operation target Including
In addition,
A procedure for obtaining a length of time required for the detected closed curve operation as an attribute of the closed curve operation that can indicate the simple closed curve trajectory;
Based on the stored rule information, when the time taken for the closed curve operation to be acquired is equal to or greater than the reference value, the order of movement of the hierarchy or the category is determined as the operation processing content, and acquired. When the length of time taken for the closed curve operation to be performed is less than the reference value, at least one operation corresponding to the attribute of the closed curve operation detected by the procedure for acquiring the attribute based on the stored rule information A program for executing a procedure for determining processing contents. Information processing device
A storage unit that holds rule information in which each of a plurality of attributes related to a closed curve operation that can indicate a simple closed curve trajectory is associated with at least one of a plurality of operation processing contents for an operation target;
The information processing apparatus is
Detect closed curve operation, get its attributes,
Based on the rule information held, at least one operation processing content corresponding to the detected closed curve operation attribute is determined,
Determining whether an operation indicating an intermediate trajectory before the simple closed curve trajectory is completely drawn can be a closed curve operation indicating the simple closed curve trajectory;
The operation indicating the intermediate trajectory determined to be the closed curve operation is detected as the closed curve operation, the simple closed curve trajectory corresponding to the intermediate trajectory is estimated, and the closed curve operation is estimated from the estimated simple closed curve trajectory. Get attributes,
An operation processing method for an information processing apparatus that notifies an operator of information indicating both states before and after execution before executing the determined operation processing content. Information processing device
A storage unit that holds rule information in which each of a plurality of attributes related to a closed curve operation that can indicate a simple closed curve trajectory is associated with at least one of a plurality of operation processing contents for an operation target;
The information processing apparatus is
Detect closed curve operation, get its attributes,
Based on the rule information held, at least one operation processing content corresponding to the detected closed curve operation attribute is determined,
The operation target has a hierarchical structure or is classified into a category,
The rule information includes a correspondence between a reference value of the length of time required for a closed curve operation that can indicate the simple closed curve trajectory as an attribute related to the closed curve operation, and the order of movement of a hierarchy or category as the operation processing content for the operation target Including
Further, the information processing apparatus
As a closed curve operation attribute that can indicate the simple closed curve trajectory, to obtain the length of time required for the detected closed curve operation,
Based on the stored rule information, when the time taken for the closed curve operation to be acquired is equal to or greater than the reference value, the order of movement of the hierarchy or the category is determined as the operation processing content, and acquired. Information for determining at least one operation processing content corresponding to the attribute of the detected closed curve operation based on the stored rule information when the length of time taken for the closed curve operation is less than the reference value An operation processing method for a processing apparatus.