WO2018186011A1 - Dispositif de traitement d'informations, procédé de traitement d'informations et programme - Google Patents

Dispositif de traitement d'informations, procédé de traitement d'informations et programme Download PDF

Info

Publication number
WO2018186011A1
WO2018186011A1 PCT/JP2018/003081 JP2018003081W WO2018186011A1 WO 2018186011 A1 WO2018186011 A1 WO 2018186011A1 JP 2018003081 W JP2018003081 W JP 2018003081W WO 2018186011 A1 WO2018186011 A1 WO 2018186011A1
Authority
WO
WIPO (PCT)
Prior art keywords
twist
information processing
display control
processing apparatus
swipe
Prior art date
Application number
PCT/JP2018/003081
Other languages
English (en)
Japanese (ja)
Inventor
津田　崇基
Original Assignee
ソニー株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニー株式会社 filed Critical ソニー株式会社
Publication of WO2018186011A1 publication Critical patent/WO2018186011A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the present disclosure relates to an information processing apparatus, an information processing method, and a program.
  • Patent Document 1 discloses an information processing apparatus that can make the relationship between an image displayed on a display unit and a user's operation closer to an actual operation.
  • the present disclosure proposes an information processing apparatus, an information processing method, and a program capable of realizing a more intuitive gesture operation.
  • a determination unit that determines, as a twist operation, a twisting operation by the operating body on the operation input screen based on operation information on the operation input screen, and an application according to the determined twist operation
  • an information processing apparatus including a display control unit that performs predetermined display control corresponding to the above.
  • the processor determines, as a twist operation, the twisting operation by the operating body with respect to the operation input screen based on the operation information by the operating body with respect to the operation input screen, and according to the determined twist operation. Proposing an information processing method including performing predetermined display control corresponding to an application.
  • the computer determines, based on the operation information by the operating body on the operation input screen, the twisting operation by the operating body on the operation input screen as a twist operation, and according to the determined twist operation
  • a program that functions as a display control unit that performs predetermined display control corresponding to an application is proposed.
  • the “Power Press” operation is an operation of pressing the belly of the finger as it is after touching the screen with the tip of the finger, and can be recognized based on a change in the contact area.
  • UI operation pushed on the existing touch panel is realizable, without adding a new (physical) structure.
  • the “Twist” operation enables analog control by rolling (twisting) a finger from the touched state to the right or left.
  • a UI operation for adjusting parameters according to the twisting condition.
  • the “Spiral” operation is an operation of rotating clockwise or counterclockwise with the fingertip as a fulcrum from the above-mentioned “Power Press” state, and can realize a UI operation such as a dial operation.
  • the “Power Swipe, Power Drag” operation is an operation for swiping or dragging the finger from the above-mentioned “Power Press” state, and can be used with a UI that moves the object.
  • gesture operations that can be used more intuitively and widely can be provided.
  • FIG. 1 is a diagram illustrating an example of the configuration of the information processing apparatus 1 according to the present embodiment.
  • the information processing apparatus 1 includes a control unit 10, an operation input unit 11, a display unit 12, and a storage unit 13.
  • the control unit 10 functions as an arithmetic processing unit and a control unit, and controls the overall operation in the information processing apparatus 1 according to various programs.
  • the control unit 10 is realized by an electronic circuit such as a CPU (Central Processing Unit) or a microprocessor, for example.
  • the control unit 10 may include a ROM (Read Only Memory) that stores programs to be used, calculation parameters, and the like, and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate.
  • control unit 10 also functions as the determination unit 101 and the display control unit 102.
  • the determination unit 101 performs a user gesture determination on the touch panel based on the touch information detected by the operation input unit 11.
  • the determination unit 101 includes Power Press, Twist, Spiral, Power Swipe, and Power Drag. It is possible to determine a predetermined gesture to be called.
  • the determination unit 101 changes the contact area (also referred to as a ground plane) by the operating body to the operation input screen (touch panel), the change in the center position (also referred to as the center of gravity) of the contact area, and the changed contact area and before the change.
  • a large number of gesture determinations can be performed based on the relationship with the center position.
  • the display control unit 102 controls display on the display unit 12 and performs display control according to the gesture determined by the determination unit 101 or performs display control according to an instruction of an application executed by the information processing apparatus 1. .
  • the operation input unit 11 receives an operation instruction from the user and outputs the operation content to the control unit 10.
  • the operation input unit 11 may be a touch sensor, a pressure sensor, or a proximity sensor provided integrally with the display unit 12.
  • a touch sensor a pressure sensor
  • a proximity sensor provided integrally with the display unit 12.
  • the operation input unit 11 is realized by a touch panel and performs gesture determination using detected touch information.
  • the operation input information to be used is touch. It is not limited to information, For example, a pressure sensor value or a proximity sensor value may be sufficient.
  • the display unit 12 is a display device that outputs various operation input screens.
  • the display unit 12 may be a display device such as a liquid crystal display (LCD) or an organic EL (Electroluminescence) display.
  • the storage unit 13 is realized by a ROM (Read Only Memory) that stores programs and calculation parameters used for the processing of the control unit 10, and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate.
  • ROM Read Only Memory
  • RAM Random Access Memory
  • the configuration of the information processing apparatus 1 has been specifically described above.
  • the information processing apparatus 1 can be realized by, for example, a smartphone, a mobile phone terminal, a tablet terminal, a wearable device (for example, a smart band, a smart watch), a PC (personal computer), or the like.
  • the configuration of the information processing apparatus 1 is not limited to the example illustrated in FIG. 1, and may be realized by an information processing system including a client terminal and a server, for example. In this case, for example, operation input information detected by the operation input unit 11 on the client terminal side is transmitted to a server on the network, gesture determination is performed on the server side, and a display control signal based on the determined gesture is transmitted to the client. Sent to the terminal.
  • FIG. 2 is a flowchart showing an operation process of the information processing apparatus according to the present embodiment.
  • the display control unit 102 of the information processing apparatus 1 displays a predetermined user interface (that is, an operation input screen) on the display unit 12 (step S103), and operation input information by the user for the user interface. (Here, touch information) is acquired from the operation input unit 11 (step S106).
  • a predetermined user interface that is, an operation input screen
  • the determination unit 101 of the information processing apparatus 1 performs a gesture determination based on the touch information (step S109). Details of the gesture determination will be described later. For example, the determination unit 101 acquires, as touch information, a change in the position, shape, area, or the like of the ground contact surface of the operation body (for example, the user's finger) with respect to the operation input screen, Perform gesture determination.
  • the determination unit 101 acquires, as touch information, a change in the position, shape, area, or the like of the ground contact surface of the operation body (for example, the user's finger) with respect to the operation input screen, Perform gesture determination.
  • the display control unit 102 of the information processing apparatus 1 performs predetermined display control according to the determined gesture (step S112).
  • Such information can be acquired by the operation input unit 11 realized by a touch panel or the like.
  • Sn for the first point (Start point) where the finger is placed with respect to the operation input unit 11 An for the area (area) in contact with the belly of the finger, and the area A symbol such as Cn is assigned to the center (centroid: Centroid point) of the.
  • Centroid point Centroid point
  • FIG. 4 is a diagram for explaining the determination conditions for the Tap operation according to the present embodiment.
  • the determination unit 101 has a time from when the finger is placed on the touch panel (operation input unit 11) to when it is released, for example, within approximately 1 second, and as shown in FIG. 4, the center of gravity C1 of the place where the finger is placed.
  • the center of gravity C2 of the place where the finger is released is the same, it is determined that the Tap operation is performed.
  • it may be added to the condition that the area A2 includes the start point S1.
  • FIG. 5 is a diagram illustrating the determination conditions for the long press operation according to the present embodiment.
  • the determination unit 101 keeps the finger placed on the touch panel (operation input unit 11) for about 1 second or more, and as shown in FIG. If the center of gravity C4 is the same, the Long press operation is determined. In addition, the case where there is no change in the area of area A3 and area A4 may be added as a condition.
  • FIG. 6 is a diagram illustrating determination conditions for a Swipe (Flick) or Drag operation according to the present embodiment.
  • the determination unit 101 monitors changes in the position, shape, and area of the ground plane after the finger is placed on the touch panel, and the following “condition a and condition b-1” or “condition a and condition b-2” If these conditions are satisfied, it is determined that the operation is Swipe (Flick) or Drag operation.
  • Condition a The finger is moved within, for example, approximately one second after the finger is placed.
  • Condition b-1 The shapes of the ground planes A5 and A6 are the same before and after the movement of the finger (or during the movement) (this condition is useful when the shape of the ground plane can be determined).
  • Condition b-2 The areas of the ground planes A5 and A6 are the same before and after the movement of the finger (or during the movement) (this condition is useful when the shape of the ground plane cannot be determined).
  • center of gravity C6 is away from C5 and the approximate point P6 is away from the starting point S5.
  • Swipe a quick sweep operation
  • Flick a sweeping operation
  • Drag a movement operation
  • FIG. 7 is a diagram for explaining the outline of the Power Press operation according to the present embodiment.
  • the power press operation is an operation in which the finger 2 (especially the fingertip) is placed on the touch panel (operation input unit 11) and then the finger 2 is laid down and pressed so that the belly of the finger 2 is brought into contact. is there.
  • a UI operation for pressing on an existing touch panel can be realized without adding a physical configuration.
  • FIG. 8 is a diagram for explaining the determination conditions for the Power Press operation according to the present embodiment.
  • the determination unit 101 monitors changes in the position, shape, and area of the ground plane after the finger is placed on the touch panel, and the following “condition c-1 and condition d and condition e” or “condition c-2 and condition d” And if condition e ”is met, it is determined that the operation is a Power Press operation.
  • Condition c-1 The shape of the ground plane A has changed characteristically (the ellipse has extended) (this condition is useful when the shape of the ground plane can be determined).
  • Condition c-2 The area of the ground plane A is increased by, for example, about 150% (this condition is useful when the shape of the ground plane cannot be determined).
  • Condition d The center of gravity C7 when the finger is placed is included in the ground contact surface A8 when the finger is pressed.
  • Condition e The location of the center of gravity C7 when the finger is placed and the location of the center of gravity C8 when the finger is pressed are different.
  • FIG. 9 is a diagram for explaining the outline of the Twist operation according to the present embodiment.
  • the Twist operation is an operation of rolling (twisting) the finger 2 on the touch panel in the right or left direction after placing the finger 2 (particularly the fingertip) on the touch panel (operation input unit 11). . More specifically, the finger 2 is rolled to the right or left side from the state in which the touch panel is touched with the finger 2, and the side surface of the finger 2 touches the touch panel (the state in which the belly of the finger 2 is perpendicular to the touch panel). It is an operation. With this two-stage operation, it is possible to realize a UI operation for adjusting parameters according to the twisting condition on an existing touch panel without adding a physical configuration.
  • FIG. 10 is a diagram for explaining the determination conditions for the Twist operation according to the present embodiment.
  • the determination unit 101 monitors changes in the position, shape, and area of the ground plane after the finger is placed on the touch panel, and the following “condition f-1 and condition g and condition h” or “condition f-2 and condition g” And the condition h ”are satisfied, the Twist operation is determined.
  • Condition f-1 The shape of the ground plane A has changed characteristically (becomes elongated) (this condition is useful when the shape of the ground plane can be determined).
  • Condition f-2 The area of the ground plane A is reduced by, for example, about 80% or more (this condition is useful when the shape of the ground plane cannot be determined).
  • Condition g The center of gravity C9 when the finger is placed is not included in the ground contact surface A10 after twisting.
  • Condition h The center-of-gravity point C9 before twisting the finger and the center-of-gravity point C10 after twisting (while twisting) are within a distance of one finger (for example, 1 cm). (Furthermore, the center of gravity C10 may be separated from the center of gravity C9 by one finger in the left-right direction (within ⁇ 45 °).)
  • FIG. 11 is a diagram for explaining the outline of the spiral operation according to the present embodiment.
  • the Spiral operation means that the finger 2 is placed on the touch panel (operation input unit 11), then the Power Press operation (see FIGS. 7 and 8) is performed, and the finger 2 is supported on the touch panel.
  • a UI operation such as a dial operation can be realized on an existing touch panel without adding a physical configuration.
  • FIG. 12 is a diagram illustrating the determination conditions for the spiral operation according to the present embodiment. After the finger is placed on the touch panel as shown in the left of FIG. 12 and then the power press operation is performed as shown in the center of FIG. 12 (the determination conditions for the power press operation are as described above). If the following conditions “condition i, condition j, condition k, and condition l” are satisfied (the state shown on the right in FIG. 12), it is determined that the operation is a spiral operation. .
  • Condition i The transition of the center of gravity from the center of gravity C11 immediately after the power press operation is performed is continuously detected, and the center of gravity when the finger is pressed against the center of gravity C11 immediately after the finger is placed (power press operation) The line L1 connecting the point C12 and the line connecting the current center of gravity C13 and the center of gravity C11 are compared, and the center L1 is rotated from the center of gravity C11.
  • Condition j The area of the ground plane A12 before being rotated and the area of the ground plane A13 after being rotated (or during rotation) are the same.
  • Condition k The center-of-gravity point C11 when the finger is placed is included in the ground contact surface A13 after the rotation (or during the rotation).
  • Condition 1 The distance between the center of gravity C11 when the finger is placed and the center of gravity C12 before the rotation and the center of gravity C11 when the finger is placed and the center of gravity C13 after the rotation (or during rotation) The distance is the same.
  • the Power Swipe (Flick) / Power Drag operation is an operation of moving a finger (Swipe, Flick, or Drag) from the state of the Power Press operation (see FIGS. 7 and 8).
  • FIG. 13 is a diagram for explaining determination conditions for the Power Swipe (Flick) / Power Drag operation according to the present embodiment. Immediately after the finger is placed on the touch panel as shown in the left of FIG. 13 and then the power press operation (the determination conditions for the power press operation are as described above) is performed as shown in the center of FIG. Continue to monitor the changes in the position, shape and area of the ground contact surface, and when the following “condition m and condition n” are satisfied (as shown in the right side of FIG. 13), it is determined as Power Swipe (Flick) / Power Drag operation To do.
  • Condition m The center-of-gravity point C15 before moving the finger is outside the current area of the ground contact surface A16.
  • Condition n The area of the ground plane A15 before being moved and the area of the ground plane A16 after being moved (or being moved) are the same.
  • Swipe a quick sweep operation
  • Flick a sweeping operation
  • Drag a movement operation
  • center of gravity C16 after movement is away from the center of gravity C15 before movement.
  • the determination unit 101 can determine that the finger 2 has moved from the direction in which the approximate point P16 of the ground contact surface A16 after movement is located.
  • the difference between the Twist operation and the Swipe / Drag operation may be determined based on the movement amount and the elapsed time (movement time). .
  • movement time elapsed time
  • FIG. 14 is a diagram for explaining operation determination conditions based on the movement amount and the elapsed time according to the present embodiment. As shown in FIG. 14, the threshold Th of the determination distance is changed according to the elapsed time. As a result, for example, a twist operation can be performed in a wider range by slowly moving a finger.
  • the Twist operation can be performed more widely by moving slowly (however, the threshold Th corresponding to the movement speed is set). Less travel distance).
  • the threshold value Th described above may be adjusted according to changes in physical movement and inclination of the terminal (information processing apparatus 1) during operation.
  • the movement and tilt of the information processing apparatus 1 can be detected by an acceleration sensor, a gyro sensor, a geomagnetic sensor, or the like (all not shown) provided in the information processing apparatus 1.
  • the information processing apparatus 1 may be moved to the right by the acceleration sensor. You may make it adjust a threshold value so that operation can be determined more easily.
  • the Twist operation is performed in the right direction
  • the hand holding the information processing apparatus 1 is twisted together, and the information processing apparatus 1 is moved in the right direction by the acceleration sensor on the assumption that the information processing apparatus 1 is slightly tilted.
  • the threshold value may be adjusted so that the Twist operation in the right direction can be more easily determined.
  • the Swipe operation performed in the horizontal direction on the touch UI has been able to control only one system parameter so far, but in this embodiment, another system parameter control can be performed by using the Twist operation. Further, by using the spiral operation, it is possible to control another parameter.
  • the operations of these systems may be independent (example of a camera application described with reference to FIG. 19) or related operations (example of a slider bar described with reference to FIG. 15). Or a series (an example of an Alphabetical index bar described with reference to FIG. 16).
  • the index finger is used as an operation body as an example, but the present embodiment is not limited to this, and continuous analog operations such as volume adjustment and angle adjustment can also be performed dynamically with the thumb. . Also, non-continuous operations such as character selection and mode switching can be finely operated with the index finger.
  • FIG. 15 is a diagram for explaining the Swipe operation and the Twist operation on the slider bar.
  • the volume adjustment slider bar 121 is displayed on the display unit 12 (touch panel display integrated with the operation input unit 11), for example, when the Swipe operation is performed with the finger 2, FIG.
  • the volume can be adjusted, and when the Twist operation is performed, the LR balance can be adjusted as shown on the right of FIG.
  • the display control unit 102 displays the LR balance adjustment screen 123 and can adjust the left / right balance according to the rotation in the left / right direction.
  • the bar knob on the balance adjustment screen 123 may be moved to the right in accordance with the degree of twisting in the right direction, and the bar knob on the balance adjustment screen 123 may be moved to the right while maintaining the twisted state. It may be moved in the direction.
  • FIG. 16 is a diagram for explaining the Swipe operation and the Twist operation on the alphabet index bar according to the present embodiment.
  • FIG. 16 when the alphabet index bar 125 of the address book is displayed on the display unit 12 (touch panel display integrated with the operation input unit 11), for example, when the Swipe operation is performed with the finger 2, FIG. Index search is possible in alphabetical order as shown at 16 left, and scrolling within the index is possible as shown at right of FIG. 16 when Twist operation is performed.
  • FIG. 17 is a diagram for explaining a Swipe operation and a Twist operation in viewpoint and line-of-sight movement according to the present embodiment.
  • a viewing screen capable of moving the viewpoint and the line of sight is displayed, as shown in the left of FIG. 17, the location (viewpoint) can be moved by the Swipe operation, as shown in the right of FIG.
  • the angle of view (line of sight) may be moved by a Twist operation.
  • the viewpoint and line-of-sight movement operations can be clearly performed by the Swipe operation and the Twist operation.
  • FIG. 18 is a diagram for explaining the shutter operation by the power press operation.
  • the finger 2 is placed on the through screen in the display unit 12 (touch panel display integrated with the operation input unit 11). In this state, it is determined that the Tap operation is performed, and focus lock is performed. 18 As shown on the right, the shutter can be released by the power press operation that presses the belly of the finger 2.
  • FIG. 19 is a diagram for explaining an example of a spiral operation and a twist operation in a camera application.
  • a brightness adjustment screen 127 is displayed in response to a spiral operation, and the brightness adjustment screen 127 moves like a dial operation that rotates clockwise or counterclockwise with a fingertip as a fulcrum. It is possible to adjust the brightness.
  • the aperture adjustment screen 129 is displayed according to the Twist operation, and the aperture value can be adjusted according to the twist.
  • the information display may be turned ON / OFF by a Tap operation, and detailed information may be displayed in an overlay by a Power press operation.
  • the filter can be switched by Twist operation, and zoom in / out may be performed by Spiral operation (after canceling the overlay display of detailed information).
  • the contact list screen When the contact list screen is displayed on the display unit 12 by the Contacts list application, for example, it is selected by Tap operation, the content Preview (email address, address, etc.) is displayed by Power press operation, and group registration is performed by Twist operation. It is also possible to execute a function (email creation, telephone call) by selecting an e-mail address, an address, etc. by a spiral operation.
  • a function electronic creation, telephone call
  • FIG. 20 is a diagram for explaining an example of the Power press operation and the Spiral operation in the Contacts list application. As shown on the left side of FIG. 20, when a contact list screen is displayed on the display unit 12, when a contact is selected by Tap operation and Power Press operation is performed as it is, a content preview screen 130 is displayed.
  • FIG. 21 is a diagram for explaining an example of the Twist operation in the Contacts list application. As shown in FIG. 21, when a Twist operation is performed in a state where a contact is selected and the content preview screen 130 is displayed, a group registration screen 132 is displayed. The user can register a group by moving the cursor to an arbitrary group. Note that the selection cursor moves sequentially according to the twist of the Twist operation.
  • the focus between character buttons can be moved by a Swipe operation, and the character type on the character button can be switched by a Twist operation.
  • a Swipe operation for example, the focus between character buttons can be moved by a Swipe operation, and the character type on the character button can be switched by a Twist operation.
  • FIG. 22 is a diagram for explaining an example of a Twist operation in text input. As shown in FIG. 22, when a Twist operation is performed on an arbitrary character button, a plurality of character types corresponding to the character button can be switched. The character type is switched according to, for example, the twist of the Twist operation.
  • the focus between character buttons is moved by the Swipe operation, and the character type can be switched by the Twist operation without releasing the finger 2 from the touch panel. Also, when you want to move to another character button after the Twist operation (the target character type is not found), move to the Swipe operation without moving the finger 2 from the touch panel and move the focus between the character buttons again. It is possible to make it.
  • Notification card display> Next, an operation example in displaying a notification card displayed on a home screen or a lock screen on a smartphone or a tablet terminal will be described.
  • the displayed notification card for example, open the notification card by Tap operation, display the context menu by Power press operation, switch the display restriction by Twist operation, and by Spiral operation (after canceling the context menu display) Perform Expand / Collapse of the notification card.
  • Dismiss (delete notification card) may be performed with Swipe operation, and context menu items may be selected with Power Drag operation.
  • Swipe operation may be performed with Swipe operation
  • context menu items may be selected with Power Drag operation.
  • Twist operation in the notification card display will be described with reference to FIG.
  • FIG. 23 is a diagram for explaining an example of the Twist operation in the notification card display according to the present embodiment.
  • the display restriction is set as shown in the right side of FIG.
  • a switching screen 137a is displayed.
  • the display restriction can be switched according to the type of the selected notification card.
  • any one of “sender only”, “title only”, “sender and title”, and “up to text” is selected as the notification card display restriction. Is possible.
  • the selection cursor on the switching screen 137a moves according to the twisting degree of the finger 2 performing the Twist operation.
  • a folder list of documents etc. is displayed by the file browser application, for example, a folder is selected by Tap operation, a context menu is displayed by Power press operation, and status (importance etc.) can be changed by Twist operation. May be.
  • FIG. 24 is a diagram for explaining an example of the Twist operation in the file browser.
  • a mark 140 indicating the status (for example, the importance level is displayed). (Star mark shown) can be given.
  • the status which can be provided is not limited to one type, For example, according to the twist condition of the finger
  • this technique can also take the following structures.
  • a determination unit that determines, as a twist operation, a twisting operation by the operating body on the operation input screen based on operation information by the operating body on the operation input screen;
  • a display control unit that performs predetermined display control corresponding to the application in accordance with the determined twist operation;
  • An information processing apparatus comprising: (2) The determination unit further determines a tap operation, a long press operation, a swipe operation, a flick operation, or a drag operation by the operation body on the operation input screen based on operation information by the operation body on the operation input screen, The information processing apparatus according to (1), wherein the display control unit performs display control different from the twist operation according to the determined tap operation, long press operation, swipe operation, flick operation, or drag operation.
  • the information processing apparatus displays a parameter adjustment screen in accordance with the twist operation and adjusts the parameter in accordance with a twisting degree in the twist operation.
  • the display control unit Scroll through the index search as you swipe, The information processing apparatus according to (1) or (2), wherein when the swipe operation is switched to the twist operation, display control is performed so that the list in the corresponding index is scrolled.
  • the display control unit Move the viewpoint of the display screen according to the swipe operation, Control to move the line of sight of the display screen according to a twist operation, The information processing apparatus according to (1) or (2).
  • the display control unit Move the focus between the text buttons on the software keyboard according to the swipe operation, Perform character type switching control of the corresponding character button according to the twist operation.
  • the information processing apparatus according to (1) or (2).
  • the determination unit Based on the change of the ground plane by the operating body to the operation input screen and the change of the center of gravity of the ground plane, the change of the ground plane and the positional relationship between the changed ground plane and the center of gravity before the change are The information processing apparatus according to any one of (1) to (6), wherein when the predetermined condition is satisfied, the twist operation is determined.
  • the determination unit changes the shape of the ground contact surface to a predetermined shape, the changed ground contact surface does not include the pre-change center point, and the distance between the pre-change center point and the post-change center point is a predetermined value.
  • the information processing apparatus according to (7), wherein when it is within the range, the twist operation is determined.
  • the area of the ground plane changes to a predetermined ratio, the ground plane after the change does not include the center of gravity before the change, and the distance between the center of gravity before the change and the center of gravity after the change is a predetermined
  • the information processing apparatus according to (7), wherein when it is within the range, the twist operation is determined.
  • Processor Determining the twisting operation by the operating body on the operation input screen as a twist operation based on the operation information by the operating body on the operation input screen; Performing predetermined display control corresponding to the application in accordance with the determined twist operation; Including an information processing method.
  • Computer A determination unit that determines, as a twist operation, a twisting operation by the operating body on the operation input screen based on operation information by the operating body on the operation input screen;
  • a display control unit that performs predetermined display control corresponding to the application in accordance with the determined twist operation;
  • a program that functions as

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

La présente invention a pour objet de fournir un dispositif de traitement d'informations, un procédé de traitement d'informations et un programme permettant d'obtenir une commande de geste plus intuitive. À cet effet, l'invention porte sur un dispositif de traitement d'informations comprenant : une unité d'évaluation qui, sur la base d'informations sur des opérations par un corps d'actionnement sur un écran d'entrée d'opération, évalue en tant qu'opération de torsion une action de torsion par le corps d'actionnement sur l'écran d'entrée d'opération ; et une unité de commande d'affichage qui, en réponse à l'opération de torsion évaluée, réalise une commande d'affichage prescrite correspondant à l'application.
PCT/JP2018/003081 2017-04-03 2018-01-31 Dispositif de traitement d'informations, procédé de traitement d'informations et programme WO2018186011A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017-073904 2017-04-03
JP2017073904 2017-04-03

Publications (1)

Publication Number Publication Date
WO2018186011A1 true WO2018186011A1 (fr) 2018-10-11

Family

ID=63712473

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/003081 WO2018186011A1 (fr) 2017-04-03 2018-01-31 Dispositif de traitement d'informations, procédé de traitement d'informations et programme

Country Status (1)

Country Link
WO (1) WO2018186011A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010503130A (ja) * 2006-09-11 2010-01-28 アップル インコーポレイテッド 画像ベースブラウジングを備えたメディアプレーヤ
JP2011014045A (ja) * 2009-07-03 2011-01-20 Sony Corp 地図情報表示装置、地図情報表示方法およびプログラム
US20120302291A1 (en) * 2011-05-24 2012-11-29 Microsoft Corporation User character input interface with modifier support
JP2013003962A (ja) * 2011-06-20 2013-01-07 Konica Minolta Business Technologies Inc 情報閲覧装置及び表示制御プログラム並びに表示制御方法
US20130318482A1 (en) * 2012-05-24 2013-11-28 International Business Machines Corporation Gestural control for quantitative inputs

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010503130A (ja) * 2006-09-11 2010-01-28 アップル インコーポレイテッド 画像ベースブラウジングを備えたメディアプレーヤ
JP2011014045A (ja) * 2009-07-03 2011-01-20 Sony Corp 地図情報表示装置、地図情報表示方法およびプログラム
US20120302291A1 (en) * 2011-05-24 2012-11-29 Microsoft Corporation User character input interface with modifier support
JP2013003962A (ja) * 2011-06-20 2013-01-07 Konica Minolta Business Technologies Inc 情報閲覧装置及び表示制御プログラム並びに表示制御方法
US20130318482A1 (en) * 2012-05-24 2013-11-28 International Business Machines Corporation Gestural control for quantitative inputs

Similar Documents

Publication Publication Date Title
US10936153B2 (en) Method and apparatus for providing a user interface on a device enabling selection of operations to be performed in relation to content
US10698567B2 (en) Method and apparatus for providing a user interface on a device that indicates content operators
US9081498B2 (en) Method and apparatus for adjusting a user interface to reduce obscuration
CN110658972B (zh) 信息处理装置、信息处理方法和计算机可读介质
US20100211915A1 (en) Input apparatus, input method, and recording medium recording input program
EP2631762A1 (fr) Procédé et appareil pour fournir une option pour permettre des sélections multiples
US20130227413A1 (en) Method and Apparatus for Providing a Contextual User Interface on a Device
US20130239058A1 (en) Handheld devices and controlling methods using the same
US20130227454A1 (en) Method and Apparatus for Providing an Option to Undo a Delete Operation
US20190095068A1 (en) Portable terminal device
US20150186009A1 (en) Electronic device, method and storage medium
JP2011243157A (ja) 電子機器、ボタンサイズ制御方法、及びプログラム
KR20150025059A (ko) 휴대단말기의 화면 표시 제어장치 및 방법
JP6342297B2 (ja) 表示制御装置および表示制御方法
WO2018186011A1 (fr) Dispositif de traitement d'informations, procédé de traitement d'informations et programme
US10416870B2 (en) Display control device and non-transitory computer-readable storage medium having program recorded thereon
JP6034140B2 (ja) 表示装置、表示制御方法及びプログラム
JP6213597B2 (ja) 表示制御装置、表示制御方法及びプログラム
JP5955421B2 (ja) 入力装置、入力支援方法及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18781727

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18781727

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP