WO2017159796A1 - Information processing method and information processing device - Google Patents

Information processing method and information processing device Download PDF

Info

Publication number
WO2017159796A1
WO2017159796A1 PCT/JP2017/010702 JP2017010702W WO2017159796A1 WO 2017159796 A1 WO2017159796 A1 WO 2017159796A1 JP 2017010702 W JP2017010702 W JP 2017010702W WO 2017159796 A1 WO2017159796 A1 WO 2017159796A1
Authority
WO
WIPO (PCT)
Prior art keywords
operation position
pinch
information processing
threshold
value
Prior art date
Application number
PCT/JP2017/010702
Other languages
French (fr)
Japanese (ja)
Inventor
教裕 植村
康平 須見
崇 大塚
資司 永田
Original Assignee
ヤマハ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2016052900A external-priority patent/JP2017167846A/en
Priority claimed from JP2016052070A external-priority patent/JP2017167792A/en
Application filed by ヤマハ株式会社 filed Critical ヤマハ株式会社
Publication of WO2017159796A1 publication Critical patent/WO2017159796A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the present invention relates to a user interface of an information processing apparatus.
  • an operation called pinch-in or pinch-out is known as an operation for reducing or enlarging a displayed image.
  • Pinch-in is an operation to pinch an image with two fingers on a touch screen and reduce the image to an arbitrary display magnification.
  • Pinch-out is to move two fingers to spread. This is an operation for enlarging the image to an arbitrary display magnification.
  • the operation method of being performed is also known.
  • Patent Document 1 discloses a mechanism for switching between a mode for displaying a single page and a mode for displaying a plurality of pages with an operation button when displaying an electronic score.
  • an object of the present invention is to make it possible to change a setting value in an information processing apparatus with an operation that is intuitive and less burdensome for the user.
  • a detection step of detecting a first operation position and a second operation position operated on an operation region, the first operation position, and the second operation are performed.
  • a determination step of determining whether a relative movement speed of the first operation position and the second operation position when at least one of the positions is no longer detected is greater than a threshold; and the first operation position and A setting step of setting any discrete value included in the predetermined first discrete value group as a set value when it is determined that the relative moving speed of the second operation position is greater than the threshold value.
  • the setting value in the information processing apparatus can be changed by an intuitive operation with less burden on the user.
  • FIG. showing appearance of information processing apparatus Block diagram showing hardware configuration of information processing apparatus Block diagram showing functional configuration of information processing apparatus
  • FIG. which shows an example of the setting value table which an information processing apparatus memorize
  • the flowchart which shows the process which information processing apparatus performs
  • FIG. 1 is a front view showing an appearance of an information processing apparatus 100 according to an embodiment of the present invention.
  • a display operation surface 101 serving as both a display surface for displaying an image and an operation surface for receiving an operation by a user is provided.
  • the information processing apparatus 100 is operated while being held in a user's hand, placed on a desk, or attached to a holder.
  • a tablet PC Personal Computer
  • a slate PC slate PC
  • PDA Personal Digital Assistant
  • the information processing apparatus 100 does not necessarily have a flat plate shape, and may be one that causes an image to be perceived stereoscopically by a method such as autostereoscopic viewing.
  • an image displayed on the information processing apparatus 100 is not limited to an electronic score, and It may be something like this.
  • FIG. 2 is a block diagram illustrating a hardware configuration of the information processing apparatus 100.
  • the information processing apparatus 100 is a computer that includes a control unit 110, a storage unit 120, a touch screen unit 130, and a communication unit 140.
  • the information processing apparatus 100 may include a speaker, a microphone (or an input / output unit thereof), a camera (including a video camera), a vibrator, and the like in addition to the configuration illustrated in FIG.
  • the control unit 110 is a means for controlling the operation of each unit of the information processing apparatus 100.
  • the control unit 110 includes an arithmetic processing device such as a CPU (Central Processing Unit) and a storage device such as a ROM (Read Only Memory) and a RAM (Random Access Memory), and executes a program stored in the ROM or the storage unit 120. Thus, each unit of the information processing apparatus 100 is controlled.
  • arithmetic processing device such as a CPU (Central Processing Unit) and a storage device such as a ROM (Read Only Memory) and a RAM (Random Access Memory)
  • ROM Read Only Memory
  • RAM Random Access Memory
  • the storage unit 120 is a means for storing data.
  • the storage unit 120 includes, for example, a recording medium such as a hard disk or a flash memory, and stores data used by the control unit 110.
  • the storage unit 120 may include a so-called removable disk, that is, a removable recording medium.
  • the storage unit 120 stores a program executed by the control unit 110 and image data (here, electronic score data) displayed on the display operation surface 101.
  • the touch screen unit 130 is a means for displaying an image and a means for receiving a user operation.
  • the touch screen unit 130 includes a display unit 131 that displays an image and an operation unit 132 that receives a user operation.
  • the display unit 131 includes a display panel that displays an image using a liquid crystal element or an organic EL (electroluminescence) element, a drive circuit that drives the display panel, and the like, and displays an image corresponding to data supplied from the control unit 110.
  • the operation unit 132 is provided so as to cover the display panel of the display unit 131 and includes a planar sensor that detects contact of a user's finger. This planar sensor (operation surface) is approximately the same size as the display panel (display surface) of the display unit 131.
  • the operation unit 132 detects a position where the finger touches the operation area called the operation surface (hereinafter, referred to as an operation position since it is a position operated by the user).
  • the operation unit 132 is compatible with so-called multi-touch, and can simultaneously detect a plurality of operation positions.
  • the communication unit 140 is a means for transmitting and receiving data.
  • the communication unit 140 may be a network interface connected to a network such as a mobile communication network or the Internet, or other wireless devices such as NFC (Near Field Communication) without using a network. It may be connected.
  • the communication unit 140 receives, for example, data (here, electronic score data) representing an image displayed on the display operation surface 101.
  • FIG. 3 is a block diagram illustrating a functional configuration of the information processing apparatus 100.
  • the operation position detection unit 111 is a function realized by the operation unit 132 and is a unit that detects an operation position operated (contacted) by the user on the display operation surface 101. Since the operation unit 132 supports multi-touch, when the user operates the touch screen unit 130 with two fingers, the operation position detection unit 111 is a position where one finger contacts the display operation surface 101. The first operation position and the second operation position that is the position at which the other finger contacts the display operation surface 102 are simultaneously detected. These operation positions are represented by X and Y coordinates in a two-dimensional orthogonal coordinate system with a predetermined position (for example, one of the center and four corners) on the display operation surface 101 as the origin. When the user moves the display operation surface 101 while touching his / her finger, the detected operation position changes from moment to moment.
  • the operation recognition unit 112 is a function realized by the control unit 110, and is a means for recognizing a user operation based on the operation position detected by the operation position detection unit 111.
  • the operation recognition unit 112 includes four types of operations, “pinch-flick-in operation” and “pinch-flick-out operation”, which are characteristic in the present embodiment, in addition to “pinch-in operation” and “pinch-out operation”. Recognize at least.
  • the operation recognition unit 112 performs “tap operation” in which one finger touches the display operation surface 101, “swipe operation” in which the finger is moved while being in contact with the display operation surface 101, or moves the finger to the display operation surface 101. You may recognize well-known operations, such as “flick operation” which performs the operation
  • the pinch-in operation and the pinch-out operation are operations that move at least one of the operation positions while keeping a finger in contact with two points on the display operation surface 101 at the same time.
  • the pinch-in operation is an operation of moving the operation position so as to reduce the distance between the two points after touching the two points on the display operation surface 101, and is also referred to as a pinch close operation.
  • the pinch-out operation is an operation of moving the operation position so as to increase the distance between the two points after touching the two points on the display operation surface 101, and is also referred to as a pinch open operation.
  • a series of operations from the time when the finger is brought into contact with the display operation surface 101 until the finger is released corresponds to one operation.
  • the pinch flick-in operation and the pinch flick-out operation are performed by moving at least one of the operation positions while keeping the finger in contact with two points on the display operation surface 101 at the same time. This is an operation of touching the operation surface 101 so as to quickly pay a finger.
  • the first half of the operation is similar to the conventional pinch-in operation and the pinch-out operation
  • the second half (last) of the operation is similar to the conventional flick operation.
  • the pinch flick-in operation after touching two points on the display operation surface 101, the operation position is moved so as to reduce the distance between the two points, and at the end of the operation, the finger is brought closer to the display operation surface. This is an operation of paying on 101.
  • the pinch flick-out operation is performed by touching two points on the display operation surface 101, moving the operation position so as to increase the distance between the two points, and further moving the finger away at the end of the operation. This is an operation for paying on the operation surface 101. Also in these pinch flick-in operations and pinch flick-out operations, a series of operations from when a finger is brought into contact with the display operation surface 101 until it is released corresponds to one operation.
  • the operation recognition unit 112 includes a determination unit 113 that determines whether the operation performed by the user is a pinch-in operation, a pinch-out operation, a pinch flick-in operation, or a pinch flick-out operation. More specifically, the determination unit 113 performs the first operation position and the second operation position when at least one of the first operation position and the second operation position is not detected when multi-touch is performed. It is determined whether or not the relative movement speed is greater than a threshold value stored in the storage unit 120.
  • the relative movement speed of the first operation position and the second operation position here refers to the relative speed of these operation positions immediately before at least one of the first operation position and the second operation position is not detected.
  • the moving speed (relative moving speed finally recognized by the control unit 110).
  • the unit 113 determines that the operation is a pinch flick-in operation or a pinch flick-out operation. Further, the determination unit 113 determines that the operation is the pinch flick-in operation when the relative movement directions of the first operation position and the second operation position are close to each other, and determines the first operation position and the second operation position. When the relative moving directions of the positions are directions away from each other, it is determined that the operation is a pinch flick out operation.
  • the relative movement speed of the first operation position and the second operation position is equal to or less than the threshold value, it means that there was no act of paying a finger at a certain speed at the end of the operation. 113 determines that it is a pinch-in operation or a pinch-out operation.
  • the setting unit 114 is a function realized by the control unit 110, and sets a setting value according to the operation recognized by the operation recognition unit 112.
  • the set value is a value used when the information processing apparatus 100 performs some processing in response to a user operation, and is a display magnification of the image in the present embodiment.
  • the display magnification is a ratio of the size of the image that is actually displayed to the size of the image determined by default.
  • the display control unit 116 is a function realized by the control unit 110 and is a means for controlling an image to be displayed on the display unit 131.
  • the display control unit 113 changes the image display magnification according to the operation. To display.
  • FIG. 4 is a diagram illustrating an example of a setting value table in which rules to be followed when setting setting values are described.
  • This setting value table is stored in the setting value storage unit 115 realized by the storage unit 120.
  • a set of discrete values first discrete value group
  • a set of discrete values of four stages of 0.5 times, 1 time, 2 times, and 4 times, for example. Is set as a set value (display magnification).
  • the pinch flick-in operation is performed once when the current display magnification is 1, the display magnification is reduced by one step, and the display magnification becomes 0.5, which is the next smaller one.
  • the display magnification becomes double, which is the next higher one. That is, among the discrete values included in the first discrete value group, the relative relationship between the first operation position and the second operation position when at least one of the first operation position and the second operation position is not detected. A discrete value corresponding to the movement direction (whether the relative movement direction of the first operation position and the second operation position is closer or farther away) is set as a set value.
  • the display magnification when the display magnification is to be changed from 2 to 4 times by a conventional pinch-in operation or pinch-out operation, it is necessary to move the finger by a certain amount on the display operation surface.
  • the conventional pinch-in operation or pinch-out operation is performed by a small amount of movement in the first half of the operation, and then the operation is performed. Since it is only necessary to pay the finger at the end of the step, the amount of movement of the finger can be reduced as compared with the prior art.
  • the display magnification changes continuously following the distance between the operation positions.
  • any value included in the set of discrete values (second discrete value group) depending on the inter-pixel distance of the display operation surface 101 is set as the display magnification.
  • the difference between the values included in the second discrete value group is much smaller than that of the first discrete value group (0.5 times, 1 time, 2 times, 4 times).
  • the user can display an image at an arbitrary display magnification desired by the user by a pinch-in operation or a pinch-out operation. That is, according to the present embodiment, it is possible to reduce both the operation burden due to the pinch flick in operation or the pinch flick out operation and the selection of an arbitrary display magnification by the pinch in operation or the pinch out operation.
  • the first discrete value group used at the time of pinch flick-in operation or pinch flick-out operation is not limited to the example of 0.5 times, 1 time, 2 times, 4 times, and 0 when the content is in units of pages. It may be a set of discrete values based on page units, such as .5 pages, 2 pages, and 8 pages. That is, the set value may be the number of pages to be displayed.
  • the specific value of the first discrete value group varies depending on the content to be displayed, the aspect ratio of the display operation surface 101, and the like, but in short, the difference between the values included in the first discrete value group is the second discrete value group. It only needs to be larger than the value group.
  • FIG. 5 is a flowchart illustrating processing executed by the control unit 110 of the information processing apparatus 100.
  • the control unit 110 recognizes the user operation based on the operation position detected by the operation unit 132 (step S2).
  • step S3 pinch flick in or pinch flick out
  • step S4 the control unit 11 determines that the operation is a pinch flick-in operation when the relative movement directions of the first operation position and the second operation position are close to each other, and among the first discrete value group, A display magnification smaller than the current display magnification is set as a setting value.
  • the control unit 11 determines that the operation is a pinch flick-out operation, and among the first discrete value group, The next larger display magnification than the current display magnification is set as the setting value. Note that, for example, when the display magnification is set to 1.2 times by the pinch-in operation or the pinch-out operation, if the pinch flick-in operation is performed once, the display magnification is more than 1.2 times in the first discrete value group. Will also be one smaller.
  • the control unit 110 displays an image according to the set display magnification (step S6).
  • step S3 when the recognition result of the user operation is a pinch-in operation or a pinch-out operation (that is, the first operation when at least one of the first operation position and the second operation position is not detected).
  • the process proceeds to step S3; pinch-in or pinch-out, and the control unit 110 sets the value included in the second discrete value group to the set value ( Display magnification) (step S5). That is, the control unit 11 determines that the operation is a pinch-in operation when the relative movement directions of the first operation position and the second operation position are close to each other, and among the second discrete value group, A display magnification smaller than the display magnification is set as a setting value.
  • control part 11 determines with it being a pinch out operation, when the relative moving direction of a 1st operation position and a 2nd operation position is a direction away from each other, among the 2nd discrete value groups, The display magnification that is next larger than the display magnification is set as the setting value. Then, the control unit 110 displays an image according to the set display magnification (step S6).
  • Step S3 when it is determined that the control unit 110 is neither a pinch flick-in operation, a pinch flick-out operation, a pinch-in operation or a pinch-out operation (Step S3; other), a corresponding process according to a user operation Is executed (step S7). For example, if the tap operation on the icon image is accepted, the control unit 110 activates the application assigned to the icon image.
  • the “corresponding process” here may be that the control unit 110 does not perform a special process, that is, does not respond to a user operation.
  • the conventional pinch-in operation or pinch-out operation is slightly performed in the first half of the operation, and then the finger is moved at the end of the operation. Since it is only necessary to pay, the amount of finger movement can be reduced as compared with the conventional method.
  • the action of moving the finger is an action of moving the finger quickly, a conceptual similarity arises in that the setting value is greatly changed step by step. From the user's point of view, the change can be made by an intuitive operation. Can be realized.
  • the operation unit of the present invention is not necessarily provided so as to overlap the display surface.
  • the operation unit may include a touch pad (also referred to as a track pad or a slide pad) as the operation surface.
  • the user's operation does not necessarily need to be an operation that contacts the operation surface, and a non-contact operation on the operation surface may be detected by the proximity sensor.
  • the operation surface is not limited to a physically existing configuration, and for example, a camera is used to capture an image of a user operating a three-dimensional operation region virtually provided in a space with a gesture or the like in the space. It may be configured to recognize an image of an operation on a region. That is, the operation area is not limited to a two-dimensional operation area, and may be a three-dimensional operation area.
  • the set value is not limited to the display magnification and the number of display pages exemplified in the embodiment, and may be any value as long as it is a value used when performing some processing in the information processing apparatus. Further, if the first discrete value group is a value that monotonously increases or decreases discretely, the interval between the values may be equal or may not be equal.
  • the display magnification is reduced or enlarged by one step.
  • the display magnification may be changed in a plurality of stages. For example, a second threshold value larger than a threshold value (first threshold value) for discriminating a pinch flick-in operation and a pinch flick-out operation from a pinch-in operation or a pinch-out operation is prepared, and the first operation position and the second operation position This is an example in which the display magnification is changed in two steps when the relative movement speed of exceeds the second threshold.
  • the set value is the number of display pages
  • a plurality of pages of content to be displayed (For example, two pages) is displayed (one step change)
  • more pages of content (for example, 4) Page) is displayed (2 step change).
  • the display magnification is changed by one step. An example in which the display magnification is changed in two steps when the pressure is greater than or equal to the threshold value may be used.
  • the image to be displayed is a page unit and the set value is the number of pages
  • the number of pages displayed on the display operation surface 101 can be changed by a user operation.
  • a predetermined operation is performed in a state where a plurality of pages are displayed on the display operation surface 101, two adjacent pages may be switched. That is, the odd page and the even page may be switched and displayed.
  • the predetermined operation is an operation recognized by the operation recognition unit 112, for example, a swipe operation.
  • the user performs an operation using not only his / her finger but also an instruction tool (hereinafter referred to as “indicator”) such as a stylus that is held by (or attached to) the user's hand. May be.
  • the operation unit in the case of using such an indicator may detect the position of the indicator by infrared rays or ultrasonic waves.
  • the position of the indicator can be detected magnetically. That is, the information processing apparatus of the present invention does not need to be provided with a touch screen.
  • the pinch-in operation and the pinch-out operation are not limited to one-hand operation, and may be performed using the right hand (finger) and the left hand (finger).
  • the present invention can also be applied to various information processing apparatuses such as game machines, music players, and electronic book readers. Further, the present invention is not an information processing apparatus alone, but an information processing apparatus including at least a display unit, and another apparatus (an apparatus for controlling display of the information processing apparatus) provided independently of the information processing apparatus It may be realized by cooperation. In this case, it is sufficient for the other apparatus to have the functional configuration shown in FIG. 3, and the display unit and the operation unit may not be provided. In this case, the present invention can be implemented in the form of a program for realizing the functional configuration shown in FIG. 3 and a recording medium on which the program is recorded. Further, such a program may be downloaded from a server device via a network and installed in an electronic device.
  • the setting value in the information processing apparatus can be changed by an operation that is intuitive and less burdensome for the user.
  • DESCRIPTION OF SYMBOLS 100 ... Information processing apparatus, 101 ... Display operation surface, 110 ... Control part, 111 ... Operation position detection part, 112 ... Operation recognition part, 113 ... Determination part, 114 ... Setting part, 115 ... Setting value memory

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

An information processing method characterized by being provided with: a detection step for detecting a first operation position and a second operation position of an operation performed in an operation area; a determination step for determining, when the first operation position and/or the second operation position can no longer be detected, whether or not a relative moving speed between the first operation position and the second operation position is greater than a threshold value; and a setting step for setting, as a setting value, one of discrete values included in a predetermined first discrete value group when the relative moving speed between the first operation position and the second operation position is determined as being greater than the threshold value.

Description

情報処理方法及び情報処理装置Information processing method and information processing apparatus
　本発明は、情報処理装置のユーザインタフェースに関する。 The present invention relates to a user interface of an information processing apparatus.
　タッチスクリーンを備える情報処理装置において、表示されている画像の縮小又は拡大を行うための操作として、ピンチインまたはピンチアウトと呼ばれるものが知られている。ピンチインとは、タッチスクリーンにおいて２本の指で画像をつまむように動かして、その画像を任意の表示倍率に縮小させる操作であり、ピンチアウトとは、２本の指を広げるように動かすことで、その画像を任意の表示倍率に拡大させる操作である。また、タッチスクリーンに指で触れるタップを２回連続させる（ダブルタップ）と、所定の表示倍率まで画像が拡大され、もう一度ダブルタップを行うと、画像が元の表示倍率に戻るとか画像がさらに拡大されるといった操作方法も知られている。また、例えば特許文献１には、電子楽譜を表示する際に、単ページを表示するモードと複数ページを表示するモードとを操作ボタンで切り替える仕組みが開示されている。 In an information processing apparatus having a touch screen, an operation called pinch-in or pinch-out is known as an operation for reducing or enlarging a displayed image. Pinch-in is an operation to pinch an image with two fingers on a touch screen and reduce the image to an arbitrary display magnification. Pinch-out is to move two fingers to spread. This is an operation for enlarging the image to an arbitrary display magnification. In addition, if you tap the touch screen with your finger twice (double tap), the image will be enlarged to the specified display magnification. If you double-tap again, the image will return to the original display magnification or the image will be enlarged further. The operation method of being performed is also known. For example, Patent Document 1 discloses a mechanism for switching between a mode for displaying a single page and a mode for displaying a plurality of pages with an operation button when displaying an electronic score.
日本国特開２００４－１４５２２０号公報Japanese Unexamined Patent Publication No. 2004-145220
　上記に例示した画像の表示倍率などの、情報処理装置においてなんらかの処理を行うときに用いる設定値を変更する場合、ユーザにとっては、直感的な操作でその変更が完了するほうが望ましいし、また、その操作に要する手間はできる限り少ないほうが望ましい。 When changing the setting value used when performing some processing in the information processing apparatus, such as the image display magnification exemplified above, it is desirable for the user to complete the change with an intuitive operation. It is desirable that the effort required for operation is as small as possible.
　そこで、本発明は、情報処理装置における設定値をユーザの直感的かつ負担の少ない操作で変更可能にすることを目的とする。 Therefore, an object of the present invention is to make it possible to change a setting value in an information processing apparatus with an operation that is intuitive and less burdensome for the user.
　上記課題を解決するため、本発明の一態様によれば、操作領域に対して操作された第１操作位置及び第２操作位置を検出する検出ステップと、前記第１操作位置及び前記第２操作位置のうち少なくとも一方が検出されなくなったときの当該第１操作位置及び当該第２操作位置の相対的な移動速度が閾値よりも大きいか否かを判定する判定ステップと、前記第１操作位置及び前記第２操作位置の相対的な移動速度が閾値よりも大きいと判定された場合には、所定の第１離散値群に含まれるいずれかの離散値を設定値として設定する設定ステップとを備えることを特徴とする情報処理方法が提供される。 In order to solve the above problems, according to one aspect of the present invention, a detection step of detecting a first operation position and a second operation position operated on an operation region, the first operation position, and the second operation are performed. A determination step of determining whether a relative movement speed of the first operation position and the second operation position when at least one of the positions is no longer detected is greater than a threshold; and the first operation position and A setting step of setting any discrete value included in the predetermined first discrete value group as a set value when it is determined that the relative moving speed of the second operation position is greater than the threshold value. An information processing method characterized by this is provided.
　本発明によれば、情報処理装置における設定値がユーザの直感的かつ負担の少ない操作で変更可能となる。 According to the present invention, the setting value in the information processing apparatus can be changed by an intuitive operation with less burden on the user.
情報処理装置の外観を示す正面図Front view showing appearance of information processing apparatus 情報処理装置のハードウェア構成を示すブロック図Block diagram showing hardware configuration of information processing apparatus 情報処理装置の機能的構成を示すブロック図Block diagram showing functional configuration of information processing apparatus 情報処理装置が記憶する設定値テーブルの一例を示す図The figure which shows an example of the setting value table which an information processing apparatus memorize | stores 情報処理装置が実行する処理を示すフローチャートThe flowchart which shows the process which information processing apparatus performs
［構成］
　図１は、本発明の一実施形態である情報処理装置１００の外観を示す正面図である。情報処理装置１００の正面には、画像を表示する表示面とユーザによる操作を受け付ける操作面とを兼ねる表示操作面１０１が設けられている。情報処理装置１００は、ユーザの手に持たれたり、机の上に置かれたり或いはホルダに取り付けられたりした状態で操作されるものであって、例えばタブレットＰＣ（Personal Computer）、スレートＰＣ、ＰＤＡ（Personal Digital Assistant）又は携帯電話機（スマートフォンを含む）などである。情報処理装置１００は、必ずしも平板状でなくてもよく、また、裸眼立体視などの方法により画像を立体的に知覚させるものであってもよい。本実施形態においては、ユーザがこの情報処理装置１００に電子楽譜を表示させて楽器の演奏を行う例を想定しているが、情報処理装置１００に表示される画像は電子楽譜に限らず、どのようなものであってもよい。 [Constitution]
FIG. 1 is a front view showing an appearance of an information processing apparatus 100 according to an embodiment of the present invention. On the front surface of the information processing apparatus 100, a display operation surface 101 serving as both a display surface for displaying an image and an operation surface for receiving an operation by a user is provided. The information processing apparatus 100 is operated while being held in a user's hand, placed on a desk, or attached to a holder. For example, a tablet PC (Personal Computer), a slate PC, a PDA (Personal Digital Assistant) or a mobile phone (including a smartphone). The information processing apparatus 100 does not necessarily have a flat plate shape, and may be one that causes an image to be perceived stereoscopically by a method such as autostereoscopic viewing. In the present embodiment, it is assumed that the user plays an instrument by displaying an electronic score on the information processing apparatus 100. However, an image displayed on the information processing apparatus 100 is not limited to an electronic score, and It may be something like this.
　図２は、情報処理装置１００のハードウェア構成を示すブロック図である。情報処理装置１００は、制御部１１０と、記憶部１２０と、タッチスクリーン部１３０と、通信部１４０とを備えたコンピュータである。なお、情報処理装置１００は、図２に示した構成のほかに、スピーカやマイクロホン（又はその入出力部）、カメラ（ビデオカメラを含む）、バイブレータなどを備えてもよい。 FIG. 2 is a block diagram illustrating a hardware configuration of the information processing apparatus 100. The information processing apparatus 100 is a computer that includes a control unit 110, a storage unit 120, a touch screen unit 130, and a communication unit 140. The information processing apparatus 100 may include a speaker, a microphone (or an input / output unit thereof), a camera (including a video camera), a vibrator, and the like in addition to the configuration illustrated in FIG.
　制御部１１０は、情報処理装置１００の各部の動作を制御する手段である。制御部１１０は、ＣＰＵ（Central Processing Unit）などの演算処理装置や、ＲＯＭ（Read Only Memory）、ＲＡＭ（Random Access Memory）などの記憶装置を備え、ＲＯＭ又は記憶部１２０に記憶されたプログラムを実行して情報処理装置１００の各部を制御する。 The control unit 110 is a means for controlling the operation of each unit of the information processing apparatus 100. The control unit 110 includes an arithmetic processing device such as a CPU (Central Processing Unit) and a storage device such as a ROM (Read Only Memory) and a RAM (Random Access Memory), and executes a program stored in the ROM or the storage unit 120. Thus, each unit of the information processing apparatus 100 is controlled.
　記憶部１２０は、データを記憶する手段である。記憶部１２０は、例えば、ハードディスクやフラッシュメモリなどの記録媒体を備え、制御部１１０が使用するデータを記憶する。記憶部１２０は、いわゆるリムーバブルディスク、すなわち着脱可能な記録媒体を含んでもよい。記憶部１２０は、制御部１１０が実行するプログラムや、表示操作面１０１に表示される画像データ（ここでは電子楽譜データ）を記憶する。 The storage unit 120 is a means for storing data. The storage unit 120 includes, for example, a recording medium such as a hard disk or a flash memory, and stores data used by the control unit 110. The storage unit 120 may include a so-called removable disk, that is, a removable recording medium. The storage unit 120 stores a program executed by the control unit 110 and image data (here, electronic score data) displayed on the display operation surface 101.
　タッチスクリーン部１３０は、画像を表示する手段であり、かつ、ユーザの操作を受け付ける手段である。タッチスクリーン部１３０は、画像を表示する表示部１３１と、ユーザの操作を受け付ける操作部１３２とを含む。表示部１３１は、液晶素子や有機ＥＬ（electroluminescence）素子により画像を表示する表示パネルと、この表示パネルを駆動する駆動回路などを備え、制御部１１０から供給されるデータに応じた画像を表示パネルに表示させる。操作部１３２は、表示部１３１の表示パネルを覆うように重ねて設けられ、ユーザの指の接触を検出する面状のセンサを備えている。この面状のセンサ（操作面）は表示部１３１の表示パネル（表示面）とほぼ同じサイズである。操作部１３２は、操作面という操作領域に対して指が接触した位置（ユーザによって操作される位置であるから、以下、操作位置という）を検出する。操作部１３２は、いわゆるマルチタッチに対応しており、複数の操作位置を同時に検出することが可能である。 The touch screen unit 130 is a means for displaying an image and a means for receiving a user operation. The touch screen unit 130 includes a display unit 131 that displays an image and an operation unit 132 that receives a user operation. The display unit 131 includes a display panel that displays an image using a liquid crystal element or an organic EL (electroluminescence) element, a drive circuit that drives the display panel, and the like, and displays an image corresponding to data supplied from the control unit 110. To display. The operation unit 132 is provided so as to cover the display panel of the display unit 131 and includes a planar sensor that detects contact of a user's finger. This planar sensor (operation surface) is approximately the same size as the display panel (display surface) of the display unit 131. The operation unit 132 detects a position where the finger touches the operation area called the operation surface (hereinafter, referred to as an operation position since it is a position operated by the user). The operation unit 132 is compatible with so-called multi-touch, and can simultaneously detect a plurality of operation positions.
　通信部１４０は、データを送受信する手段である。通信部１４０は、例えば移動体通信網やインターネットなどのネットワークに接続するネットワークインタフェースであってもよいし、ＮＦＣ（Near Field Communication）による無線通信のように、他の電子機器とネットワークを介さずに接続するものであってもよい。通信部１４０は、例えば表示操作面１０１に表示される画像を表すデータ（ここでは電子楽譜データ）などを受信する。 The communication unit 140 is a means for transmitting and receiving data. The communication unit 140 may be a network interface connected to a network such as a mobile communication network or the Internet, or other wireless devices such as NFC (Near Field Communication) without using a network. It may be connected. The communication unit 140 receives, for example, data (here, electronic score data) representing an image displayed on the display operation surface 101.
　図３は、情報処理装置１００の機能的構成を示すブロック図である。操作位置検出部１１１は、操作部１３２によって実現される機能であり、表示操作面１０１においてユーザにより操作（接触）された操作位置を検出する手段である。操作部１３２はマルチタッチに対応しているから、ユーザが２本の指でタッチスクリーン部１３０を操作した場合、操作位置検出部１１１は、一方の指が表示操作面１０１に接触した位置である第１操作位置、及び、他方の指が表示操作面１０２に接触した位置である第２操作位置を同時に検出する。これらの操作位置は、表示操作面１０１の所定の位置（例えば、中心や四隅のいずれか）を原点とした２次元直交座標系におけるＸ，Ｙ座標で表わされる。ユーザが表示操作面１０１に指を触れた状態で移動させると、検出される操作位置は時々刻々と変化することになる。 FIG. 3 is a block diagram illustrating a functional configuration of the information processing apparatus 100. The operation position detection unit 111 is a function realized by the operation unit 132 and is a unit that detects an operation position operated (contacted) by the user on the display operation surface 101. Since the operation unit 132 supports multi-touch, when the user operates the touch screen unit 130 with two fingers, the operation position detection unit 111 is a position where one finger contacts the display operation surface 101. The first operation position and the second operation position that is the position at which the other finger contacts the display operation surface 102 are simultaneously detected. These operation positions are represented by X and Y coordinates in a two-dimensional orthogonal coordinate system with a predetermined position (for example, one of the center and four corners) on the display operation surface 101 as the origin. When the user moves the display operation surface 101 while touching his / her finger, the detected operation position changes from moment to moment.
　操作認識部１１２は、制御部１１０によって実現される機能であり、操作位置検出部１１１により検出された操作位置に基づいてユーザの操作を認識する手段である。本実施形態において、操作認識部１１２は、「ピンチイン操作」及び「ピンチアウト操作」のほか、本実施形態において特徴となる「ピンチフリックイン操作」及び「ピンチフリックアウト操作」という、４種類の操作を少なくとも認識する。なお、操作認識部１１２は、１本の指を表示操作面１０１に触れる「タップ操作」、指を表示操作面１０１に接触させたまま移動させる「スワイプ操作」、又は、指を表示操作面１０１に接触させた後で払うような動作を行う「フリック操作」など、周知の操作について認識してもよい。 The operation recognition unit 112 is a function realized by the control unit 110, and is a means for recognizing a user operation based on the operation position detected by the operation position detection unit 111. In the present embodiment, the operation recognition unit 112 includes four types of operations, “pinch-flick-in operation” and “pinch-flick-out operation”, which are characteristic in the present embodiment, in addition to “pinch-in operation” and “pinch-out operation”. Recognize at least. Note that the operation recognition unit 112 performs “tap operation” in which one finger touches the display operation surface 101, “swipe operation” in which the finger is moved while being in contact with the display operation surface 101, or moves the finger to the display operation surface 101. You may recognize well-known operations, such as "flick operation" which performs the operation | movement which pays after making it contact.
　ピンチイン操作及びピンチアウト操作は、表示操作面１０１の２点に同時に指を接触させたまま、少なくともいずれか一方の操作位置を移動させる操作である。ピンチイン操作は、表示操作面１０１の２点に触れた後に、その２点間の距離を狭めるように操作位置を移動させる操作であり、ピンチクローズ操作とも呼ばれる。また、ピンチアウト操作は、表示操作面１０１の２点に触れた後に、その２点間の距離を広げるように操作位置を移動させる操作であり、ピンチオープン操作とも呼ばれる。ピンチイン操作及びピンチアウト操作においては、指を表示操作面１０１に接触させてから離すまでの一連の動作が１回の操作に相当する。 The pinch-in operation and the pinch-out operation are operations that move at least one of the operation positions while keeping a finger in contact with two points on the display operation surface 101 at the same time. The pinch-in operation is an operation of moving the operation position so as to reduce the distance between the two points after touching the two points on the display operation surface 101, and is also referred to as a pinch close operation. The pinch-out operation is an operation of moving the operation position so as to increase the distance between the two points after touching the two points on the display operation surface 101, and is also referred to as a pinch open operation. In the pinch-in operation and the pinch-out operation, a series of operations from the time when the finger is brought into contact with the display operation surface 101 until the finger is released corresponds to one operation.
　ピンチフリックイン操作及びピンチフリックアウト操作は、操作の前半においては表示操作面１０１の２点に同時に指を接触させたまま少なくともいずれか一方の操作位置を移動させ、さらに、その操作の最後に表示操作面１０１において指を素早く払うようにタッチする操作である。要するに、ピンチフリックイン操作及びピンチフリックアウト操作において、その操作の前半は、従来のピンチイン操作及びピンチアウト操作に類似し、その操作の後半（最後）は、従来のフリック操作に類似している。ピンチフリックイン操作は、表示操作面１０１の２点に触れた後に、その２点間の距離を狭めるように操作位置を移動させ、さらにその操作の最後に、指を近づけるようにして表示操作面１０１上で払うようにする操作である。また、ピンチフリックアウト操作は、表示操作面１０１の２点に触れた後に、その２点間の距離を広げるように操作位置を移動させ、さらにその操作の最後に、指を遠ざけるようにして表示操作面１０１上で払うようにする操作である。これらのピンチフリックイン操作及びピンチフリックアウト操作においても、指を表示操作面１０１に接触させてから離すまでの一連の動作が１回の操作に相当する。 In the first half of the operation, the pinch flick-in operation and the pinch flick-out operation are performed by moving at least one of the operation positions while keeping the finger in contact with two points on the display operation surface 101 at the same time. This is an operation of touching the operation surface 101 so as to quickly pay a finger. In short, in the pinch flick-in operation and the pinch flick-out operation, the first half of the operation is similar to the conventional pinch-in operation and the pinch-out operation, and the second half (last) of the operation is similar to the conventional flick operation. In the pinch flick-in operation, after touching two points on the display operation surface 101, the operation position is moved so as to reduce the distance between the two points, and at the end of the operation, the finger is brought closer to the display operation surface. This is an operation of paying on 101. The pinch flick-out operation is performed by touching two points on the display operation surface 101, moving the operation position so as to increase the distance between the two points, and further moving the finger away at the end of the operation. This is an operation for paying on the operation surface 101. Also in these pinch flick-in operations and pinch flick-out operations, a series of operations from when a finger is brought into contact with the display operation surface 101 until it is released corresponds to one operation.
　操作認識部１１２は、ユーザによってなされた操作が、ピンチイン操作、ピンチアウト操作、ピンチフリックイン操作又はピンチフリックアウト操作のいずれであるかを判定する判定部１１３を備える。より具体的には、判定部１１３は、マルチタッチがなされた場合において、第１操作位置及び第２操作位置のうち少なくとも一方が検出されなくなったときの当該第１操作位置及び当該第２操作位置の相対的な移動速度が、記憶部１２０に記憶された閾値よりも大きいか否かを判定する。ここでいう第１操作位置及び第２操作位置の相対的な移動速度とは、第１操作位置及び第２操作位置のうち少なくとも一方が検出されなくなったときの直前の、これら操作位置の相対的な移動速度（制御部１１０によって最後に認識された相対的な移動速度）である。 The operation recognition unit 112 includes a determination unit 113 that determines whether the operation performed by the user is a pinch-in operation, a pinch-out operation, a pinch flick-in operation, or a pinch flick-out operation. More specifically, the determination unit 113 performs the first operation position and the second operation position when at least one of the first operation position and the second operation position is not detected when multi-touch is performed. It is determined whether or not the relative movement speed is greater than a threshold value stored in the storage unit 120. The relative movement speed of the first operation position and the second operation position here refers to the relative speed of these operation positions immediately before at least one of the first operation position and the second operation position is not detected. The moving speed (relative moving speed finally recognized by the control unit 110).
　ここで、第１操作位置及び第２操作位置の相対的な移動速度が閾値よりも大きい場合には、操作の最後に或る程度の速さで指を払う行為があったということだから、判定部１１３は、ピンチフリックイン操作又はピンチフリックアウト操作であると判定する。さらに、判定部１１３は、第１操作位置及び第２操作位置の相対的な移動方向が互いに近づく方向である場合には、ピンチフリックイン操作であると判定し、第１操作位置及び第２操作位置の相対的な移動方向が互いに遠ざかる方向である場合には、ピンチフリックアウト操作であると判定する。 Here, if the relative movement speed of the first operation position and the second operation position is larger than the threshold value, it means that there was an action of paying a finger at a certain speed at the end of the operation. The unit 113 determines that the operation is a pinch flick-in operation or a pinch flick-out operation. Further, the determination unit 113 determines that the operation is the pinch flick-in operation when the relative movement directions of the first operation position and the second operation position are close to each other, and determines the first operation position and the second operation position. When the relative moving directions of the positions are directions away from each other, it is determined that the operation is a pinch flick out operation.
　一方、第１操作位置及び第２操作位置の相対的な移動速度が閾値以下である場合には、操作の最後で或る程度の速さで指を払う行為がなかったということだから、判定部１１３は、ピンチイン操作又はピンチアウト操作であると判定する。 On the other hand, if the relative movement speed of the first operation position and the second operation position is equal to or less than the threshold value, it means that there was no act of paying a finger at a certain speed at the end of the operation. 113 determines that it is a pinch-in operation or a pinch-out operation.
　設定部１１４は、制御部１１０によって実現される機能であり、操作認識部１１２によって認識された操作に応じて設定値を設定する。ここで、設定値とは、情報処理装置１００がユーザの操作に応じて何らかの処理を行うときに用いる値であり、本実施形態では画像の表示倍率である。表示倍率は、デフォルトで決められた画像の大きさに対して実際に表示される画像の大きさの比率である。 The setting unit 114 is a function realized by the control unit 110, and sets a setting value according to the operation recognized by the operation recognition unit 112. Here, the set value is a value used when the information processing apparatus 100 performs some processing in response to a user operation, and is a display magnification of the image in the present embodiment. The display magnification is a ratio of the size of the image that is actually displayed to the size of the image determined by default.
　表示制御部１１６は、制御部１１０によって実現される機能であり、表示部１３１に表示させる画像を制御する手段である。表示制御部１１３は、操作認識部１１２により認識された操作が、ピンチイン操作、ピンチアウト操作、ピンチフリックイン操作又はピンチフリックアウト操作である場合に、その操作に応じて画像の表示倍率を変更して表示させる。 The display control unit 116 is a function realized by the control unit 110 and is a means for controlling an image to be displayed on the display unit 131. When the operation recognized by the operation recognition unit 112 is a pinch-in operation, a pinch-out operation, a pinch flick-in operation, or a pinch flick-out operation, the display control unit 113 changes the image display magnification according to the operation. To display.
　図４は、設定値を設定するときに従うべきルールが記述された設定値テーブルの一例を示す図である。この設定値テーブルは、記憶部１２０によって実現される設定値記憶部１１５に記憶されている。図４に示すように、ピンチフリックイン操作又はピンチフリックアウト操作においては、例えば０．５倍、１倍、２倍、４倍という４段階の離散的な値の集合（第１離散値群）に含まれるいずれかの値が設定値（表示倍率）として設定されるようになっている。 FIG. 4 is a diagram illustrating an example of a setting value table in which rules to be followed when setting setting values are described. This setting value table is stored in the setting value storage unit 115 realized by the storage unit 120. As shown in FIG. 4, in the pinch flick-in operation or pinch flick-out operation, for example, a set of discrete values (first discrete value group) of four stages of 0.5 times, 1 time, 2 times, and 4 times, for example. Is set as a set value (display magnification).
　例えば、現在の表示倍率が１倍の場合にピンチフリックイン操作が１回なされると、表示倍率が１段階縮小されて、表示倍率は１倍の次に小さい０．５倍になる。一方、現在の表示倍率が１倍の場合にはピンチフリックアウト操作が１回なされると、表示倍率が１段階拡大されて、表示倍率は１倍の次に大きい２倍になる。つまり、第１離散値群に含まれる離散値のうち、第１操作位置及び第２操作位置のうち少なくとも一方が検出されなくなったときの当該第１操作位置及び当該第２操作位置の相対的な移動方向（第１操作位置及び第２操作位置の相対的な移動方向が近づく方向か遠ざかる方向か）に応じた離散値が設定値として設定される。 For example, if the pinch flick-in operation is performed once when the current display magnification is 1, the display magnification is reduced by one step, and the display magnification becomes 0.5, which is the next smaller one. On the other hand, when the current display magnification is 1, when the pinch flick-out operation is performed once, the display magnification is enlarged by one step, and the display magnification becomes double, which is the next higher one. That is, among the discrete values included in the first discrete value group, the relative relationship between the first operation position and the second operation position when at least one of the first operation position and the second operation position is not detected. A discrete value corresponding to the movement direction (whether the relative movement direction of the first operation position and the second operation position is closer or farther away) is set as a set value.
　従来のピンチイン操作又はピンチアウト操作によって例えば表示倍率を２倍から４倍に変更させようとした場合、表示操作面上で指を或る程度の量だけ移動させる必要がある。一方、上記のようなピンチフリックイン操作又はピンチフリックアウト操作で表示倍率の変更を実現するならば、操作の前半で従来のピンチイン操作又はピンチアウト操作を少しの移動量だけ行ってから、その操作の最後で指を払うだけでよいから、指の移動量を従来よりも減らすことができる。 For example, when the display magnification is to be changed from 2 to 4 times by a conventional pinch-in operation or pinch-out operation, it is necessary to move the finger by a certain amount on the display operation surface. On the other hand, if the display magnification is changed by the pinch flick-in operation or the pinch flick-out operation as described above, the conventional pinch-in operation or pinch-out operation is performed by a small amount of movement in the first half of the operation, and then the operation is performed. Since it is only necessary to pay the finger at the end of the step, the amount of movement of the finger can be reduced as compared with the prior art.
　また、指を払うという動作は指を比較的速く動かす動作であるから、画像の急激な縮小又は拡大という処理結果との間に概念的な類似性を有する。よって、ユーザから見れば、画像の表示倍率を或る程度の量で段階的に縮小又は拡大するという処理を直観的な操作で指示することができる。 In addition, since the operation of moving the finger is an operation of moving the finger relatively quickly, there is a conceptual similarity with the processing result of abrupt reduction or enlargement of the image. Therefore, from the viewpoint of the user, an intuitive operation can be instructed to reduce or enlarge the image display magnification stepwise by a certain amount.
　次に、ピンチイン操作又はピンチアウト操作においては、表示倍率が操作位置間の距離に追随して連続的に変化する。ただし、連続的とはいっても、現実には表示操作面１０１の画素間距離に依存した離散的な値の集合（第２離散値群）に含まれるいずれかの値が表示倍率として設定される。この第２離散値群に含まれる互いの値の差は、第１の離散値群（０．５倍、１倍、２倍、４倍と）に比べて格段に小さい。ユーザは、ピンチイン操作又はピンチアウト操作によって、自らが望む任意の表示倍率で画像を表示させることができる。つまり、本実施形態によれば、ピンチフリックイン操作又はピンチフリックアウト操作による操作負担の軽減と、ピンチイン操作又はピンチアウト操作による任意の表示倍率の選択との双方を実現可能となる。 Next, in the pinch-in operation or the pinch-out operation, the display magnification changes continuously following the distance between the operation positions. However, although it is continuous, in reality, any value included in the set of discrete values (second discrete value group) depending on the inter-pixel distance of the display operation surface 101 is set as the display magnification. . The difference between the values included in the second discrete value group is much smaller than that of the first discrete value group (0.5 times, 1 time, 2 times, 4 times). The user can display an image at an arbitrary display magnification desired by the user by a pinch-in operation or a pinch-out operation. That is, according to the present embodiment, it is possible to reduce both the operation burden due to the pinch flick in operation or the pinch flick out operation and the selection of an arbitrary display magnification by the pinch in operation or the pinch out operation.
　なお、ピンチフリックイン操作又はピンチフリックアウト操作時に用いられる第１離散値群は、０．５倍、１倍、２倍、４倍という例に限らず、コンテンツがページ単位の場合には、０．５ページ、２ページ、８ページというようにページ単位を基準とした離散値の集合であってもよい。つまり、設定値は表示対象のページ数であってもよい。第１離散値群の具体的な値は、表示対象となるコンテンツや表示操作面１０１のアスペクト比などにより異なるが、要するに、第１離散値群に含まれる互いの値の差が第２の離散値群と比べて大きければよい。 Note that the first discrete value group used at the time of pinch flick-in operation or pinch flick-out operation is not limited to the example of 0.5 times, 1 time, 2 times, 4 times, and 0 when the content is in units of pages. It may be a set of discrete values based on page units, such as .5 pages, 2 pages, and 8 pages. That is, the set value may be the number of pages to be displayed. The specific value of the first discrete value group varies depending on the content to be displayed, the aspect ratio of the display operation surface 101, and the like, but in short, the difference between the values included in the first discrete value group is the second discrete value group. It only needs to be larger than the value group.
［動作］
　図５は、情報処理装置１００の制御部１１０が実行する処理を示すフローチャートである。制御部１１０は、表示操作面１０１に対してユーザによる操作があった場合には（ステップＳ１；ＹＥＳ）、操作部１３２が検出した操作位置に基づいてユーザの操作を認識する（ステップＳ２）。 [Operation]
FIG. 5 is a flowchart illustrating processing executed by the control unit 110 of the information processing apparatus 100. When there is an operation by the user on the display operation surface 101 (step S1; YES), the control unit 110 recognizes the user operation based on the operation position detected by the operation unit 132 (step S2).
　ユーザの操作の認識結果がピンチフリックイン操作又はピンチフリックアウト操作であった場合には（つまり、第１操作位置及び第２操作位置のうち少なくとも一方が検出されなくなったときの当該第１操作位置及び当該第２操作位置の相対的な移動速度が閾値よりも大きい場合には）、ステップＳ３；ピンチフリックインまたピンチフリックアウトに進み、制御部１１０は、第１離散値群に含まれるいずれかの値を設定値（表示倍率）とする（ステップＳ４）。つまり、制御部１１は、第１操作位置及び第２操作位置の相対的な移動方向が互いに近づく方向である場合には、ピンチフリックイン操作であると判定し、第１離散値群のうち、現在の表示倍率よりも次に小さい表示倍率を設定値として設定する。また、制御部１１は、第１操作位置及び第２操作位置の相対的な移動方向が互いに遠ざかる方向である場合には、ピンチフリックアウト操作であると判定し、第１離散値群のうち、現在の表示倍率よりも次に大きい表示倍率を設定値として設定する。なお、ピンチイン操作又はピンチアウト操作によって例えば表示倍率が１．２倍に設定されている状態において、ピンチフリックイン操作が１回なされると、第１離散値群において表示倍率が１．２倍よりも１つ小さい１倍になる。また、ピンチイン操作又はピンチアウト操作によって例えば表示倍率が１．２倍に設定されている状態において、ピンチフリックアウト操作が１回なされると、第１離散値群において表示倍率が１．２倍よりも１つ大きい２倍になる。そして、制御部１１０は、設定された表示倍率に従って画像を表示する（ステップＳ６）。 When the recognition result of the user operation is a pinch flick-in operation or a pinch flick-out operation (that is, the first operation position when at least one of the first operation position and the second operation position is not detected) When the relative movement speed of the second operation position is larger than the threshold value), the process proceeds to step S3; pinch flick in or pinch flick out, and the control unit 110 is included in the first discrete value group. Is set as a set value (display magnification) (step S4). That is, the control unit 11 determines that the operation is a pinch flick-in operation when the relative movement directions of the first operation position and the second operation position are close to each other, and among the first discrete value group, A display magnification smaller than the current display magnification is set as a setting value. In addition, when the relative movement direction of the first operation position and the second operation position is away from each other, the control unit 11 determines that the operation is a pinch flick-out operation, and among the first discrete value group, The next larger display magnification than the current display magnification is set as the setting value. Note that, for example, when the display magnification is set to 1.2 times by the pinch-in operation or the pinch-out operation, if the pinch flick-in operation is performed once, the display magnification is more than 1.2 times in the first discrete value group. Will also be one smaller. For example, when the display magnification is set to 1.2 times by the pinch-in operation or the pinch-out operation, when the pinch flick-out operation is performed once, the display magnification is more than 1.2 times in the first discrete value group. Is also one larger double. Then, the control unit 110 displays an image according to the set display magnification (step S6).
　ステップＳ３において、ユーザの操作の認識結果がピンチイン操作又はピンチアウト操作であった場合には（つまり、第１操作位置及び第２操作位置のうち少なくとも一方が検出されなくなったときの当該第１操作位置及び当該第２操作位置の相対的な移動速度が閾値以下の場合には）、ステップＳ３；ピンチインまたピンチアウトに進み、制御部１１０は、第２離散値群に含まれる値を設定値（表示倍率）とする（ステップＳ５）。つまり、制御部１１は、第１操作位置及び第２操作位置の相対的な移動方向が互いに近づく方向である場合には、ピンチイン操作であると判定し、第２離散値群のうち、現在の表示倍率よりも次に小さい表示倍率を設定値として設定する。また、制御部１１は、第１操作位置及び第２操作位置の相対的な移動方向が互いに遠ざかる方向である場合には、ピンチアウト操作であると判定し、第２離散値群のうち、現在の表示倍率よりも次に大きい表示倍率を設定値として設定する。そして、制御部１１０は、設定された表示倍率に従って画像を表示する（ステップＳ６）。 In step S3, when the recognition result of the user operation is a pinch-in operation or a pinch-out operation (that is, the first operation when at least one of the first operation position and the second operation position is not detected). When the relative movement speed of the position and the second operation position is equal to or less than the threshold value), the process proceeds to step S3; pinch-in or pinch-out, and the control unit 110 sets the value included in the second discrete value group to the set value ( Display magnification) (step S5). That is, the control unit 11 determines that the operation is a pinch-in operation when the relative movement directions of the first operation position and the second operation position are close to each other, and among the second discrete value group, A display magnification smaller than the display magnification is set as a setting value. Moreover, the control part 11 determines with it being a pinch out operation, when the relative moving direction of a 1st operation position and a 2nd operation position is a direction away from each other, among the 2nd discrete value groups, The display magnification that is next larger than the display magnification is set as the setting value. Then, the control unit 110 displays an image according to the set display magnification (step S6).
　また、ステップＳ３において、制御部１１０は、ピンチフリックイン操作、ピンチフリックアウト操作、ピンチイン操作又はピンチアウト操作のいずれでもないと判定した場合（ステップＳ３；その他）、ユーザの操作に応じた対応処理を実行する（ステップＳ７）。例えば、制御部１１０は、アイコン画像に対するタップ操作が受け付けられた場合であれば、当該アイコン画像に割り当てられたアプリを起動する。なお、ここでいう「対応処理」は、制御部１１０が特別な処理を行わないこと、すなわちユーザの操作に応答しないことであってもよい。 In Step S3, when it is determined that the control unit 110 is neither a pinch flick-in operation, a pinch flick-out operation, a pinch-in operation or a pinch-out operation (Step S3; other), a corresponding process according to a user operation Is executed (step S7). For example, if the tap operation on the icon image is accepted, the control unit 110 activates the application assigned to the icon image. The “corresponding process” here may be that the control unit 110 does not perform a special process, that is, does not respond to a user operation.
　以上のように、本実施形態によれば、設定値を段階的に大きく変更しようとした場合、操作の前半で従来のピンチイン操作又はピンチアウト操作を少し行ってから、その操作の最後で指を払うだけでよいから、指の移動量を従来よりも減らすことができる。また、指を払うという動作は指を速く動かす動作であるから、設定値を段階的に大きく変更するということに概念的な類似性が生じ、ユーザから見れば、直観的な操作でその変更を実現することができる。さらに、本実施形態によれば、ピンチフリックイン操作又はピンチフリックアウト操作による操作負担の軽減と、ピンチイン操作又はピンチアウト操作による任意の表示倍率の選択との双方を実現可能となる。 As described above, according to the present embodiment, when the set value is to be greatly changed step by step, the conventional pinch-in operation or pinch-out operation is slightly performed in the first half of the operation, and then the finger is moved at the end of the operation. Since it is only necessary to pay, the amount of finger movement can be reduced as compared with the conventional method. In addition, since the action of moving the finger is an action of moving the finger quickly, a conceptual similarity arises in that the setting value is greatly changed step by step. From the user's point of view, the change can be made by an intuitive operation. Can be realized. Furthermore, according to the present embodiment, it is possible to realize both the reduction of the operation load by the pinch flick-in operation or the pinch flick-out operation and the selection of an arbitrary display magnification by the pinch-in operation or the pinch out operation.
［変形例］
　本発明は、上述した各実施形態の態様に限らず、他の態様でも実施することができる。本発明は、例えば、以下の変形例に示す態様によっても実施可能である。なお、本発明は、これら複数の変形例を組み合わせた態様で実施されてもよい。 [Modification]
The present invention is not limited to the aspect of each embodiment described above, and can be implemented in other aspects. The present invention can also be implemented, for example, by the modes shown in the following modifications. In addition, this invention may be implemented in the aspect which combined these some modifications.
（１）上述した実施形態は、画像を表示する面（表示面）と操作を受け付ける面（操作面）とが重なっている場合を例示したものである。しかし、本発明の操作部は、必ずしも表示面に重ねて設けられている必要はなく、例えば、操作面としてタッチパッド（トラックパッド、スライドパッドともいう）を備える構成であってもよい。また、ユーザの操作は、必ずしも操作面に接触する操作でなくてもよく、操作面に対する非接触操作を近接センサによって検出してもよい。さらに、操作面は物理的に実在する構成に限らず、例えば空間に仮想的に設けられた３次元の操作領域をユーザがその空間内におけるジェスチャ等によって操作する様子をカメラで撮像し、その操作領域に対する操作を画像認識するような構成であってもよい。つまり、操作領域は、２次元の操作領域に限らず、３次元の操作領域であってもよい。 (1) The embodiment described above exemplifies a case where a surface for displaying an image (display surface) and a surface for receiving an operation (operation surface) overlap. However, the operation unit of the present invention is not necessarily provided so as to overlap the display surface. For example, the operation unit may include a touch pad (also referred to as a track pad or a slide pad) as the operation surface. Further, the user's operation does not necessarily need to be an operation that contacts the operation surface, and a non-contact operation on the operation surface may be detected by the proximity sensor. Furthermore, the operation surface is not limited to a physically existing configuration, and for example, a camera is used to capture an image of a user operating a three-dimensional operation region virtually provided in a space with a gesture or the like in the space. It may be configured to recognize an image of an operation on a region. That is, the operation area is not limited to a two-dimensional operation area, and may be a three-dimensional operation area.
（２）設定値は、実施形態に例示した表示倍率や表示ページ数に限らず、情報処理装置においてなんらかの処理を行うときに用いる値であれば、どのようなものであってもよい。また、第１離散値群は、離散的に単調増加又は減少する値ならば、互いの値の間隔は均等であってもよいし、均等でなくてもよい。 (2) The set value is not limited to the display magnification and the number of display pages exemplified in the embodiment, and may be any value as long as it is a value used when performing some processing in the information processing apparatus. Further, if the first discrete value group is a value that monotonously increases or decreases discretely, the interval between the values may be equal or may not be equal.
（３）実施形態において、ピンチフリックイン操作又はピンチフリックアウト操作が１回なされると、表示倍率が１段階だけ縮小又は拡大されていたが、１回のピンチフリックイン操作又はピンチフリックアウト操作によって表示倍率を複数段階変更してもよい。例えば、ピンチフリックイン操作及びピンチフリックアウト操作と、ピンチイン操作又はピンチアウト操作とを識別する閾値（第１の閾値）よりも大きい第２の閾値を用意し、第１操作位置及び第２操作位置の相対的な移動速度が第２の閾値を超える場合には表示倍率を２段階変更するといった例である。例えば、設定値が表示ページ数の場合、第１操作位置及び第２操作位置の相対的な移動速度が第１の閾値より大きく第２の閾値以下のときは、表示対象であるコンテンツの複数ページ（例えば、２ページ）が表示され（１段階変更）、第１操作位置及び第２操作位置の相対的な移動速度が第２の閾値より大きいときは、コンテンツのより多くのページ（例えば、４ページ）が表示される（２段階変更）。また、操作面に対する操作の押圧力を検出可能な構成の場合には、例えばピンチフリックイン操作及びピンチフリックアウト操作時の押圧力が閾値未満の場合には表示倍率を１段階変更し、その押圧力が閾値以上の場合には表示倍率を２段階変更するといった例でもよい。 (3) In the embodiment, when the pinch flick-in operation or the pinch flick-out operation is performed once, the display magnification is reduced or enlarged by one step. However, by one pinch flick-in operation or pinch flick-out operation The display magnification may be changed in a plurality of stages. For example, a second threshold value larger than a threshold value (first threshold value) for discriminating a pinch flick-in operation and a pinch flick-out operation from a pinch-in operation or a pinch-out operation is prepared, and the first operation position and the second operation position This is an example in which the display magnification is changed in two steps when the relative movement speed of exceeds the second threshold. For example, when the set value is the number of display pages, when the relative movement speed of the first operation position and the second operation position is greater than the first threshold and less than or equal to the second threshold, a plurality of pages of content to be displayed (For example, two pages) is displayed (one step change), and when the relative movement speed of the first operation position and the second operation position is greater than the second threshold, more pages of content (for example, 4) Page) is displayed (2 step change). In the case of a configuration that can detect the pressing force of the operation on the operation surface, for example, when the pressing force during the pinch flick-in operation and the pinch flick-out operation is less than the threshold value, the display magnification is changed by one step. An example in which the display magnification is changed in two steps when the pressure is greater than or equal to the threshold value may be used.
（４）表示する画像がページ単位であり、設定値がページ数であると、ユーザの操作によって、表示操作面１０１に表示するページ数を変更することができる。複数ページが表示操作面１０１に表示されている状態で、所定の操作が行われる場合、互いに隣接する２ページを入れ替えてもよい。つまり、奇数ページと偶数ページを入れ替えて表示してもよい。所定の操作とは、操作認識部１１２によって認識される操作であり、例えば、スワイプ操作である。 (4) When the image to be displayed is a page unit and the set value is the number of pages, the number of pages displayed on the display operation surface 101 can be changed by a user operation. When a predetermined operation is performed in a state where a plurality of pages are displayed on the display operation surface 101, two adjacent pages may be switched. That is, the odd page and the even page may be switched and displayed. The predetermined operation is an operation recognized by the operation recognition unit 112, for example, a swipe operation.
（５）ユーザは、自身の指に限らず、スタイラスなどのユーザが手に持って（あるいは手に装着して）動かす指示用の器具（以下「指示体」という。）を用いて操作を行ってもよい。このような指示体を用いる場合の操作部は、指示体の位置を赤外線や超音波によって検出するものであってもよい。また、先端に磁性体を備える指示体を用いた場合には、指示体の位置を磁気的に検出することも可能である。すなわち、本発明の情報処理装置は、タッチスクリーンを備えるものである必要はない。さらに、ピンチイン操作やピンチアウト操作は、片手での操作に限らず、右手（の指）と左手（の指）とを用いて行われてもよい。 (5) The user performs an operation using not only his / her finger but also an instruction tool (hereinafter referred to as “indicator”) such as a stylus that is held by (or attached to) the user's hand. May be. The operation unit in the case of using such an indicator may detect the position of the indicator by infrared rays or ultrasonic waves. In addition, when an indicator having a magnetic body at the tip is used, the position of the indicator can be detected magnetically. That is, the information processing apparatus of the present invention does not need to be provided with a touch screen. Further, the pinch-in operation and the pinch-out operation are not limited to one-hand operation, and may be performed using the right hand (finger) and the left hand (finger).
（６）本発明は、ゲーム機、音楽プレーヤ、電子書籍リーダなど、さまざまな情報処理装置に対しても適用可能である。また、本発明は、情報処理装置単体ではなく、少なくとも表示部を備える情報処理装置と、情報処理装置とは独立に設けられた他の装置（情報処理装置の表示を制御するための装置）との協働によって実現されてもよい。この場合において、当該他の装置は、図３に示した機能的構成を備えれば十分であり、表示部や操作部を備えていなくてもよい。この場合、本発明は、図３に示した機能的構成を実現するためのプログラムや、これを記録した記録媒体の形態でも実施され得る。また、かかるプログラムは、サーバ装置からネットワークを介してダウンロードされて電子機器にインストールされてもよい。 (6) The present invention can also be applied to various information processing apparatuses such as game machines, music players, and electronic book readers. Further, the present invention is not an information processing apparatus alone, but an information processing apparatus including at least a display unit, and another apparatus (an apparatus for controlling display of the information processing apparatus) provided independently of the information processing apparatus It may be realized by cooperation. In this case, it is sufficient for the other apparatus to have the functional configuration shown in FIG. 3, and the display unit and the operation unit may not be provided. In this case, the present invention can be implemented in the form of a program for realizing the functional configuration shown in FIG. 3 and a recording medium on which the program is recorded. Further, such a program may be downloaded from a server device via a network and installed in an electronic device.
　本出願は、２０１６年３月１６日出願の日本特許出願（特願２０１６－０５２０７０）及び２０１６年３月１６日出願の日本特許出願（特願２０１６－０５２９００）に基づくものであり、その内容はここに参照として取り込まれる。 This application is based on a Japanese patent application filed on March 16, 2016 (Japanese Patent Application No. 2016-052070) and a Japanese patent application filed on March 16, 2016 (Japanese Patent Application No. 2016-052900). Incorporated herein by reference.
本発明によれば、情報処理装置における設定値がユーザの直感的かつ負担の少ない操作で変更可能となる。 According to the present invention, the setting value in the information processing apparatus can be changed by an operation that is intuitive and less burdensome for the user.
１００…情報処理装置、１０１…表示操作面、１１０…制御部、１１１…操作位置検出部、１１２…操作認識部、１１３…判定部、１１４…設定部、１１５…設定値記憶部、１１６…表示制御部、１２０…記憶部、１３０…タッチスクリーン部、１３１…表示部、１３２…操作部、１４０…通信部。 DESCRIPTION OF SYMBOLS 100 ... Information processing apparatus, 101 ... Display operation surface, 110 ... Control part, 111 ... Operation position detection part, 112 ... Operation recognition part, 113 ... Determination part, 114 ... Setting part, 115 ... Setting value memory | storage part, 116 ... Display Control unit, 120 ... storage unit, 130 ... touch screen unit, 131 ... display unit, 132 ... operation unit, 140 ... communication unit.

Claims (10)

  1. 　操作領域に対して操作された第１操作位置及び第２操作位置を検出する検出ステップと、
    　前記第１操作位置及び前記第２操作位置のうち少なくとも一方が検出されなくなったときの当該第１操作位置及び当該第２操作位置の相対的な移動速度が閾値よりも大きいか否かを判定する判定ステップと、
    　前記第１操作位置及び前記第２操作位置の相対的な移動速度が閾値よりも大きいと判定された場合には、所定の第１離散値群に含まれるいずれかの離散値を設定値として設定する設定ステップと
    　を備えることを特徴とする情報処理方法。     A detection step of detecting a first operation position and a second operation position operated with respect to the operation region;
    It is determined whether a relative moving speed of the first operation position and the second operation position when at least one of the first operation position and the second operation position is not detected is greater than a threshold value. A determination step;
    If it is determined that the relative movement speed of the first operation position and the second operation position is greater than a threshold value, any one of the discrete values included in the predetermined first discrete value group is set as a set value. An information processing method comprising: a setting step.
  2. 　前記設定ステップにおいて、前記第１操作位置及び前記第２操作位置のうち少なくとも一方が検出されなくなったときの当該第１操作位置及び当該第２操作位置の相対的な移動速度が閾値以下の場合には、前記第１離散値群に比べて互いの値の差が小さい第２の離散値群に含まれるいずれかの離散値を設定値として設定する
    　ことを特徴とする請求項１記載の情報処理方法。     In the setting step, when a relative moving speed of the first operation position and the second operation position when at least one of the first operation position and the second operation position is not detected is equal to or less than a threshold value. 2. The information processing according to claim 1, wherein any one of the discrete values included in the second discrete value group having a smaller difference between the values than the first discrete value group is set as a set value. Method.
  3. 　前記設定ステップにおいて、前記第１離散値群のうち、前記第１操作位置及び前記第２操作位置のうち少なくとも一方が検出されなくなったときの当該第１操作位置及び当該第２操作位置の相対的な移動方向に応じた離散値を設定値として設定する
    　ことを特徴とする請求項１又は２記載の情報処理方法。     In the setting step, relative to the first operation position and the second operation position when at least one of the first operation position and the second operation position is not detected in the first discrete value group. The information processing method according to claim 1, wherein a discrete value corresponding to a specific moving direction is set as a set value.
  4. 　前記設定値は画像の表示倍率である
    　ことを特徴とする請求項１～３のいずれか１項に記載の情報処理方法。     The information processing method according to any one of claims 1 to 3, wherein the set value is an image display magnification.
  5. 　前記閾値は、第１の閾値と、前記第１の閾値よりも大きい第２の閾値を含み、
    　前記第１操作位置及び前記第２操作位置の相対的な移動速度が前記第１の閾値よりも大きく前記第２の閾値以下と判定された場合は、前記表示倍率を１段階変更し、
    前記第１操作位置及び前記第２操作位置の相対的な移動速度が前記第２の閾値よりも大きいと判定された場合は、前記表示倍率を２段階変更する
    　ことを特徴とする請求項４記載の情報処理方法。     The threshold includes a first threshold and a second threshold that is greater than the first threshold;
    If it is determined that the relative movement speed of the first operation position and the second operation position is greater than the first threshold and less than or equal to the second threshold, the display magnification is changed by one step,
    5. The display magnification is changed in two steps when it is determined that a relative moving speed between the first operation position and the second operation position is larger than the second threshold value. Information processing method.
  6. 　前記設定値は画像の表示ページ数である
    　ことを特徴とする請求項１～３のいずれか１項に記載の情報処理方法。     The information processing method according to any one of claims 1 to 3, wherein the set value is the number of display pages of an image.
  7. 　前記画像が複数ページ表示された状態で、前記操作領域に対して、スワイプ操作が行われると、前記画像の互いに隣接する２ページが入れ替えられて表示される
    　ことを特徴とする請求項６記載の情報処理方法。     The two adjacent pages of the image are switched and displayed when a swipe operation is performed on the operation area in a state where the image is displayed in a plurality of pages. Information processing method.
  8. 　前記閾値は、第１の閾値と、前記第１の閾値よりも大きい第２の閾値を含み、
    　前記第１操作位置及び前記第２操作位置の相対的な移動速度が前記第１の閾値よりも大きく前記第２の閾値以下と判定された場合は、前記表示ページ数を１段階変更し、
    前記第１操作位置及び前記第２操作位置の相対的な移動速度が前記第２の閾値よりも大きいと判定された場合は、前記表示ページ数を２段階変更する
    　ことを特徴とする請求項６記載の情報処理方法。     The threshold includes a first threshold and a second threshold that is greater than the first threshold;
    When it is determined that the relative movement speed of the first operation position and the second operation position is greater than the first threshold value and less than or equal to the second threshold value, the display page number is changed by one step,
    The display page number is changed in two steps when it is determined that a relative moving speed between the first operation position and the second operation position is larger than the second threshold value. The information processing method described.
  9. 　操作領域に対して行われた操作の位置である第１操作位置及び第２操作位置を検出し、
    　前記第１操作位置及び前記第２操作位置のうち少なくとも一方が検出されなくなったときの当該第１操作位置及び当該第２操作位置の相対的な移動速度と閾値との比較結果に基づき、前記操作領域に対して行われた操作が、ピンチイン操作、ピンチアウト操作、及びピンチイン操作又はピンチアウト操作の最後にフリック操作が行われる操作、のいずれかであるかを判定する判定ステップと、
    　前記判定した前記操作領域に対して行われた操作に基づき、所定の散値群に含まれるいずれかの離散値を設定値として設定する設定ステップと
    　を備えることを特徴とする情報処理方法。     Detecting a first operation position and a second operation position which are positions of operations performed on the operation area;
    Based on a comparison result between a relative movement speed of the first operation position and the second operation position when at least one of the first operation position and the second operation position is not detected and a threshold value, the operation is performed. A determination step of determining whether an operation performed on the region is any one of a pinch-in operation, a pinch-out operation, and an operation in which a flick operation is performed at the end of the pinch-in operation or the pinch-out operation;
    An information processing method comprising: a setting step of setting any discrete value included in a predetermined scatter value group as a set value based on an operation performed on the determined operation area.
  10. 　操作領域に対して操作された第１操作位置及び第２操作位置を検出する検出部と、
    　前記第１操作位置及び前記第２操作位置のうち少なくとも一方が検出されなくなったときの当該第１操作位置及び当該第２操作位置の相対的な移動速度が閾値よりも大きいか否かを判定する判定部と、
    　前記第１操作位置及び前記第２操作位置の相対的な移動速度が閾値よりも大きいと判定された場合には、所定の第１離散値群に含まれるいずれかの離散値を設定値として設定する設定部と
    　を備えることを特徴とする情報処理装置。     A detection unit for detecting a first operation position and a second operation position operated on the operation region;
    It is determined whether a relative moving speed of the first operation position and the second operation position when at least one of the first operation position and the second operation position is not detected is greater than a threshold value. A determination unit;
    If it is determined that the relative movement speed of the first operation position and the second operation position is greater than a threshold value, any one of the discrete values included in the predetermined first discrete value group is set as a set value. An information processing apparatus comprising: a setting unit that performs:
PCT/JP2017/010702 2016-03-16 2017-03-16 Information processing method and information processing device WO2017159796A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2016-052900 2016-03-16
JP2016-052070 2016-03-16
JP2016052900A JP2017167846A (en) 2016-03-16 2016-03-16 Display device, display method, and display program
JP2016052070A JP2017167792A (en) 2016-03-16 2016-03-16 Information processing method and information processor

Publications (1)

Publication Number Publication Date
WO2017159796A1 true WO2017159796A1 (en) 2017-09-21

Family

ID=59850347

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/010702 WO2017159796A1 (en) 2016-03-16 2017-03-16 Information processing method and information processing device

Country Status (1)

Country Link
WO (1) WO2017159796A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001290585A (en) * 2000-01-31 2001-10-19 Canon Inc Position information processor, position information processing method and program, and operation device and its method and program
JP2011217081A (en) * 2010-03-31 2011-10-27 Sharp Corp Image display apparatus, image forming apparatus, image display method, computer program, and recording medium
JP2012121179A (en) * 2010-12-06 2012-06-28 Sharp Corp Image forming apparatus, and display control method
JP2014106753A (en) * 2012-11-28 2014-06-09 Brother Ind Ltd Image processing program, image processing system, and image processing method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001290585A (en) * 2000-01-31 2001-10-19 Canon Inc Position information processor, position information processing method and program, and operation device and its method and program
JP2011217081A (en) * 2010-03-31 2011-10-27 Sharp Corp Image display apparatus, image forming apparatus, image display method, computer program, and recording medium
JP2012121179A (en) * 2010-12-06 2012-06-28 Sharp Corp Image forming apparatus, and display control method
JP2014106753A (en) * 2012-11-28 2014-06-09 Brother Ind Ltd Image processing program, image processing system, and image processing method

Similar Documents

Publication Publication Date Title
US8610678B2 (en) Information processing apparatus and method for moving a displayed object between multiple displays
JP5295328B2 (en) User interface device capable of input by screen pad, input processing method and program
JP5750875B2 (en) Information processing apparatus, information processing method, and program
US9696882B2 (en) Operation processing method, operation processing device, and control method
JP6157885B2 (en) Display control method for portable terminal device
JP2010538350A (en) Portable terminal with touch screen
KR20120080202A (en) Electronic apparatus using touch panel and setting value modification method of same
JP2010086230A (en) Information processing apparatus, information processing method and program
CN106716493A (en) Method of styling content and touch screen device for styling content
JP6048489B2 (en) Display device
JP2019023849A (en) Input control method, computer, and program
JP6758921B2 (en) Electronic devices and their control methods
JP6758922B2 (en) Electronic devices and their control methods
TWI564780B (en) Touchscreen gestures
JP6768426B2 (en) Display control device, its control method, program, and storage medium
JP2016133978A (en) Information processor, information processing method and program
WO2017159796A1 (en) Information processing method and information processing device
US10983686B2 (en) Display control apparatus equipped with touch panel, control method therefor, and storage medium storing control program therefor
JP6907368B2 (en) Electronic devices and their control methods
JP2017167792A (en) Information processing method and information processor
JP6971573B2 (en) Electronic devices, their control methods and programs
JP2020510272A (en) Navigation system
JP7196246B2 (en) USER INTERFACE PROCESSING PROGRAM, RECORDING MEDIUM, USER INTERFACE PROCESSING METHOD
JP7030527B2 (en) Electronic devices, information processing methods, programs and storage media
JP7077024B2 (en) Electronic devices, information processing methods, programs and storage media

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17766792

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17766792

Country of ref document: EP

Kind code of ref document: A1