WO2015059992A1

WO2015059992A1 - Information processing device, information processing method, and program

Info

Publication number: WO2015059992A1
Application number: PCT/JP2014/071639
Authority: WO
Inventors: 元輝東出; 航樋下; 啓一郎宮川
Original assignee: ソニー株式会社
Priority date: 2013-10-25
Filing date: 2014-08-19
Publication date: 2015-04-30

Abstract

[Problem] To propose a method for, at the time that a manipulator is removed from an operating surface, minimizing possible change in the position on the operating surface pointed to by the manipulator. [Solution] An information processing device according to the present invention is provided with a processing unit for obtaining a signal from a detection unit, which detects contact or close proximity of a manipulator to an operating surface, and varying a predetermined control parameter in accordance with the movement of the manipulator as detected on the basis of the signal, wherein, after detection of a first state in which a first manipulator is in contact with or in close proximity to a first operating surface, the processing unit varies the control parameter for the first manipulator in such a manner that the amount of change in the control parameter per a predetermined distance traveled by the first manipulator after detection of a second state in which a second operating surface is manipulated while the first manipulator is in contact with or in close proximity to the first operating surface, is smaller than the amount of change in the control parameter per the predetermined distance traveled by the first manipulator after the detection of the first state but before the detection of the second state.

Description

Information processing apparatus, information processing method, and program

The present disclosure relates to an information processing apparatus, an information processing method, and a program.

In recent years, information processing apparatuses such as notebook PCs and tablet terminals equipped with touch panels and touch pads (hereinafter referred to as touch panels) have become widespread. Such an information processing apparatus detects, as a pointing position, a position where the operation body touches the operation surface of the touch panel.

For example, Patent Document 1 discloses a technique for designating (pointing) a position by touching a slider displayed on an operation surface on a touch panel with a finger as an operation body.

JP 2010-165337 A

By the way, when the operating tool is moved away from the operating surface, the pointing position may be shifted. For example, when the operating body is separated from the operation surface diagonally, the pointing position is moved in conjunction with the oblique movement of the operating body, unlike when the operating body is separated vertically from the operation surface. As a result, there is a possibility that the pointing position after releasing the operating body is shifted from the desired pointing position before releasing the operating body.

Therefore, the present disclosure proposes a method for suppressing the displacement of the pointing position that may occur when the operating body is separated from the operation surface.

According to the present disclosure, a process of obtaining a signal from a detection unit that detects contact or proximity of the operation body to the operation surface and changing a predetermined control parameter according to the movement of the operation body detected based on the signal. And a change of the control parameter corresponding to the predetermined movement amount of the first operating body after the first state in which the first operating body is in contact with or close to the first operating surface is detected. The predetermined amount of the first operating body after the second state in which the first operating body is in contact with or close to the first operating surface and the operation on the second operating surface is detected is detected rather than the amount. An information processing apparatus is provided that reduces the amount of change in the control parameter corresponding to the amount of movement.

Further, according to the present disclosure, a signal is acquired from a detection unit that detects contact or proximity of the operating tool to the operation surface, and the processor detects the movement of the operating tool detected based on the acquired signal. The control corresponding to a predetermined amount of movement of the first operating body after detecting a first state in which the first operating body is in contact with or close to the first operating surface by changing a predetermined control parameter. The first operating body after the second state in which the first operating body is in contact with or close to the first operating surface and the operation on the second operating surface is detected is detected rather than the change amount of the parameter. Reducing the amount of change of the control parameter corresponding to the predetermined movement amount.

Further, according to the present disclosure, the computer acquires a signal from the detection unit that detects contact or proximity of the operation body to the operation surface, and according to the movement of the operation body detected based on the acquired signal. The control corresponding to a predetermined amount of movement of the first operating body after detecting a first state in which the first operating body is in contact with or close to the first operating surface by changing a predetermined control parameter. The first operating body after the second state in which the first operating body is in contact with or close to the first operating surface and the operation on the second operating surface is detected is detected rather than the change amount of the parameter. A program is provided for causing the change amount of the control parameter corresponding to the predetermined movement amount to be reduced.

As described above, according to the present disclosure, it is possible to suppress the deviation of the pointing position that may occur when the operating body is separated from the operation surface.

Note that the above effects are not necessarily limited, and any of the effects shown in the present specification, or other effects that can be grasped from the present specification, together with or in place of the above effects. May be played.

1 is a diagram illustrating an example of a schematic configuration of an imaging display system 10 according to an embodiment of the present disclosure. It is a block diagram which shows an example of a function structure of the information processing apparatus 100 which concerns on one Embodiment. It is a figure which shows an example of the operation screen 700 displayed on the display part 110 which concerns on one Embodiment. It is a figure for demonstrating the example of a user's operation with respect to the operation screen 700 which concerns on one Embodiment. It is a figure for demonstrating the example of a user's operation with respect to the operation screen 700 which concerns on one Embodiment. It is a figure for demonstrating the example of a user's operation with respect to the operation screen 700 which concerns on one Embodiment. It is a figure for demonstrating the example of a user's operation with respect to the operation screen 700 which concerns on one Embodiment. It is a figure for demonstrating the example of a display of the operation screen 700 which concerns on one Embodiment. It is a figure for demonstrating the example of a display of the operation screen 700 which concerns on one Embodiment. It is a figure for demonstrating the example of a display of the operation screen 700 which concerns on one Embodiment. It is a figure for demonstrating the example of a display of the operation screen 700 which concerns on one Embodiment. It is a flowchart which shows the operation example of the information processing apparatus 100 which concerns on one Embodiment. It is explanatory drawing which showed the hardware structural example of the information processing apparatus 100 which concerns on one Embodiment.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

The description will be made in the following order.
1. 1. Overview of imaging display system 2. Configuration example of information processing apparatus Example of operation on operation screen 3-1. Example of operation screen 3-2. Example of operation for operation screen 3-3. Example of operation screen display 4. 4. Example of operation of information processing apparatus Hardware configuration Summary

<1. Overview of imaging display system>
An overview of an imaging display system 10 according to an embodiment of the present disclosure will be described with reference to FIG.

FIG. 1 is a diagram illustrating an example of a schematic configuration of an imaging display system 10 according to an embodiment. The imaging display system 10 displays an image captured by the imaging device on the display device. As illustrated in FIG. 1, the imaging display system 10 includes an imaging device 20, a display device 30, and an information processing device 100. The imaging device 20, the display device 30, and the information processing device 100 can communicate with each other wirelessly or by wire.

The imaging device 20 is a video camera or a digital camera that captures an image of a subject or landscape. The imaging device 20 transmits the captured image to the display device 30. The user can change various settings of the imaging device 20. For example, the color setting of an image captured by the imaging device 20 can be changed. In the present embodiment, the user can change the setting by remote operation using the information processing apparatus 100. Note that the user may change the setting with an operation unit provided in the imaging device 20.

The display device 30 is a television, for example, and displays the captured image received from the imaging device 20. For example, the display device 30 displays an image captured by the imaging device 20 in real time. Accordingly, the user can view the imaging result of the display device 30 while remotely operating the imaging device 20 with the information processing apparatus 100.

The information processing apparatus 100 is, for example, a tablet terminal, a smartphone, or a notebook PC, and is an apparatus that can remotely operate the imaging apparatus 20. The user can change various settings of the imaging apparatus 20 by performing a touch operation on the operation screen of the information processing apparatus 100. For example, the user can adjust the color of the captured image on the operation screen. The detailed configuration of the information processing apparatus 100 will be described later.

<2. Configuration example of information processing apparatus>
With reference to FIG. 2, an exemplary configuration of the information processing apparatus 100 will be described in an embodiment of the present disclosure.

FIG. 2 is a block diagram illustrating an example of a functional configuration of the information processing apparatus 100 according to an embodiment. The information processing apparatus 100 has a function of remotely operating the imaging apparatus 20. As illustrated in FIG. 2, the information processing apparatus 100 includes a display unit 110, an operation unit 120, a control unit 130, a storage unit 140, and a communication unit 150.

(Display unit 110)
The display unit 110 displays characters, images, and other information on the screen. Display of characters, images, and other information on the display unit 110 is controlled by the control unit 130. In the present embodiment, the display unit 110 displays an operation screen for changing the settings of the imaging device 20. As the display unit 110, for example, a liquid crystal display or an organic EL display is used.

(Operation unit 120)
The operation unit 120 receives an operation on the information processing apparatus 100 by the user. The operation unit 120 is, for example, a touch panel provided on the surface of the display unit 110 or integrated with the display unit 110. The user can change the setting of the imaging device 20 by performing a touch operation on the operation surface of the touch panel with a finger that is an example of an operation body. Hard keys and buttons may be used for the operation unit 120 in addition to the touch panel. Note that the touch operation means an operation in which an input is confirmed when the finger contacts the operation surface, or an input is confirmed when the finger comes out of contact with the operation surface (so-called tap).

In the above description, the user performs a touch operation on the operation unit 120 with a finger. However, the present invention is not limited to this. For example, the user may perform an operation with a pen or the like. In the above description, the operation unit 120 accepts an input operation when the operation body touches the touch panel. However, the operation unit 120 is not limited to this. For example, the operation unit 120 may accept an input operation when the operation body approaches the touch panel. good. Furthermore, the operation unit 120 is not limited to a touch panel, and may be a touch pad, for example.

(Control unit 130)
The control unit 130 is configured with an electronic circuit, for example, and controls the entire operation of the information processing apparatus 100. The control unit 130 further includes an operation detection unit 132, a post-detection processing unit 134 that is an example of a processing unit, and a display control unit 136.

(Operation detection unit 132)
The operation detection unit 132 touches or approaches an operation body (for example, a user's finger) with respect to an operation screen (in other words, an operation surface of the operation unit 120 integrated with the display unit 110) displayed on the display unit 110. Is detected. The operation detection unit 132 can identify and detect contact or proximity of a plurality of operation objects to the operation screen. For example, the operation detection unit 132 can detect that the second operating body is in contact with or close to another area of the operation screen while the first operating body is in contact with or close to an area of the operation screen.

(Post-detection processing unit 134)
The post-detection processing unit 134 has a function of performing a predetermined process on the detection result of the contact or proximity of the operating body by the operation detecting unit 132. The post-detection processing unit 134 according to the present embodiment changes a predetermined control parameter according to the movement of the operation body detected based on the operation result of the operation detection unit 132. Specifically, the post-detection processing unit 134 controls the control corresponding to a predetermined movement amount of the first operating body after the first state in which the first operating body is in contact with or close to the first operating surface is detected. More than the amount of change in a parameter (for example, a parameter related to the movement of the operation target displayed on the display unit), the first operation body is in contact with or close to the first operation surface and the operation on the second operation surface is performed. The amount of change in the control parameter corresponding to the predetermined amount of movement of the first operating body after the performed second state is detected is reduced. In such a case, even if the first operating body moves erroneously from the desired pointing position, the amount of movement of the operation target is handled small, so that deviation from the desired pointing position can be suppressed.

Here, the first state is a state in which the first operating body is in contact with or close to the predetermined first operation region of the operation screen, and the second state is a second operation region outside the first operation region of the operation screen. The second operating body is in contact with or in close proximity. Thereby, even if the 1st operation body and the 2nd operation body are operated together, the 1st state of the 1st operation body and the 2nd state of the 2nd operation body can be detected easily.

Further, the second operation area is an area around the first operation area, and is an area away from the first operation body when the first state is detected by a predetermined distance. Accordingly, the user can easily bring the second operating body into contact with or close to the second operating area during the operation of the first operating body in the first operating area. Note that the second operation area may vary depending on the position at which the first operating body contacts or approaches the operation screen. Thereby, it becomes easy to set a 2nd operation area | region to the position which makes a 2nd operation body contact or approach from the operation position of a 1st operation body easily.

The post-detection processing unit 134 fixes the position of the operation target with respect to the operation of the first operating body when the second state of the second operating body is detected. In such a case, even if the first operating body is erroneously moved from the desired pointing position, the operation target does not move, so that deviation from the desired pointing position can be suppressed.

The post-detection processing unit 134 may decrease the movement amount of the operation target corresponding to the predetermined operation amount of the first operating body while the detection of the second state of the second operating body is continued. In such a case, while the user intends, the movement amount of the first moving body can be handled small, so that the user's intention is easily reflected.

The post-detection processing unit 134 may decrease the movement amount of the operation target corresponding to the predetermined operation amount of the first operating body after the second state of the second operating body is detected once. In such a case, since the operation of the second operating body is simplified, the operability is improved.

(Display control unit 136)
The display control unit 136 controls display on the display unit 110. When the second state of the second operating body is detected, the display control unit 136 according to the present embodiment displays the processing of the post-detection processing unit 134 in association with the operation screen. Thereby, the user can recognize that the processing of the post-detection processing unit 134 is reflected by looking at the display content of the operation screen.

Here, the display control unit 136 may display the processing of the post-detection processing unit 134 in association with the operation screen while the first operating body moves from the first state. Thereby, the user can recognize that the process of the post-detection processing unit 134 is reflected even if the first operating body is erroneously moved from the first state.

The display control unit 136 may display character information indicating the position of the second operation area on the operation screen. Accordingly, the user can easily recognize the position of the second operation area by looking at the displayed character information.

Further, the display control unit 136 may display the second operation area in a different display form from the first operation area on the operation screen. For example, the display control unit 136 displays the second operation area so that it is emphasized more than the first operation area. This makes it easier for the user to identify the second operation area.

The display control unit 136 may display a predetermined button on the operation screen when the operation detection unit 132 detects the first state of the first operation body. The state in which the second operating body is in contact with or close to the predetermined button may be the second state described above. In such a case, the user can easily recognize a method that can easily shift to the second state.

(Storage unit 140)
The storage unit 140 stores a program executed by the control unit 130 and information necessary for processing by the control unit 130. For example, the storage unit 140 stores adjustment information of settings of the imaging device 20 adjusted by the user on the operation screen.

(Communication unit 150)
The communication unit 150 is an interface that performs communication with other devices (the imaging device 20 and the display device 30). Communication with other devices by the communication unit 150 is controlled by the control unit 130. For example, the communication unit 150 transmits the adjustment information of the setting of the imaging device 20 adjusted by the user on the operation screen to the imaging device 20.

In the above description, the operation detection unit 132, the post-detection processing unit 134, and the display control unit 136 are provided in the tablet terminal, the smartphone, and the notebook PC as the information processing apparatus 100. However, the present invention is not limited to this. . For example, the operation detection unit 132, the post-detection processing unit 134, and the display control unit 136 may be provided in a server that can communicate with the information processing apparatus 100 via a network. In such a case, the server receives information operated by the user using a tablet terminal or the like, and executes functions as the operation detection unit 132, the post-detection processing unit 134, and the display control unit 136.

In the above description, the touch operation in which the operating body contacts the touch panel has been described as an example, but the present invention is not limited to this. The present disclosure can be applied to an apparatus that detects a pointing operation on various operation surfaces. For example, the present invention can also be applied to a device that detects that the operating tool is close to the operating surface, or a method that detects the gesture of the operating tool or the operator using an imaging device such as a camera.

<3. Example of operation on the operation screen>
Hereinafter, an operation screen displayed on the display unit 110 for adjusting the setting of the imaging device 20 and an operation example on the operation screen will be described.

(3-1. Example of operation screen)
An example of the operation screen displayed on the display unit 110 according to the embodiment will be described with reference to FIG. Here, the color of the image will be described as an example of the setting of the imaging device 20 to be adjusted, but is not limited thereto, and various settings related to the imaging device 20 can be adjusted on the operation screen.

FIG. 3 is a diagram illustrating an example of the operation screen 700 displayed on the display unit 110 according to the embodiment. An operation screen 700 illustrated in FIG. 3 is a screen for adjusting the color of an image captured by the imaging device 20. The operation screen 700 includes three

operation areas

710, 720, and 730 for adjusting color. The three

operation areas

710, 720, and 730 have different degrees of brightness that can be adjusted. The user can adjust the color of the imaging device 20 by performing a touch operation in the

operation areas

710, 720, and 730. In FIG. 3, three operation areas 710 to 730 are shown, but the present invention is not limited to this. For example, the number of operation areas may be two or less, or four or more.

Since the configuration of the three operation areas 710 to 730 is the same, here, the operation area 730 will be described as an example. The operation area 730 includes an adjustment area 731, an adjustment bar 732, and a reset button 733.

The adjustment area 731 is, for example, a circular area. A movable pointer 731a (an example of an operation target) is displayed in the adjustment area 731 and the color is adjusted according to the position of the pointer 731a. The user performs a touch operation so as to move the position of the pointer 731 a in the adjustment area 731.

The position of the bar of the adjustment bar 732 varies depending on the degree of user adjustment in the adjustment area 731. Note that the user can change the position of the bar by performing a touch operation on the adjustment bar 732.

The reset button 733 has a function of returning the color adjustment to a preset initial value when the user performs a touch operation.

(3-2. Examples of operations on the operation screen)
Examples of user operations on the operation screen 700 according to an embodiment will be described with reference to FIGS. 4 to 7. Here, an operation in the operation area 730 of the operation screen 700 will be described as an example. In the present embodiment, the operation screen 700 corresponds to the first operation surface and the second operation surface.

4 to 7 are diagrams for explaining an example of a user operation on the operation screen 700 according to an embodiment. First, as shown in FIG. 4, the user places one of the fingers as the first operation body on the pointer 731a of the adjustment area 731 of the operation area 730 (here, the first operation body is described as an index finger F1). Contact. The user can move the position of the pointer 731a by moving the index finger F1 in contact with the pointer 731a. Note that when the finger contacts the pointer 731a, an image of a circular area may be displayed around the pointer 731a. Here, as shown in FIG. 4, the circular area may be subjected to gradation so that the color becomes darker toward the pointer 731 a located at the center. This makes it easier for the user to guess the position of the pointer 731a hidden behind the finger. In the above description, an image of a circular area is displayed. However, the present invention is not limited to this. For example, a rectangular area may be displayed.

In the present embodiment, the user brings another finger, which is the second operation body, into contact with an area outside the adjustment area 731 in the operation area 730 before releasing the index finger F1 from the operation screen 700. For example, in a state where the index finger F1 that contacts the pointer 731a is stopped at a predetermined position (hereinafter referred to as a first position), the user moves the thumb F2 outside the adjustment area 731 in the operation area 730 as shown in FIG. Touch the area. As a result, the pointer 731a is fixed at the first position. In this embodiment, the adjustment area 731 corresponds to the first operation area, and the area other than the adjustment area 731 in the operation area 730 corresponds to the second operation area.

When the thumb F2 contacts an area outside the adjustment area 731 in the operation area 730, the operation screen 700 shows information indicating that the position of the pointer 731a is fixed. For example, as shown in FIG. 5, a balloon 740 is displayed in association with the pointer 731a. Thereby, the user can easily recognize that the position of the pointer 731a is fixed.

The fixing of the pointer 731a at the first position is continued while the thumb F2 is in contact with the area outside the adjustment area 731. For this reason, even if the index finger F1 moves from the first position while the thumb F2 is in contact with the area outside the adjustment area 731, the pointer 731 a does not move because it is fixed as shown in FIG. 6. On the other hand, when the user releases the thumb F2 from the operation screen 700, the position of the pointer 731a is fixed. When the pointer 731a is fixed, the display of the image of the circular area around the pointer 731a described in FIG. 4 may be changed. For example, the degree of gradation may be changed, the area may be reduced, or the circle may be changed to another shape (for example, a rectangle), or these may be combined. This makes it easier for the user to recognize that the pointer 731a is fixed.

In order to confirm the color adjustment on the operation screen 700, it is necessary to release the index finger F1 that has been in contact with the pointer 731a. In the present embodiment, the index finger F1 is released in a state where the thumb F2 is in contact with the area outside the adjustment area 731 as shown in FIG. As a result, the color is adjusted to correspond to the pointer 731a fixed at the first position.

In the above description, the position of the pointer 731a is fixed while the thumb F2 as the second operating body is in contact with the area outside the adjustment area 731. However, the present invention is not limited to this. For example, the position of the pointer 731a may be fixed if the thumb F2, which is the second operating body, is brought into contact with an area outside the adjustment area 731 once. In such a case, when the thumb F2 comes into contact with the area outside the adjustment area 731 once again, the position of the pointer 731a is released. In such a case, operability is improved because only one touch is required. Further, the position of the pointer 731a may be fixed by bringing the thumb F2 as the second operating body into contact with the area outside the adjustment area 731 a plurality of times (for example, twice). This makes it easy to distinguish from other touch operations. Further, the position of the pointer 731a may be fixed when a gesture operation such as a flick operation or a drag operation is performed with the thumb F2.

In the above description, the second operating body is one finger (thumb F2). However, the present invention is not limited to this. For example, the second operating body may be a plurality of fingers. Then, the position of the pointer 731a may be fixed by bringing a plurality of fingers into contact with the area outside the adjustment area 731 once.

In the above description, when the second operating body is brought into contact with an area outside the adjustment area 731, the position of the pointer 731 a is fixed. However, the present invention is not limited to this. For example, when the second operating body is brought into contact with an area outside the adjustment area 731, the moving speed may be decreased when the first operating body subsequently moves. In such a case, the moving speed of the pointer 731a is also slowed down. As a result, even if the first operating body is moved by mistake, the amount of movement of the pointer 731a can be reduced, so that the displacement of the indicated position of the pointer 731a can be suppressed. Further, it becomes easy to finely adjust the indicated position of the pointer 731a. When the moving speed of the first operating body is slowed down, the position of the pointer 731a may be fixed by making another operating body contact the area outside the adjustment area 731 again.

In the above description, the second operating body is brought into contact with an area outside the adjustment area 731. However, the position of the pointer 731a is fixed, but the present invention is not limited to this. For example, the position of the pointer 731a may be fixed when the second operating body is brought into contact with a position separated from the first operating body by a predetermined distance in the adjustment region 731. In such a case, the contact position of the second operating body that fixes the position of the pointer 731a varies depending on the position of the first operating body.

In the above description, an example in which one adjustment area 731 of the operation screen 700 is operated with the first operating body has been described. However, the present invention is not limited to this. For example, the two

adjustment areas

721 and 731 on the operation screen 700 may be operated simultaneously with two fingers (first operating body). Specifically, the user may bring the index finger of the left hand into contact with the pointer 721a in the adjustment area 721, and the index finger of the right hand may be brought into contact with the pointer 731a in the adjustment area 731.

In such a case, when the left hand or the right thumb (second operating body) is brought into contact with an area other than the adjustment area 721 and the adjustment area 731, the positions of the pointer 721 a and the pointer 731 a are fixed. Alternatively, when the left hand or the right thumb (second operating body) is brought into contact with an area other than the adjustment area 721 and the adjustment area 731, only the pointer in the adjustment area closer to the thumb may be fixed.

In the above description, the display screen 700 that adjusts the settings of the imaging device 20 is described as an example of the operation screen that the operating body touches or approaches. However, the present invention is not limited to this and can be applied to various operation screens. For example, the present invention can be applied to the operation of the operating body on the map screen.

(3-3. Display example of operation screen)
In the present embodiment, the display of the operation screen 700 is controlled so that the user can easily fix the pointer 731a. A display example of the operation screen 700 according to an embodiment will be described with reference to FIGS. Here, an operation in the operation area 720 of the operation screen 700 will be described as an example.

FIG. 8 is a diagram for explaining a display example of the operation screen 700 according to an embodiment. In the display example shown in FIG. 8, a fixing area 750 (second operation area) for contacting the second operating body (thumb F2) in order to fix the position of the pointer 721a touched by the first operating body (index finger F1), Is highlighted. In other words, the area other than the adjustment area 721 and the fixed area 750 on the operation screen 700 is darkly displayed so as not to be noticeable. The fixed area 750 is not displayed before the index finger F1 comes into contact with the adjustment area 721.

The fixed area 750 is formed around the circular adjustment area 721 as shown in FIG. 8 and is a circular area larger than the adjustment area 721. When the user brings the thumb F2 into contact with the fixed area 750 while the index finger F1 is in contact with the pointer 721a, the position of the pointer 721a is fixed. By highlighting the fixed area 750 in this way, the user can easily recognize the area for fixing the pointer 721a. As a result, user operability is improved.

FIG. 9 is a diagram for explaining a display example of the operation screen 700 according to an embodiment. In the display example shown in FIG. 9, a fixing button 752 for bringing the second operating body (thumb F2) into contact is displayed in order to fix the position of the pointer 721a touched by the first operating body (forefinger F1). At this time, areas other than the adjustment area 721 and the fixed button 752 are darkly displayed so as not to stand out. Note that the fixed button 752 is not displayed before the index finger F1 contacts the adjustment area 721. However, the present invention is not limited to this, and the fixed button 752 may always be displayed on the operation screen 700 before the index finger F1 contacts the adjustment area 721.

The fixed button 752 is arranged around the adjustment area 721 (specifically, below the adjustment area 721) as shown in FIG. The fixed button 752 is disposed at a position where the user can easily touch the second operating body. When the user brings the thumb F2 into contact with the fixed button 752 while the index finger F1 is in contact with the pointer 721a, the position of the pointer 721a is fixed. By displaying the fixing button 752 in this way, the user can easily recognize the area for fixing the pointer 721a.

FIG. 10 is a diagram for explaining a display example of the operation screen 700 according to an embodiment. In the display example shown in FIG. 10, character information 754 indicating a region in which the second operating body (thumb F2) is brought into contact with the first operating body (forefinger F1) in order to fix the position of the pointer 721a is displayed. . At this time, the areas other than the adjustment area 721 and the character information 754 are darkly displayed so as not to stand out. Note that the character information 754 is not displayed before the index finger F1 contacts the adjustment area 721.

The character information 754 is displayed above the operation screen 700 as shown in FIG. The character information 754 includes information indicating that the pointer 721a is fixed. When the user who has seen the character information 754 touches the thumb F2 with an area outside the adjustment area 721 on the operation screen 700 while the index finger F1 is in contact with the pointer 721a, the position of the pointer 721a is fixed. By displaying the character information 754 in this way, the user can easily recognize a method for fixing the pointer 721a.

FIG. 11 is a diagram for explaining a display example of the operation screen 700 according to an embodiment. In the display example shown in FIG. 11, in order to fix the position of the pointer 721a touched by the first operating body (forefinger F1), the fixing area where the second operating body (thumb F2) is contacted is displayed in different colors. .

The fixed areas are all areas other than the adjustment area 721 on the operation screen 700 as shown in FIG. In the fixed area, character information indicating that the pointer 721a is fixed when touched is also displayed. When the user brings the thumb F2 into contact with an area outside the adjustment area 721 while the index finger F1 is in contact with the pointer 721a, the position of the pointer 721a is fixed. By highlighting the fixed area in this way, the user can easily recognize the area for fixing the pointer 721a.

In the above description, information on which the pointer 721a is fixed is displayed on the operation screen 700 of the information processing apparatus 100. However, the present invention is not limited to this. For example, when the pointer 721a is fixed, the information processing apparatus 100 transmits information related to the fixing of the pointer 721a to the display device 30 to display information indicating that the pointer 721a is fixed on the display device 30. Also good. Since the user adjusts while viewing the display device 30, if information on which the pointer 721 a is fixed is displayed on the display device 30, the user can easily recognize that the pointer 721 a is fixed.

In the above description, the first operating body and the second operating body are operated on the operation screen 700 of one display unit 110. However, the present invention is not limited to this. For example, the present invention can be applied to an apparatus having two display units each provided with an operation screen. The two display units may be provided in separate housings so as to be foldable via, for example, a hinge unit. Further, the two display units may be separately provided in the housing so as to be capable of wireless communication. Then, for example,

adjustment areas

711, 721, and 731 shown in FIG. 4 are displayed on one operation screen (corresponding to the first operation surface) of the two display units, and the other operation screen (corresponding to the second operation surface). In FIG. 4, adjustment bars 712, 722, and 732 shown in FIG. 4 are displayed.

In the above description, when the second operating body touches the operation screen 700, the pointer 731a operated by the first operating body is fixed. However, the present invention is not limited to this. For example, when an operation is performed on the operation screen 700 with a hard key provided on the operation unit 120, the pointer 731a may be fixed.

<4. Example of operation of information processing apparatus>
An operation example of the information processing apparatus 100 according to an embodiment of the present disclosure will be described with reference to FIG.

FIG. 12 is a flowchart illustrating an operation example of the information processing apparatus 100 according to an embodiment. The processing shown in FIG. 12 is realized by the CPU of the information processing apparatus 100 executing a program stored in the ROM. The program to be executed may be stored in a recording medium such as a CD (Compact Disk), a DVD (Digital Versatile Disk), or a memory card, or may be downloaded from a server or the like via the Internet.

12 is started when the display control unit 136 displays the operation screen 700 as shown in FIG. 3 on the display unit 110 (step S102). The displayed operation screen 700 is a screen for adjusting the color of an image captured by the imaging device 20.

Next, when the user performs an operation on the operation screen 700 with the first operation body (here, the index finger F1), the operation detection unit 132 detects contact or proximity of the index finger F1 to the operation screen 700. (Step S104). For example, the operation detection unit 132 detects that the index finger F1 has touched the pointer 721a of the adjustment area 721.

Next, the operation detection unit 132 determines whether or not the user is in contact with or close to the operation screen 700 with the second operation body (here, the thumb F2) (step S106). When the user fixes the pointer 721a, for example, the thumb F2 is brought into contact with the outside of the adjustment area 721 on the operation screen 700.

If it is determined in step S106 that the thumb F2 is in contact with or close to the operation screen 700 (Yes), the post-detection processing unit 134 fixes the position of the pointer 721a (step S108). For this reason, even if the index finger F1 subsequently moves, the pointer 721a does not move. At this time, the display control unit 136 displays information indicating that the position of the pointer 721a is fixed on the display screen 700 (step S110). Thereby, the user can easily recognize that the pointer 721a is fixed.

Next, the operation detection unit 132 determines whether or not the index finger F1 has left the operation screen 700 (step S112). When adjusting to the color corresponding to the fixed position of the pointer 721a, the user releases the index finger F1.

If it is determined in step S112 that the index finger F1 has left the operation screen 700 (Yes), the post-detection processing unit 134 determines a value corresponding to the fixed position of the pointer 721a as the color adjustment value. (Step S114). Thereafter, the communication unit 150 transmits the determined color adjustment value to the imaging device 20. As a result, the imaging device 20 adjusts the color tone based on the received adjustment value, and transmits the adjusted image to the display device 30.

On the other hand, if it is determined in step S106 that the thumb F2 is not in contact with or close to the operation screen 700 (No), the post-detection processing unit 134 moves the thumb F2 without fixing the pointer 721a. Accordingly, the position of the pointer 721a is also moved (step S116). Next, the operation detection unit 132 determines whether or not the index finger F1 has left the operation screen 700 (step S118).

If it is determined in step S118 that the index finger F1 has moved away from the operation screen 700 (Yes), the post-detection processing unit 134 corresponds to the position where the index finger F1 of the pointer 721a has moved away as the color adjustment value. The value is tested (step S120). Thereafter, the communication unit 150 transmits the determined color adjustment value to the imaging device 20. As a result, the imaging device 20 adjusts the color tone based on the received adjustment value, and transmits the adjusted image to the display device 30.

<5. Hardware configuration>
The operation performed by the information processing apparatus 100 described above is realized by the cooperation of the hardware configuration of the information processing apparatus 100 and software. Therefore, hereinafter, a hardware configuration of the information processing apparatus 100 will be described.

FIG. 13 is an explanatory diagram showing a hardware configuration example of the information processing apparatus 100 according to an embodiment. As shown in FIG. 13, the information processing apparatus 100 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, an input device 208, an output device 210, A storage device 211, a drive 212, and a communication device 215 are provided.

The CPU 201 functions as an arithmetic processing unit and a control unit, and controls the overall operation in the information processing apparatus 100 according to various programs. Further, the CPU 201 may be a microprocessor. The ROM 202 stores programs used by the CPU 201, calculation parameters, and the like. The RAM 203 temporarily stores programs used in the execution of the CPU 201, parameters that change as appropriate during the execution, and the like. These are connected to each other by a host bus including a CPU bus.

The input device 208 generates an input signal based on an input by the user, such as a mouse, a keyboard, a touch panel, a touch pad, a button, a microphone, a switch, and a lever, and an input by the user, and outputs the input signal to the CPU 201. It consists of an input control circuit. A user of the information processing apparatus 100 can input various data and instruct a processing operation to the information processing apparatus 100 by operating the input device 208.

The output device 210 includes a display device such as a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, and a lamp. Furthermore, the output device 210 includes an audio output device such as a speaker and headphones. For example, the display device displays a captured image or a generated image. On the other hand, the audio output device converts audio data or the like into audio and outputs it.

The storage apparatus 211 is a data storage apparatus configured as an example of a storage unit of the information processing apparatus 100 according to the present embodiment. The storage device 211 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device 211 stores programs executed by the CPU 201 and various data.

The drive 212 is a storage medium reader / writer, and is built in or externally attached to the information processing apparatus 100. The drive 212 reads information recorded on a removable storage medium 220 such as a mounted magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs the information to the RAM 203. The drive 212 can also write information into the removable storage medium 220.

The communication device 215 is a communication interface configured with, for example, a communication device for connecting to the network 230. The communication device 215 may be a wireless LAN (Local Area Network) compatible communication device, an LTE (Long Term Evolution) compatible communication device, or a wire communication device that performs wired communication.

The network 230 is a wired or wireless transmission path for information transmitted from a device connected to the network 230. For example, the network 230 may include a public line network such as the Internet, a telephone line network, and a satellite communication network, various LANs (Local Area Network) including Ethernet (registered trademark), WAN (Wide Area Network), and the like. The network 230 may also include a dedicated line network such as an IP-VPN (Internet Protocol-Virtual Private Network).

<6. Summary>
As described above, the information processing apparatus 100 according to an embodiment of the present disclosure is configured so that the first operation body after the first state in which the first operation body is in contact with or close to the first operation surface is detected. The first operating body touches or approaches the first operation surface rather than the change amount of the control parameter (specifically, the parameter related to the movement of the operation target displayed on the display unit) corresponding to the movement amount. In addition, the amount of change in the control parameter corresponding to the predetermined amount of movement of the first operating body after the detection of the second state in which the operation on the second operation surface is performed is reduced. In such a case, the movement amount of the operation target (pointer) with respect to the operation of the first operating body after the second state is detected (for example, the operation of moving the first operating body away from the operation screen) becomes small. For this reason, it can suppress that the pointing position after separating the 1st operation body from the operation screen shifts from the desired pointing position when the 1st operation body is located in the 1st state.

In particular, when the second state is detected, the information processing apparatus 100 fixes the position of the operation target (the position of the pointer) with respect to the operation of the first operating body. Thereby, it is possible to prevent the pointing position after the first operating body is separated from the operation screen from deviating from a desired pointing position when the first operating body is positioned in the first state.

The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

In addition, the effects described in this specification are merely illustrative or illustrative, and are not limited. That is, the technology according to the present disclosure can exhibit other effects that are apparent to those skilled in the art from the description of the present specification in addition to or instead of the above effects.

The following configurations also belong to the technical scope of the present disclosure.
(1)
A processing unit that acquires a signal from a detection unit that detects contact or proximity of the operation body to the operation surface and changes a predetermined control parameter according to the movement of the operation body detected based on the signal,
The processing unit is more than a change amount of the control parameter corresponding to a predetermined movement amount of the first operating body after the first state in which the first operating body is in contact with or close to the first operating surface is detected. Corresponding to the predetermined amount of movement of the first operating body after the second state in which the first operating body is in contact with or close to the first operating surface and an operation on the second operating surface is detected is detected. An information processing apparatus that reduces a change amount of the control parameter.
(2)
The second state is a state in which at least one second operation body is in contact with or close to the second operation surface.
The information processing apparatus according to (1).
(3)
The control parameter is a parameter related to the movement of the operation target displayed on the display unit.
The information processing apparatus according to (1) or (2).
(4)
When the second state is detected, the processing unit fixes the position of the operation target with respect to the operation of the first operating body.
The information processing apparatus according to (3).
(5)
When the second state is detected, the display control unit further includes a display control unit that displays the processing content of the processing unit in association with the first operation surface.
The information processing apparatus according to any one of (1) to (4).
(6)
The display control unit displays the processing content of the processing unit in association with the first operation surface while the first operating body moves from the first state.
The information processing apparatus according to (5).
(7)
The second operation surface is the same operation surface as the first operation surface.
The information processing apparatus according to (2).
(8)
The first state is a state in which the first operating body is in contact with or in proximity to a predetermined first operating area of the first operating surface.
The second state is a state in which the second operating body is in contact with or close to a second operation region outside the first operation region.
The information processing apparatus according to (7).
(9)
The second operation area is an area around the first operation area.
The information processing apparatus according to (8).
(10)
A display control unit for displaying character information indicating a position of the second operation area on the first operation surface;
The information processing apparatus according to (8) or (9).
(11)
A display control unit for displaying the second operation area on the first operation surface in a display form different from that of the first operation area;
The information processing apparatus according to any one of (8) to (10).
(12)
The second operation area is an area separated from the first operation body by a predetermined distance when the first state is detected.
The information processing apparatus according to any one of (8) to (11).
(13)
The second operation area varies according to a position where the first operation body contacts or approaches the first operation surface.
The information processing apparatus according to (12).
(14)
The second state is a state in which the second operating body is in contact with or close to a predetermined button on the second operation surface.
The information processing apparatus according to (2).
(15)
A display control unit for displaying the predetermined button on the first operation surface when the detection unit detects the first state;
The information processing apparatus according to (14).
(16)
The processing unit reduces a change amount of the control parameter corresponding to the predetermined movement amount of the first operating body while the detection of the second state is continued.
The information processing apparatus according to any one of (1) to (15).
(17)
When the second state is detected once, the processing unit reduces a change amount of the control parameter corresponding to the predetermined movement amount of the first operating body.
The information processing apparatus according to any one of (1) to (16).
(18)
The second operation surface is an operation surface different from the first operation surface.
The information processing apparatus according to (1).
(19)
Obtaining a signal from a detection unit that detects contact or proximity of the operation body to the operation surface;
A predetermined control parameter is changed according to the movement of the operating body detected based on the acquired signal by the processor, and a first state in which the first operating body is in contact with or close to the first operating surface is detected. The first operating body is in contact with or close to the first operating surface and the operation on the second operating surface is larger than the change amount of the control parameter corresponding to the predetermined movement amount of the first operating body after Reducing the amount of change in the control parameter corresponding to the predetermined movement amount of the first operating body after the second state in which the operation is performed is detected;
Including an information processing method.
(20)
On the computer,
Obtaining a signal from a detection unit that detects contact or proximity of the operation body to the operation surface;
After changing a predetermined control parameter according to the movement of the operating body detected based on the acquired signal, after the first state in which the first operating body is in contact with or close to the first operating surface is detected More than the amount of change in the control parameter corresponding to the predetermined movement amount of the first operating body, the first operating body is in contact with or close to the first operating surface and the operation on the second operating surface is performed. Reducing a change amount of the control parameter corresponding to the predetermined movement amount of the first operating body after the second state is detected;
A program for running

DESCRIPTION OF SYMBOLS 10 Imaging display system 20 Imaging apparatus 30 Display apparatus 100 Information processing apparatus 110 Display part 120 Operation part 130 Control part 132 Operation detection part 134 Post-detection process part 136 Display control part 700 Operation screen 710,720,730 Operation area 711,721, 731

Adjustment area

711a, 721a, 731a Pointer

Claims

A processing unit that acquires a signal from a detection unit that detects contact or proximity of the operation body to the operation surface and changes a predetermined control parameter according to the movement of the operation body detected based on the signal,
The processing unit is more than a change amount of the control parameter corresponding to a predetermined movement amount of the first operating body after the first state in which the first operating body is in contact with or close to the first operating surface is detected. Corresponding to the predetermined amount of movement of the first operating body after the second state in which the first operating body is in contact with or close to the first operating surface and an operation on the second operating surface is detected is detected. An information processing apparatus that reduces a change amount of the control parameter.
The second state is a state in which at least one second operation body is in contact with or close to the second operation surface.
The information processing apparatus according to claim 1.
The control parameter is a parameter related to the movement of the operation target displayed on the display unit.
The information processing apparatus according to claim 1.
When the second state is detected, the processing unit fixes the position of the operation target with respect to the operation of the first operating body.
The information processing apparatus according to claim 3.
When the second state is detected, the display control unit further includes a display control unit that displays the processing content of the processing unit in association with the first operation surface.
The information processing apparatus according to claim 1.
The display control unit displays the processing content of the processing unit in association with the first operation surface while the first operating body moves from the first state.
The information processing apparatus according to claim 5.
The second operation surface is the same operation surface as the first operation surface.
The information processing apparatus according to claim 2.
The first state is a state in which the first operating body is in contact with or in proximity to a predetermined first operating area of the first operating surface.
The second state is a state in which the second operating body is in contact with or close to a second operation region outside the first operation region.
The information processing apparatus according to claim 7.
The second operation area is an area around the first operation area.
The information processing apparatus according to claim 8.
A display control unit for displaying character information indicating a position of the second operation area on the first operation surface;
The information processing apparatus according to claim 8.
A display control unit for displaying the second operation area on the first operation surface in a display form different from that of the first operation area;
The information processing apparatus according to claim 8.
The second operation area is an area separated from the first operation body by a predetermined distance when the first state is detected.
The information processing apparatus according to claim 8.
The second operation area varies according to a position where the first operation body contacts or approaches the first operation surface.
The information processing apparatus according to claim 12.
The second state is a state in which the second operating body is in contact with or close to a predetermined button on the second operation surface.
The information processing apparatus according to claim 2.
A display control unit for displaying the predetermined button on the first operation surface when the detection unit detects the first state;
The information processing apparatus according to claim 14.
The processing unit reduces a change amount of the control parameter corresponding to the predetermined movement amount of the first operating body while the detection of the second state is continued.
The information processing apparatus according to claim 1.
When the second state is detected once, the processing unit reduces a change amount of the control parameter corresponding to the predetermined movement amount of the first operating body.
The information processing apparatus according to claim 1.
The second operation surface is an operation surface different from the first operation surface.
The information processing apparatus according to claim 1.
Obtaining a signal from a detection unit that detects contact or proximity of the operation body to the operation surface;
A predetermined control parameter is changed according to the movement of the operating body detected based on the acquired signal by the processor, and a first state in which the first operating body is in contact with or close to the first operating surface is detected. The first operating body is in contact with or close to the first operating surface and the operation on the second operating surface is larger than the change amount of the control parameter corresponding to the predetermined movement amount of the first operating body after Reducing the amount of change in the control parameter corresponding to the predetermined movement amount of the first operating body after the second state in which the operation is performed is detected;
Including an information processing method.
On the computer,
Obtaining a signal from a detection unit that detects contact or proximity of the operation body to the operation surface;
After changing a predetermined control parameter according to the movement of the operating body detected based on the acquired signal, after the first state in which the first operating body is in contact with or close to the first operating surface is detected More than the amount of change in the control parameter corresponding to the predetermined movement amount of the first operating body, the first operating body is in contact with or close to the first operating surface and the operation on the second operating surface is performed. Reducing a change amount of the control parameter corresponding to the predetermined movement amount of the first operating body after the second state is detected;
A program for running