JP2014157402A - Display device, electronic apparatus, display method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device, an electronic apparatus, a display method, and a program which can enhance operability for moving a display area of a content without an input device for moving the display area of the content.SOLUTION: A display unit 12 displays an electronic content such as an electronic document or an electronic map on a screen. An input unit 14 detects a positional relation between an operation body and the display unit 12. The operation body is an object different from a display device 1. A control unit 20 moves a display area displaying a content, according to an inclination of the operation body against the screen that is calculated on the basis of the positional relation detected by the input unit 14.

Description

  The present invention relates to a display device, an electronic device, a display method, and a program, and more particularly, to a display device, an electronic device, a display method, and a program that display content.

  An example of a display device that displays content such as an electronic document or an electronic map is a touch screen device. The touch screen device is a device formed by integrating a display device such as a liquid crystal display or an LED (Light Emitting Diode) display and an input device such as a touch panel or a touch pad. The touch screen device detects a position touched by the user's finger with a sensor of the input device, specifies which display element of the display elements displayed by the display device is designated, and performs a corresponding operation. Therefore, the user can operate the device by directly touching the screen. Unlike the input using the keyboard and mouse, the buttons and the keyboard displayed on the screen can be directly touched to input, so that there is an advantage that the user can easily operate intuitively.

  When the content displayed by the display device is larger than the screen of the display device, in order to display a part of the content outside the screen, it is necessary to perform a scroll operation for moving the display region that is the region where the content is displayed. is there. For example, a PC (Personal Computer) can be scrolled using an input device such as a mouse or a numeric keypad. In the case of a game machine, a scroll operation can be performed using an input device such as a joystick or operation keys. For example, when the user tilts the joystick in a certain direction, the display area continuously moves in the tilted direction while the joystick is tilted. Thus, the display area can be easily moved by using an input device such as a joystick.

  On the other hand, the touch screen device as described above is generally not provided with such an input device. Examples of the scroll operation in the touch screen device include a drag (swipe) operation, a flick operation, and a scroll bar operation. The drag (swipe) operation is an operation of sliding while keeping a finger in contact with the screen. When the drag operation is performed, the content moves in accordance with the slide of the finger. The flick operation is an operation in which a finger is brought into contact with the screen and slid and released immediately. When the flick operation is performed, the content moves in the sliding direction so as to be played along with the slide of the finger. In the drag operation and the flick operation, the display area is moved by moving the content in the direction in which the finger is slid. For example, if the user wants to display the lower part of the content that is not displayed on the screen, the user can scroll the content upward by sliding his / her finger in the direction opposite to the desired direction (in this case, upward). Manipulate. As a result, the display area moves downward, so that the lower part of the content can be displayed.

  The scroll bar operation is an operation of dragging the knob of the scroll bar displayed at the end (right end or lower end) of the screen. In the scroll bar operation, the display area moves in the direction in which the knob is dragged. For example, when it is desired to display the lower part of the content that is not displayed on the screen, the user operates to slide the knob in the desired direction (downward in this case). As a result, the display area moves downward, so that the lower part of the content can be displayed. At this time, the content scrolls up.

  In the drag operation or flick operation, the amount that the display area can be moved by one operation is limited. Therefore, when the display area is moved when browsing a content that is considerably larger than the size of the screen, it is necessary to perform a drag operation or a flick operation many times in order to display the entire content. Further, in the scroll bar operation, since the size of the knob is small, it is difficult to perform a fine operation. Further, in the scroll bar operation, it is difficult to use the scroll bars provided in the vertical direction and the horizontal direction at the same time for scrolling obliquely.

  In the case of scroll bar operation, the scroll bar occupies a part of the screen. Therefore, the area where the content is actually displayed is reduced, and the viewability of the content during the movement of the display area is deteriorated. In the case of a drag operation and a flick operation, the finger is brought into contact with the screen while the display area is moving. Therefore, since the content is covered with a finger, the viewability of the content during the movement of the display area is deteriorated.

  In relation to the above technology, for example, Patent Document 1 discloses a mobile phone terminal having a display unit and a tilt detection sensor, and the tilt angle of the main body of the mobile phone terminal measured by the tilt detection sensor. A mobile phone comprising: a counter that counts the number of tilts that exceeds a certain value; and a control unit that scrolls a display screen of the display unit based on the number of tilts counted by the counter. A terminal display screen control device is disclosed.

  In Patent Document 2, the scroll direction is set to the contact center and the screen center as the start point and the end point, respectively, and the scroll speed is changed according to the contact area, and the scroll speed is changed only by the operation of bringing the finger into contact with the touch panel. An apparatus that can be disclosed is disclosed.

JP 2001-136259 A JP 2006-268073 A

  With the technique of Patent Document 1, since the terminal body is tilted when scrolling, it is difficult to perform a scroll operation while viewing the screen. Therefore, there is little possibility that the viewability of the content during the movement of the display area is improved. Further, in Patent Document 1, scrolling is stopped by tilting the terminal in the reverse direction, but an operation with quick response becomes difficult. Further, in the technique of Patent Document 2, since the finger is touched in the scroll direction, the content is covered with the finger, and there is little possibility that the viewability is improved. In other words, with the techniques of Patent Document 1 and Patent Document 2, it is difficult to move the display area of the content without deteriorating operability and viewability.

  An object of the present invention is to solve such a problem, and improves the operability when moving the content display area without an input device for moving the content display area. Another object of the present invention is to provide a display device, an electronic device, a display method, and a program that can be executed.

  A display device according to the present invention is detected by a display unit that displays content on a screen, an input unit that detects a positional relationship between an operating body that is a separate object from the display device and the screen, and the input unit. Control means for moving a display area in which the content is displayed based on an inclination of the operating tool with respect to the screen calculated based on the positional relationship.

  An electronic device according to the present invention is detected by a display unit that displays content on a screen, an input unit that detects a positional relationship between an operation body that is a separate object from the electronic device and the screen, and the input unit. Control means for moving a display area in which the content is displayed based on an inclination of the operating tool with respect to the screen calculated based on the positional relationship.

  The display method according to the present invention is a display method in a display device that displays content on a screen, and includes a first step of detecting a positional relationship between an operation tool that is an object separate from the display device and the screen. Based on the positional relationship detected in the first step, the second step of calculating the tilt of the operating body with respect to the screen, and on the basis of the tilt calculated in the second step, the content is And a third step of moving the display area to be displayed.

  A program according to the present invention is a program executed by a display device that displays content on a screen, and obtains a positional relationship between an operation tool that is an object separate from the display device and the screen. A second step of calculating an inclination of the operating tool with respect to the screen based on the positional relationship acquired in the first step, and the content based on the inclination calculated in the second step. And causing the computer of the display device to execute a third step of moving the display area in which is displayed.

  According to the present invention, a display device, an electronic device, a display method, and a program capable of improving the operability when moving the content display area without an input device for moving the content display area. Can provide.

It is a figure which shows the outline | summary of the display apparatus concerning embodiment of this invention. 1 is a diagram showing a display device according to a first exemplary embodiment; 1 is a diagram illustrating a cross section of a display device according to a first exemplary embodiment; It is a figure which shows each component implement | achieved by the control part shown in FIG. It is a flowchart which shows the process performed by the control part shown in FIG. FIGS. 3A and 3B are diagrams for explaining processing performed by the control unit illustrated in FIG. 2, in which FIG. 2A is a diagram illustrating a state in which an operating body is in contact with an input unit, and FIG. It is the figure which looked at the contact area | region and approach area | region in the state of A) from the upper side, (C) is a figure which shows an initial stage inclination vector. FIGS. 3A and 3B are diagrams for explaining processing performed by the control unit illustrated in FIG. 2, and FIG. 3A is a diagram illustrating a state in which the tilt of the operating body has changed, and FIG. ) Is a view of the contact area and the approach area in the state of () from the upper side, (C) is a view showing the changed gradient vector, and (D) is a view showing the difference vector. FIGS. 3A and 3B are diagrams for explaining processing performed by the control unit illustrated in FIG. 2, and FIG. 3A is a diagram illustrating a state in which the tilt of the operating body has changed, and FIG. ) Is a view of the contact area and the approach area in the state of () from the upper side, (C) is a view showing the changed gradient vector, and (D) is a view showing the difference vector. FIGS. 3A and 3B are diagrams for explaining processing performed by the control unit illustrated in FIG. 2, in which FIG. 2A is a diagram illustrating a state in which an operating body is in contact with an input unit, and FIG. It is the figure which looked at the contact area | region and approach area | region in the state of A) from the upper side, (C) is a figure which shows an initial stage inclination vector. FIGS. 3A and 3B are diagrams for explaining processing performed by the control unit illustrated in FIG. 2, in which FIG. 2A is a diagram illustrating a state in which the tilt of the operation body has changed, and FIG. ) Is a view of the contact area and the approach area in the state of () from the upper side, (C) is a view showing the changed gradient vector, and (D) is a view showing the difference vector.

[Outline of Embodiment of the Present Invention]
Prior to the description of the embodiment, the outline of the display device according to the embodiment of the present invention will be described with reference to FIG. FIG. 1 is a diagram showing a display device 1 according to an embodiment of the present invention. As shown in FIG. 1, the display device 1 includes a display unit 12 that is a display unit, an input unit 14 that is an input unit, and a control unit 20 that is a control unit.

  The display unit 12 displays electronic content such as an electronic document or an electronic map on the screen. The input unit 14 detects the positional relationship between the operating tool and the display unit 12. Here, the operating body is an object separate from the display device 1. The control unit 20 moves the display area in which the content is displayed according to the tilt of the operation tool with respect to the screen calculated based on the positional relationship detected by the input unit 14. The specific functions of each component will be described later.

  According to the display device 1 according to the embodiment of the present invention, it is possible to improve the operability when moving the content display area without the input device for moving the content display area. Note that even if the program is incorporated in the control unit 20 or the electronic device incorporates the configuration of the display device 1, the content display area can be changed without an input device for moving the content display area. The operability when moving can be improved.

[Embodiment 1]
Hereinafter, embodiments will be described with reference to the drawings. FIG. 2 is a diagram illustrating the display device 1 according to the first embodiment. As shown in FIG. 2, the display device 1 includes a display unit 12, an input unit 14, a control unit 20, and a storage unit 16 that stores information. Hereinafter, substantially the same components are denoted by the same reference numerals.

  The display device 1 is, for example, a touch screen device such as a smartphone, a tablet terminal, or a car navigation device. The display unit 12 is, for example, a liquid crystal display or an LED display. The display unit 12 displays the content stored in the storage unit 16, but may display the content received via a network such as the Internet or a LAN (Local Area Network) by, for example, streaming. Moreover, the display part 12 is exposed in the state covered with the input part 14 from the opening part of the housing | casing.

  The input unit 14 is, for example, a capacitive touch panel or the like, and is operated by bringing an operating body into contact with the input unit 14. Here, the operating body is a finger or a touch pen, etc., and is an object capable of operating a capacitive touch panel. The input unit 14 is arranged on the display surface of the display unit 12 as shown in FIG. That is, the input unit 14 and the display unit 12 integrally form a screen for displaying content, and the user can bring the operating tool into contact with the screen via the input unit 14.

  The “screen” refers to an area surface where content is displayed on the display device 1. Further, “the operating body touches the screen” means that, for example, when the display device is a touch screen like the display device 1 in the present embodiment, the input unit 14 and the display unit 12 are integrated. That is, the operating body comes into contact with the configured screen (the surface of the input unit 14). In other words, “the operating body comes into contact with the input unit 14” means that the operating body comes into contact with the screen (which is configured by integrating the input unit 14 and the display unit 12). Further, when the display device is a display such as a PC, “the operating body touches the screen” means that the operating body touches the surface of the display.

  The control unit 20 includes, for example, a central processing unit (CPU), a memory, an input / output port, and the like, and executes various controls using various programs stored in the storage unit 16. The storage unit 16 is, for example, a hard disk and stores information such as programs or contents.

  An operation in the display device 1 will be described. When the user brings the operating tool into contact with a desired position of the input unit 14, the input unit 14 outputs coordinate information (position information) of the touched point to the control unit 20. The control unit 20 realizes a predetermined function based on a program stored in the storage unit 16 and controls the display unit 12 to display information stored in the storage unit 16. Specifically, when receiving the coordinate information from the input unit 14, the control unit 20 determines which position of the content displayed on the display unit 12 the coordinate information corresponds to, and sets the position of the content. Perform the corresponding function.

Here, a method for detecting whether or not the operating tool has touched the screen will be described. In the capacitance method, the input unit 14 detects contact by measuring the capacitance generated between an operating body such as a finger and the input unit 14 (screen). Since the finger has conductivity, a capacitance is generated between the finger and the input unit 14. In general, the area of two conductor plates parallel to each other is S [m ² ], the distance between the two conductor plates is D [m], and the dielectric constant of the dielectric filled between the two conductor plates is ε Then, the capacitance C [F] generated between the two conductor plates is expressed by the following formula 1.
C = (ε * S) / D (Formula 1)

  As shown in Equation 1, the smaller the distance between the two conductor plates, the larger the generated capacitance, and the larger the distance between the two conductor plates, the larger the generated capacitance. It gets smaller. Therefore, in FIG. 3A, the capacitance increases as the distance D between the operating tool 90 and the input unit 14 decreases (as the operating tool 90 approaches the input unit 14).

  The input unit 14 measures the generated capacitance. Then, as shown in FIG. 3B, when the operating body 90 approaches the input unit 14 as much as possible and the distance D approaches 0 as much as possible, the measured capacitance value becomes a predetermined threshold value Cth1 (contact Threshold value Cth1) or more. At that time, the input unit 14 determines that the operating body 90 has approached (contacted) enough to be considered to have contacted the input unit 14. Further, the input unit 14 sets a position where the capacitance equal to or greater than the contact threshold Cth1 is measured as a contact point, and outputs coordinate information of the contact point to the control unit 20.

  As shown in FIG. 3C, when the user is wearing gloves, even if the gloves contact the input unit 14, the finger cannot contact the input unit 14. However, as shown in Equation 1, even if the finger and the input unit 14 are not in contact, capacitance is generated. Therefore, by lowering the value of the contact threshold Cth1, it is possible to sense contact even when wearing gloves. In this way, even in a state of not being in contact, the input unit 14 can detect an operating body that has approached the input unit 14 with a certain distance. In this way, the function of detecting the operating tool even when the screen is not touched is called a hovering function.

  In the hovering function, the threshold value of the capacitance generated in the “approached to some extent” state can be determined in advance as an approach threshold value Cth2 (<Cth1). That is, when the measured electrostatic capacitance C is smaller than the contact threshold Cth1 but greater than or equal to the approach threshold Cth2, the operating body is not in contact with the input unit 14, but is in a state of approaching with a certain interval. is there. At that time, the input unit 14 determines that the operating body 90 has approached the input unit 14 to some extent although it has not touched. Further, the input unit 14 sets a position where the capacitance equal to or greater than the approach threshold Cth2 is measured as an approach point, and outputs coordinate information of the approach point to the control unit 20. As will be described below, the control unit 20 calculates the inclination of the operating tool with respect to the display unit 12 based on the coordinate information of the contact point and the approach point from the input unit 14. And the control part 20 is controlled to move the display area in the display part 12 based on the inclination.

FIG. 4 is a diagram showing each component realized by the control unit 20 shown in FIG. FIG. 5 is a flowchart showing processing performed by the control unit 20. 6-10 is a figure for demonstrating the process performed by the control part 20. FIG.
As illustrated in FIG. 4, the control unit 20 includes a movement control start unit 202, a contact region detection control unit 204, a contact region coordinate acquisition unit 206, a center calculation unit 208, an approach region detection control unit 214, and an approach region coordinate acquisition unit 216. , Inclination calculation unit 218, data storage unit 220, change detection unit 230, movement control end unit 232, difference calculation unit 240, movement speed calculation unit 242, movement direction calculation unit 244, and display area movement control unit 246. .

  In addition, each component which the control part 20 implement | achieves is realizable by making a program run by control of the arithmetic unit (not shown) with which the control part 20 which is a computer is provided, for example. More specifically, the control unit 20 is realized by loading a program stored in the storage unit 16 into a memory (not shown) and executing the program under the control of the arithmetic device. In addition, each component is not limited to being realized by software by a program, but may be realized by any combination of hardware, firmware, and software.

  The control unit 20 determines whether to start the movement control (S102). Specifically, the movement control start unit 202 is a signal (start signal) indicating that an operation (movement start operation) for starting the movement (scroll operation) of the content display area has been performed on the input unit 14. ) Is received. Here, the movement start operation may be, for example, an operation in which the user brings the operating body into contact with the input unit 14 at the same position for a certain time (for example, 2 seconds) (long press). Further, the movement start operation may be, for example, an operation of bringing the operating body into contact (tapping) with a predetermined position (for example, lower right) on the screen.

  When it is determined that the control unit 20 starts movement control (YES in S102), the control unit 20 acquires the contact area A1 and the approach area A2 (S104). Specifically, when the movement control start unit 202 receives a start signal, the movement control start unit 202 first outputs a start signal to the contact area detection control unit 204. Here, the contact area A <b> 1 is an area (coordinate group) where it is determined that the operating tool has touched the input unit 14 (screen). The approach area A2 is an area (coordinate group) that is determined to have approached to some extent although the operating body is not in contact with the input unit 14 (screen).

  When the contact area detection control unit 204 receives the start signal, the coordinate information at the position where the input unit 14 detects a capacitance equal to or greater than the contact threshold Cth1, that is, the position where the operating tool contacts the input unit 14, Control to output to the control unit 20. The contact area coordinate acquisition unit 206 acquires, from the input unit 14, coordinate information (contact area coordinates) at a position where a capacitance greater than or equal to the contact threshold Cth1 is detected. Further, the contact area coordinate acquisition unit 206 stores the acquired contact area coordinates in the data storage unit 220.

  For example, as illustrated in FIG. 6A, when the operating body 90 comes into contact with the input unit 14, when the distance from the surface (screen) of the input unit 14 is within D1, the input unit 14 A capacitance greater than or equal to the threshold Cth1 is detected. At this time, as illustrated in FIG. 6B, the input unit 14 uses (X2, Y2), (X2, Y3), and (X2) as the coordinates of the contact point at which the capacitance equal to or greater than the contact threshold Cth1 is measured. X2, Y4) are detected. The input unit 14 outputs a set of coordinates of these contact points as a contact area A1, and outputs the coordinate information (contact area coordinates) to the control unit 20, and the contact area coordinate acquisition unit 206 outputs the contact area coordinates. Get the coordinates.

  When the contact area coordinate acquisition unit 206 receives the contact area coordinates, the movement control start unit 202 next outputs a start signal to the approach area detection control unit 214. When the approach region detection control unit 214 receives the start signal, the approach region detection control unit 214 detects, for the input unit 14, a position where a capacitance smaller than the contact threshold Cth 1 but greater than the approach threshold Cth 2, that is, the operating body approaches the input unit 14. Control is performed so that the coordinate information at the determined position is output to the control unit 20. The approach area coordinate acquisition unit 216 acquires, from the input unit 14, coordinate information (approach area coordinates) at a position where a capacitance smaller than the contact threshold Cth1 but greater than the approach threshold Cth2 is detected. The approach area coordinate acquisition unit 216 stores the acquired approach area coordinates in the data storage unit 220.

  For example, as illustrated in FIG. 6A, when the operating body 90 comes into contact with the input unit 14, the distance from the surface (screen) of the input unit 14 is farther than D <b> 1 and within D <b> 2. The part 90a is not in contact with the input unit 14, but is close to a certain extent. That is, the part 90a of the operating body 90 generates a capacitance that is smaller than the contact threshold Cth1 but greater than or equal to the approach threshold Cth2. Accordingly, at this time, the input unit 14 detects a capacitance that is smaller than the contact threshold Cth1 but greater than or equal to the approach threshold Cth2.

  At this time, as illustrated in FIG. 6B, the input unit 14 uses (X3, Y2) as the coordinates of the approach point where the capacitance smaller than the contact threshold Cth1 but greater than the approach threshold Cth2 is measured. ), (X3, Y3), (X3, Y4), (X4, Y2), (X4, Y3), (X4, Y4) and (X5, Y3). The input unit 14 sets a set of coordinates of these approach points as the approach region A2, and outputs these coordinate information (approach region coordinates) to the control unit 20. The approach region coordinate acquisition unit 216 Get the coordinates.

  Next, the control unit 20 calculates an initial inclination vector B1 (S106). Here, the initial inclination vector is a vector indicating the inclination of the operating body before the operating body comes into contact with the input unit 14 (screen) and the inclination of the operating body is changed. This initial inclination vector becomes a reference vector for calculating the moving speed and moving direction of the display area in the subsequent processing.

  As a specific process, first, the center calculation unit 208 calculates the coordinates of the center of the contact area A1 from the contact area coordinates. Specifically, the center calculation unit 208 calculates an average value for each X coordinate and Y coordinate of the contact area coordinates. Then, the center calculation unit 208 sets the average value of the X coordinates as the X coordinate of the center point, and sets the average value of the Y coordinates as the Y coordinate of the center point. Further, the center calculation unit 208 stores the coordinate information of the center point in the data storage unit 220.

  In the example of FIG. 6, the contact area coordinates are (X2, Y2), (X2, Y3), and (X2, Y4). Therefore, if the coordinates of the center point of the contact area A1 are (Xc, Yc), the center calculation unit 208 Calculates Xc (= X2) from Xc = (X2 + X2 + X2) / 3. Further, the center calculation unit 208 calculates Yc (= Y3) from Yc = (Y2 + Y3 + Y4) / 3.

  The inclination calculation unit 218 calculates a point farthest from the center point of the contact area A1 among the approach area coordinates. Specifically, the inclination calculating unit 218 calculates the distance between the center point of the contact area A1 and each point of the approach area coordinates, and the point of the approach area coordinates having the largest distance from the center point of the contact area A1. The farthest point. Then, the inclination calculation unit 218 is an initial value that indicates the inclination of the initial operating body when the operating body touches the input unit 14 (screen), with a vector starting from the center point of the contact area A1 and ending at the farthest point. Calculated as an inclination vector B1. In other words, the inclination calculation unit 218 uses the initial inclination of the vector having the maximum vector length (scalar amount) among vectors starting from the center point of the contact area A1 and ending at each point of the approach area coordinates. Calculated as vector B1. Further, the inclination calculation unit 218 stores information indicating the initial inclination vector B1 in the data storage unit 220. When there are a plurality of vectors having the largest scalar quantity, the inclination calculation unit 218 may calculate the average of these vectors as the initial inclination vector B1 (the same applies to the changed inclination vector B2 in the subsequent processing of S120). ).

  In the example of FIG. 6, the approach area coordinates (X3, Y2), (X3, Y3), (X3, Y4), (X4, Y2), (X4, Y3), (X4, Y4) and (X5, Y3) Among these, the point farthest from the center point (Xc, Yc) = (X2, Y3) is (X5, Y3). Therefore, as illustrated in FIG. 6C, the inclination calculation unit 218 uses a vector having the center point (Xc, Yc) = (X2, Y3) as the start point and (X5, Y3) as the end point as the initial inclination. Let it be vector B1.

  When the initial inclination vector B1 is calculated, the control unit 20 acquires the contact area A1 and the approach area A2 again (S108). Specifically, the contact area detection control unit 204 controls the input unit 14 to output the contact area coordinates to the control unit 20 again. Then, the contact area coordinate acquisition unit 206 acquires the contact area coordinates from the input unit 14 again, and stores the acquired contact area coordinates in the data storage unit 220. Furthermore, the approach area detection control unit 214 controls the input unit 14 to output the approach area coordinates to the control unit 20 again. Then, the approach area coordinate acquisition unit 216 acquires the approach area coordinates from the input unit 14 again, and stores the acquired approach area coordinates in the data storage unit 220. As described above, when the operating tool touches the screen and the display area moving process starts, the contact area A1 and the approach area A2 can always be detected.

  The control unit 20 determines whether or not the contact area A1 has changed (S110). Specifically, the change detection unit 230 determines whether the contact area coordinates stored in the data storage unit 220 have changed. For example, when the coordinates of the center point calculated by the center calculation unit 208 are included in the contact area coordinates acquired in the process of S108, the change detection unit 230 determines that the contact area A1 has not changed. On the other hand, the change detection unit 230 determines that the contact area A1 has changed when the coordinates of the center point are not included in the contact area coordinates acquired in the process of S108. Note that the change detection unit 230 may determine that the contact area A1 has changed when the contact area coordinates that make up the contact area A1 change even a little, and the change detection unit 230 may determine in advance the contact area coordinates that make up the contact area A1. It may be determined that the contact area A1 has changed when the coordinates of the determined ratio have changed.

  A specific example will be described with reference to FIG. As illustrated in FIG. 7B, the contact area coordinates are increased because the contact area of the operating body 90 is increased as compared to the case of FIG. However, the coordinates (X2, Y3) of the center point calculated by the center calculation unit 208 in the process of S106 are included in the contact area coordinates. Therefore, in this example, the change detection unit 230 determines that the contact area A1 has not changed. As described above, the inclination of the operating body is changed by using whether or not the coordinates (X2, Y3) of the center point calculated by the center calculation unit 208 in the process of S106 are included in the contact area coordinates. In this case, even if the contact area is slightly deviated, the movement process can be continued.

  When it is determined that the contact area A1 has changed (YES in S110), the control unit 20 ends the movement control. Specifically, if the coordinates of the center point are not included in the contact area coordinates acquired in the process of S108, the change detection unit 230 outputs a signal indicating that to the movement control end unit 232. At that time, the movement control end unit 232 ends the movement process (scroll operation) of the content display area. If the coordinates of the contact area change, for example, the coordinates of the center point are not included in the contact area coordinates, the user is likely to desire to cancel the scroll operation by moving the operating tool away from the screen. is there.

  On the other hand, when it is determined that the contact area A1 has not changed (NO in S110), the control unit 20 determines whether the approach area A2 has changed (S112). Specifically, the change detection unit 230 determines whether or not the approach area coordinates stored in the data storage unit 220 have changed. For example, the change detection unit 230 determines that the approach area A2 has changed when the approach area coordinates constituting the approach area A2 have changed even a little. Note that the change detection unit 230 approaches when some of the coordinates of the approach area coordinates constituting the approach area A2 (for example, coordinates that affect the inclination vector, such as coordinates far from the center point) change. It may be determined that the area A2 has changed.

  When it is determined that the approach area A2 has not changed (NO in S112), the process of the control unit 20 returns to S108, and the control unit 20 acquires the contact area A1 and the approach area A2 again (S108). And the control part 20 repeats judgment (S110) of the presence or absence of a change of contact area A1, and judgment (S112) of the presence or absence of a change of approach area A2.

  On the other hand, when it is determined that the approach area A2 has changed (YES in S112), the control unit 20 calculates the changed gradient vector B2 (S120). Specifically, the change detection unit 230 outputs a signal to the inclination calculation unit 218 when the approach region coordinates change. When the inclination calculation unit 218 receives the signal, the inclination calculation unit 218 calculates a point farthest from the center point (calculated in S106) of the contact area A1 in the approach area coordinates after the change. Then, the inclination calculation unit 218 calculates a vector having the center point of the contact area A1 as the start point and the farthest point as the end point, as in the process of S106. This vector is a post-change inclination vector B2 indicating the inclination after the inclination of the operating body is changed from the initial inclination of the operating body.

  In the example of FIG. 7, as illustrated in FIG. 7A, the operation tool 90 is in a sleeping state with respect to the input unit 14 (screen). That is, the inclination of the operating body 90 with respect to the input unit 14 is larger than the state of FIG. 6A (the angle between the operating body 90 and the input unit 14 is reduced). In this case, the upper part of the operating body 90 (the part far from the contact position) approaches the input unit 14. Therefore, as illustrated in FIG. 7B, when the inclination of the operating body 90 increases, the approach region A2 extends in a direction away from the center point (Xc, Yc) = (X2, Y3). Of the approach area coordinates after the change, the point farthest from the center point (Xc, Yc) = (X2, Y3) is (X8, Y3). Therefore, as illustrated in FIG. 7C, the inclination calculation unit 218 changes the vector having the center point (Xc, Yc) = (X2, Y3) as the start point and (X8, Y3) as the end point after the change. Let it be an inclination vector B2.

  Thus, the magnitudes (scalar amounts) of the inclination vectors such as the initial inclination vector B1 and the changed inclination vector B2 increase as the operating body is inclined. Furthermore, the direction of the inclination vector indicates the direction in which the operating body is inclined. Therefore, the inclination vector indicates the inclination of the operating body.

  Next, the control unit 20 calculates a difference vector B3 indicating a difference between the initial inclination vector B1 and the changed inclination vector B2 (S122). Specifically, the difference calculation unit 240 calculates a difference between the initial inclination vector B1 calculated in the process of S106 and the post-change inclination vector B2 calculated in the process of S120, and calculates the calculated vector as a difference. Let it be vector B3. More specifically, the difference calculation unit 240 calculates the X component and the Y component of the initial inclination vector B1 from the coordinates of the start point and the end point of the initial inclination vector B1, respectively. Similarly, the difference calculation unit 240 calculates the X component and the Y component of the changed gradient vector B2 from the coordinates of the start point and the end point of the changed gradient vector B2, respectively. Then, the difference calculation unit 240 can calculate the X component of the difference vector B3 by subtracting the X component of the initial gradient vector B1 from the X component of the post-change gradient vector B2. Furthermore, the difference calculation unit 240 can calculate the Y component of the difference vector B3 by subtracting the Y component of the initial inclination vector B1 from the Y component of the post-change inclination vector B2.

  In the example of FIG. 7, as illustrated in FIG. 7D, the X component of the initial gradient vector B1 is +3, and the X component of the post-change gradient vector B2 is +6. Therefore, the X component of the difference vector B3 is +3. . Further, since the Y component of the initial gradient vector B1 and the Y component of the post-change gradient vector B2 are both 0, the Y component of the difference vector B3 is 0. Therefore, the difference calculation unit 240 calculates the difference vector B3 of (X, Y) = (+ 3, 0).

  Next, the control unit 20 calculates the moving speed and moving direction of the display area (S124). Specifically, the movement speed calculation unit 242 calculates the movement speed of the display area, and outputs the calculated movement speed to the display area movement control unit 246. In addition, the movement direction calculation unit 244 calculates the movement direction of the display area, and outputs the calculated movement direction to the display area movement control unit 246. The movement direction calculation unit 244 calculates the movement direction of the display area from the direction of the difference vector B3. That is, the movement direction calculation unit 244 may set the direction of the difference vector B3 as the movement direction of the display area.

The moving speed calculation unit 242 calculates the moving speed of the display area from the scalar quantity of the difference vector B3. For example, the moving speed calculation unit 242 calculates the moving speed V using the following equation (2).
V = (| B3 | / E) * Vst (Formula 2)
Here, | B3 | is the scalar quantity of the difference vector B3. Vst is a predetermined standard speed. The standard speed may be a speed at which the user can recognize that the scroll speed is neither fast nor slow. Further, E is a coefficient for determining increase / decrease from the standard speed, and may be calculated from, for example, the initial gradient vector B1.

  Specifically, the coefficient E may be half of the scalar quantity of the initial gradient vector B1 (that is, E = | B1 | / 2). By defining in this way, when the inclination of the operating body is changed so that the scalar quantity of the difference vector B3 is half the scalar quantity of the initial inclination vector B1, the movement (scrolling) at the standard speed Vst is performed. It becomes possible. In this case, in the example of FIG. 7, the scalar quantity of the difference vector B3 is 3, and the scalar quantity of the initial gradient vector B1 is 3, so V = 2Vst.

  Note that the maximum value of the scalar amount of the inclination vector depends on the length in the vertical direction and the length in the horizontal direction of the input unit 14 (screen), and the length of the operation body. That is, the scalar quantity of the inclination vector is equal to or less than the length of the operating body. Further, if the length of the operating body is such that it protrudes from the input unit 14 (screen), the X component (horizontal direction) of the difference vector B3 is the input unit 14 (screen) no matter how much the operating body is tilted. The Y component (vertical direction) of the difference vector B3 is equal to or less than the vertical length of the input unit 14 (screen). Accordingly, the value of the coefficient E may be calculated in advance from the maximum value of the scalar quantity of the gradient vector. For example, the value of the coefficient E may be 1/2 or 1/4 of the maximum value of the scalar vector of the gradient vector.

  Further, the coefficient E and the standard speed Vst may be arbitrarily adjusted by the user. Thus, the user can arbitrarily adjust the relationship between the degree of change of the operating tool and the moving speed of the display area. That is, for example, when the user feels that the moving speed is fast even though the inclination of the operating body is slightly changed, the coefficient E can be increased or the standard speed Vst can be decreased.

  Next, the control unit 20 controls the display unit 12 to move the display area (S126). Specifically, the display area movement control unit 246 moves the display area in the direction calculated by the movement direction calculation unit 244 at the speed (V) calculated by the movement speed calculation unit 242. 12 is controlled. Thus, for example, in the example of FIG. 7, the display area moves in the positive direction of the X direction at a speed of V = (| B3 | / (3/2)) * Vst (= 2Vst). That is, it becomes possible to view the positive portion of the content in the X direction.

  Further, the display area movement control unit 246 may cause the display unit 12 to display a speed indicator for displaying the moving speed when the display area is moved. Thereby, the user can confirm the current moving speed. Therefore, the user can grasp how much the display area moves at a desired speed by tilting the operating tool, and how much the moving speed changes when the tilt of the operating tool is changed. Can be confirmed.

  Furthermore, suppose that the inclination of the operating body has changed from the state of FIG. 7 to the state of FIG. As illustrated in FIG. 8A, the operation body 90 is in a state of being raised with respect to the input unit 14 (screen). That is, the inclination of the operating tool 90 with respect to the input unit 14 is smaller than that in the state of FIG. 6A (the angle between the operating tool 90 and the input unit 14 approaches 90 degrees). In this case, the upper part of the operating body 90 (the part far from the contact position) is separated from the input unit 14. Therefore, as illustrated in FIG. 8B, when the inclination of the operation body 90 is reduced, the approach area A2 is contracted in the direction of the center point (Xc, Yc) = (X2, Y3).

  Of the approach area coordinates after the change, the points farthest from the center point (Xc, Yc) = (X2, Y3) are (X3, Y4) and (X3, Y2). At this time, the inclination calculation unit 218 includes a vector having a center point (Xc, Yc) = (X2, Y3) as a start point and (X3, Y4) as an end point, and a center point (Xc, Yc) = (X2, Y3). A vector that is the average of the vectors with the starting point (X3, Y2) as the end point is calculated. Specifically, an average value is calculated for each of the X component and Y component of each vector, and a vector having the average value as each component is defined as a post-change gradient vector B2. As a result, as illustrated in FIG. 8C, the inclination calculation unit 218 changes the vector having the center point (Xc, Yc) = (X2, Y3) as the start point and (X3, Y3) as the end point. The rear slope vector B2.

  At this time, since the X component of the initial gradient vector B1 is +3 and the X component of the post-change gradient vector B2 is +1, the X component of the difference vector B3 is −2. Further, since the Y component of the initial gradient vector B1 and the Y component of the post-change gradient vector B2 are both 0, the Y component of the difference vector B3 is 0. Therefore, as illustrated in FIG. 8D, the difference calculation unit 240 calculates a difference vector B3 of (X, Y) = (− 2, 0). Furthermore, from the above equation 2, the moving speed calculation unit 242 calculates the moving speed as V = (2 / (3/2)) * Vst = 4 / 3Vst. Moreover, since the direction of the difference vector B3 is the negative direction of the X direction, the movement direction calculation unit 244 calculates the movement direction as the negative direction of the X direction. Therefore, the display area movement control unit 246 moves the display area in the negative direction of the X direction at a speed of V = 4 / 3Vst. That is, the moving direction of the display area is reversed from the state of FIG. As described above, the moving direction of the display area can be easily changed only by changing the inclination of the operating tool.

  An example in which the display area is moved in both the X direction and the Y direction (that is, obliquely) will be described with reference to FIGS. 9 and 10. As illustrated in FIG. 9A, first, the tip of the operation body 90 is brought into contact with the input unit 14. At this time, as illustrated in FIG. 9B, the contact area coordinate acquisition unit 206 acquires a point (X2, Y5) as the contact area coordinates. Therefore, the center calculation unit 208 is centered on (X2, Y5). The approach area coordinate acquisition unit 216 acquires (X2, Y1), (X2, Y2), (X2, Y3), and (X2, Y4) as the approach area coordinates. Therefore, the inclination calculation unit 218 sets the vector starting from the center point (X2, Y5) and ending at the point (X2, Y1) farthest from the center point as the initial inclination vector B1 (S104, S106).

  Furthermore, it is assumed that the tilt of the operating body has changed from the state of FIG. 9 to the state of FIG. As illustrated in FIG. 10A, the operation body 90 is moved so as to rotate counterclockwise around the contact point. At this time, as illustrated in FIG. 10B, since the contact area coordinates are (X2, Y5), the change detection unit 230 determines that the contact area A1 has not changed. In addition, since the approach area coordinate acquisition unit 216 has acquired (X3, Y4), (X4, Y3), and (X5, Y2) as the approach area coordinates, the change detection unit 230 changes the approach area A2. (S110, S112).

  Of the approach region coordinates after the change, the point farthest from the center point (Xc, Yc) = (X2, Y5) is (X5, Y2). Therefore, as illustrated in FIG. 10C, the inclination calculation unit 218 calculates a vector having a center point (Xc, Yc) = (X2, Y5) as a start point and (X5, Y2) as an end point. The rear slope vector B2 is set (S120).

  Furthermore, since the X component of the initial gradient vector B1 is 0 and the X component of the post-change gradient vector B2 is +3, the X component of the difference vector B3 is +3. Further, since the Y component of the initial gradient vector B1 is −4 and the Y component of the post-change gradient vector B2 is −3, the Y component of the difference vector B3 is +1. Therefore, as illustrated in FIG. 10D, the difference calculation unit 240 calculates a difference vector B3 of (X, Y) = (+ 3, +1). Then, the display area movement control unit 246 moves the display area in the direction of the difference vector B3 at a movement speed corresponding to the scalar amount of the difference vector B3. Thereby, the display area can be moved in an oblique direction.

  As described above, in the first embodiment, it is possible to execute continuous scrolling just by tilting the operating body that is in contact with the screen, for example, to operate a joystick. There is no need to repeat it over and over. In addition, the moving direction and moving speed of the display area can be arbitrarily and easily changed simply by changing the tilt of the operating tool.

  In addition, the moving direction and moving speed of the display area can be changed arbitrarily by simply changing the tilt while maintaining the contact position while the operating tool is in contact with any position on the screen. It will only cover the smallest part of the content. Therefore, it is possible to improve the viewability of the content. Furthermore, since the user can move the display area by tilting the operating body while looking at the screen, it is possible to improve the viewability of the content.

  Further, by calculating the initial inclination vector B1 in a state where the operating body is first contacted and using it as a reference for the moving speed and moving direction of the display area, the reference inclination can be easily set. In the case of a joystick, the vertical direction is generally used as a reference. However, when the operating body is a finger, there is a nail, so it is difficult to stand the finger vertically on the screen unless it is conscious. However, in the first embodiment, since the reference can be arbitrarily set, the state where the finger is naturally placed on the screen can be used as the reference. Therefore, by changing the inclination from the state, the moving speed and the moving direction can be changed from the natural state.

[Modification]
Note that the present invention is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit of the present invention. For example, the example of the operation body is not limited to the finger. Any object that can detect tilt can be used. Moreover, the various electronic devices provided with the component of the display apparatus concerning Embodiment 1 mentioned above may be sufficient.

  In the first embodiment described above, the display area is moved, but the content itself may be moved in the direction of the difference vector. At this time, the display area moves in the direction opposite to the direction of the difference vector. In Embodiment 1 described above, the calculation is performed for each of the horizontal direction (X component) and the vertical direction (Y component) of the screen. However, content that scrolls only in the vertical direction (Y direction) of the screen. In the case of, calculation may be performed excluding the X component.

  Moreover, in Embodiment 1 mentioned above, although the input part 14 was arrange | positioned on the display part 12, the relationship between the display part 12 and the input part 14 may be reverse. That is, the display unit 12 may be on the input unit 14. Furthermore, in Embodiment 1 mentioned above, although the input part 14 was a touch panel, it is not restricted to a touch panel. In the first embodiment described above, the capacitance is detected as a method of detecting the tilt of the operating body. However, the tilt may not be detected by the capacitance.

  For example, the inclination of the operating body may be detected by an inclination sensor that can be attached to the operating body. In this case, the tilt sensor becomes the input unit 14. In addition, the tilt of the operating tool may be detected by a camera that measures the positional relationship between the operating tool and the display unit (screen). In this case, the camera becomes the input unit 14. In addition, the tilt of the operating tool may be detected by a sensor that measures the distance between the operating tool and the screen (or a physical quantity that changes according to the distance). That is, the display device is not limited to the touch screen device, and may be a display of a PC, for example. In addition, since the inclination can be detected by using the input unit 14 that is originally provided by detecting the inclination by the capacitance, the above-described device is not necessary.

  In the flowchart shown in FIG. 5, the order of processing (steps) can be changed as appropriate. Further, another process (step) may be executed while one process (step) is being executed. One or more of the plurality of processes (steps) may be omitted. For example, the process of S112 may not be performed, and the difference vector B3 may always be calculated regardless of whether or not A2 is changed. Further, the process of S108 may be started before the process of S106 is completed.

DESCRIPTION OF SYMBOLS 1 Display apparatus 12 Display part 14 Input part 16 Storage part 20 Control part 202 Movement control start part 204 Contact area detection control part 206 Contact area coordinate acquisition part 208 Center calculation part 214 Approach area detection control part 216 Approach area coordinate acquisition part 218 Inclination Calculation unit 220 Data storage unit 230 Change detection unit 232 Movement control end unit 240 Difference calculation unit 242 Movement speed calculation unit 244 Movement direction calculation unit 246 Display area movement control unit

Claims (14)

A display device,
Display means for displaying content on the screen;
Input means for detecting the positional relationship between the operation body, which is an object separate from the display device, and the screen;
And a control unit configured to move a display area in which the content is displayed based on an inclination of the operating body with respect to the screen calculated based on a positional relationship detected by the input unit. The display device according to claim 1, wherein the control unit moves the display area of the content based on a change amount of the tilt of the operation body. The control means maintains the screen of the operating body while maintaining the inclination of the operating body in the first state when the operating body touches the screen and the contact position of the operating body in the first state. The display device according to claim 2, wherein the display area of the content is moved based on a difference from the tilt of the operating body in the second state when the tilt with respect to is changed. The display device according to claim 2, wherein the control unit changes a moving speed of a display area of the content based on the change amount. The display device according to claim 2, wherein the control unit changes a moving direction of the display area of the content based on the amount of change. The input means measures a physical quantity that changes in accordance with a distance between the operation body and the screen in association with a position of the screen,
The display device according to any one of claims 1 to 5, wherein the control unit calculates an inclination of the operation body based on the physical quantity measured by the input unit. The input means measures a capacitance generated by the operation body approaching the screen in association with a position of the screen;
The display device according to claim 6, wherein the control unit calculates an inclination of the operation body based on the capacitance measured by the input unit. The control means detects, on the screen, a region including a position where the capacitance is equal to or greater than a first threshold as a first region where the operating body is in contact with the screen, and the capacitance is A region that includes a position that is smaller than the first threshold and greater than a second threshold that is smaller than the first threshold, but the operating body is not touching the screen but is approaching the second The display device according to claim 7, wherein the display device is detected as an area, and an inclination of the operating body is detected based on the first area and the second area. The control means is based on a first vector starting from the center of the first region and ending at a point farthest from the center of the first region in the second region. The display device according to claim 8, wherein inclination is detected. The control means calculates a second vector indicating a difference between the first vectors when the tilt of the operating body changes, and based on the second vector, the moving speed of the content display area and The display device according to claim 9, wherein the moving direction is calculated. The display device according to claim 1, wherein the control unit causes the display unit to display a moving speed meter indicating a moving speed of the display area during movement of the display area of the content. Electronic equipment,
Display means for displaying content on the screen;
Input means for detecting a positional relationship between the operation body, which is an object separate from the electronic device, and the screen;
An electronic device comprising: control means for moving a display area in which the content is displayed based on an inclination of the operating body with respect to the screen calculated based on a positional relationship detected by the input means. A display method in a display device for displaying content on a screen,
A first step of detecting a positional relationship between the operating body, which is an object separate from the display device, and the screen;
A second step of calculating an inclination of the operating body with respect to the screen based on the positional relationship detected in the first step;
And a third step of moving a display area in which the content is displayed based on the inclination calculated in the second step. A program executed by a display device that displays content on a screen,
A first step of acquiring a positional relationship between the operation body, which is an object separate from the display device, and the screen;
A second step of calculating an inclination of the operating body with respect to the screen based on the positional relationship acquired in the first step;
A program for causing a computer of the display device to execute a third step of moving a display area in which the content is displayed based on the inclination calculated in the second step.

Images