JP2012073962A - Electronic device and object display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the inconvenience of, when an object shown on a display screen of an electronic device is moved by touching the object by a finger over a long distance, moving the finger touching the screen over the long distance.SOLUTION: An electronic device includes: display means for displaying a display screen 61 for showing an object 30; detection means for detecting a first position where the object 30 shown on the display screen 61 is specified and a second position specified on the display screen; and display means for calculating a position of the object 30 to be moved on the basis of a relative position between the detected first position and second position, and displaying a movement destination of the object 30 on the display screen.

Description

  Embodiments described herein relate generally to an electronic device in which a user can move an object such as an icon by touching a display.

In recent years, electronic devices that allow a user to touch a display and move an object such as an icon have become popular.
Among these, for example, there is a method that draws a locus while touching an object with a finger on a display screen from the movement source to the movement destination of the object.

  However, this method has a problem that it is troublesome for the user to move the finger while touching the screen when the moving distance of the object is long.

JP-A-10-105334

  When moving an object displayed on the display screen of an electronic device while touching it with a finger, for example, when the moving distance of the object is long, it is troublesome to move the finger touching the screen over a long distance. To solve this problem has been a problem.

The electronic device of the embodiment includes a display unit that displays a display screen on which an object is displayed.
The image processing apparatus further includes detection means for detecting a first position where the object displayed on the display screen is designated and a second position designated on the display screen.
In addition, a display unit is provided that calculates a position where the object moves based on the detected relative position between the first position and the second position, and displays the movement destination of the object on the display screen. .

The perspective view which shows the structure of the electronic device which concerns on embodiment. 1 is a block diagram showing a system configuration of an electronic device according to an embodiment. The figure which shows an example in which the 1st position which concerns on an object is designated to the user in the electronic device which concerns on embodiment. The figure which shows an example in which the 2nd position on a display screen is designated by the user in the electronic device which concerns on embodiment. 6 is a diagram illustrating an example of displaying an object movement destination based on a relative position between a first position and a second position designated by a user in the electronic apparatus according to the embodiment. FIG. 6 is a diagram illustrating an example in which the destination of the object moves in accordance with the movement of the second position designated by the user in the electronic apparatus according to the embodiment. FIG. FIG. 6 is a diagram illustrating an example in which an object moves to a movement destination when an operation of moving the object at a first position is performed in the electronic apparatus according to the embodiment. FIG. 6 is a diagram for explaining an example of a unit that calculates and displays an object movement destination based on a first position and a second position designated by a user in the electronic apparatus according to the embodiment. 6 is a diagram for explaining an example of moving an object from one display screen to another display screen in the electronic apparatus according to the embodiment. FIG. 6 is a flowchart for explaining the operation of the electronic apparatus according to the embodiment. 6 is a diagram for explaining an example in which an object to be moved is applied to a window of a screen such as a PC in the electronic apparatus according to the embodiment. 6 is a diagram for explaining an example in which an object to be moved is applied to a straight line in the electronic apparatus according to the embodiment. FIG.

Hereinafter, embodiments will be described with reference to the drawings.
FIG. 1 is a perspective view showing an external appearance of an electronic apparatus according to an embodiment of the present invention. This electronic apparatus is realized as a notebook type personal computer 10, for example.

  As shown in FIG. 1, the computer 10 includes a computer main body 11 and a display unit 12. The display unit 12 includes an LCD (liquid crystal display) 17. The display unit 12 is attached to the computer main body 11 so as to be rotatable between an open position where the upper surface of the computer main body 11 is exposed and a closed position covering the upper surface of the computer main body 11.

  The computer main body 11 has a thin box-shaped casing. On the upper surface of the computer main body 11, a keyboard 13, a power button 14 for powering on / off the computer 10, an input operation panel 15, a touch pad 16, Speakers 18A, 18B, etc. are arranged. Various operation buttons are provided on the input operation panel 15.

  Further, on the right side surface of the computer main body 11, for example, a USB (Universal Serial Bus) 2.0 standard USB cable or a USB connector 19 for connecting a USB device is provided.

  Furthermore, an external display connection terminal (not shown) corresponding to, for example, the HDMI (high-definition multimedia interface) standard is provided on the back surface of the computer main body 11. This external display connection terminal is used to output a digital video signal to an external display.

FIG. 2 is a diagram showing a system configuration of the computer 10.
As shown in FIG. 2, the computer 10 includes a CPU (central processing unit) 101, a north bridge 102, a main memory 103, a south bridge 104, a GPU (Graphics Processing Unit) 105, a VRAM (video RAM: random access). memory) 105A, sound controller 106, BIOS-ROM (basic input / output system-read only memory) 107, LAN (local area network) controller 108, hard disk drive (HDD) 109, optical disk drive (ODD) 110, USB controller 111A , A card controller 111B, a wireless LAN controller 112, an embedded controller / keyboard controller (EC / KBC) 113, an EEPROM (electrically erasable programmable ROM) 114, and the like.

  The CPU 101 is a processor that controls the operation of each unit in the computer 10. The CPU 101 executes various application programs such as an operating system (OS) 201 and a photo movie creation application program 202 that are loaded from the HDD 109 to the main memory 103.

  The photo movie creation application program 202 is software that reproduces various digital contents stored in the HDD 109, for example. The photo movie creation application program 202 has a moving image generation function. This moving image generation function is a function for creating a moving image (photo movie, slide show) using a material such as a photograph (digital content) stored in the HDD 109 or the like, for example.

  Further, the moving image generation function includes a function of analyzing a material used for creating a moving image. The photo movie creation application program 202 reproduces a moving image created using the material and displays it on the screen (LCD 17).

The CPU 101 also executes the BIOS stored in the BIOS-ROM 107. The BIOS is a program for hardware control.
The north bridge 102 is a bridge device that connects the local bus of the CPU 101 and the south bridge 104. The north bridge 102 also includes a memory controller that controls access to the main memory 103. The north bridge 102 also has a function of executing communication with the GPU 105 via, for example, a PCI EXPRESS serial bus.

The GPU 105 is a display controller that controls the LCD 17 used as a display monitor of the computer 10.
A display signal generated by the GPU 105 is sent to the LCD 17. The GPU 105 can also send a digital video signal to the external display 1 via the HDMI control circuit 3 and the HDMI terminal 2.

  The HDMI terminal 2 is the aforementioned external display connection terminal. The HDMI terminal 2 can send an uncompressed digital video signal and a digital audio signal to the external display 1 such as a television with a single cable. The HDMI control circuit 3 is an interface for sending a digital video signal to an external display 1 called an HDMI monitor via the HDMI terminal 2.

  The south bridge 104 controls each device on a peripheral component interconnect (PCI) bus and each device on a low pin count (LPC) bus. Further, the south bridge 104 includes an IDE (Integrated Drive Electronics) controller for controlling the HDD 109 and the ODD 110.

Further, the south bridge 104 has a function of executing communication with the sound controller 106.
The sound controller 106 is a sound source device, and outputs audio data to be reproduced to the speakers 18A and 18B or the HDMI control circuit 3. The LAN controller 108 is a wired communication device that executes IEEE 802.3 standard wired communication, for example, while the wireless LAN controller 112 is a wireless communication device that executes IEEE 802.11g standard wireless communication, for example. The USB controller 111A executes communication with an external device (connected via the USB connector 19) that supports, for example, the USB 2.0 standard.

  For example, the USB controller 111A is used for receiving an image data file stored in a digital camera, for example. The card controller 111B executes data writing and reading with respect to a memory card such as an SD card inserted into a card slot provided in the computer main body 11.

  The EC / KBC 113 is a one-chip microcomputer in which an embedded controller for power management and a keyboard controller for controlling the keyboard 13 and the touch pad 16 are integrated. The EC / KBC 113 has a function of turning on / off the computer 10 in accordance with the operation of the power button 14 by the user.

In this embodiment, the user can easily perform the operation on the display screen without continuously touching the locus from the movement source to the movement destination of the object.
In this embodiment, the user touches the object with one finger, for example, and touches the object with the other finger while touching the object.
Then, as will be described later, for example, a target display indicating the destination of the object is displayed on the display screen in accordance with the vector specified by the two fingers of the one finger and the other finger.

The user moves the position of the other finger touching the screen while viewing the target display. When the position of the other finger moves, the target display moves.
Then, while observing the target display, the position of the other finger touching the screen is moved, and the target display is moved to the position where the object is to be moved and adjusted.
In addition, when the user performs an operation (for example, to move) the object toward the target display with the one finger (first finger), the object moves to the target display position.

  “Harau” is a gesture that corresponds to “Harai” of “Hane”, “Tome”, and “Harai” in the calligraphy. In this case, as described above, for example, an object on the display screen is touched with one finger (first finger) or the like, and this object is moved toward the target display.

FIG. 3 is a diagram illustrating an example in which the first position related to the object is designated by the user in the electronic apparatus according to the embodiment.
The operation of the electronic device in this embodiment is controlled by the CPU 101.
Reference numeral 61 denotes a display screen (display) displayed on the LCD 17 which is a video display unit of the electronic device 10.
In this embodiment, the video display unit (LCD) 17 includes a touch sensor (not shown). When the user touches the video display unit (LCD) 17, the position on the display screen (display) touched by the user is detected and reported to the CPU 101.

  Here, the video display unit (LCD) 17 includes a touch sensor and detects the position on the display screen (display) touched by the user. The position detection on the display screen (display) is performed by, for example, a camera or the like. It is also possible to provide a separate and detect the position of the video display unit (LCD) 17 touched by the user.

Reference numeral 30 denotes an object displayed on a display screen (display) 61, and is an icon here, for example.
Reference numeral 31 is, for example, a user's finger. Here, although expressed as a finger, it may be a part of the user's body other than the finger, or may be other than a human body such as a pen, as long as the position on the display screen (display) 61 can be designated. This is referred to herein as the first finger.

  Further, the position on the display screen (display) 61 may be indirectly specified by using a device such as an external device connected to the touch pad 16 or the computer 10. The device that designates the position on the display screen (display) 61 may be a device that communicates with the personal computer 10 remotely.

  In addition to the target display indicating the movement destination of the object, a cursor or the like is displayed on the display screen (display) 61 to indicate which position on the display screen (display) 61 is specified by the user. Also good.

  The user touches the object (icon) 30 displayed on the display screen (display) 61 with the first finger. Thereby, the position of the object (icon) 30, that is, the first position is designated.

FIG. 4 is a diagram illustrating an example in which the second position on the display screen is designated by the user in the electronic apparatus according to the embodiment.
Reference numeral 32 is here also the user's finger, for example. Similarly to the above, it is expressed as a finger here, but it may be a part of the user's body other than the finger, or may be other than a human body such as a pen, and the position on the display screen (display) 61 can be designated. good. This is referred to herein as the second finger. The second finger of the user touches the display screen (display) 61 in an area around the object (icon) 30 (a position different from the first position touched by the first finger), for example.

  Here, the user touches the object (icon) 30 displayed on the display screen (display) 61 with the first finger, while the second finger is on the display screen (display) 61 at a position different from the first finger. touch.

  FIG. 5 is a diagram illustrating an example of displaying an object movement destination based on a relative position between the first position and the second position designated by the user in the electronic apparatus according to the embodiment.

Reference numeral 33 is a target display.
For example, when the first position and the second position are designated as described above, the target display 33 is displayed accordingly.
As described above, when the user touches the display screen (display) 61 with the second finger while touching the object (icon) 30 displayed on the display screen (display) 61 with the first finger, the object (icon) is touched. A target display 33 is displayed as the position of the 30 destination.

  That is, the object is based on the relative position of the second position where the second finger contacts the display screen (display) 61 as well as the first position where the first finger contacts the display screen (display) 61. The position where the (icon) 30 moves is calculated, and the movement destination of the object (icon) 30 is displayed on the display screen 61.

FIG. 6 is a diagram illustrating an example in which the destination of the object moves in accordance with the movement of the second position designated by the user in the electronic device according to the embodiment.
In this embodiment, the target display 33 moves according to the relative positions of the first finger 31 and the second finger 32.
The user moves the second finger to move the target display 33 to a position where the object (icon) 30 is to be moved.
As described above, when the user touches the display screen (display) 61 with the second finger while touching the object (icon) 30 displayed on the display screen (display) 61 with the first finger, the object (icon) is touched. A target display 33 is displayed as the position of 30 destinations.

  In this state, the user moves the second finger 32 while touching the display screen (display) 61 or touches the object (icon) 30 displayed on the display screen (display) 61 with the first finger. The position where the second finger 32 touches the display screen (display) 61 is moved.

  Then, the position of the target display 33 moves in accordance with the movement of the position of the second finger 32. The target display 33 indicates the position of the movement destination of the object (icon) 30 as described above.

Reference numeral 41 a indicates a locus of movement of the position of the second finger 32 on the display screen (display) 61 touched by the user.
Reference numeral 41b indicates the locus of the position of the target display 33 that has moved in response to this.
That is, when the user moves the second finger 32, the position of the target display 33 moves accordingly.
FIG. 7 is a diagram illustrating an example of the movement of the object to the movement destination by the operation of moving the object at the first position in the electronic apparatus according to the embodiment.

The operation in this embodiment is as follows.
First, as described above, the user touches the display screen (display) 61 with the second finger while touching the object (icon) 30 displayed on the display screen (display) 61 with the first finger. ) A target display 33 is displayed as the position of the movement destination of 30.

  Next, as described above, the user moves the second finger touching the display screen (display) 61 while viewing the position of the target display 33 displayed on the display screen (display) 61, The position of the display 33 is adjusted.

  Next, when the user determines that the position of the target display 33, that is, the position at which the object (icon) 30 is to be moved is generally a desired position, the user, for example, on the display screen (display) 61 as described above. Then, an operation of placing the second finger in the direction of the target display 61 (an operation of moving in the direction of the movement destination) is performed.

Then, the object (icon) 30 moves to the target display 33 position.
FIG. 8 is a diagram for explaining an example of a unit that calculates and displays the movement destination of the object based on the first position and the second position designated by the user in the electronic apparatus according to the embodiment.

  Reference numeral 51 is a vector 1. Vector 1 (51) is a vector based on the first position and the second position designated by the user. The vector 1 (51) has a direction from the first position to the second position, and has a length between the first position and the second position.

  Reference numeral 52 is a vector 2. Here, the vector 1 (51) and the vector 2 (51) are expressed by the following relationship, for example. Here, the function f () is a function having a vector in the range that can be taken by the vector 1 as a domain and a scalar value as a range.

Vector 2 = f (vector 1) * (vector 1)
The function f () may take a constant value regardless of the vector 1, may be a function dependent on the length of the vector 1, or may be a function dependent on the direction of the vector 1.
Further, the vector 1 and the vector 2 can be expressed by the following relationship. Here, a position vector representing the position of the object (icon) 30 on the screen is set as a vector 3. The function g () is a function whose domain is a set of vectors in the range that can be taken by the vector 1 and vectors in the range of values that the vector 3 can take, and whose scalar value is the range.

Vector 2 = g (vector 1, vector 3) * (vector 1)
With this configuration, in this embodiment, when the object (icon) 30 in the display screen (display) 61 is moved, for example, the display screen (display) 61 is configured as a large screen, and the object Even when the movement distance of the (icon) 30 is long, the movement of the object (icon) 30 can be realized with the movement of the finger smaller than the actual movement distance as described above.

FIG. 9 is a diagram illustrating an example of moving an object from one display screen to another display screen in the electronic apparatus according to the embodiment.
Here, two display screens (display 1 (61a) and display 2 (61b)) are displayed on the display screen 61.
And here, the operation | movement which moves the object (icon) 30 currently displayed on the display 1 (61a) to the display 2 (61b) is performed.
First, an object (icon) 30 is displayed on the display 1 (61a).
Next, in order to move the object (icon) 30 to the display 2 (61b), the user touches the object (icon) 30 displayed on the display screen (display) 61 with the first finger as described above. Touch the display screen 61 with two fingers. Then, a target display 33 is displayed as the position to which the object (icon) 30 is moved.

Next, the user moves the second finger so that the position of the target display 33 is displayed on the display 2 (61b).
When the position of the target display 33 is displayed on the display 2 (61b), the operation of holding the second finger in the direction of the target display 33 is performed as described above.
Then, the object (icon) 30 displayed on the display 1 (61a) moves to the display 2 (61b).
With this configuration, for example, a plurality of display screens (display 1 (61a) and display 2 (61b)) are displayed, and a plurality of display screens (display 1 (61a) and display 2 (61b)) are displayed. The object (icon) 30 can be moved.

FIG. 10 is a flowchart for explaining the operation of the electronic apparatus according to the embodiment.
Reference S100 is a start step. Then, it progresses to the step which attached | subjected code | symbol S101.
Reference numeral S <b> 101 is a step of displaying the object (icon or the like) 30 on the display screen 61. Then, it progresses to the step which attached | subjected code | symbol S102.
Reference numeral S <b> 102 is a step of detecting that the user touches the object (icon etc.) 30 on the screen with the first finger 31. Then, it progresses to the step which attached | subjected code | symbol S103.

Reference numeral S103 is a step of detecting that the user touches the screen with the second finger 32 while the first finger 31 is touching the screen. Then, it progresses to the step which attached | subjected code | symbol S104.
Reference numeral S <b> 104 is a step of calculating the position of the target display 33 from the relative relationship between the position of the first finger 31 and the position of the second finger 32. Then, it progresses to the step which attached | subjected code | symbol S105.

Reference numeral S105 is a step of displaying the target display 33 at the position calculated in the step denoted by reference numeral S104. Then, it progresses to the step which attached | subjected code | symbol S106.
Reference numeral S <b> 106 is a step of detecting an action (for example, a movement) that moves the object (icon or the like) 30 in the direction of the target display 33 while being touched by the first finger 31. If detected, it is determined that the user has finished moving the target display 33 on the screen to the position where the object (icon etc.) 30 is to be moved, and the process proceeds to the step marked S108 (Yes). ). When not detected, it progresses to the step which attached | subjected code | symbol S107 subsequently (No).

  Reference S107 is a step of detecting whether or not the second finger 32 has been moved while touching the object (such as an icon) 30 with the first finger. If it is detected, the process proceeds to the step marked S104 (Yes). When not detected, it progresses to the step which attached | subjected code | symbol S106 subsequently (No).

Symbol S108 is a step of moving the object (icon or the like) 30 to the target display 33 position. Then, it progresses to the step which attached | subjected code | symbol S109.
Reference numeral S109 is a step of erasing the display of the target display 33. Then, it progresses to the step which attached | subjected code | symbol S110.
Reference numeral 110 denotes an end step, and the processing here ends.
Although not specifically shown in FIG. 10, an operation (for example, an operation) of moving the object (icon or the like) 30 in the direction of the target display 33 while being touched with the first finger 31 in the step of S <b> 106. If the first finger 31 has left the screen before it is detected, the process immediately proceeds to the step marked S109. In this case, the object (icon or the like) 30 is not moved to the target display 33 position.

FIG. 11 is a diagram illustrating an example in which an object to be moved is applied to a window on a screen of a PC or the like in the electronic apparatus according to the embodiment.
In this embodiment, the movement of the object (icon etc.) 30 is applied to a window of a display screen such as a PC.
Reference numeral 71 denotes a displayed window, and reference numeral 72 denotes a window whose size is changed.
For example, the lower left corner (symbol 71a) of the displayed window 71 is treated as equivalent to the object (icon etc.) 30 and the user is displayed on the display screen (display) 61 with the first finger in the same manner as described above. While touching the lower left corner 71a of the window 71, the display screen (display) 61 is touched with a second finger to display a target display (not shown) as the position to which the lower left corner 71a of the window 71 is moved. The second finger touching the display screen (display) 61 is moved while viewing the screen to adjust the target display position.

  When the second finger is moved (moving in the direction of the movement destination) as described above, the lower left corner 71a of the window 71 moves to the target display position, as shown in the figure. To the lower left corner (reference numeral 71b) of the window 72.

In this embodiment, the window size is changed from the window 71 to the window 72 in accordance with the movement from 71a to 71b.
By configuring in this way, in this embodiment, the present invention can be applied to changing the size of the window.
FIG. 12 is a diagram illustrating an example in which an object to be moved is applied to a straight line in the electronic apparatus according to the embodiment.
In this embodiment, the movement of the object (icon or the like) 30 is applied to the creation of a straight line, for example.
Reference numeral 73 is a straight line to be created.
Reference numeral 81a is the start point of the straight line to be created, and reference numeral 81b is the end point of the straight line 73 to be created.
For example, the start point 81a of the straight line 73 to be created is treated as equivalent to the object (icon or the like) 30, and the second touching the start point 81a of the straight line 73 to be created with the first finger is performed as described above. The display screen (display) 61 is touched with a finger to display the target display as the end point 81b of the straight line 73 to be created (not shown), and the second finger touching the display screen (display) 61 is moved. , Adjust the display position of the target.

Then, a straight line 73 is created by performing the action of putting the second finger on (the action of moving in the direction of the movement destination) in the same manner as described above.
With this configuration, this embodiment can also be applied to the creation of a straight line.
In the above embodiment, a notebook type personal computer is used as an electronic device. However, this embodiment is not limited to this, and a large display such as a portable device or a TV smaller than the personal computer is used. The present invention can also be applied to a device having a screen, a car navigation device, a remote controller used for a TV, and the like.

  Further, the user's operation does not necessarily have to be performed with a finger, as long as the position of the object on the display screen and an arbitrary position on the display screen can be designated. Or you may operate with the finger of both the right hand and the left hand.

  By configuring as described above, in the embodiment of the present invention, when the object displayed on the display screen of the electronic device is moved by touching with the finger, the finger touching the screen is moved over a long distance. It is possible to reduce troublesomeness.

  Note that the above embodiment is not limited to the description itself, and in the implementation stage, the constituent elements can be variously modified and embodied without departing from the spirit of the invention.

  DESCRIPTION OF SYMBOLS 10 ... Electronic device, 17 ... Video | video display part (LCD), 30 ... Object (icon), 31 ... User's finger (1st finger), 32 ... User's finger (2nd finger), 33 ... Target display 51 ... Vector 1, 52 ... Vector 2, 61 ... Display screen (display).

Claims (6)

Display means for displaying a display screen on which the object is displayed;
Detecting means for detecting a first position at which an object displayed on the display screen is designated and a second position designated on the display screen;
An electronic apparatus comprising: a display unit configured to calculate a position where the object moves based on a relative position between the detected first position and second position, and to display a movement destination of the object on the display screen. .   The electronic device according to claim 1, wherein when the second position moves, the display unit moves and displays the movement destination of the object according to the second position.   The detection means further includes means for detecting an action such that the designated object is moved in the direction of the movement destination of the object, and if an action such that the object is moved is detected, The electronic apparatus according to claim 1, wherein the object is displayed by moving to the position of the destination.   The electronic device according to claim 1, wherein the detection unit includes a touch sensor, and the first position and the second position are detected.   The electronic device according to claim 1, wherein the designation of the first position on the display screen and the designation of the second position are designated by a user's finger. Displaying a display screen on which the object is displayed;
Detecting a first position where an object displayed on the display screen is designated and a second position designated on the display screen;
An object display comprising: calculating a position where the object moves based on a relative position between the detected first position and the second position, and displaying a movement destination of the object on the display screen. Method.

Images