JP5510008B2 - Mobile terminal device - Google Patents

Description

  The present invention relates to a mobile terminal device such as a mobile phone or a game machine.

  As is well known, it is difficult for a portable terminal device such as a mobile phone or a game machine to have a large display unit from the viewpoint of maintaining portability. For this reason, recently, the mobile terminal device can provide more visual information to the user by including a plurality of display units.

  However, in the conventional portable terminal device, for example, when two display units are provided, when an object displayed on one display unit is moved to the other display unit and displayed, both display units are physically separated. Therefore, there are problems such as complicated operation for the user to move the object freely, or operation that is difficult to understand intuitively (for example, see Patent Document 1).

JP 2004-280319 A

  The present invention has been made to solve the above problem, and an object thereof is to provide a portable terminal device capable of moving and displaying an object between a plurality of display units with a simple and intuitive operation. And

In order to achieve the above object, the present invention provides a first display input comprising first display means for displaying an image and first input means for detecting a position operated with respect to the first display means. A second display input means comprising: means; a second display means for displaying an image; and a second input means for detecting a position operated with respect to the second display means; and detection of the first input means. Based on the result, target designation means for designating a drawing object displayed on the first display means as a target, position receiving means for accepting designation of the position of the second display means through the second input means, and the drawing object target specifying means has specified as the target, and a display control means for displaying the position of the second display means the position accepting unit receives, accepts on operation by the user The position receiving means includes the second display means through the second input means in a state in which the third input means is turned on after the target receiving means receives the instruction. The specification of the position of was accepted .

As described above, in the present invention, an instruction for designating a drawing object displayed on the first display means is accepted, and a designation of the position of the second display means is accepted, and the drawing object is received by the second display means. It is displayed at the position.
Therefore, according to the present invention, it is possible to provide a mobile terminal device capable of moving and displaying an object between a plurality of display units with a simple and intuitive operation.

The figure which shows the external appearance of one Embodiment of the portable terminal device concerning this invention. The circuit block diagram which shows the structure of the portable terminal device shown in FIG. The flowchart for demonstrating operation | movement of the portable terminal device shown in FIG.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
The mobile terminal device according to an embodiment of the present invention is, for example, a mobile phone, a PDA (Personal Digital Assistants), a portable game machine, and the like. In the following description, a mobile phone is taken as an example.

  FIG. 1 shows the appearance of a mobile phone according to an embodiment of the present invention. That is, this mobile phone is a foldable mobile phone having a structure in which the first housing 1 and the second housing 2 are rotatably connected by the hinge 3. Here, a folding mobile phone as shown in FIG. 1 is described as an example, but a mobile phone that is slidable or a mobile phone that does not have a deforming mechanism may be used.

  FIG. 2 is a block diagram showing a configuration of the mobile phone shown in FIG. As shown in this figure, the main components are a wireless communication unit 10, a display input unit 20, a call unit 30, an operation unit 40, a camera unit 41, a storage unit 50, and an infrared communication unit 60. A wireless communication function including a GPS receiving unit 70, a motion sensor unit 80, a power supply unit 90, and a main control unit 100, and performing mobile wireless communication via the base station device BS and the mobile communication network NW as main functions. Is provided.

  The radio communication unit 10 performs radio communication with the base station apparatus BS accommodated in the mobile communication network NW according to the instruction of the main control unit 100, and thereby transmits and receives voice data, e-mail data, etc. Web data and streaming data are received.

  Under the control of the main control unit 100, the display input unit 20 displays images (still images and moving images), character information, etc., visually transmits information to the user, and detects user operations on the displayed information. A so-called touch panel, which includes a first touch panel 21 and a second touch panel 22.

  The first touch panel 21 includes a display panel 21a such as an LCD (Liquid Crystal Display) and an operation panel 21b. Similarly, the second touch panel 22 includes a display panel 22a such as an LCD and an operation panel 22b. For example, as shown in FIG. 1, the first touch panel 21 is mounted on the first housing 1, and the second touch panel 22 is mounted on the second housing 2.

  The operation panels 21b and 22b are made of a transparent material capable of visually recognizing images displayed on the display panels 21a and 22a, placed on the display surfaces of the display panels 21a and 22a, and operated by a user's finger or stylus It is a device for detecting the coordinates. The detection signal detected by this device is output to the main control unit 100, and the main control unit 100 detects the operated position (coordinates) on the display panel 21a or 22a based on the detection signal. As the position detection method employed in the operation panels 21b and 22b, there are a matrix switch method, a resistive film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, a capacitance method, etc. Good.

  The call unit 30 includes a speaker 31 and a microphone 32, converts user's voice input through the microphone 32 into voice data that can be processed by the main control unit 100, and outputs the voice data to the main control unit 100, or a wireless communication unit. 10 or the audio data received by the infrared communication unit 60 is decoded and output from the speaker 31. For example, as shown in FIG. 1, the speaker 31 is mounted on the first housing 1, and the microphone 32 is mounted on the second housing 2.

  The operation unit 40 is a hardware key using a key switch or the like, and receives an instruction from the user through this. For example, as shown in FIG. 1, it is mounted in the vicinity of the second touch panel 22 of the second housing 2 and is turned on when pressed with a finger or the like, and turned off by a restoring force such as a spring when the finger is released. It is a button type switch.

  The camera unit 41 is a digital camera that performs electronic photography using an imaging element such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge-Coupled Device), and image data obtained by imaging under the control of the main control unit 100. Is converted into compressed image data such as JPEG (Joint Photographic coding Experts Group) and recorded in the storage unit 50 described later. For example, as shown in FIG. 1, it is mounted in the vicinity of the first touch panel 21 of the first housing 1.

  The storage unit 50 includes a control program and control data of the main control unit 100, application software, address data that associates the name and telephone number of the communication partner, transmitted / received e-mail data, Web data downloaded by Web browsing, The downloaded content data is stored, and streaming data and the like are temporarily stored. The storage unit 50 includes one or more storage units such as an HDD, a RAM, a ROM, and an IC memory.

  The infrared communication unit 60 performs infrared communication with an opposite device (for example, another mobile phone MS) having an infrared communication function, and is set for operation by the main control unit 100 and transmitted from the main control unit 100. Data is transmitted by infrared light, or data transmitted by infrared light from the opposite device is received, and this is output to the main control unit 100 as received data.

  The GPS receiving unit 70 receives GPS signals transmitted from GPS (Global Positioning System) satellites ST1 to STn in accordance with instructions from the main control unit 100, and executes positioning calculation processing based on the received plurality of GPS signals. Detects position information including the latitude, longitude, and altitude of the mobile phone.

The motion sensor unit 80 includes, for example, a triaxial acceleration sensor, and detects the physical movement of the mobile phone according to an instruction from the main control unit 100. Thereby, the moving direction and speed of the mobile phone are detected. This detection result is output to the main control unit 100.
The power supply unit 90 supplies power stored in a battery (not shown) to each unit of the mobile phone in accordance with an instruction from the main control unit 100.

  The main control unit 100 includes a microprocessor, operates according to a control program and control data stored in the storage unit 50, and controls each part of the mobile phone in an integrated manner. In order to perform communication and data communication, a mobile communication control function for controlling each part of the communication system and an application processing function are provided.

  The application processing function is realized by the main control unit 100 operating in accordance with application software stored in the storage unit 50. For example, infrared communication that controls the infrared communication unit 60 to perform data communication with the opposite device. There are functions, e-mail functions for sending and receiving e-mails, and web browsing functions for browsing web pages.

  The main control unit 100 also has an image processing function for displaying video on the display input unit 20 based on image data (still image data or moving image data) such as received data or downloaded streaming data. In this image processing function, the main control unit 100 decodes the image data, performs image processing on the decoding result, and displays an image on the display input unit 20.

  The main control unit 100 detects display control on the display panels 21a and 22a and user operations through the operation unit 40, the first touch panel 21, and the second touch panel 22, and performs various control operations according to the operations. .

  For example, the main control unit 100 treats the display area of the display panel 21a and the display area of the display panel 22a as a continuous display area, virtually displays a desktop, and displays a plurality of icons on the desktop. The operation on the icon is accepted by a single operation on the operation unit 40, the first touch panel 21 and the second touch panel 22, or a combined operation.

  In addition, the main control unit 100 detects a gesture operation on the first touch panel 21 or the second touch panel 22 and executes a preset function in accordance with the detected gesture operation. Gesture operation is not a conventional simple touch operation, but an operation that draws a trajectory with a finger or the like, designates a plurality of positions at the same time, or combines these to draw a trajectory for at least one of a plurality of positions. means.

  Next, the operation of the mobile phone configured as described above will be described. In the following description, an operation in a case where a drawing object displayed on the first touch panel 21 (or the second touch panel 22) is moved to the second touch panel 22 (or the first touch panel 21) and displayed will be described. This operation is realized by the main control unit 100 executing the process shown in FIG. 3, and the mobile phone is turned on and receives input through the first touch panel 21 and the second touch panel 22. When it reaches the state, it is executed repeatedly. The control program and control data for the process shown in FIG. 3 are stored in the storage unit 50.

  First, in step 3a, the main control unit 100 determines whether a touch operation is being performed on the first touch panel 21 or the second touch panel 22 based on the detection result of the operation panel 21b or 22b. Here, when a detection signal is given from the operation panel 21b or 22b and it is determined that a touch operation is being performed, the process proceeds to step 3b, while no detection signal is given and the touch operation is being performed. If it is determined that there is not, the process proceeds to step 3a and the above determination is performed again.

  In step 3b, the main controller 100 detects the touch-operated coordinates based on the detection signal given in step 3a, and proceeds to step 3c. Note that the coordinates detected here include information for identifying which one of the first touch panel 21 and the second touch panel 22 is operated.

  In step 3c, the main control unit 100 determines whether or not a drawing object is displayed at the coordinates detected in step 3b. Here, if it is detected that the drawing object is displayed at the above-mentioned coordinates, the process proceeds to step 3d. On the other hand, if it cannot be detected, the process proceeds to step 3a. At this time, if the touch operation detected in step 3a has been completed, that is, if the touch operation has not been continued, the process proceeds to step 3a.

  In step 3d, the main control unit 100 determines whether or not the operation unit 40 (hardware key) has been pressed. Here, when the operation unit 40 is pressed, the process proceeds to step 3e. On the other hand, when the operation unit 40 is not pressed, the process proceeds to step 3a. At this time, if the touch operation detected in step 3a has been completed, that is, if the touch operation has not been continued, the process proceeds to step 3a.

  In step 3e, the main control unit 100 sets the drawing object having the coordinates detected in step 3b, that is, the drawing object detected in step 3c, as a target for changing the display position, and proceeds to step 3f. As a result, the drawing object (target) is in the hold state.

  In step 3f, the main control unit 100 determines whether or not the touch operation detected in step 3a is released while the operation unit 40 is being pressed. Here, when it is detected that the touch operation detected in Step 3a has been released while the operation unit 40 is being pressed, the process proceeds to Step 3h, while in other cases, that is, the touch operation. If is not released, or if the pressing of the operation unit 40 is released before the touch operation is released, the process proceeds to step 3g.

  In step 3g, the main control unit 100 determines whether or not the pressing of the operation unit 40 has been released. Here, when the pressing of the operation unit 40 is released, the process proceeds to step 3l. On the other hand, when the pressing of the operation unit 40 is not released, the process proceeds to step 3f.

  In step 3h, the main control unit 100 determines whether a touch operation is being performed on the first touch panel 21 or the second touch panel 22 based on the detection result of the operation panel 21b or 22b. Here, when a detection signal is given from the operation panel 21b or 22b and it is determined that a touch operation is being performed, the process proceeds to step 3i. On the other hand, no detection signal is given and the touch operation is being performed. If it is determined that there is not, the process proceeds to step 3k.

  In step 3i, the main control unit 100 detects the touched coordinates based on the detection signal given in step 3h, and proceeds to step 3j. Note that the coordinates detected here include information for identifying which one of the first touch panel 21 and the second touch panel 22 is operated.

  In step 3j, the main control unit 100 displays the drawing object set as the target at the coordinates detected in step 3i instead of the current display position, and proceeds to step 3k. Thereby, for example, when the coordinates detected in step 3b are the coordinates on the first touch panel 21, and the coordinates detected in step 3j are the coordinates on the second touch panel 22, the drawing object as the target is The first touch panel 21 is moved to the second touch panel 22 and displayed.

In step 3k, the main control unit 100 determines whether or not the pressing of the operation unit 40 is released. Here, when the pressing of the operation unit 40 is released, the process proceeds to step 3l. On the other hand, when the pressing of the operation unit 40 is not released, the process proceeds to step 3h.
In step 3l, the main control unit 100 cancels the target setting set in step 3e, and proceeds to step 3a.

  As described above, in the mobile phone configured as described above, a drawing object to be moved (target) is designated by an operation in which the touch operation and the hardware key (operation unit 40) are combined, and then the destination is moved by the touch operation. By specifying the position, the drawing object is displayed at the destination.

  Therefore, according to the mobile phone configured as described above, a drawing object can be accurately moved to a target position and displayed between a plurality of touch panels with a simple and intuitive operation.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. Further, for example, a configuration in which some components are deleted from all the components shown in the embodiment is also conceivable. Furthermore, you may combine suitably the component described in different embodiment.

  As an example, for example, in the above-described embodiment, the drawing object to be moved is set as a target by combining the touch operation and the hardware key (operation unit 40), but is set by other actions. You may do it.

  For example, using a multi-touch type device capable of sensing multipoint input as the operation panels 21b and 22b, the user can use two fingers to draw a drawing object that the user wants to move on the operation panel (21b or 22b). The main control unit 100 determines from the detection signal of the operation panel 21b or 22b that the “pinch” operation has been performed.

  Specifically, the main control unit 100 sets a target for a drawing object that exists between the directions in which the two detection points move. In addition, the main control unit 100 detects a tap operation, a double-click operation, a continuous contact operation for 1 second or more from the detection signal, and sets the operated drawing object as a target. It may be.

  In the above embodiment, the target setting is prevented from being released by holding down the hardware key (operation unit 40) after the drawing object is set as the target in step 3e. Instead of this, for example, once the target is set, even if the operation on the hardware key (operation unit 40) is finished, the target set state is maintained (held) and the coordinate input of the movement destination is waited and touched. When an operation is performed, the target may be moved to that position and displayed.

  That is, the hold may be maintained without pressing the hardware key (operation unit 40). When holding target settings in this way, special operations (such as the “pinch” operation, tap operation, double-click operation, and continuous contact operation of 1 second or more) are used to distinguish them from other operations. You may make it set.

  In addition, a tunnel entrance icon (or a warp entrance icon) indicating an entrance leading to the second touch panel 22 (or the first touch panel 21) is displayed on the first touch panel 21 (or the second touch panel 22). On the two touch panel 22 (or the first touch panel 21), a tunnel exit icon (or warp exit icon) indicating an exit from the tunnel entrance icon (or warp entrance icon) is displayed.

  When the drawing object to be moved is dragged and superimposed on the tunnel entrance icon (or warp entrance icon), the main control unit 100 detects this operation and draws the overlay on the tunnel entrance icon (or warp entrance icon). Erase the object and display it on the tunnel exit icon (or warp exit icon). Also by such processing, the drawing object can be accurately moved to a target position between a plurality of touch panels and displayed. Note that on one touch panel (21 or 22), the tunnel entrance icon (or warp entrance icon) and the tunnel exit icon (or warp exit icon) may be combined with one icon.

  In the above-described embodiment, it is described that the touch operation is determined in step 3a and then the pressing of the hardware key is detected in step 3d. However, in addition to or instead of this, for example, by touch operation Alternatively, the target may be set by detecting a hardware key press first. That is, the order of Steps 3a to 3c and Step 3d may be changed, and the pressing of the hardware key is detected in a state where no touch operation is detected (corresponding to Step 3d), and then the drawing object is displayed. When a touch operation on coordinates is detected (steps 3a to 3c), the drawing object may be set as a target.

  Furthermore, although the first touch panel 21 and the second touch panel 22 have been described as being provided on one device, they may be provided on each of two different devices. In this case, in the device A that includes a wireless communication unit (a short-range wireless communication unit such as infrared communication or Bluetooth (registered trademark)) in which the two devices communicate with each other wirelessly and the drawing object to be moved exists, FIG. Perform the indicated process.

  However, when step 3h is reached, apparatus A notifies apparatus B as the movement destination that it is waiting for the designation of the movement position by wireless communication, and apparatus B that has received this notification detects step 3h. As a process corresponding to the above, position designation by a touch operation is detected, and the detection result is returned to the apparatus A.

  In the device A, in step 3i, the data of the drawing object is transmitted to the device B through the wireless communication unit, and the device B receives the data by the wireless communication unit included in the device, and the position detected in the step 3h Displays drawing objects based on the data. As described above, even when two touch panels are mounted on different devices, a drawing object can be transmitted by communicating between the two touch panels.

In the above embodiment, the touch panel has been described as an example, but a user operation may be detected by a proximity sensor that does not require contact.
Also, when the result of step 3f is Yes and the drawing object to be moved is confirmed, the main control unit 100 uses the detection result of the motion sensor unit 80, and the drawing object is higher in accordance with the inclination of the posture. It may be moved so that it flows downward, and when it becomes horizontal, the movement is stopped and the drawing object is kept at that position and displayed. That is, the position of the movement destination may be specified by the posture of the mobile phone.
In addition, it goes without saying that the present invention can be similarly implemented even if various modifications are made without departing from the gist of the present invention.

  DESCRIPTION OF SYMBOLS 1 ... 1st housing | casing, 2 ... 2nd housing | casing, 3 ... Hinge, 10 ... Wireless communication part, 20 ... Display input part, 21 ... Touch panel, 21b ... Operation panel, 21a ... Display panel, 22 ... Touch panel, 22b ... Operation panel, 22a ... display panel, 30 ... communication unit, 31 ... speaker, 32 ... microphone, 40 ... operation unit, 41 ... camera unit, 50 ... storage unit, 60 ... infrared communication unit, 70 ... GPS receiver unit, 80 ... Motion sensor unit, 90 ... power supply unit, 100 ... main control unit, BS ... base station device, MS ... mobile phone, NW ... mobile communication network, ST1-STn ... GPS satellite.

Claims (3)

A first display input means comprising a first display means for displaying an image and a first input means for detecting a position operated with respect to the first display means;
A second display input means comprising: a second display means for displaying an image; and a second input means for detecting a position operated with respect to the second display means;
Target designating means for designating a drawing object displayed on the first display means as a target based on a detection result of the first input means;
Position accepting means for accepting designation of the position of the second display means through the second input means;
Display control means for displaying the drawing object designated as the target by the target designation means at the position of the second display means accepted by the position acceptance means ;
A third input means for receiving an ON operation from the user;
With
The position accepting means accepts designation of the position of the second display means through the second input means in a state where the third input means is turned on after the target accepting means accepts the instruction < A portable terminal device characterized by the above. A first display input means comprising a first display means for displaying an image and an input means for detecting a position operated with respect to the first display means;
Second display means for displaying an image;
Attitude detection means for detecting the attitude;
Target designation means for designating a drawing object displayed on the first display means based on the detection result of the first input means;
Display control means for displaying a drawing object designated as a target by the target designation means at a position of the second display means according to a detection result of the posture detection means ;
A third input means for receiving an ON operation from the user;
With
The position accepting means accepts designation of the position of the second display means through the second input means in a state where the third input means is turned on after the target accepting means accepts the instruction < A portable terminal device characterized by the above. When the first input unit detects an operation of pinching a drawing object displayed on the first display unit with the finger, the target designating unit specifies a drawing object as a target of the pinching operation. the portable terminal device according to claim 1 or claim 2, characterized in that.

Images