JP6166961B2 - mobile computer - Google Patents

Description

  The present invention relates to a mobile terminal equipped with a display. In particular, the display position on a display such as map information in which display elements are two-dimensionally arranged can be easily performed without performing detailed operations such as touch operations and key operations. It relates to mobile terminals that can be selected.

  The performance of smartphones has improved dramatically, and usage forms as an alternative terminal for personal computers are increasing. However, a portable small information terminal (mobile terminal) typified by a smartphone is forced to perform an input operation with a small number of physical keys and a touch panel operation, so that the operation is complicated and erroneous input is likely to occur.

  In Patent Document 1, in order to efficiently search for target destination information from an address book in which a large number of destination information is registered, by inputting not only the first character of the name to be searched but also the second character, A technique for narrowing down a search target in advance is disclosed.

  Patent Document 2 discloses a technique in which an acceleration sensor or a gyro sensor is provided in a control unit body of a game machine, and data generated from the acceleration sensor or the gyro sensor is output as operation data.

  Patent Document 3 discloses a technique in which an acceleration sensor or gyro sensor is provided in a control unit body of a game machine, and data generated from the acceleration sensor or gyro sensor is output as the position and orientation of the control unit.

JP 11-163999 A JP 2007-83013 A JP 2007-313354 A

  In Patent Document 1, the first character and the second character of the name to be searched must be keyed, so the mobile terminal such as a smartphone that is small and equipped with only a small number of physical keys and touch keys has poor operability. There was a technical problem that input is likely to occur.

  In Patent Documents 2 and 3, although various operation data can be input to the game machine by an operation that causes the controller of the game machine to change acceleration or posture, the game player visually indicates the result of the operation on the controller. There is no need to confirm, but it can be confirmed on a separate monitor. That is, in Patent Documents 2 and 3, even if a large acceleration or posture change is applied to the controller, the monitor that reflects the operation content is always in a fixed state, so there is no restriction on the acceleration or posture change applied to the controller. .

  On the other hand, in a mobile terminal such as a smartphone, the terminal user must operate the terminal body while confirming the display content on the display. Therefore, an operation that causes the display to be out of view, an operation that causes the display to move at high speed and makes it difficult to read text or the like, or an operation that causes the display to tilt and makes it difficult to read text or the like must be excluded.

  An object of the present invention is to solve the above technical problem and to provide a mobile terminal that can easily select information on a small display of the mobile terminal according to the moving direction and moving distance of the mobile terminal.

  In order to achieve the above object, the present invention is characterized in that the following specific features of the invention are provided in a mobile terminal equipped with a display.

  (1) Information storage means for storing two-dimensional display information, movement detection means for detecting movement of the mobile terminal, and the relative position between the mobile terminal and the two-dimensional display information virtually arranged opposite to the mobile terminal Position estimation means for estimating movement based on the detection result of movement, and display control means for displaying a corresponding area of two-dimensional display information observed through the mobile terminal virtually at the relative position on the display. .

  (2) The display control means includes display magnification control means for controlling the display magnification of the corresponding area according to the virtual distance between the mobile terminal and the two-dimensional display information.

(3) Display magnification control means, if the mobile terminal is a convex lens having an optical axis perpendicular to the front and back direction, the observation magnification of the virtual image observed through the mobile terminal is two-dimensional display information and the mobile terminal The display magnification is controlled by simulating the movement that changes according to the virtual distance.

  (4) When the movement of the mobile terminal in the surface direction is detected, the position estimation means is connected to the mobile terminal and the two-dimensional display information until the movement is detected until the movement is detected. The relative position with was fixed.

  (5) The display has a touch sensor function, and the position estimation means is a relative position between the mobile terminal and the two-dimensional display information even if the movement detection means detects the parallel movement of the mobile terminal when the display is touched. Was fixed.

  (6) The display control means reduces the display magnification when the start of parallel movement of the mobile terminal is detected, and returns the display magnification to the magnification before the start of parallel movement when the completion of this parallel movement is detected. .

  According to the present invention, the following effects are achieved.

  (1) Since it becomes possible to select the display position and display magnification of the two-dimensional display information just by moving the mobile terminal, especially in mobile terminals that can not provide a large input device such as smartphones and tablet terminals, The information selection operation can be performed accurately and easily.

(2) Since the display magnification can be adjusted by adjusting the virtual distance with the two-dimensional display information virtually arranged in parallel on the back side of the mobile terminal, the display magnification can be adjusted by an intuitive operation.

  (3) Since the display magnification is adjusted according to an operation in which the mobile terminal is regarded as an magnifying loupe (convex lens), the display magnification can be adjusted by the same operation as the magnifying loupe.

  (4) When acceleration exceeding a predetermined reference value or simple touch operation is detected, the relative position between the mobile terminal and the two-dimensional display information is maintained regardless of the movement of the mobile terminal. The mobile terminal can be moved while maintaining the relative position with the display information, and the movement space of the mobile terminal can be easily secured.

  (5) The display magnification is lowered while the movement of the mobile device is detected, but is restored after the movement of the mobile terminal is completed (the display magnification is increased). The disadvantage that the moving amount of the display position becomes smaller than the moving amount of the smartphone can be solved.

It is the block diagram which showed the structure of the principal part of the smart phone to which this invention is applied. It is the figure which showed the virtual positional relationship of a smart phone and two-dimensional display information. It is the figure which showed the control method of display magnification. It is the figure which showed the control method of the display magnification according to the virtual distance of a smart phone and two-dimensional display information. It is the figure which showed an example of the method of the map search with the smart phone to which invention is applied. It is the figure which showed an example of the method of the map (photograph data arrange | positioned on the top) by the smart phone which applied invention. It is the figure which showed an example of the method of the address book search by the smart phone to which invention is applied. It is the figure which showed the method of the icon / thumbnail search by the smart phone to which invention is applied. It is the figure which showed the method (the 1) which translates a smart phone, maintaining the relative position of a smart phone and two-dimensional display information. It is the figure which showed the method (the 2) which translates a smart phone, maintaining the relative position of a smart phone and two-dimensional display information. It is the figure which showed the method of automatically controlling the magnification of 2D display information according to the movement state of a smart phone.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a functional block diagram showing a configuration of a main part of a mobile terminal according to an embodiment of the present invention. Here, illustration of components unnecessary for the description of the present invention is omitted.

  In the present embodiment, a smartphone is assumed as the mobile terminal, and the movement detection unit 1 detects the movement of the smartphone SP based on the acceleration generated in the smartphone SP. In the present embodiment, the movement detection unit 1 includes the acceleration sensor 1a, and the movement direction and the movement amount of the smartphone SP are detected based on the triaxial acceleration. In addition to the acceleration sensor 1a, an electronic compass 1b and a proximity sensor 1c may be provided, and the movement direction and the movement amount may be detected using the sensors 1a, 1a, and 1c together.

  The information storage unit 4 stores information (two-dimensionally displayed on the display 5 of the smartphone SP, such as map information, newspapers, magazines, address books, and icons and thumbnails of various information (applications, still image files, moving image files, etc.). Dimension display information) is stored. As schematically illustrated in FIG. 2, the position estimation unit 2 determines the relative position between the smartphone SP and the two-dimensional display information I that is virtually disposed opposite to the smartphone SP in the movement direction and the movement amount. Estimate based on the detection result.

  The display control unit 3 includes a display magnification control unit 3a, and displays an image of a corresponding region of the two-dimensional display information I observed through the smartphone SP virtually at the relative position. The display magnification control unit 3a controls the display magnification of the corresponding region image based on the virtual distance between the smartphone SP and the two-dimensional display information I. In the present embodiment, the display magnification of the corresponding area image is increased as the virtual distance between the smartphone SP and the two-dimensional display information I increases.

For example, as shown in FIG. 3, the display magnification control of the display magnification control unit 3a is performed by transmitting the mobile terminal at the relative position if the smartphone SP is a convex lens OL having an optical axis A perpendicular to the front and back direction. This can be realized by simulating a movement in which the observation magnification of the virtual image that will be observed in accordance with the virtual distance changes.

  FIG. 4 is a diagram schematically showing the function of the display magnification control unit 3a. FIG. 4A shows the virtual two-dimensional display information I moved in parallel by moving the smartphone SP in the direction of the back surface. FIG. 5B shows the control when the smartphone SP is translated from the front direction and separated from the virtual two-dimensional display information I. FIG.

  In the present embodiment, the magnification control is performed by regarding the smartphone SP as a convex lens OL having an optical axis perpendicular to the front and back directions. Therefore, the smartphone SP is translated in the rear direction, and the convex lens OL is moved to the two-dimensional display information I. If the movement approaching is simulated, the magnification of the virtual image displayed on the display 5 increases as shown in FIG. On the other hand, if the smartphone SP is translated in the front direction and the operation of separating the convex lens OL from the two-dimensional display information I is simulated, the virtual image displayed on the display 5 as shown in FIG. The enlargement rate of becomes low.

The display magnification control simulating such a convex lens detects the amount of movement of the smartphone SP in the optical axis direction by the movement detection unit 1 and calculates the virtual distance from the virtual two-dimensional array image I. This can be realized by applying the change in the size of the virtual image as the display magnification by applying the formula of the convex lens.

  FIG. 5 is a diagram showing a basic observation method of the two-dimensional display information I by the smartphone SP to which the present invention is applied. Here, map observation will be described as an example.

  When the user moves the smartphone SP in the right direction from the initial display state in FIG. 5E, the movement detection unit 1 detects the movement direction and the movement amount. The position estimation unit 2 estimates the relative position between the moved smartphone SP and the two-dimensional display information I based on the movement direction and the movement amount. In the display control unit 3, based on the relative position estimation result, the map display position moves to the right as shown in FIG. Further, when the user moves the smartphone leftward from the display state of FIG. 9E, the display position of the map moves leftward as shown in FIG. When the user moves the smartphone in the vertical direction from the display state shown in FIG. 5E, the map display position moves in the vertical direction (not shown).

  On the other hand, when the user moves the smartphone SP forward from the display state of FIG. 5E, in other words, when the smartphone SP is separated from the map virtually arranged in parallel on the back side of the smartphone SP, the movement is performed. The direction and amount of movement are detected by the movement detector 1. The position estimation unit 2 estimates the relative position between the moved smartphone SP and the two-dimensional display information I based on the movement direction and the movement amount. In the display control unit 3, based on the relative position estimation result, the display magnification on the display 5 is increased by the display magnification control unit 3a as shown in FIG.

  On the other hand, when the user moves the smartphone in the heel direction, in other words, when the smartphone SP is brought close to a map virtually arranged in parallel on the back surface side of the smartphone SP, the movement direction and the movement amount are changed as described above. It is detected by the detection unit 1. The position estimation unit 2 estimates the relative position between the moved smartphone SP and the two-dimensional display information I based on the movement direction and the movement amount. In the display control unit 3, based on the relative position estimation result, the display magnification on the display 5 is lowered by the display magnification control unit 3a as shown in FIG.

  When the smartphone SP is moved in the left front direction, the left direction movement and the front direction movement are detected at the same time, so as shown in FIG. Control is realized at the same time. Similarly, when the smartphone is moved to the starboard direction, the rightward movement and the movement to the saddle direction are detected at the same time, so as shown in FIG. Control is realized at the same time.

  As described above, in this embodiment, the desired position on the map can be observed at a desired magnification according to the combination of the moving directions by simply moving the smartphone up and down, left and right, and back and forth (front / back). .

  FIG. 6 is a diagram showing a map observation method using the smartphone SP to which the present invention is applied. In this embodiment, thumbnails such as photographs, coupons, and guidance related to the position are displayed at each position of the map information. Images are embedded and displayed in advance.

  At the start of observation, as shown in FIG. 5A, the relative position between the smartphone SP and the map M is set to a predetermined reference position or a position at the end of the previous observation, and the display 5 shows the relative position. The image information associated with the position is enlarged and superimposed on the map display.

  When the smartphone SP is translated in the right direction from this state, the position of the map display moves to the right according to the amount of movement as shown in FIG. Is enlarged and displayed in a superimposed manner. Furthermore, when the smartphone SP is translated downward from the reference position in FIG. (A), as shown in FIG. (C), the map display position is moved downward according to the amount of movement, The image information associated with the position is enlarged and superimposed.

  FIG. 7 is a diagram showing an example of an address book search operation method using the smartphone SP to which the present invention is applied. In the address book, the registrant's destination information and the like are grouped into “a” line, “ka” line, “sa” line, etc. based on the reading of the name. Sorted in order. Here, the description starts from a state in which the registrant of the group in the “NA” row is referenced.

  As shown in (a) of the figure, when the smartphone is translated downward from the state where the address card C1 of “Nakamura Manaka” is displayed, the address card that is selectively displayed based on the acceleration is displayed. It progresses in the order of the Japanese syllabary, and the display switches to the display of the address card C2 of “Manami Nakamura” as shown in FIG.

  Although illustration is omitted, when the smartphone is translated upward from the state where the address card C1 of “Nakamura Manaka” is displayed [(a)], the address is based on the acceleration. The card retreats with 50 sounds and switches to the display of the address card “Mana Nakamura”.

  On the other hand, when the smartphone is translated in the right direction from the state where the address card C1 of “Nakamura Manaka” is displayed [FIG. (A)], according to the acceleration at that time, (c) in FIG. As shown, the group to be selected and displayed is switched from “Na Line” to “Ha Line”, and here, the address card C3 of “Hamura Manami” is displayed. At this time, if the acceleration at the time of movement is large, it is possible to move to the “ma” line or the “ya” line at a stretch.

  Although not shown, when the smartphone is translated in the left direction from the state where the address card C1 of “Nakamura Manaka” is displayed [FIG. ”Line to the previous“ ta ”line.

  Furthermore, when the address card of “Nakamura Manaka” is displayed [Fig. (A)], moving the smartphone towards the user, as shown in Fig. (D), the magnifier is displayed. A part of the address card C1, for example, a display portion of a telephone number or an e-mail address is enlarged and displayed so as to be enlarged and observed away from the address card C1.

  The number of addresses sent and returned depends on the amount of movement of the smartphone SP and the acceleration at the time of movement, and the amount of advance / return increases as the amount of movement increases or the acceleration increases. In other words, if the smartphone SP is quickly moved at a large acceleration, the number of feed / return can be increased even with a small amount of movement.

  FIG. 8 is a diagram showing an information selection method using the smartphone SP to which the present invention is applied. In this embodiment, a desired icon or the like is selected from a number of two-dimensionally arranged icons and thumbnails. The

  When the smartphone is translated downward from the reference position shown in FIG. 11 (a), the icons to be selected and displayed advance in the order of arrangement in the same column based on the acceleration, and the display shown in FIG. Switch to display. In addition, when the smartphone is translated in the right direction from the reference position shown in (a) in the figure, the icons to be selected and displayed proceed in the order of arrangement in the same row according to the acceleration at that time, and (c) in the figure. Switches to the display shown in.

  By the way, when magnifying and magnifying a newspaper or the like with a magnifier, for example, when the magnifier is gradually moved to the right and the observation position is being advanced to the right, the movement limit is exceeded, and no further movement is possible. In this case, the entire paper surface must be moved to the left, and such inconvenience can occur in the information selection according to the present invention.

  In the present invention, as shown in FIG. 9, in order to move the observation position from the reference position in FIG. 9B to the right, the smartphone SP is moved to the limit position in the right direction as shown in FIG. If the observation position is still not enough and the observation position cannot be moved to the right side, move the smartphone SP in parallel to the front side and then move it to the left as shown in Fig. 5 (a). Secure the range of movement to the right.

  When the smartphone SP is moved to the front side with a large acceleration exceeding the reference value, the movement detection unit 1 determines that the movement is not an enlarged display operation but a position movement operation, and the movement is determined to be completed. The movement signal is not output until. As a result, the user can move the smartphone SP in the left direction while maintaining the relative position between the smartphone SP and the two-dimensional display information I, and can secure an operation area in the right direction. . The completion of the movement can be estimated when the acceleration change in the parallel direction falls below a predetermined reference value.

  Instead of moving after lifting the smartphone SP as described above, the movement detection function by the movement detection unit 1 is disabled when the display 5 is touched as shown in FIG. By doing so, you may enable it to move smart phone SP, maintaining the relative position of smart phone SP and two-dimensional display information.

Furthermore, although the display magnification has been described as being controlled based on the virtual distance between the smartphone SP and the two-dimensional display information I in the above embodiment, the present invention is not limited to this, and FIG. As shown in Fig. 2, the display magnification is reduced when movement in the two-dimensional direction with an acceleration exceeding a predetermined reference value is detected, while the display magnification is returned (enlarged) when the completion of movement is detected. Also good. In this way, it is possible to eliminate the inconvenience that the moving amount of the display position becomes smaller than the moving amount of the smartphone SP if the enlarged display is maintained.

  As described above, according to the present embodiment, display selection is possible only by moving the information terminal without performing fine input operations such as screen touch and keyboard operation. In an information terminal that cannot be provided with an input device, an information selection operation can be accurately and simplified.

  DESCRIPTION OF SYMBOLS 1 ... Movement detection part, 1a ... Acceleration sensor, 1b ... Electronic compass, 1c ... Proximity sensor, 2 ... Position estimation part, 3 ... Display control, 3a ... Display magnification control part, 4 ... Information storage part, 5 ... Display

Claims (9)

In a mobile device with a display,
Information storage means for storing two-dimensional display information;
Movement detection means for detecting movement of the mobile terminal and outputting a movement signal;
Position estimation means for estimating a relative position between the mobile terminal and the two-dimensional display information that is virtually opposed to the mobile terminal based on the movement signal;
Display control means for displaying on the display a corresponding region of two-dimensional display information that is virtually transmitted through the mobile terminal and observed at the relative position;
The movement detection means does not output the movement signal until the movement in the parallel direction is completed when the movement of the mobile terminal in the surface direction is detected and the acceleration of the movement is larger than a predetermined reference value. Mobile terminal characterized by.   2. The mobile terminal according to claim 1, wherein the display control means includes display magnification control means for controlling a display magnification of the corresponding area in accordance with a virtual distance between the mobile terminal and the two-dimensional display information.   The mobile terminal according to claim 2, wherein the display magnification control means increases the display magnification of the corresponding area as the virtual distance increases. If the mobile terminal is a convex lens having an optical axis perpendicular to the front and back direction, the display magnification control means is configured so that an observation magnification of a virtual image observed through the mobile terminal at the relative position is observed according to the virtual distance. 4. The mobile terminal according to claim 2, wherein the display magnification of the corresponding area is controlled by simulating the movement that changes. The two-dimensional display information is configured by two-dimensionally arranging character information in the order of 50 sounds,
The mobile terminal according to claim 1, wherein the display control unit displays character information included in the corresponding area on a display. The two-dimensional display information is a map;
The mobile terminal according to any one of claims 1 to 4, wherein the display control means displays a map of the corresponding area on a display.   The mobile terminal according to claim 6, wherein the display control unit superimposes and displays information associated with the map of the corresponding area on the map. The two-dimensional display information is a two-dimensional array of icons and / or thumbnails;
The mobile terminal according to claim 1, wherein the display control unit displays an icon and / or a thumbnail included in the corresponding area.   The display control means reduces the display magnification when the movement detection means detects the start of parallel movement of the mobile terminal, and when the completion of the parallel movement is detected, the display control means changes the display magnification to the magnification before the start of the parallel movement. The mobile terminal according to claim 1, wherein the mobile terminal is returned.