JP6344006B2 - Portable information device, method for reporting object in portable information device, and program for portable information device - Google Patents

Description

  The present invention relates to a portable information device, an object notification method in the portable information device, and a program for the portable information device.

  In recent years, as one of wearable portable information devices, a wristband type portable information device with a display around a wrist has been developed. In such a portable information device, when the display mounting area is provided over the half circumference of the arm, a display area hidden from the arm is generated from the viewpoint of the user, so that the entire display can be viewed at a time. become unable. For this reason, it is raised as a problem that the user cannot grasp the whole image of the display content including the position of the object displayed on the display, and the operability is deteriorated.

  By the way, for example, in Patent Document 1, a driver's hand holding a plurality of vibrators on the steering wheel and holding the gripping portion has a vibration source in the right direction from the left of the gripping portion to the right of the gripping portion. Techniques for navigating by transmitting tactile stimuli such as moving are described. Further, for example, in Patent Document 2, a plurality of vibrators are provided in a vehicle seat, and a plurality of vibration elements corresponding to the moving direction of the host vehicle are vibrated in an order corresponding to the moving direction, thereby indicating the direction of movement to the driver The technology is described.

International Publication No. 2011/071044 JP 2009-031946 A

  As described above, Patent Document 1 and Patent Document 2 describe a technique for giving operation information and the like to a driver using vibration. However, in the portable information device, when the entire image of display contents cannot be grasped However, an effective improvement method using these techniques has not been obtained.

  The present invention has been made in view of the above circumstances, and it is possible to accurately grasp the position of an object displayed on a display unit that is difficult to visually recognize the whole at a time. An object is to provide a notification method and a program of a portable information device.

A first aspect according to the present invention includes:
Display means having a display part that is difficult to visually recognize the whole at once;
Specifying means for specifying a predetermined object displayed on the display unit by the display means;
Identified by showing the display of the direction of the object specified by the specifying means outside the display area that can be viewed by the user at a time in the display unit in a part of the display area that can be viewed by the user at a time. Informing means for informing the position of the object that has been made ;
A portable information device characterized by comprising:

The second aspect of the present invention is:
Identifying a predetermined object displayed on a display part that is difficult to visually recognize the whole at once;
The object specified by showing a display indicating the direction of the specified object outside the display area visible to the user at a time on the display unit in a part of the display area visible to the user at a time Informing the position of
An object notification method in a portable information device including

The third aspect of the present invention is:
A function for identifying a predetermined object displayed on a display unit that is difficult to see the whole at once,
The object specified by showing a display indicating the direction of the specified object outside the display area visible to the user at a time on the display unit in a part of the display area visible to the user at a time A function to notify the position of
A program for a portable information device is provided.

  According to the present invention, it is possible to provide a portable information device, a method for notifying an object in a portable information device, and a program for the portable information device that can accurately grasp the position of an object displayed on a display unit that is difficult to visually recognize at once. be able to.

It is a figure which shows the external appearance structure of the portable information terminal which concerns on embodiment of this invention. It is a block diagram which shows the internal structure of the portable information terminal which concerns on embodiment of this invention. 3 is a flowchart showing the operation of the first embodiment. 6 is a flowchart showing the operation of the second embodiment. It is the figure which showed on the screen the alerting | reporting form of the specific object in Example 2. FIG.

  DESCRIPTION OF EMBODIMENTS Hereinafter, a mode for carrying out the present invention (hereinafter simply referred to as the present embodiment) will be described in detail with reference to the accompanying drawings. Note that the same numbers or symbols are assigned to the same elements throughout the description of the embodiment.

(Configuration of the embodiment)
Here, as a portable information device according to the present embodiment, a wrist terminal 1 worn on a user's arm is illustrated. A wrist terminal 1 whose appearance is shown in FIG. 1 includes a flexible display device (hereinafter, a curved display device) such as an LCD (liquid crystal) or OLED (organic EL) having a curved image display surface as a display unit 12 on the outside. 120) is implemented. Here, the display surface of the curved display device 120 is mounted over the half circumference of the arm. Therefore, from the user's point of view, a display screen area hidden by the arm is generated, so that the entire display screen can be viewed at a time. I can't.

  In addition, two or more vibration elements 130 (stimulation elements) that transmit vibration stimulation to the user's arm are provided at different positions as the vibration output unit 13 inside the wrist terminal 1. Here, when two vibration stimuli are applied on the skin, the “phantom sensation technique” is used in which the stimuli fuse and perceive vibration at a point between the two points. According to this phantom sensation technique, the position at which vibration is perceived can be changed by controlling the balance of the strengths of the two stimuli.

  FIG. 2 shows an internal configuration of the wrist terminal 1. According to FIG. 2, the wrist terminal 1 includes an operation unit 11, a display unit 12, and a vibration output unit 13 connected to the terminal main body unit 10 as peripheral devices. The terminal main body 10 has a function of specifying a predetermined object displayed on the display unit 12 (curved surface display device 120) that is difficult to visually recognize the whole at once, and an effective screen area of the display unit 12 (curved surface display device 120). Alternatively, a function of notifying the position of the specified object outside the effective screen area is executed.

Here, “effective screen area” means a display area that can be viewed by the user at one time, and “outside the effective screen area” means an area that is difficult to view unless it is hidden by the user's arm and scrolled. And an area virtually existing outside the screen.
An area that exists virtually outside the screen is, for example, an area outside the screen that exists virtually, such as a part that does not fit within the screen when a map is opened on the screen. That is.

  In order to realize the above-described functions, the terminal body unit 10 includes, for example, a control unit 101 incorporating a microprocessor as a control center, and includes a memory 102, a touch panel driver 103, a display driver 104, and a vibration element driver 105. Consists of.

  The memory 102 stores a program of the portable information terminal according to the present embodiment for the terminal main body 10 to realize the above-described function. In addition, a VRAM (Video RAM) area is allocated to a partial area of the memory 102, and image information for at least one screen including the specified object is stored therein. The control unit 101 sequentially reads and executes the program recorded in the memory 102, thereby notifying the position of the object identified by stimulating the user's body surface with the vibration output unit 13 (vibration element 130). The intensity of the stimulus applied to the body surface of the two vibration elements 130 at different positions is controlled so as to change the position felt as the stimulus position. Note that a temperature stimulus using a Peltier element or the like instead of the vibration element 130 may be substituted.

  The control unit 101 may use the display unit 12 (curved surface display device 120) instead of the vibration stimulus or the temperature stimulus described above when notifying the position of the identified object. For example, a reduced display showing the entire image of the display unit 12 (curved surface display device 120) is performed on a part of the effective screen area of the display unit 12 (curved surface display device 120), and the specified object is displayed on the display unit 12 (curved surface display device). 120) may be notified by a reduced display, a display indicating the direction of the object specified in the effective screen area of the display unit 12 may be performed, and further, the display unit 12 A pseudo transparent display of an object outside the effective screen area may be performed in the effective screen area. When the control unit 101 detects a predetermined operation on the notified position, the control unit 101 moves (scrolls) the screen and displays the specified object on the display unit 12 (curved surface display device 120) at a predetermined position (for example, the screen). Control to display in the center). Note that the scrolling can move the screen in any direction, up, down, left, and right.

  The touch panel driver 103 includes control hardware and control software that captures coordinate data when a user touches a touch panel 110 connected to the terminal body 10 as the operation unit 11. The display driver 104 includes control hardware and control software for displaying an image generated by the control unit 101 on the curved display device 120 connected to the terminal main body unit 10 as the display unit 12. The display driver 104 reads out an image stored in a VRAM area allocated to a partial area of the memory 102 in synchronization with the display timing of the display unit 12 (curved surface display device 120), and displays the display unit 12 (curved surface display device 120). To obtain the desired display.

  The vibration element driver 105 includes control hardware and control software for vibrating the vibration element 130 connected to the terminal body 10 as the vibration output unit 13.

  The touch panel 110 is stacked on the curved display device 120, and the touch panel 110 constitutes a touch screen that detects a position touched by a user's finger or the like and inputs coordinate data thereof. A capacitive system or a resistive film system is adopted, but other systems may be used. The curved display device 120 is an output device that displays an image generated by the control unit 101. The vibration element 130 is a stimulation device such as an electric motor that applies vibration stimulation to the body surface of the user. Instead of the vibration element 130, a Peltier element that imparts a thermal stimulus to the user's body surface may be used.

(Operation of the embodiment)
Hereinafter, the operation of the portable information terminal according to the present embodiment will be described in detail for each example. First, the operation of the first embodiment will be described with reference to the flowchart of FIG.

Example 1.
Here, it is assumed that an object for informing the position is specified in advance by setting registration. Examples of objects to be identified (hereinafter also referred to as “specific objects”) include frequently used icons, maps, web pages, and time displays. Further, the destination or current location may be used as the specific object when the map is displayed. The object specification is set by default or can be set by the user. Furthermore, for example, when a mail or the like is received, setting and registration may be performed so that a mail icon is automatically notified as a specific object.

The control unit 101 constantly monitors the touch operation of the touch panel 110 by the user (click operation by tap, scroll operation by drag, etc.).
According to FIG. 3, the control unit 101 acquires location information that is the coordinate position of the specific object set in advance described above (step S101). Then, according to the acquired location information of the specific object, control is performed to cause the vibration element driver 105 to vibrate the vibration element 130 so that the place is perceived (step S102). In this case, the vibration element may be vibrated when the user taps or clicks on the touch panel 110 or touches a specific location on the display screen.

  That is, in step S102, the control unit 101 controls the vibration element 130 to transmit a sensory stimulus such that the position of the specific object is vibrating to the arm, and the effective screen area of the display unit 12 (curved surface display device 120). The position of the object displayed in the area that cannot be recognized from the viewpoint of the user outside is notified.

  Subsequently, when the control unit 101 detects a touch input of the position (the position of the specific object) that vibrates, that is, a touch by the user (“YES” in step S103), the control unit 101 performs the display unit 12 (curved surface display device 120). Screen scroll control is performed, and movement control of the effective screen area is performed so that the position of the notified specific object is at the center (predetermined position) of the effective screen area (step S104). The scroll control is executed when the control unit 101 rewrites the image in the VRAM area assigned to the memory 102. When the position of the specific object is moved by scrolling, the vibration location is also moved following the movement of the image.

According to the first embodiment, for example, a map including the current location is displayed in the effective screen area of the display unit 12 (curved surface display device 120), and the destination is not within the screen, that is, outside the effective screen area. If the destination is set to a specific object in a region virtually existing outside the screen, the position of the display unit 12 (curved surface display device) closest to the destination is perceived in the display screen. The vibration output unit 13 (vibration element 130) is vibrated to make the user perceive.
More specifically, when the destination is virtually present at a position outside the right end of the screen, the position of the right end of the screen is vibrated to allow the user to perceive. Also, at this time, if the destination that is the specific object is far from the screen (effective screen area), weakly vibrate the position of the right edge of the screen, and if close, strongly vibrate the position of the right edge of the screen, You may be made to notify how far the destination is from the effective screen area. Note that the present invention is not limited to vibration intensity. For example, it is possible to express how much the destination, which is a specific object, is out of the effective screen area by changing the rhythm of vibration. is there.

Example 2
The first embodiment includes the vibration output unit 13 (vibration element 130), and the terminal main body unit 10 (notification unit) gives a stimulus to the body surface by the vibration output unit 13 (vibration element 130), so that the position of the specific object is determined. Was informed. In Example 2 described below, notification is performed on the display unit 12 (curved surface display device 120) instead of the vibration output unit 13 (vibration element 130).

  That is, in the second embodiment described below, the vibration output unit 13 (the vibration element 130) and the vibration element driver 105 are not necessary in the internal configuration of the wrist terminal 1 illustrated in FIG. Other configurations are the same as those of the first embodiment. Hereinafter, the operation of the second embodiment will be described in detail with reference to the flowchart of FIG. However, it is not limited to notifying using the vibration stimulus or the temperature stimulus described above, and a notification means using the vibration stimulus or the temperature stimulus may be further added as necessary.

  Here, as in the first embodiment, it is assumed that an object for informing the position is specified in advance. Note that the control unit 101 constantly monitors the touch operation of the touch panel 110 by the user. According to FIG. 4, the control unit 101 acquires location information (coordinate position) of a specific object (step S201). Next, according to the acquired location information of the specific object, the control unit 101 performs display for informing the location on a part of the effective screen area of the display unit 12 (curved surface display device 120) (step S202).

  Three specific display methods for informing where the specific object is located in the display unit 12 (curved surface display device 120) in step S202 are illustrated in FIGS. 5 (a), (b), and (c). . For example, as shown in FIG. 5A, the entire image A displayed in a reduced size is displayed in a partial area (effective screen area 12a) of the display unit 12 (curved surface display device 120), and out of the effective screen area. The position of the specific object in 12b is notified. In FIG. 5A, in the reduced overall image A, the area indicated by the thick frame indicates the effective screen area 12a, and the position of the specific object outside the effective screen area 12b is indicated by hatching.

Further, for example, the position of a specific object located outside the effective screen area 12b may be indicated by a display such as an arrow B shown in FIG. 5 (a) and 5 (b), for the sake of convenience, the area below the line indicated by the dotted line is shown as an area that is not visible to the user.
Further, as shown in FIG. 5 (c), the object outside the effective screen area 12b that is hidden behind the wrist terminal 1 is thinly displayed, and the icon or the like on the back side of the effective screen area 12a is transparent. A display (transparent display) that the user feels as if it is visible may be displayed on the display unit 12 (curved surface display device 120).

  Returning to the flowchart of FIG. 4, the user touches the position of the notified specific object based on the display as described above, and when the control unit 101 detects a touch operation (step S <b> 203 “YES”). ), Screen scroll control of the curved surface display device 120 is performed, and scroll control of the effective screen area is performed so that the position of the notified specific object is moved to the center (predetermined position) of the effective screen area 12a (step S204). . Further, in the above description, the position of the specific object is touched. Instead, it may be a touch of the reduced-sized whole image A, arrow B, or transparent display icon. The scroll control is executed when the control unit 101 rewrites the contents of the VRAM area allocated to the memory 102.

(Effect of embodiment)
As described above, according to the portable information device (list terminal 1) according to the present embodiment, the control unit 101 is a predetermined object displayed on the display unit 12 (curved surface display device 120) that is difficult to visually recognize the whole at once. And the position of the specific object in the effective screen area 12a of the display unit 12 (curved surface display device 120) or outside the effective screen area 12b is informed so that it is in a position that cannot be recognized from the user's viewpoint. Even if there is a specific object outside the effective screen area, the position of the specific object can be easily grasped, so that operability is improved and usability is improved. Further, by notifying the position of an object outside the effective screen area 12b at a position that cannot be recognized from the user's viewpoint by vibration stimulation or temperature stimulation, the user intuitively grasps the position of the object. The touched object is scrolled to a predetermined position on the screen (a position that can be seen by the user) simply by touching the place where the stimulus exists.

  Further, instead of vibration stimulation and temperature stimulation, the entire image including the outside of the effective screen area 12b is reduced and displayed on a part of the effective screen area 12a of the display unit 12 (curved surface display device 120). Displaying the position of the specific object, displaying a display indicating the direction in which the specific object exists in the effective screen area 12a, or performing a transparent display so that the hidden part can be seen through. Thus, the user can easily grasp the position of a specific object, and by simply touching the grasped position, the object can be scrolled to a predetermined position on the screen (a position visible to the user). Therefore, the operability can be improved and the usability can be improved.

  When there are a plurality of objects to be specified, if the objects are numbered and set and registered, the number corresponding to the object displayed on a part of the display unit 12 (curved surface display device 120) is specified. The position can be notified. Although the clock displayed on the display unit 12 (curved surface display device 120) has been described as being displayed on the display unit 12 (curved surface display device 120), a real clock is inserted into the clock. It may be replaced with a thing.

  Moreover, although only the wrist terminal 1 is illustrated as the portable information device according to the present embodiment, the present invention is not limited to the wrist terminal 1 and can be applied to all portable information devices having the display unit 12 that is difficult to visually recognize at a time. . For example, when the display area is on the front and back surfaces, or when the display area extends over a plurality of pages.

  As mentioned above, although this invention was demonstrated using embodiment, it cannot be overemphasized that the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiments. Further, it is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.

[Appendix]
[Claim 1]
Display means having a display part that is difficult to visually recognize the whole at once;
Specifying means for specifying a predetermined object displayed on the display unit by the display means;
Informing means for informing the position of the object specified by the specifying means outside the display area that the user can view at a time in the display unit;
A portable information device characterized by comprising:
[Claim 2]
Further comprising a stimulating element,
The portable information device according to claim 1, wherein the notification unit notifies a position of the object specified by applying a stimulus to a body surface by the stimulation element.
[Claim 3]
The stimulation elements are two or more and provided at different positions,
The portable information device according to claim 2, wherein the notification means controls the intensity of stimulation given to the body surface of the two stimulation elements at different positions so as to change the position felt as the stimulation position. .
[Claim 4]
The portable information device according to claim 2 or 3, wherein the stimulus is a vibration stimulus to the body surface.
[Claim 5]
The portable information device according to claim 2 or 3, wherein the stimulus is a warm stimulus to the body surface.
[Claim 6]
The display unit performs a reduced display showing a whole image of the display unit in a part of the display area that can be visually recognized by a user at a time,
The portable information device according to any one of claims 1 to 5, wherein the notification unit notifies the specified position of the object during the reduced display.
[Claim 7]
The notification means notifies the position of the specified object by showing a display indicating the direction of the specified object in a part of the display area where the user can visually recognize at once. The portable information device according to any one of claims 1 to 5.
[Claim 8]
The portable information device according to any one of claims 1 to 5, wherein the notification unit notifies the specified object by displaying it in a pseudo-transparent display.
[Claim 9]
A moving means for moving the screen so as to display the object specified at a predetermined position of the display unit;
The said moving means moves the said screen by performing predetermined operation with respect to the said alert | reported position, The said specified object is displayed on the predetermined position of the said display part from Claim 1 characterized by the above-mentioned. The portable information device according to claim 7.
[Claim 10]
Identifying a predetermined object displayed on a display part that is difficult to visually recognize the whole at once;
Informing the position of the specified object outside the display area that the user can view at a time on the display unit;
An object notification method in a portable information device.
[Claim 11]
A function for identifying a predetermined object displayed on a display unit that is difficult to see the whole at once,
A function of notifying a position of the specified object outside the display area that the user can view at a time in the display unit;
A program of a portable information device characterized by realizing the above.

DESCRIPTION OF SYMBOLS 1 ... Portable information terminal (list terminal), 10 ... Terminal main-body part, 11 ... Operation part, 12 ... Display part, 12a ... Effective screen area | region, 13 ... Vibration output part, 101 ... Control part, 102 ... Memory, 103 ... Touch panel Driver 104 ... Display driver 105 ... Vibration element driver 110 ... Touch panel 120 ... Curved surface display device 130 ... Vibration element

Claims (12)

Display means having a display part that is difficult to visually recognize the whole at once;
Specifying means for specifying a predetermined object displayed on the display unit by the display means;
Identified by showing the display of the direction of the object specified by the specifying means outside the display area that can be viewed by the user at a time in the display unit in a part of the display area that can be viewed by the user at a time. Informing means for informing the position of the object that has been made ;
A portable information device characterized by comprising: Display means having a display part that is difficult to visually recognize the whole at once;
Specifying means for specifying a predetermined object displayed on the display unit by the display means;
Informing means for informing the position of the object specified by the specifying means outside the display area that the user can view at a time in the display unit;
With
The display unit performs a reduced display showing a whole image of the display unit in a part of the display area that can be visually recognized by a user at a time,
The portable information device characterized in that the notification means notifies the specified position of the object during the reduced display. Display means having a display part that is difficult to visually recognize the whole at once;
Specifying means for specifying a predetermined object displayed on the display unit by the display means;
Informing means for informing the position of the specified object by displaying the object specified by the specifying means outside the display area visible to the user at a time on the display unit in a pseudo-transparent display. When,
A portable information device characterized by comprising: Display means having a display part that is difficult to visually recognize the whole at once;
Specifying means for specifying a predetermined object displayed on the display unit by the display means;
Informing means for informing the position of the object specified by the specifying means outside the display area that the user can view at a time in the display unit;
Moving means for moving a screen by performing a predetermined operation on the notified position and displaying the specified object at a predetermined position of the display unit;
A portable information device characterized by comprising: Identifying a predetermined object displayed on a display part that is difficult to visually recognize the whole at once;
The object specified by showing a display indicating the direction of the specified object outside the display area visible to the user at a time on the display unit in a part of the display area visible to the user at a time Informing the position of
An object notification method in a portable information device. Identifying a predetermined object displayed on a display part that is difficult to visually recognize the whole at once;
Informing the position of the specified object outside the display area that the user can view at a time on the display unit;
Including
The display unit performs a reduced display showing a whole image of the display unit in a part of the display area that can be visually recognized by a user at a time,
In the notifying step, a notification method of an object in a portable information device is provided by notifying the specified position of the object during the reduced display. Identifying a predetermined object displayed on a display part that is difficult to visually recognize the whole at once;
Informing the position of the identified object by showing the identified object that is outside the display area visible to the user at a time on the display unit in a pseudo-transparent display,
An object notification method in a portable information device. Identifying a predetermined object displayed on a display part that is difficult to visually recognize the whole at once;
Informing the position of the specified object outside the display area that the user can view at a time on the display unit;
A moving step of moving the screen by performing a predetermined operation on the notified position and displaying the identified object at a predetermined position of the display unit;
An object notification method in a portable information device. A function for identifying a predetermined object displayed on a display unit that is difficult to see the whole at once,
The object specified by showing a display indicating the direction of the specified object outside the display area visible to the user at a time on the display unit in a part of the display area visible to the user at a time A function to notify the position of
A program of a portable information device characterized by realizing the above. A function for identifying a predetermined object displayed on a display unit that is difficult to see the whole at once,
A function of notifying a position of the specified object outside the display area that the user can view at a time in the display unit;
Realized,
The display unit performs a reduced display showing a whole image of the display unit in a part of the display area that can be visually recognized by a user at a time,
In the function of notifying, a program for a portable information device that notifies by indicating the position of the identified object during the reduced display. A function for identifying a predetermined object displayed on a display unit that is difficult to see the whole at once,
A function of notifying the position of the specified object by showing the specified object that is outside the display area that the user can view at a time in the display unit in a pseudo-transparent manner;
A program of a portable information device characterized by realizing the above. A function for identifying a predetermined object displayed on a display unit that is difficult to see the whole at once,
A function of notifying a position of the specified object outside the display area that the user can view at a time in the display unit;
A moving function for moving the screen by performing a predetermined operation on the notified position and displaying the specified object at a predetermined position of the display unit;
A program of a portable information device characterized by realizing the above.

Images