JP2011205206A - Electronic apparatus, direction presenting method for electronic apparatus, program and direction presenting system for electronic apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic apparatus, a direction presenting method for the electronic apparatus, a program and a direction presenting system for the electronic apparatus, capable of presenting, for example, the directions of a target place, a person or a communication party by a tactile sense during calling in real time.SOLUTION: A position information capturing means, an azimuth information capturing means, an image information capturing means for capturing at least a part of image information of user's face, and an output section are connected to a control section. The control section includes: a target position specifying means and a target direction specifying means; a first difference detecting means for detecting the difference between the target direction and the reference direction of an electronic apparatus; a relative posture specifying means; a coordinate converting means for converting coordinates into a target direction with reference to the direction of the user's face; a second difference detecting means for detecting the difference between the target direction after the coordinate conversion and the target direction before the coordinate conversion; and an output section control means for controlling the output section on the basis of the detected difference information. The output section includes a tactile sense presenting means for presenting the direction.

Description

  The present invention relates to an electronic device, an electronic device direction presentation method, a program, and an electronic device direction presentation system.

  The functions of mobile electronic devices are increasing year by year, and various communication means such as telephone calls, e-mails, images, videos, and chats are used. However, conventional communication is centered on communication using so-called vision and hearing centered on voice, text, and images. In addition to information, new communication means and functions that enable people to communicate with each other more sensibly have not yet been realized.

  In the user interface, communication using human tactile sensations and sensory functions that sense force (hereinafter referred to as force sensation) has been studied, but there has been no practical use, and a vibration motor is used for calling on mobile phones. However, it is only for notification of incoming calls and is not currently used as a communication tool.

  As a related technology, use positioning information to express the registered contact information on the display by changing the size of the icon according to the current direction and distance. Thus, a device that provides a sense of realism has been proposed (see, for example, Patent Document 1). In the case of direction presentation using a display, in order to check the display, the user must make a call with the main body away from the ear like a TV phone, and the content of the call leaks to the surroundings or there is noise There is a problem that it is difficult to hear in the environment. In addition, there is a problem that the direction presentation by voice such as car navigation disturbs the call. Although a mobile terminal that displays a map on a display and presents a direction has been proposed (see, for example, Patent Document 2), it is assumed that the user searches for a target direction while viewing the screen, and the same as described above. There is a problem.

  On the other hand, a haptic human navigation system that uses a tactile sensation and a haptic sensation to present a direction to a user in a form that is intuitively easy to understand has been proposed (for example, see Patent Document 3). However, there has been no example of a function that directly guides the user to the other party or the target direction based on the user's face (line of sight) during a call (when the electronic device is directly applied to the ear).

Special table 2009-517762 JP 2001-023076 A JP 2004-177360 A

  In the present invention, as new communication means, during a call, for example, an electronic device capable of presenting a target location, a person, and the direction of the other party in real time by tactile sense, a direction presentation method for the electronic device, a program, and an electronic device An object is to provide a direction presentation system.

In order to achieve the above object, an electronic device of the present invention includes:
Position information capturing means, orientation information capturing means, image information capturing means for capturing image information of at least a part of the user's face, a control unit and an output unit,
Each capturing means is connected to the control unit,
The control unit is connected to the output unit;
The control unit is
Target position specifying means for specifying the position of the target;
Target direction specifying means for specifying a target direction which is the direction of the target object from the position information acquired using the position information acquisition means and the position information of the specified target object;
First difference detection means for detecting a difference between the target direction and a reference direction of the electronic device;
Relative posture specifying means for specifying the relative posture between the electronic device and the user's face from the image information captured using the image information capturing means;
Coordinate conversion means for converting coordinates to a target direction based on the orientation of the user's face based on the specified target direction and the relative posture information;
Second difference detection means for detecting a difference between the target direction after the coordinate conversion and the target direction before the coordinate conversion;
Output unit control means for controlling the output unit based on the detected difference information,
The output unit includes tactile sense presenting means for presenting a direction.

The electronic device direction presentation method of the present invention uses the electronic device of the present invention,
A position information capturing process, an orientation information capturing process, an image information capturing process for capturing at least part of image information of the user's face, a control process, and an output process;
The control step is
A target position identifying step for identifying the position of the target;
A target direction specifying step for specifying a target direction which is a direction of the target from the position information acquired in the position information capturing step and the information of the position of the specified target;
A first difference detection step of detecting a difference between the target direction and a reference direction of the electronic device;
A relative posture identifying step for identifying a relative posture between the electronic device and the user's face from the image information captured using the image information capturing step;
A coordinate conversion step of converting coordinates into a target direction based on the orientation of the user's face based on the specified target direction and the relative posture information;
A second difference detection step of detecting a difference between the target direction after the coordinate conversion and the target direction before the coordinate conversion;
An output unit control step for controlling the output unit based on the detected difference information,
The output step includes a tactile sense presentation step of presenting a direction.

  The program of the present invention is characterized in that the electronic device direction presentation method of the present invention can be executed on the electronic device.

  The electronic device direction presentation system of the present invention provides a direction presentation function by the electronic device direction presentation method of the present invention.

  According to the present invention, even during a call, for example, an electronic device capable of presenting a target location, a person, and the direction of a call partner in real time by tactile sense, a direction presentation method for an electronic device, a program, and an electronic device A direction presentation system can be provided.

It is a figure which shows an example of a structure of the electronic device which concerns on embodiment of this invention. It is a figure which shows an example of a structure of the electronic device which concerns on embodiment of this invention. It is a schematic diagram which shows an example of the direction presentation by the electronic device which concerns on embodiment of this invention. It is a schematic perspective view of an example of the electronic device of the present invention. It is a schematic diagram which shows an example of the relationship between the user's face (line of sight) direction at the time of a call and the relative posture of the electronic device according to the embodiment of the present invention. It is a schematic diagram which shows the other example of the relationship between the user's face (line of sight) direction at the time of the telephone call which concerns on embodiment of this invention, and the relative attitude | position of an electronic device. It is a schematic diagram which shows the further another example of the relationship between the user's face (line of sight) direction at the time of the telephone call which concerns on embodiment of this invention, and the relative posture of an electronic device. It is a flowchart which shows an example of operation | movement of the electronic device of this invention. It is a schematic diagram which shows the other example of the direction presentation by the electronic device which concerns on embodiment of this invention.

  Hereinafter, the electronic device and the direction presentation method of the electronic device of the present invention will be described in detail. However, the present invention is not limited to the following embodiments.

(Embodiment 1)
FIG. 1 illustrates an example of a configuration of an electronic device of the present invention. As shown in FIG. 1, the electronic apparatus 10 of this example includes a position information capturing unit 206, an orientation information capturing unit 207, an image information capturing unit 204 that captures image information of at least a part of the user's face, a control unit 100, and an output. The unit 300 is provided. Each capturing unit is connected to the control unit 100, and the control unit 100 is connected to the output unit 300. The output unit 300 includes tactile sense presenting means 310 for presenting a direction. The control unit 100 uses a target position specifying unit 101 that specifies the position of a target, position information acquired using the position information acquiring unit 206, and information on the position of the specified target. Using target direction specifying means 102 for specifying a target direction that is the direction of an object, first difference detection means 103 for detecting a difference between the target direction and a reference direction of an electronic device, and the image information capturing means 204 Relative posture specifying means 106 for specifying a relative posture between the electronic device and the user's face from the captured image information, and based on the information on the specified target direction and the relative posture, the user's face orientation is used as a reference. A coordinate conversion means 107 for converting coordinates into the target direction, a second difference detection means 108 for detecting a difference between the target direction after the coordinate conversion and the target direction before the coordinate conversion, Based on the issued difference information, and an output unit control means 109 for controlling the output unit 300.

  In the control unit 100, when the electronic device 10 of this example is a mobile phone terminal, switching software for enabling or disabling the direction presentation function of a call partner, a target, or a place during a call Can also be provided. These software can be switched as necessary if the switching selection is enabled by a display menu or a shortcut key.

  When the direction presentation function of the other party, target or place at the time of a call is valid, the position and orientation of the electronic device main body with respect to the ground are detected from the information captured by the position information capturing unit 206 and the direction information capturing unit 207. Is done. Further, the target position specifying means 101 provided in the control unit 100 specifies a target position such as a call partner, a target or a place. The target direction specifying means 102 uses the position information of the electronic device main body and the specified target position information to specify the direction from the electronic device to the target (target direction).

  Further, the posture of the electronic device 10 main body is determined from the information captured by the orientation information capturing unit 207. A first difference detection unit 103 that detects a difference between a reference direction of the electronic device 10 main body (for example, a normal direction of the display of the electronic device 10) and a target direction according to the posture of the electronic device 10 main body. The difference from the target direction can be specified. Based on this difference, the control unit 100 controls the output unit 300 to allow the user to recognize the target direction.

  FIG. 2 is a diagram showing a part of the configuration of the electronic apparatus according to the present embodiment in more detail. An image information capturing unit 204 is connected to the control unit 100. As the image information capturing means 204, a camera can be used, but there is no limitation as long as the image information can be captured. There is no limit. Further, there may be a plurality of cameras, and control may be performed so that the angle of view during a call is adjusted to an angle at which a feature appears on the user's face. In addition to the camera mounted on the display screen facing the user side during a call, the mobile phone captures a target object other than itself, such as a camera mounted on the opposite side of the display screen. A camera that captures the angle of view is generally installed.

  As the position information capturing means 206, a position information system using a wireless base station, such as positioning of a GPS or GSM cell, estimation from a wireless LAN (Wi-Fi) access point position, or positioning using a base station is used. can do. In addition, the position information can be taken in by manually setting the current position. In addition, there is no limitation as long as it has a function for specifying the position. Further, the azimuth information capturing means 207 can use a magnetic sensor. The magnetic sensor detects geomagnetism and the like, and detects the orientation of the electronic device with respect to the earth. Furthermore, in some cases, it is assumed that it is necessary to detect the gravity and detect the attitude of the electronic device. In this case, the gravity direction information capturing unit 208 is connected to the control unit 100 and captures information. It is possible. An acceleration sensor can be used for detecting gravity. In recent years, a three-axis acceleration sensor has been mounted, and not only gravity but also movements and movements can be detected and used as a substitute for operation.

  In order to guide the user's face (line of sight) in the target direction, the control unit 100 is provided with face information detection means 104 and face information direction-specific pattern storage means 105. Further, using the face information detecting means 104 and the face information direction pattern information stored in the face information direction pattern storage means 105, the relative position and orientation of the user and the electronic device can be specified. Posture specifying means 106 is provided. Further, a target direction specifying unit 102 is provided for specifying the position of the electronic device from the position information capturing unit 206 and specifying the target direction such as a communication partner or object with reference to the electronic device using the target position specifying unit 101. Yes.

  Furthermore, there is means 107 for converting coordinates from the above-described relative orientation specifying means 106 and the target direction based on the electronic device to the target direction based on the user's face (line of sight). Second difference detection means 108 is provided for detecting a difference between target direction data based on the user's face (line of sight) and target direction data based on the electronic device before coordinate conversion.

  In the present embodiment, a transmission / reception unit 202 and a storage unit 203 for exchanging information with other devices are connected to the control unit 100 of the electronic device main body. An antenna 201 is further connected to the transmission / reception means 202. In this example, although the form which is the connection by radio | wireless was shown, it is not limited to this, The connection by wire may be sufficient. Furthermore, an I / F 205 with other devices is connected to the control unit 100. Specifically, USB, IEEE1394, card memory slot, IrDa, Bluetooth, etc. can be used as the I / F 205 with the other device. In addition, other sensors 209 are connected. Examples of the other sensors 209 include an acceleration sensor, a temperature sensor, a humidity sensor, a pressure sensor, and an optical sensor.

  As described above, the output unit 300 includes the tactile sense (force sense) presentation unit 310 that presents a direction. It is preferable that the tactile sense presenting unit 310 presents a direction by changing a physical quantity. For example, vibration generating means 323 for generating vibration (vibration) is generally provided as means for notifying an incoming call or the like in an electronic device such as a mobile phone terminal. In the present invention, this vibration generating means 323 can also be used as the tactile sense presenting means of the present invention. For example, when a predetermined direction is presented during a call, the user can be guided in a predetermined direction by changing the vibration interval, size, frequency, vibration pattern, and the like as the user approaches the target direction. As an example, when the target direction is on the south side, the vibration continuously occurs when the user faces north, the vibration becomes intermittent when the user faces east or west, and the vibration stops when facing the south. A presentation method is possible. In this case, the user may turn in the direction in which the vibration has stopped.

  Further, as the tactile sense presenting means 310, heat generating means for generating heat can be used. FIG. 3A is a diagram for explaining an example of tactile sensation presentation means using heat generation means. The tactile sense presenting means 310 of this example is formed in a circular pad shape, and a heating element is embedded therein. When direction presenting information is output from the control unit 100, the heat generating elements corresponding to the direction of the tactile sense presenting means generate heat. In FIG. 3 (a), a warm feeling can be felt by touching the hatched portion, and in this case, the user can recognize that the direction of the arrow in the figure is the presented direction. it can.

  Further, as the tactile sense presenting means 310, a jog dial or the like capable of presenting a direction by rotating is exemplified. FIG. 3B-1 is a diagram for explaining an example of tactile sense presentation means using a jog dial. The tactile sense presenting means 310 of this example is formed in a rotatable dial shape. When direction presentation information is output from the control unit 100, the jog dial rotates in a direction desired to be directed to the user. FIG. 3B-2 is a schematic view of the state of the user who is talking on the mobile phone with a jog dial as seen from above. When the direction in which the user is facing differs from the presentation direction, the jog dial rotates as shown in the left figure. When the user changes the direction according to the rotation direction of the jog dial and faces in the same direction as the presentation direction, the rotation of the jog dial stops. In this case, by stopping the rotation of the jog dial, the user can recognize that the arrow direction in the figure is the presented direction.

  It is preferable that the tactile sensation presentation unit presents a direction of two or more dimensions because the target direction can be presented directly. Examples of the tactile sense presenting means for presenting a direction of two or more dimensions include a joystick and a jog ball which will be described later.

  The output unit 300 may include, for example, a speaker 320, a display unit 321, a light emitting unit 322, a vibration generating unit 323, and the like in addition to the tactile sense providing unit 310. Each of these components may be used alone or in combination with the tactile sense presenting means 310. For example, in the above-described example, in order to notify that the user is directed in the presented direction, an alarm sound is generated from the speaker 320 or light is emitted from the light emitting means 322 together with the stop of vibration or the rotation of the jog dial. A signal can also be generated. By using these means in combination, direction presentation to the user can be performed more reliably.

  In addition, the electronic device 10 includes a voice capturing unit 410, an operation unit 420, and the like, but the details of the mounting structure are omitted because a known structure can be adopted.

  The control unit 100 captures information captured by the image information capturing unit 204 such as a camera, and the face information detection unit 104 in the control unit 100 has features such as a face outline, a nose, and a mouth. Information is extracted. By the pattern matching between the information extracted by the face information detection unit 104 and the information stored in the pattern storage unit 105 according to the direction of the face information, Identify posture. The specification is performed by the relative posture specifying means 106 that is also in the control unit 100.

(Embodiment 2)
Next, an example of detecting a relative position or posture using an image will be described with reference to FIGS. FIG. 4 is a schematic perspective view of an example of an electronic apparatus (mobile phone terminal) according to the present invention. FIG. 4A is a view of the electronic apparatus of this example as viewed from the display surface side (the side where the display or the touch panel is provided), and FIG. 4B is a view as viewed from the back side. The electronic device 10 includes a speaker 320, a sound capturing unit 410, and an image information capturing unit (camera) 204. In the electronic apparatus 10 of this example, the image information capturing means (camera) 204 is attached near the sound capturing means 410 (near the mouth during a call). Although the folding type mobile phone terminal is illustrated in this figure, the electronic apparatus of the present invention is not limited to this, and may be a straight type or a slide type. Further, in this drawing, display of members such as a display portion, operation buttons, and a touch panel, which are usually provided in an electronic device, is omitted.

  FIG. 5 is a schematic diagram showing the user's head when the electronic device (mobile phone terminal) 10 is held with the left hand and is listening with the left ear. FIG. 5 is a perspective view of the face as viewed from the front, and the lower part of each shows an image image captured from the image information capturing means (camera) 204 of the electronic device. Each drawing shows a state in which the electronic device 10 is rotated in a plane parallel to the direction of the face (line of sight) around the ear pad. FIG. 6 is a schematic diagram showing the user's head in the same manner as FIG. 5 when holding the same electronic device (mobile phone terminal) 10 with the right hand and listening with the right ear. 5 and 6 show examples in which the normal direction of the display surface of the electronic device and the user's face (line of sight) direction are almost orthogonal.

  Each of the central views of FIGS. 5 and 6 shows a case where the electronic apparatus is gripped in a standard state. The left diagram in FIG. 5 and the right diagram in FIG. 6 show a case where the electronic device is gripped in a state of being rotated to the near side with the ear fitting portion as the center. Moreover, the right figure of FIG. 5 and the left figure of FIG. 6 have shown the case where the electronic device is hold | gripped in the state rotated to the back side centering | focusing on the ear fitting part. For the image captured from the image information capturing means (camera) 204, the face information detecting means 104 in the control unit 100 detects each part of the feature points such as the chin, the mouth, and the vertex of the forehead. Get angle information of virtual line connecting The relative position or posture between the user's face (line of sight) and the electronic device during a call can be specified by pattern matching of this angle information with the angle information stored in the face information direction pattern storage means 105. . The specification is performed by the relative posture specifying means 106 that is also in the control unit 100. The face information direction pattern storage means 105 captures in advance an image when the user holds the electronic device in a talking state. The captured image may be a face, a part of the face, or a part of the body. Feature points are extracted from the captured image. Any feature points can be used as long as they can identify a part of the user's body, such as a face contour, a contour of a part of the face such as the nose, mouth and cheeks, a mole or a heel. In this way, by comparing each time using the image information of the normal call state created in advance and the newly acquired image information, the relative orientation between the user's face direction and the electronic device can be determined. Can be obtained in real time.

  The association between the image information of the normal call state created in advance and the relative position can be calibrated by capturing an image with the user and the electronic device facing in a known direction (calibration). ). For example, since the electronic device itself also has direction information by capturing image information when the user faces true north and holds the electronic device in a call state, the image when the user holds the electronic device with the right hand It becomes possible to distinguish the image when the electronic device is held with the left hand. Furthermore, if at least three or more feature points can be identified, it is possible to calculate a relative position change from a normal stance during a call by polar coordinate conversion, and direction presentation based on the orientation of the user's face can be performed. It becomes possible.

  A camera can be used to extract the feature points. However, since a CCD or CMOS camera also recognizes infrared rays, moles and wrinkles can be detected prominently. If three or more positions can be recorded, it is possible to detect the distance in the similarity deformation, the rotation in the rotation angle, and the change in the parallelism to the surface in the shape deformation. Can be accurately calculated. In consideration of the speed of movement of a person during a call, the image information capturing means (camera) does not have to be constantly operated, and can be used by intermittently capturing image information.

  The pattern stored in the pattern information storage unit 105 according to the direction of the face information may be a data table based on general characteristics. The face image of the user himself / herself is directly taken into a table and used for image matching. Also good.

  FIG. 7 is a schematic diagram when the direction of the user's face (line of sight) changes in the direction of gravity in addition to the left-right direction. If the user's orientation and three-dimensional position information can be specified, the direction of gravity may have to be taken into account. Also in this case, the operation can be performed in the same manner as described with reference to FIGS. 5 and 6 except that the information on the direction of gravity is taken into account.

  When the positional relationship between the electronic device and the target is specified, the user's electronic device is specified by the position information capturing means 206 (normally GPS is used), and the target position information such as the call partner is the target position specifying means 101. Specified by. However, as a precondition, it is a condition that the other party or the target is permitted to disclose the position information. From the information of the target position specifying unit 101 and the position information capturing unit 206, the target direction with respect to the electronic device is specified by the target direction specifying unit 102. Further, the coordinate conversion means 107 converts the direction of the target place, person, and the other party to the direction based on the user's face (line of sight) based on the information on the relative face between the user's face (line of sight) and the electronic device. . Thereby, the control unit 100 can calculate the difference between the target direction based on the user's face (line of sight) and the target direction based on the electronic device main body. This calculation is executed by the second difference detection means 108 in the control unit 100. The three-dimensional coordinate conversion can be performed by adding a matrix (3 × 3) representing rotation and a translation vector (3 elements) to a coordinate vector (3 elements). As for the calculation for specifying the direction on the earth, a spherical trigonometric method used in a car navigation system or the like can be used. Based on the difference between the detected directions, the control unit 100 controls each output unit of the output unit 300.

  FIG. 8 is a flowchart showing the above operation. When the target is detected, the electronic device detects the target direction (S1), and then detects the direction of the electronic device itself (S2). Then, image information such as a part of the user's face is captured (S3). The captured image information is compared with information of a table of known relative orientations and images captured in advance (S4), and information on the relative position between the user's face orientation and the electronic device is obtained. Conversion to the target direction based on the orientation of the user's face is performed from the information on the obtained relative position (S5). In the next step (S6), it is determined whether there is a difference between the target direction and the user's face direction. When it is determined that there is the difference (Yes), the output unit control means operates to give an instruction to the output unit so as to present a direction according to the difference (S7). When it is determined that there is no difference (No), the direction presentation is completed (S8). If the call is continued and further direction presentation is required, the steps after S2 are repeated.

(Embodiment 3)
In the present embodiment, as another example of the direction presentation to the user, the tactile sense presentation unit 310 presents a two-dimensional or higher direction. Examples of tactile sense presenting means for presenting directions of two or more dimensions include a joystick and a jog ball. For example, if a haptic presentation means 310 such as a joystick that falls in four directions or a jog ball that rotates in any direction is used, it can be guided directly to a target direction with respect to the user's face (line of sight). Further, by adding information such as vibration and presentation timing to the direction presentation, a sense of distance can be presented.

  In the case where the tactile sense presenting means 310 is a joystick, for example, the joystick is presented by inclining the joystick in the direction closest to the target direction from the current user's face (line of sight) orientation, as shown in FIG. It is also possible to present using a jog ball 310 or the like. For directions that cannot be expressed in two dimensions, specify the direction up to the limit of the display area until the range of angles that can be expressed is reached, and vector expression from where the range of directions and quantities can be expressed, etc. A display method is conceivable. Furthermore, if a means capable of presenting a direction in three dimensions is used, the direction can be directly displayed as a vector regardless of the posture of the user and the gripping state of the electronic device. In the example shown in FIG. 9, the user can read the direction by touching the jog ball 310 with the index finger during a call and feeling the rotation direction by touch.

  As described above, according to the electronic device of the present invention, the user can know the difference of the target direction with respect to the reference provided in the electronic device main body in real time by tactile sense, so the target direction can be searched using the electronic device. It becomes. In addition, even when the target location, person, and the direction of the other party of the call are presented while the user is making a call, the electronic device has a relative positional relationship between the direction of the user's face (line of sight) and the electronic device, The opposite posture can be recognized. Therefore, it is possible to provide a direction presentation function that takes into account the orientation of the user's face (line of sight) and a direction presentation function that does not interfere with hearing or visual perception during a call. Thereby, there is an effect that it is possible to provide a direction presentation service during a call without stress.

  In addition, it is possible to confirm each other's direction by waiting in crowds, people who are not acquainted can identify each other, and blind people can also recognize each other's direction, so they can meet more smoothly There are effects such as being able to. Furthermore, communication that appeals to a sense of reality and sensitivity can be realized by knowing the direction of the call partner, target, and location.

  The present invention can be applied to all electronic devices that exchange information, such as mobile phones, PDAs (Personal Digital Assistants or Personal Data Assistance), and notebook PCs, and has a wide range of uses.

  A part or all of the above-described embodiment can be described as in the following supplementary notes, but is not limited thereto.

(Supplementary Note 1) A position information capturing unit, an orientation information capturing unit, an image information capturing unit that captures image information of at least a part of the user's face, a control unit, and an output unit.
Each capturing means is connected to the control unit,
The control unit is connected to the output unit;
The control unit is
Target position specifying means for specifying the position of the target;
Target direction specifying means for specifying a target direction which is the direction of the target object from the position information acquired using the position information acquisition means and the position information of the specified target object;
First difference detection means for detecting a difference between the target direction and a reference direction of the electronic device;
Relative posture specifying means for specifying the relative posture between the electronic device and the user's face from the image information captured using the image information capturing means;
Coordinate conversion means for converting coordinates to a target direction based on the orientation of the user's face based on the specified target direction and the relative posture information;
Second difference detection means for detecting a difference between the target direction after the coordinate conversion and the target direction before the coordinate conversion;
Output unit control means for controlling the output unit based on the detected difference information,
The electronic device, wherein the output unit includes tactile sense presenting means for presenting a direction.

(Supplementary note 2) The electronic apparatus according to Supplementary note 1, wherein the output unit control means operates when the difference is detected.

(Supplementary note 3) The electronic apparatus according to Supplementary note 1 or 2, wherein the tactile sense presenting means presents a direction by a change in physical quantity.

(Supplementary note 4) The electronic device according to any one of supplementary notes 1 to 3, wherein the tactile sense presenting means is a vibration generating means.

(Supplementary note 5) The electronic apparatus according to any one of supplementary notes 1 to 4, wherein the tactile sense presenting means is a heat generating means.

(Supplementary note 6) The electronic device according to any one of supplementary notes 1 to 5, wherein the tactile sense presenting means is a jog dial.

(Supplementary note 7) The electronic device according to any one of supplementary notes 1 to 6, wherein the tactile sense presenting means presents a direction of two or more dimensions.

(Supplementary note 8) The electronic device according to supplementary note 7, wherein the tactile sense presenting means is a joystick.

(Supplementary note 9) The electronic apparatus according to supplementary note 7, wherein the tactile sense presenting means is a jog ball.

(Supplementary Note 10) The position information capturing means is selected from GPS or GSM cell positioning, wireless LAN (Wi-Fi) access point position estimation, positioning using a base station, and manual current position setting. 10. The electronic device according to any one of appendices 1 to 9, wherein the electronic device is means for capturing position information by a method.

(Additional remark 11) The said control part has a means to extract a feature point from the said image information, The electronic device in any one of Additional remark 1 to 10 characterized by the above-mentioned.

(Supplementary note 12) The electronic apparatus according to any one of Supplementary notes 1 to 11, wherein the image information capturing unit intermittently captures image information.

(Supplementary note 13) The electronic apparatus according to any one of Supplementary notes 1 to 12, wherein the image information capturing means is a camera.

(Additional remark 14) The said relative attitude | position identification means has a means to compare the said image information with the image information of the reference direction acquired previously, The additional remark 1 to 13 characterized by the above-mentioned. Electronics.

(Appendix 15) Using the electronic device according to any one of Appendices 1 to 14,
A position information capturing process, an orientation information capturing process, an image information capturing process for capturing at least part of image information of the user's face, a control process, and an output process;
The control step is
A target position identifying step for identifying the position of the target;
A target direction specifying step for specifying a target direction which is a direction of the target from the position information acquired in the position information capturing step and the information of the position of the specified target;
A first difference detection step of detecting a difference between the target direction and a reference direction of the electronic device;
A relative posture identifying step for identifying a relative posture between the electronic device and the user's face from the image information captured using the image information capturing step;
A coordinate conversion step of converting coordinates into a target direction based on the orientation of the user's face based on the specified target direction and the relative posture information;
A second difference detection step of detecting a difference between the target direction after the coordinate conversion and the target direction before the coordinate conversion;
An output unit control step for controlling the output unit based on the detected difference information,
The electronic device direction presentation method, wherein the output step includes a tactile sense presentation step of presenting a direction.

(Additional remark 16) The said output part control process is performed when the said difference is detected, The direction presentation method of the electronic device of Additional remark 15 characterized by the above-mentioned.

(Additional remark 17) The direction presentation method of the electronic device of Additional remark 15 or 16 characterized by the said tactile sense presentation process being a process of presenting a direction by the change of physical quantity.

(Supplementary note 18) The electronic device direction presentation method according to any one of supplementary notes 15 to 17, wherein the tactile sense presentation step is a vibration generation step.

(Supplementary note 19) The electronic device direction presentation method according to any one of supplementary notes 15 to 18, wherein the tactile sense presentation step is a heat generation step.

(Supplementary note 20) The electronic device direction presentation method according to any one of supplementary notes 15 to 19, wherein the tactile sense presentation step is a step of presenting a direction of two or more dimensions.

(Supplementary note 21) The position information capturing step is selected from GPS or GSM cell positioning, estimation from a wireless LAN (Wi-Fi) access point position, positioning using a base station, and manual setting of the current position The electronic device direction presentation method according to any one of appendices 15 to 20, characterized in that it is a step of acquiring position information by a method described above.

(Supplementary note 22) The electronic device direction presentation method according to any one of supplementary notes 15 to 21, wherein the control step includes a step of extracting a feature point from the image information.

(Supplementary Note 23) The electronic device direction presentation method according to any one of Supplementary Notes 15 to 22, wherein the image information capturing step is a step of intermittently capturing image information.

(Additional remark 24) The said relative attitude | position identification process has the process of comparing the said image information and the image information of the reference direction acquired previously, The additional description 15 to 23 characterized by the above-mentioned. The direction presentation method of electronic equipment.

(Additional remark 25) The program which can perform the direction presentation method of the electronic device in any one of Additional remarks 15 to 24 on an electronic device.

(Supplementary note 26) A direction presentation system for an electronic device, which provides a direction presentation function according to the direction presentation method for an electronic device according to any one of Supplementary notes 15 to 24.

10 Electronic devices (mobile phone terminals)
DESCRIPTION OF SYMBOLS 100 Control part 101 Target position specific | specification means 102 Target direction specific | specification means 103 1st difference detection means 104 (Body reference direction and target direction) Face information detection means 105 Pattern information means 106 according to direction of face information Relative attitude | position specific means 107 (From terminal reference to user face orientation reference) coordinate conversion means 108 (difference between user face direction and target direction) second difference detection means 109 output unit control means 201 antenna 202 transmission / reception means 203 storage means 204 image information Capture means (camera)
205 I / F with other devices
206 Position information capturing unit 207 Direction information capturing unit 208 Gravity direction information capturing unit 209 Other sensor 300 Output unit 310 Tactile sense presenting unit (jog ball)
320 Speaker 321 Display unit 322 Light emitting unit 323 Vibration generating unit 410 Audio capturing unit 420 Operation unit

Claims (10)

Position information capturing means, orientation information capturing means, image information capturing means for capturing image information of at least a part of the user's face, a control unit and an output unit,
Each capturing means is connected to the control unit,
The control unit is connected to the output unit;
The control unit is
Target position specifying means for specifying the position of the target;
Target direction specifying means for specifying a target direction which is the direction of the target object from the position information acquired using the position information acquisition means and the position information of the specified target object;
First difference detection means for detecting a difference between the target direction and a reference direction of the electronic device;
Relative posture specifying means for specifying the relative posture between the electronic device and the user's face from the image information captured using the image information capturing means;
Coordinate conversion means for converting coordinates to a target direction based on the orientation of the user's face based on the specified target direction and the relative posture information;
Second difference detection means for detecting a difference between the target direction after the coordinate conversion and the target direction before the coordinate conversion;
Output unit control means for controlling the output unit based on the detected difference information,
The electronic device, wherein the output unit includes tactile sense presenting means for presenting a direction. The electronic apparatus according to claim 1, wherein the output unit control unit operates when the difference is detected. The electronic device according to claim 1, wherein the tactile sense presenting unit presents a direction by a change in physical quantity. The electronic device according to any one of claims 1 to 3, wherein the tactile sense presenting unit presents a direction of two or more dimensions. 5. The electronic apparatus according to claim 1, wherein the control unit includes means for extracting a feature point from the image information. The electronic apparatus according to claim 1, wherein the image information capturing unit intermittently captures image information. The electronic device according to claim 1, wherein the relative posture specifying unit includes a unit that compares the image information with image information in a reference direction acquired in advance. machine. Using the electronic device according to any one of claims 1 to 7,
A position information capturing process, an orientation information capturing process, an image information capturing process for capturing at least part of image information of the user's face, a control process, and an output process;
The control step is
A target position identifying step for identifying the position of the target;
A target direction specifying step for specifying a target direction which is a direction of the target from the position information acquired in the position information capturing step and the information of the position of the specified target;
A first difference detection step of detecting a difference between the target direction and a reference direction of the electronic device;
A relative posture identifying step for identifying a relative posture between the electronic device and the user's face from the image information captured using the image information capturing step;
A coordinate conversion step of converting coordinates into a target direction based on the orientation of the user's face based on the specified target direction and the relative posture information;
A second difference detection step of detecting a difference between the target direction after the coordinate conversion and the target direction before the coordinate conversion;
An output unit control step for controlling the output unit based on the detected difference information,
The electronic device direction presentation method, wherein the output step includes a tactile sense presentation step of presenting a direction.   9. A program capable of executing the electronic device direction presentation method according to claim 8 on the electronic device.   9. A direction presentation system for an electronic device, which provides a direction presentation function according to the direction presentation method for an electronic device according to claim 8.

Images