JP2007067724A - Mobile terminal device and display method - Google Patents

Mobile terminal device and display method Download PDF

Info

Publication number
JP2007067724A
JP2007067724A JP2005250218A JP2005250218A JP2007067724A JP 2007067724 A JP2007067724 A JP 2007067724A JP 2005250218 A JP2005250218 A JP 2005250218A JP 2005250218 A JP2005250218 A JP 2005250218A JP 2007067724 A JP2007067724 A JP 2007067724A
Authority
JP
Japan
Prior art keywords
display
peripheral device
device
icon
peripheral
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
JP2005250218A
Other languages
Japanese (ja)
Inventor
Kazunari Fujiwara
Yuji Hashimoto
Atsushi Hattori
Toyoki Kawahara
Atsushi Nakamura
Mikito Sugiura
Yoshihiko Takei
敦司 中村
豊樹 川原
淳 服部
幹人 杉浦
裕司 橋本
良彦 竹井
一成 藤原
Original Assignee
Matsushita Electric Ind Co Ltd
松下電器産業株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Matsushita Electric Ind Co Ltd, 松下電器産業株式会社 filed Critical Matsushita Electric Ind Co Ltd
Priority to JP2005250218A priority Critical patent/JP2007067724A/en
Publication of JP2007067724A publication Critical patent/JP2007067724A/en
Application status is Withdrawn legal-status Critical

Links

Images

Abstract

PROBLEM TO BE SOLVED: To search for peripheral devices existing around a mobile terminal device and display easy-to-understand position information such as the direction in which the peripheral device exists and the distance to the peripheral device, improving user convenience and burden. To provide a portable terminal device and a display method for mitigation.
Upon receiving a search list from a wireless communication unit, a display control unit acquires a corresponding icon from an icon table stored in a storage unit based on a model identifier of the search list, and searches the search list. The display of the icon is controlled based on the position information. In the icon display control based on the position information, the icon display position is determined based on the direction included in the position information, and the icon display size is determined based on the distance included in the position information.
[Selection] Figure 2

Description

  The present invention relates to a mobile terminal device and a display method, and more particularly to a mobile terminal device and a display method for displaying peripheral devices existing around the mobile terminal device.

  2. Description of the Related Art Conventionally, mobile terminals such as mobile phones have become multifunctional, and in addition to voice calls, sending and receiving e-mails, accessing the Internet, downloading contents such as music and images, and moving images taken with a camera along with voice A device equipped with an application for realizing various services such as a so-called videophone for transmitting and receiving is becoming widespread.

  In addition, with the spread of networks such as LAN (Local Area Network) and the Internet, by connecting various devices such as personal computer devices, AV devices, communication devices, home appliances, etc. to the network and providing mutual functions, For example, a device cooperation system that realizes a service that cannot be realized by a single device is attracting attention. In such a device cooperation system, there are several protocols for searching for devices and the like, for example, Jini (registered trademark), UPnP (Universal Plug and Play), Bluetooth (registered trademark) which is a short-range wireless communication system. Inquiry, SDP (Service Discovery Protocol) and the like.

Patent Document 1 discloses a technique for displaying information devices currently being communicated, their types, operating conditions, and the like on a limited display screen of portable information devices or the like used in the device cooperation system. In the information device described in Patent Document 1, for each information device, an icon corresponding to the type, built-in function, owner, and the like is stored in association with each other, and a wireless link with another information device is established. The icon corresponding to the information device is selected and displayed, and the icon is changed and displayed in accordance with the change in the operation status of the information device.
JP 2003-295994 A

  However, in the information device disclosed in Patent Document 1, when a wireless link is established with the information device, an icon corresponding to the information device is selected and displayed, and the icon is changed according to a change in the operation status of the information device. Since it is only displayed, it is insufficient as information when the user selects a peripheral device.

  In other words, it is possible to display peripheral device information on a limited display screen, but location information such as the direction in which the peripheral device exists and the distance to the peripheral device is not displayed, so the user selects the peripheral device. It is not enough information to do.

  The present invention has been made in view of the above points, searches for peripheral devices existing around the mobile terminal device, and displays position information such as the direction of the peripheral device and the distance to the peripheral device in an easy-to-understand manner. Thus, it is an object of the present invention to provide a portable terminal device and a display method that improve user convenience and reduce the burden.

  The mobile terminal device according to the present invention performs wireless communication with a peripheral device, and based on the wireless communication means for searching for the peripheral device and acquiring the position information of the peripheral device, and the position information of the peripheral device acquired by the wireless communication means. The display control means for controlling the display of the peripheral device icon and the display means for displaying the peripheral device icon by the display control of the display control means are adopted.

  According to this configuration, position information such as the direction in which the side device exists and the distance to the peripheral device can be displayed in an easy-to-understand manner, improving user convenience and reducing the burden.

  According to another aspect of the present invention, there is provided a mobile terminal device according to claim 1, wherein the display control means controls a display position of the peripheral device icon based on a direction included in the position information. .

  According to this configuration, the user can intuitively know the direction in which the peripheral device exists.

  The portable terminal device according to the present invention is the portable terminal device according to claim 2, wherein the display control means is configured such that the peripheral device in front of the device is on the upper side, and the peripheral device on the rear side of the device is on the lower side. A configuration is adopted in which the peripheral device in the right direction from the device is on the right side and the peripheral device in the left direction from the device is on the left side, and the display position of each peripheral device icon is controlled.

  According to this configuration, the user can intuitively know the direction in which a plurality of peripheral devices exist.

  Moreover, the portable terminal device of the present invention is the portable terminal device according to claim 2 or 3, wherein the display control means has a peripheral device in the right front direction from the own device on the upper right side and a peripheral device in the left front direction from the own device. A configuration is adopted in which the display position of each peripheral device icon is controlled such that the device is on the upper left side, the peripheral device in the rear right direction from the own device is on the lower right side, and the peripheral device in the rear left direction from the own device is on the lower left side.

  According to this configuration, the user can intuitively know the direction in which a plurality of peripheral devices exist.

  Moreover, the portable terminal device of the present invention is the portable terminal device according to any one of claims 1 to 4, wherein the display control unit is configured to display the peripheral device icon based on a distance included in the position information. A configuration for controlling the display form is adopted.

  According to this configuration, the user can intuitively know the distance to the peripheral device.

  The portable terminal device according to the present invention is the portable terminal device according to claim 5, wherein the display control means displays a peripheral device icon in a short distance from its own device as a display form of the peripheral device icon. A configuration is adopted in which control is performed so that peripheral device icons at a long distance from the apparatus are displayed small.

  According to this configuration, the user can intuitively know whether the distance to the plurality of peripheral devices is a short distance or a long distance.

  The display method of the present invention is a display method for displaying a plurality of peripheral devices existing around a mobile terminal device, and acquires position information for searching for peripheral devices by wireless communication and acquiring peripheral device position information. A display control step for controlling display of peripheral device icons based on the acquired peripheral device position information, and a display step for displaying peripheral device icons by the display control.

  According to this method, position information such as the direction in which the side device exists and the distance to the peripheral device can be displayed in an easy-to-understand manner, improving user convenience and reducing the burden.

  ADVANTAGE OF THE INVENTION According to this invention, position information, such as the direction in which a side apparatus exists, a distance with a peripheral device, etc. can be displayed easily, a user's usability can be improved and a burden can be reduced.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram illustrating a system configuration example of a wireless network system applied to the present embodiment. In FIG. 1A, the wireless network system 1 includes a mobile phone terminal 10 and peripheral devices 20-23. The mobile phone terminal 10 and the peripheral devices 20 to 23 have a wireless communication function. Further, in the present embodiment, as shown in FIG. 5B by surrounding with a dotted-line square, the front, front right direction, front left direction, right direction, left side are centered on the user having the mobile phone terminal 10. Eight directions of direction, rear, rear right direction, and rear left direction are used as directions in which peripheral devices are located.

  With reference to this illustrated direction, the peripheral device 20 is positioned in the left front direction of the mobile phone terminal 10, the peripheral device 21 is positioned in front of the mobile phone terminal 10, and the peripheral device 22 is in the right direction of the mobile phone terminal 10. The peripheral device 23 is located in the rear right direction of the mobile phone terminal 10.

  The range of a circle indicated by a dotted line in the figure is for determining whether the wireless communication distance from the mobile phone terminal 10 to the peripheral devices 20 to 23 is a short distance (for example, within 5 m) or a long distance (for example, 5 m or more). This is a distance discrimination area, and the discrimination distance is used as a distance discrimination threshold. With the distance determination threshold, the peripheral devices 20 and 21 are located at a long distance from the mobile phone terminal 10, and the peripheral devices 22 and 23 are located at a short distance from the mobile phone terminal 10. The type of the peripheral device 20 is a printer including a printing unit, the type of the peripheral devices 21 and 23 is a display including a display unit, and the type of the peripheral device 22 is a video camera including an imaging unit. .

  Note that these peripheral devices 20 to 23 are merely examples, and any peripheral device having a wireless communication function may be used. For example, a microphone having voice input means, a speaker or headphones having voice output means, a headset having voice input means and voice output means, a digital camera having imaging means, and a keyboard or mouse having key input means Any device capable of communicating with the mobile phone terminal 10 by a wireless communication means such as a video having a recording means, an audio recorder having a recording means, a personal computer, or a PDA (Personal Digital Assistance) may be used.

  In this embodiment, Bluetooth is used as a device communication wireless communication method. However, other device cooperation wireless communication methods such as wireless LAN, UWB (Ultra Wide Band), NFC (Near Field Communication), ZigBee (registered trademark) or the like may be used.

  FIG. 2 is a block diagram showing a configuration of the mobile phone terminal 10 of FIG. 2, the mobile phone terminal 10 includes an application execution unit 100, a storage unit 101, a selection control unit 102, a wireless communication unit 103, a control unit 110, a communication unit 111, a key input unit 112, a display, Unit 113, display control unit 114, audio input unit 115, and audio output unit 116.

  The application execution unit 100 executes various application programs stored in the storage unit 101 under the control of the control unit 110. The storage unit 101 stores an icon table in which icons corresponding to application program and peripheral device type identifiers are registered.

  In the selection control unit 102, when one or more predetermined keys are pressed to make a selection with the key input unit 112, the peripheral device indicated by the selection auxiliary function included in the display unit 113 described later is selected. This is stored, and the selection instruction is transmitted to the wireless communication unit 103 via the control unit 110.

  The wireless communication unit 103 has a Bluetooth communication function used in the present embodiment, and executes a device cooperation communication protocol with the peripheral devices 20 to 23 by the communication function. The control unit 110 controls each unit in the mobile phone terminal 10 to control the mobile phone function and various application functions. The communication unit 111 has a mobile communication function, and transmits and receives a call signal by executing a mobile communication protocol with a mobile phone terminal as a communication partner via a mobile network (not shown).

  The key input unit 112 includes a numeric keypad and various function keys, and outputs a key input signal corresponding to the key input operation to the control unit 110. The display unit 113 includes a liquid crystal display panel or the like, and displays icons and the like of the peripheral devices 20 to 23 by display control of the display control unit 114. The display control unit 114 performs display control of the icon display of each peripheral device 20 to 23 on the display unit 113 based on the position information of each peripheral device 20 to 23 acquired by the wireless communication unit 103.

  The voice input unit 115 includes a microphone or the like, converts a user's transmission voice into a transmission voice signal, and outputs the transmission voice signal to the control unit 110. The audio output unit 116 includes a speaker or the like, converts the received audio signal input from the control unit 110, and outputs the received audio.

  Next, the operation in the wireless network system 1 of FIG. 1 will be described below. In this operation, an example will be described in which the mobile phone terminal 10 searches for a peripheral device existing in the wireless communication area, and the search result is divided and displayed in a search result display area set in the display unit 113. FIG. 3 is a diagram illustrating an example of a search result display area set in the display unit 113. In the search result display area 300, the display area of the display unit 113 is divided into nine areas (areas 1 to 9).

  The display operation of the peripheral device icon in the mobile phone terminal 10 of the present embodiment will be described with reference to the flowchart shown in FIG.

  In the key input unit 112 of the mobile phone terminal 10, when a user presses one or more predetermined keys for searching for a peripheral device, the peripheral device search request for requesting the peripheral device is controlled. The data is transmitted to the display control unit 114 via the unit 110.

  Note that the peripheral device search request is issued when one or more predetermined keys are pressed by the key input unit 112, when a predetermined signal is received by the wireless communication unit 103, or by the voice input unit 115. Corresponding to a case where a predetermined procedure is performed to request a peripheral device search, such as when a predetermined voice is input or when a predetermined application is executed by the application execution unit 100 Is transmitted from the means.

  In addition, in the wireless communication method used in the peripheral device search, if a search with conditions is possible, a search condition such as a device type and a position (search range) is also transmitted in the peripheral device search instruction. It may be.

  When receiving a peripheral device search request from the control unit 110 (step S1), the display control unit 114 transmits the peripheral device search instruction to the wireless communication unit 103 via the control unit 110 (step S2). Upon receiving the peripheral device search instruction, the wireless communication unit 103 searches for peripheral devices and acquires position information (distance and direction) in accordance with a well-known Bluetooth inquiry (Inquiry) and SDP (Service Discovery Protocol).

  The wireless communication unit 103 creates a search list from the acquired information, and transmits the search list to the display control unit 114 via the control unit 110. An example of the search list is shown in FIG. The search list 500 includes device identifiers, type identifiers, and position information (distance, direction) of the searched peripheral devices 20 to 23. The position information includes the distance from the mobile phone terminal 10, the direction, and the direction information. Consists of

  If the device list, type identifier, and location information are included in the search list, other information related to peripheral devices such as wireless radio wave status, peripheral device status, and icon information to be displayed is added. May be. The device identifier may be anything as long as it can identify the device, such as the name of the device such as “peripheral device 20” shown in the figure or the device address such as “10.10.10.1”. The type identifier may be anything as long as it can identify the type of device, such as the type of device such as “display” and the function of the device such as “display function”. The position information may be anything as long as it indicates the position of the peripheral device, such as an absolute position, an address, a floor, a building name, and a floor number, in addition to the relative distance and direction from the mobile phone terminal 10.

  In addition, the search for peripheral devices may be performed using the above-described known technology or a unique procedure. When using this unique procedure, any layer of that procedure may be used. In addition, the acquisition of the relative distance from the mobile phone terminal 10 in the position information may be performed using a known procedure defined by each wireless communication method such as UWB, and the wireless coverage area can be controlled. A technique of measuring a distance by changing a wireless coverage area using a wireless communication method such as Bluetooth may be applied.

  In addition, all peripheral devices 20 to 23 and the mobile phone terminal 10 have means for acquiring an absolute position such as a GPS (Global Positioning System), and have a unique procedure such as a known procedure for acquiring a relative position between devices from the absolute position. The following procedure may be used. When using this unique procedure, any layer of that procedure may be used. In addition, acquisition of the relative direction from the mobile phone terminal 10 in the position information may be performed using a known technique such as a known technique using an array antenna or the like, or a procedure using the GPS. When using this unique procedure, any layer of that procedure may be used.

  Upon receiving the search list 500 from the wireless communication unit 103 (step S3), the display control unit 114 acquires a corresponding icon from the icon table stored in the storage unit 101 based on the device identifier of the search list 500 ( In step S4), icon display is controlled based on the position information of the search list 500 (step S5). In the icon display control based on the position information, the icon display position (areas 1 to 9 in FIG. 3) is determined based on the direction included in the position information, and the icon display size is determined based on the distance included in the position information. To do.

  That is, when the direction of the position information is the front left direction, it is the region 1 of FIG. 3, the front is the region 2, the front right direction is the region 3, the left direction is the region 4, the right direction The display position is controlled to be set in the area 6, in the case of the left rear direction, in the area 7, in the rear direction in the area 8, and in the rear right direction, the area 9 is controlled.

  According to the positions of the peripheral devices 20 to 23 shown in FIG. 1, the peripheral device 20 is in the region 1, the peripheral device 21 is in the region 2, the peripheral device 22 is in the region 6, and the peripheral device 23 is in the region 9. The display position is determined.

  Further, when the distance of the position information is a short distance (for example, within 5 m), the icon display is large, and when the distance is a long distance (for example, 5 m or more), the icon display is small, and the display is controlled. According to the positions of the peripheral devices 20 to 23 illustrated in FIG. 1, the icons of the peripheral devices 20 and 21 are controlled to be small and the icons of the peripheral devices 22 and 23 are displayed to be large.

  An example of the icon table is shown in FIG. This icon table 600 shows a case where icons corresponding to a display, a video camera, a printer, and a digital camera are registered as peripheral device type identifiers.

  It should be noted that the icon display control may be any control method that can recognize differences in peripheral devices such as color, darkness, shape, hierarchy of pages, etc. in addition to display position and size. The combination of the position information components (distance, direction) and the icon display control (display position, size) may be any display control method in which the position information components can be intuitively understood. Further, the display position of the icon is not limited to the direction of FIG. 1 as long as it is arranged so that the direction can be intuitively understood in the search result display area 300. The size of the icon may be a display form that allows the distance to be intuitively understood in the search result display area 300, and any display form may be used. In this embodiment, an example of two stages of a large icon and a small icon is shown, but the size may be increased, and the size of the icon is continuously controlled in proportion to the distance. You may make it do. Further, although the threshold value for controlling the size of the icon is 5 m, it may be longer or shorter than this.

  Next, when the display control unit 114 determines the display position and the display form, the display control unit 114 reads a corresponding icon from the icon table 600 stored in the storage unit 101, and issues a display instruction for displaying the icon via the control unit 110. It transmits to the display part 113 (step S6), and complete | finishes this process. When receiving the display instruction, the display unit 113 displays the icons of the peripheral devices 20 to 23 in the search result display area 300 according to the display instruction.

  FIG. 7 shows an example of icon display displayed on the display unit 113 by the search result display control described above. As shown in FIG. 7, a printer icon indicating the peripheral device 20 is displayed in a small area 1, a display icon indicating the peripheral device 21 is displayed in a small area 2, and a video camera icon indicating the peripheral device 22 is displayed in the area. 6, and a display icon indicating the peripheral device 23 is displayed large in the area 9. At this time, a device identifier is also displayed below each icon. In the area 5, an icon indicating the user of the mobile phone terminal 10 is displayed, and “4” indicating the number of searched peripheral devices is displayed on the upper portion of the display unit 113. Nothing is displayed in the areas 3, 4, 7, and 8 where the peripheral device is not searched.

  From the display contents of the search result, the user of the mobile phone terminal 10 can intuitively know the types of the peripheral devices 20 to 23 existing around the own device, the direction and distance in which they exist.

  The device identifier and the number of searched peripheral devices may or may not be displayed, and their display positions are not particularly limited. In the area 5, icons, characters, and the like indicating the user and the mobile phone terminal 10 may be displayed, and the display form is not limited. An icon, characters, or the like indicating that the device has not been searched may be displayed in the area where the peripheral device has not been searched.

  Further, another display example of the search result is shown in FIG. In this display example, the distance determination area of FIG. 1 is displayed as an area, the icons of the peripheral devices 20 to 23 are displayed in a size corresponding to the corresponding direction and distance, and the device identifier is displayed below each icon. The number of the searched peripheral devices is displayed at the upper part of the display unit 113.

  Even in the display contents of such a search result, the user of the mobile phone terminal 10 can intuitively know the types of the peripheral devices 20 to 23 existing around the own device, the direction and distance in which they exist. .

  Next, additional operations other than the display control operation of the display control unit 114 will be described below.

  First, the operation of the display control unit 114 when there are a plurality of peripheral devices in the same direction of the mobile phone terminal 10 will be described with reference to the display examples of FIGS.

  When there are a plurality of peripheral devices in the same direction from the mobile phone terminal 10, the display control unit 114 transmits a display instruction to the display unit 113 via the control unit 110 so that the display is divided into a plurality of pages. As shown in FIG. 9, the display unit 113 displays the page number “1/2” at the top of the search result display screen and the “next page” at the bottom to search the user for the second page. Specify that there is a result. In the key input unit 112, when “next page” is operated by pressing one or more predetermined keys to perform page switching, the search result of the first page displayed on the display unit 113 is 2 Switch to the search result display of the page.

  Therefore, for example, when the peripheral device 24 (display) further exists at a long distance (for example, 5 m or more) in the rear right direction of the mobile phone terminal 10, the page switching operation causes the second page to be displayed as shown in FIG. A small display icon indicating the peripheral device 24 is displayed in the area 9 in the search result display screen.

  Therefore, even when there are a plurality of peripheral devices in the same direction, the user can intuitively know that there are a plurality of peripheral devices in the same direction.

  Note that the display method when there are a plurality of peripheral devices in the same direction may be hierarchical display by the illustrated page, or the number of peripheral devices to be displayed at one time is limited and a plurality of peripheral devices are displayed on one page. Peripheral devices may be displayed, or only the nearest peripheral device may be displayed. In short, what is necessary is just to display so that a user can understand the positional information of a peripheral device intuitively, and the display form is not specifically limited.

  Further, the display position and display timing of the page number are not particularly limited. In addition to the method of key operation of the key input unit 112, the page switching method is predetermined when a predetermined signal is received by the wireless communication unit 103 or when the voice input unit 115 of the mobile phone terminal 10 is predetermined. The procedure may be a predetermined procedure for switching pages when a received voice is input.

  Next, the operation of the display control unit 114 when the orientation of the mobile phone terminal 10 is changed will be described with reference to the display example of FIG.

  The display control unit 114 of the mobile phone terminal 10 has a direction detection function for detecting a direction in which the mobile phone terminal 10 is facing (hereinafter referred to as a direction), and stores the direction when the search list is received, When the current orientation of the mobile phone terminal 10 is changed from the stored orientation, a display position change instruction for correcting the display position of the currently displayed icon is transmitted to the display unit 113 via the control unit 110.

  Upon receiving the display position change instruction, display unit 113 changes the display position of the icon being displayed in accordance with the display position change instruction and displays it in the search result display area. Accordingly, for example, when the search result shown in FIG. 7 is displayed as the search result searched in the direction of the user in FIG. 1B, the user changes the direction 45 ° to the left as shown in FIG. 11 ( In the case of turning to the left in the figure), the change in the direction is detected by the display control unit 114, and a display position change instruction for correcting the display position of the icon being displayed in FIG. 113. As a result, as shown in FIG. 11, the icon of the peripheral device 20 is changed and displayed from the region 1 to the region 3, the icon of the peripheral device 21 is changed and displayed from the region 2 to the region 6, and the icon of the peripheral device 22 is changed to the region 6. Is changed from area 9 to area 7, and the icon of the peripheral device 23 is changed from area 9 to area 7.

  Therefore, even when the orientation of the user is changed, the display position of the icon of the peripheral device is changed according to the change of the orientation, so that the user can intuitively understand the positional relationship between the mobile phone terminal and the peripheral device when the orientation is changed. Can know.

  If the wireless communication unit 103 has a direction detection function, the direction may be detected using this function. In this case, the direction when searching for the peripheral device may be stored. Further, the acquisition timing of the current orientation may be periodically performed, or may be acquired by recognizing that the user has moved using an acceleration sensor or the like. In addition, whether or not the orientation has been changed may be determined when the orientation is changed beyond a certain level, or the orientation may be changed, or the icon display position may be changed (here, the region is changed). It may be determined that the change has occurred when straddling occurs. Further, not only the direction but also the change of other position information such as a relative distance may be detected to correct the icon display control (size, display position, etc.). In this case, the position information may be detected by using a GPS or an acceleration sensor.

  Next, the operation of the display control unit 114 when there is a peripheral device that cannot be used by the mobile phone terminal 10 will be described with reference to the display example of FIG.

  The display control unit 114 of the mobile phone terminal 10 is already reserved for the searched peripheral device as a result of checking the schedule when the searched peripheral device is in use, or by accessing a server that manages the schedule of the peripheral device. If the searched peripheral device is unusable, such as when the icon is entered, an unusable instruction for dimming the display color of the icon of the peripheral device is transmitted to the display unit 113 via the control unit 110.

  When the display unit 113 receives the unusable instruction, the display unit 113 displays the icon display color in the search result display area in accordance with the unusable instruction. For example, as shown in FIG. 12, when the peripheral device 23 is unusable, the display color of the icon of the peripheral device 23 is displayed light.

  Therefore, even when there is an unusable peripheral device among the searched peripheral devices, the user can intuitively identify the unusable peripheral device because the icon is displayed with a thin display color or the like. I can know.

  The icon display control may be any display control method that intuitively indicates that the color cannot be used, such as color, size, and shape, in addition to the darkness of the display color. In addition, it is not necessary to display an icon of an unusable peripheral device. The number of unusable peripheral devices may or may not be displayed, and the display position and display timing are not particularly limited.

  Next, an operation of selecting and connecting a desired peripheral device by key input from the peripheral devices displayed in the search result will be described with reference to display examples of FIGS.

  The display unit 113 includes a selection assisting function (see FIG. 13) that can intuitively perform selection by moving a cursor or the like for each peripheral device area displayed as a search result. This selection assist function is controlled according to a key input operation of the key input unit 112.

  The selection control unit 102 stores that the peripheral device pointed to by the selection assist function of the display unit 113 is selected when one or more predetermined keys are pressed to make a selection at the key input unit 112. The selection instruction is transmitted to the display unit 113 via the control unit 110.

  When receiving the selection instruction, the display unit 113 changes the background color of the icon of the selected peripheral device according to the selection instruction as shown in FIG. Further, the number “1/4” of the selected peripheral devices is displayed on the upper portion of the display unit 113 in FIG.

  When one or more predetermined keys are pressed to connect to a peripheral device at the key input unit 112, the selection control unit 102 instructs to connect to the selected peripheral device stored therein. Is transmitted to the wireless communication unit 103 via the control unit 110. Upon receiving the peripheral device connection instruction, the wireless communication unit 103 wirelessly connects to the selected peripheral device in accordance with a well-known wireless communication method based on Bluetooth.

  Therefore, even when a desired peripheral device is selected and connected from the searched peripheral devices, the user intuitively selects the desired peripheral device by a simple key operation such as a cursor on the displayed search result display screen. Can be connected.

  Note that the selection assist function may be controlled using signal reception of the wireless communication unit 103, voice input of the voice input unit 115 of the mobile phone terminal 10, or the like. In addition to the above selection and connection procedure, peripheral devices are selected and connected when a predetermined signal is received by the wireless communication unit 103 or when a predetermined sound is input from the sound input unit 115. Any procedure may be used as long as it is a predetermined procedure for selecting and connecting peripheral devices. In addition to the display form described above, display control of the selected icon may be any control method that intuitively indicates that the selected icon is selected, such as color, size, shape, and darkness. Further, the number of selected peripheral devices may be displayed or not displayed. Further, the display location and display timing are not particularly limited.

  Next, an operation when displaying detailed information of a desired peripheral device by key input from the peripheral device displayed on the display unit 113 will be described with reference to display examples of FIGS.

  As shown in FIG. 13, the display unit 113 includes a selection assist function that can intuitively select a cursor or the like. The selection assist function is controlled according to the key input of the key input unit 112.

  When one or more predetermined keys are pressed to display the detailed information of the peripheral device by the key input unit 112, the selection control unit 102 details the peripheral device indicated by the selection assist function of the display unit 113. Information and a detailed information display instruction are transmitted to the display unit 113 via the control unit 110. The detailed information is information registered in the search list, and is other information related to the peripheral device such as a device identifier, a type identifier, position information, a radio wave state, and an operation state of the peripheral device.

  When receiving the detailed information display instruction, the display unit 113 displays the detailed information of the selected peripheral device as shown in FIG. 15 according to the detailed information display instruction. FIG. 15 is a detailed information display example when a detailed information display instruction is given for the peripheral device 21 (display) existing in front of the mobile phone terminal 10. In this case, as the detailed information of the peripheral device 21, “display” indicating the type identifier, “Company A” indicating the manufacturer name, “32 type” indicating the function, and “forward 5 m or more” indicating the position information. And are displayed.

  FIG. 16 is a detailed information display example when a detailed information display instruction is issued for the peripheral device 23 (display) that cannot be used. In this case, information “2005/3/1 14: 00-16: 00” indicating the operating state and “Taro Yamada” indicating the user are displayed as detailed information of the peripheral device 23.

  Therefore, even when the detailed information of the desired peripheral device is displayed from the displayed peripheral devices, the user intuitively selects the desired peripheral device with a simple key operation such as a cursor on the displayed search result display screen. Detailed information can be displayed.

  In addition to the above cursor key operations, the peripheral device is selected when a predetermined signal is received by the wireless communication unit 103 or when a predetermined voice is input by the voice input unit 115 of the mobile phone terminal 10. Any procedure may be used as long as it is a predetermined procedure for displaying the detailed information of the peripheral device. Further, detailed information may be displayed only by overlaying a cursor on a display area of a desired peripheral device.

  The present invention searches for peripheral devices that exist around the mobile terminal device, and displays easy-to-understand position information such as the direction in which the peripheral device exists and the distance to the peripheral device, improving user convenience and burden. It is useful for a portable terminal device and a peripheral device display method for reducing the above-mentioned problem.

(A) of the wireless network system which concerns on one embodiment of this invention is a figure which shows the whole structure, (b) is a figure which shows the presence direction of the peripheral device with respect to a mobile telephone terminal Block diagram showing a configuration of a mobile phone terminal according to the present embodiment The figure which shows the search result display area of the display part which concerns on this Embodiment. The flowchart which shows operation | movement from the peripheral device search of the mobile telephone terminal which concerns on this Embodiment to search result display. The figure which shows an example of the search list which concerns on this Embodiment The figure which shows an example of the icon table which concerns on this Embodiment The figure which shows the example of a display of the search result of the display part which concerns on this Embodiment The figure which shows the other example of a display of the search result of the display part which concerns on this Embodiment The figure which shows the example of a display of the search result of a display part when several peripheral devices exist in the same direction which concerns on this Embodiment The figure which shows the example of a display of the search result of a display part when several peripheral devices exist in the same direction which concerns on this Embodiment The figure which shows the example of a display of the search result of a display part when the direction of the mobile telephone terminal user which concerns on this Embodiment is changed The figure which shows the example of a display of the search result of a display part when the unusable peripheral device which concerns on this Embodiment exists The figure which shows the selection assistance function which selects a peripheral device in the search result display screen which concerns on this Embodiment. The figure which shows the example of a display when a peripheral device is selected by the selection assistance function which concerns on this Embodiment The figure which shows the example of a display of the detailed information of the peripheral device selected in the search result display screen which concerns on this Embodiment The figure which shows the example of a display of the detailed information when the peripheral device selected in the search result display screen concerning this Embodiment is unusable.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Wireless network system 10 Mobile phone terminal 20-23 Peripheral device 100 Application execution part 101 Memory | storage part 102 Selection control part 103 Wireless communication part 110 Control part 111 Communication part 112 Key input part 113 Display part 114 Display control part 115 Voice input part 116 Audio output unit 300 Search result display area 500 Search list 600 Icon table

Claims (7)

  1. Wireless communication means for performing wireless communication with the peripheral device, searching for the peripheral device, and acquiring position information of the peripheral device;
    Display control means for controlling the display of the peripheral device icon based on the peripheral device position information acquired by the wireless communication means;
    Display means for displaying peripheral device icons by display control of the display control means;
    A portable terminal device comprising:
  2.   The mobile terminal device according to claim 1, wherein the display control unit controls a display position of the peripheral device icon based on a direction included in the position information.
  3.   The display control means includes peripheral devices in front of the own device on the upper side, peripheral devices in the rear from the own device on the lower side, peripheral devices in the right direction from the own device on the right side, and peripheral devices in the left direction from the own device. 3. The mobile terminal device according to claim 2, wherein the display position of each peripheral device icon is controlled on the left side.
  4.   The display control means is configured such that the peripheral device in the front right direction from the own device is on the upper right side, the peripheral device in the front left direction from the own device is on the upper left side, and the peripheral device in the rear right direction from the own device is on the lower right side. 4. The portable terminal device according to claim 2, wherein the peripheral device in the rear left direction from the device is controlled to the lower left side, and the display position of each peripheral device icon is controlled.
  5.   5. The portable terminal device according to claim 1, wherein the display control unit controls a display form of the peripheral device icon based on a distance included in the position information.
  6.   The display control means controls the display form of the peripheral device icon to display a peripheral device icon at a short distance from the own device and to display a small peripheral device icon at a long distance from the own device. The mobile terminal device according to claim 5.
  7. A display method for displaying a plurality of peripheral devices existing around a mobile terminal device,
    A location information acquisition step of searching for a peripheral device by wireless communication and acquiring location information of the peripheral device;
    Based on the acquired location information of the peripheral device, a display control step for controlling the display of the peripheral device icon,
    A display step of displaying a peripheral device icon by the display control;
    A display method characterized by comprising:
JP2005250218A 2005-08-30 2005-08-30 Mobile terminal device and display method Withdrawn JP2007067724A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2005250218A JP2007067724A (en) 2005-08-30 2005-08-30 Mobile terminal device and display method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2005250218A JP2007067724A (en) 2005-08-30 2005-08-30 Mobile terminal device and display method

Publications (1)

Publication Number Publication Date
JP2007067724A true JP2007067724A (en) 2007-03-15

Family

ID=37929420

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2005250218A Withdrawn JP2007067724A (en) 2005-08-30 2005-08-30 Mobile terminal device and display method

Country Status (1)

Country Link
JP (1) JP2007067724A (en)

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009217815A (en) * 2008-03-07 2009-09-24 Samsung Electronics Co Ltd User interface apparatus of mobile station having touch screen and method thereof
KR20110016167A (en) * 2009-08-11 2011-02-17 엘지전자 주식회사 Electronic device and control method thereof
KR20110055275A (en) * 2009-11-19 2011-05-25 엘지전자 주식회사 Apparatus and method for displaying menus on mobile terminal
JP2011124804A (en) * 2009-12-10 2011-06-23 Toshiba Corp Communication device and position information transmitting/receiving method
WO2012033065A1 (en) * 2010-09-09 2012-03-15 富士通株式会社 Information processing device
JP2012080533A (en) * 2010-09-30 2012-04-19 Immersion Corp Haptically enhanced interactivity with interactive content
JP2012178752A (en) * 2011-02-28 2012-09-13 Casio Comput Co Ltd Portable apparatus and program
JP2012217126A (en) * 2011-03-31 2012-11-08 Brother Ind Ltd Program of portable device, portable device, and control method of portable device
JP2012235440A (en) * 2010-09-29 2012-11-29 Brother Ind Ltd Program of mobile device, mobile device, and method of controlling mobile device
JP2012533951A (en) * 2009-07-21 2012-12-27 エスティー‐エリクソン、ソシエテ、アノニム Bluetooth device detection device and process
JP2013251913A (en) * 2009-10-02 2013-12-12 Qualcomm Inc Device movement user interface gestures for file sharing functionality
JP2014038600A (en) * 2012-07-20 2014-02-27 Ricoh Co Ltd Information providing device, information providing method, and information providing system
JP2014093625A (en) * 2012-11-02 2014-05-19 Yamaha Corp Music system control method
JP5505412B2 (en) * 2009-05-14 2014-05-28 日本電気株式会社 Information processing apparatus, external device expansion system, external device expansion method, external device expansion program, and program recording medium
JP2014103673A (en) * 2013-11-27 2014-06-05 Canon Inc Communication device, its control method, and program
JP2014165601A (en) * 2013-02-22 2014-09-08 Ricoh Co Ltd Information output system, portable terminal, control method, and program
KR101442544B1 (en) 2007-12-18 2014-09-23 엘지전자 주식회사 Mobile terminal and its method for displaying radio device
JP2014206904A (en) * 2013-04-15 2014-10-30 オリンパス株式会社 Wearable device, program and display control method of wearable device
JP2014531657A (en) * 2011-09-16 2014-11-27 サムスン エレクトロニクス カンパニー リミテッド Object search method and system on network
KR101472785B1 (en) * 2008-01-07 2014-12-16 삼성전자주식회사 Method for optimized-sharing multimedia contents and mobile terminal using the same
KR101474456B1 (en) * 2008-08-29 2014-12-19 엘지전자 주식회사 Mobile terminal and method for blocking device thereof
KR101518830B1 (en) 2008-09-02 2015-05-12 삼성전자주식회사 Collecting Information Display Device For Portable Device And Method Using the same
CN104869268A (en) * 2014-02-26 2015-08-26 富士施乐株式会社 Display Control Apparatus, Image Forming Apparatus, And Non-transitory Computer Readable Medium
JP2015170051A (en) * 2014-03-05 2015-09-28 京セラドキュメントソリューションズ株式会社 device registration program
WO2015174112A1 (en) * 2014-05-15 2015-11-19 ソニー株式会社 Terminal device, system, information presentation method, and program
JP2016133468A (en) * 2015-01-22 2016-07-25 飛島建設株式会社 Positioning system
US9571625B2 (en) 2009-08-11 2017-02-14 Lg Electronics Inc. Electronic device and control method thereof
US9606762B2 (en) 2010-09-29 2017-03-28 Brother Kogyo Kabushiki Kaisha Non-transitory computer-readable recording device storing computer program including instructions for causing a device to select an object device with which the device communicates
KR101859959B1 (en) * 2011-07-25 2018-05-21 엘지전자 주식회사 Mobile terminal, and method for operating the same
US10523804B2 (en) 2011-09-16 2019-12-31 Samsung Electronics Co., Ltd. Method and system for searching for object in network

Cited By (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101442544B1 (en) 2007-12-18 2014-09-23 엘지전자 주식회사 Mobile terminal and its method for displaying radio device
KR101472785B1 (en) * 2008-01-07 2014-12-16 삼성전자주식회사 Method for optimized-sharing multimedia contents and mobile terminal using the same
JP2009217815A (en) * 2008-03-07 2009-09-24 Samsung Electronics Co Ltd User interface apparatus of mobile station having touch screen and method thereof
US9983777B2 (en) 2008-03-07 2018-05-29 Samsung Electronics Co., Ltd. User interface method and apparatus for mobile terminal having touchscreen
US9104301B2 (en) 2008-03-07 2015-08-11 Samsung Electronics Co., Ltd. User interface method and apparatus for mobile terminal having touchscreen
KR101474456B1 (en) * 2008-08-29 2014-12-19 엘지전자 주식회사 Mobile terminal and method for blocking device thereof
KR101518830B1 (en) 2008-09-02 2015-05-12 삼성전자주식회사 Collecting Information Display Device For Portable Device And Method Using the same
JP5505412B2 (en) * 2009-05-14 2014-05-28 日本電気株式会社 Information processing apparatus, external device expansion system, external device expansion method, external device expansion program, and program recording medium
US9002273B2 (en) 2009-07-21 2015-04-07 St-Ericsson Sa Apparatus and process for detection of a bluetooth device
JP2012533951A (en) * 2009-07-21 2012-12-27 エスティー‐エリクソン、ソシエテ、アノニム Bluetooth device detection device and process
EP2293531B1 (en) * 2009-08-11 2019-10-02 Lg Electronics Inc. Electronic device and control method thereof
US10289371B2 (en) 2009-08-11 2019-05-14 Lg Electronics Inc. Electronic device and control method thereof
KR101669520B1 (en) * 2009-08-11 2016-10-26 엘지전자 주식회사 Electronic device and control method thereof
KR20110016167A (en) * 2009-08-11 2011-02-17 엘지전자 주식회사 Electronic device and control method thereof
US9571625B2 (en) 2009-08-11 2017-02-14 Lg Electronics Inc. Electronic device and control method thereof
JP2013251913A (en) * 2009-10-02 2013-12-12 Qualcomm Inc Device movement user interface gestures for file sharing functionality
KR101641236B1 (en) 2009-11-19 2016-07-20 엘지전자 주식회사 Apparatus and method for displaying menus on mobile terminal
KR20110055275A (en) * 2009-11-19 2011-05-25 엘지전자 주식회사 Apparatus and method for displaying menus on mobile terminal
JP2011124804A (en) * 2009-12-10 2011-06-23 Toshiba Corp Communication device and position information transmitting/receiving method
WO2012033065A1 (en) * 2010-09-09 2012-03-15 富士通株式会社 Information processing device
JP2012060479A (en) * 2010-09-09 2012-03-22 Fujitsu Ltd Information processing apparatus
JP2012235440A (en) * 2010-09-29 2012-11-29 Brother Ind Ltd Program of mobile device, mobile device, and method of controlling mobile device
US9606762B2 (en) 2010-09-29 2017-03-28 Brother Kogyo Kabushiki Kaisha Non-transitory computer-readable recording device storing computer program including instructions for causing a device to select an object device with which the device communicates
US9727217B2 (en) 2010-09-30 2017-08-08 Immersion Corporation Haptically enhanced interactivity with interactive content
US10248298B2 (en) 2010-09-30 2019-04-02 Immersion Corporation Haptically enhanced interactivity with interactive content
US10073598B2 (en) 2010-09-30 2018-09-11 Immersion Corporation Haptically enhanced interactivity with interactive content
JP2012080533A (en) * 2010-09-30 2012-04-19 Immersion Corp Haptically enhanced interactivity with interactive content
JP2012178752A (en) * 2011-02-28 2012-09-13 Casio Comput Co Ltd Portable apparatus and program
JP2012217126A (en) * 2011-03-31 2012-11-08 Brother Ind Ltd Program of portable device, portable device, and control method of portable device
KR101859959B1 (en) * 2011-07-25 2018-05-21 엘지전자 주식회사 Mobile terminal, and method for operating the same
KR101930510B1 (en) * 2011-09-16 2018-12-19 삼성전자주식회사 Method and system for searching object in network
JP2014531657A (en) * 2011-09-16 2014-11-27 サムスン エレクトロニクス カンパニー リミテッド Object search method and system on network
US10523804B2 (en) 2011-09-16 2019-12-31 Samsung Electronics Co., Ltd. Method and system for searching for object in network
JP2014038600A (en) * 2012-07-20 2014-02-27 Ricoh Co Ltd Information providing device, information providing method, and information providing system
JP2014093625A (en) * 2012-11-02 2014-05-19 Yamaha Corp Music system control method
JP2014165601A (en) * 2013-02-22 2014-09-08 Ricoh Co Ltd Information output system, portable terminal, control method, and program
JP2014206904A (en) * 2013-04-15 2014-10-30 オリンパス株式会社 Wearable device, program and display control method of wearable device
JP2014103673A (en) * 2013-11-27 2014-06-05 Canon Inc Communication device, its control method, and program
CN104869268B (en) * 2014-02-26 2018-05-29 富士施乐株式会社 Display control unit, image forming apparatus and display control method
CN104869268A (en) * 2014-02-26 2015-08-26 富士施乐株式会社 Display Control Apparatus, Image Forming Apparatus, And Non-transitory Computer Readable Medium
JP2015170051A (en) * 2014-03-05 2015-09-28 京セラドキュメントソリューションズ株式会社 device registration program
JPWO2015174112A1 (en) * 2014-05-15 2017-04-20 ソニー株式会社 Terminal device, system, information presentation method and program
WO2015174112A1 (en) * 2014-05-15 2015-11-19 ソニー株式会社 Terminal device, system, information presentation method, and program
JP2016133468A (en) * 2015-01-22 2016-07-25 飛島建設株式会社 Positioning system

Similar Documents

Publication Publication Date Title
EP3036596B1 (en) Method, apparatus, and computer program product for management of connected devices, such as in a wireless docking environment
US7027881B2 (en) Remote control system, electronic device, and program
US6622018B1 (en) Portable device control console with wireless connection
JP4571690B2 (en) Method, apparatus, and storage medium storing computer program for operating mobile device in response to user input via movement of mobile device
JP2010523023A (en) Method, system, and mobile device for prioritizing a discovered device list
US7184707B2 (en) Communication device and a method for controlling the communication device
JP2010130669A (en) In-vehicle device and wireless communication system
KR20130048928A (en) Apparatus and method for controlling controllable device in portable terminal
US8547342B2 (en) Gesture-based delivery from mobile device
US20030018744A1 (en) Bluetooth device position display
JP2008517525A (en) Portable wireless communication apparatus displaying information on a plurality of display screens, operating method of the portable wireless communication apparatus, and computer program for operating the portable wireless communication apparatus
US8731610B2 (en) Method for adaptive user interface in mobile devices
KR20080075698A (en) Apparatus for providing location information of hand-held devices and method thereof
US20070238475A1 (en) Wireless communications device with priority list
KR20120017617A (en) Method and system for bluetooth communication
JP2006262420A (en) Electronic equipment, registration method and registration program therefor
US20070264976A1 (en) Portable device with short range communication function
US20090029736A1 (en) Mobile terminal and sim indicative information display method thereof
US6999721B2 (en) Unified object transfer for multiple wireless transfer mechanisms
KR20110015105A (en) Mobile terminal providing environment adapted to present situation and method for operating the same
KR20140146954A (en) Method and device for providing service
KR101807286B1 (en) Method and apparatus for performing function in mobile terminal using short range communication
US8378807B2 (en) Bluetooth communication method and system
KR20110040198A (en) Method for controlling mobile device, display apparatus and video system
US20070026904A1 (en) Handsfree device

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20080715

A761 Written withdrawal of application

Free format text: JAPANESE INTERMEDIATE CODE: A761

Effective date: 20090601