JP2010191813A - Information retrieval system, information retrieval method, and terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information retrieval system, an information retrieval method and a terminal, enabling intuitive selection, without requiring setting by a user, when selecting retrieval information to be displayed. <P>SOLUTION: This information retrieval system 1 includes a retrieval information holding part 34 for holding the retrieval information in association with positional information of a corresponding retrieval object, a retrieval information display selection part 18 for selecting the retrieval information to be displayed by the terminal 10, from the retrieval information held by the retrieval information holding part 34, based on a position of the terminal 10 calculated by a terminal position calculating part 12, a direction determined based on a screen display part 20 of the terminal 10 calculated by a terminal direction calculating part 19, and a posture of the terminal 10 calculated by a terminal posture calculating part 17, and a screen display part 20 for displaying the retrieval information selected by a retrieval information display selection part 18, on the terminal 10. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an information search system, an information search method, and a terminal.

  In recent years, a search service using augmented reality (AR) by a mobile terminal has been proposed (for example, Patent Document 1).

  These can display a search result on the screen based on information on the actual position and the direction in which the camera is facing.

JP 2008-250474 A

  However, according to the method described in Patent Document 1, detailed information such as facilities and places in the shooting range is displayed on the screen based on the image shot by the camera, and the user can set the search range by the user. There is a problem that it is necessary to set (select the type of search object by an icon. Refer to FIG. 8 of Patent Document 1), which is troublesome.

  Therefore, in order to solve the above-described problem, the present invention provides an information search system, an information search method, and a terminal that can be selected intuitively without requiring setting by a user when selecting search information to be displayed. The purpose is to provide.

  In order to solve the above problem, an information search system according to the present invention is an information search system including a terminal having a screen display means for displaying search information related to a search target, the search information corresponding to the position information of the search target and Search information holding means for holding in association, terminal position calculating means for calculating the position of the terminal, terminal direction calculating means for calculating a direction determined based on the screen display means of the terminal, and terminal for calculating the attitude of the terminal Based on the position calculated by the terminal position calculating means, the terminal position calculated by the terminal position calculating means, the direction determined based on the terminal screen display means calculated by the terminal direction calculating means, and the terminal posture calculated by the terminal attitude calculating means Search information display selection means for selecting search information to be displayed by the terminal from the search information held by the search information holding means. And displaying the retrieval information selected by the information display selecting means.

  Accordingly, the user can display desired search information on the screen display means by changing the attitude of the terminal, and does not require setting and selects search information to be displayed intuitively. It becomes possible.

  In the information search system according to the present invention, the search information display selection unit determines whether the longitudinal direction of the screen display unit is a vertical direction or a horizontal direction based on the terminal posture calculated by the terminal posture calculation unit. However, if it is determined that the longitudinal direction is the vertical direction, search information related to the search object located at a location relatively far from the terminal position is selected, and if the longitudinal direction is determined to be the horizontal direction, It is preferable to select search information related to a search target located at a location relatively close to the position of the terminal.

  Thus, when it is desired to search for information in the vicinity of a wide range or search for information in a distant range within a narrow range, switching can be performed by changing the attitude of the terminal. In addition, when the longitudinal direction of the screen is the vertical direction, search information related to the search target that is relatively far away is displayed, and when the longitudinal direction of the screen is the horizontal direction, search information related to the search target that is relatively close Is displayed and switching is intuitive. Therefore, the user can select search information to be displayed intuitively without setting.

  In the information search system according to the present invention, the search information display selection unit determines whether the longitudinal direction of the screen display unit is a vertical direction or a horizontal direction based on the terminal posture calculated by the terminal posture calculation unit. However, when it is determined that the longitudinal direction is the vertical direction, it is preferable to select search information related to the search target located inside the search target.

  Thereby, when it is desired to display search information related to a search target located inside a tall search target such as a building, the display can be changed by changing the attitude of the terminal. In addition, when the longitudinal direction of the screen is the vertical direction, the search information related to the search target located inside the tall search target is displayed, and the change is intuitive. Therefore, the user can select search information to be displayed intuitively without changing the setting.

  In the information search system according to the present invention, the terminal further includes image acquisition means for acquiring an image, and the search information display selection means is selected from search objects included in the image captured by the image acquisition means. It is preferable to select search information to be displayed by the terminal.

  Thereby, the search information to be displayed is selected from the search targets included in the image actually captured by the image acquisition means, and the user can select the search target more easily. It becomes.

  In the information search system according to the present invention, the search information display selection unit detects the feature point of the subject from the image taken by the image acquisition unit, and the detected feature point and the search information holding unit hold the detected feature point. It is preferable to determine the display position of the search information based on the feature point pattern information.

  Thereby, since the display position of the search target is determined based on the image actually acquired by the image acquisition means, the search information can be displayed at a more accurate display position.

  In the information search system according to the present invention, the search information display selection unit detects the feature point of the subject from the image taken by the image acquisition unit, and the detected feature point and the search information holding unit hold the detected feature point. It is preferable to determine the display position of the search information based on the feature point pattern information and not display the search information related to the search target when the search target is not shown in the image.

  As a result, the search information related to the search target that is not shown in the image actually acquired by the image acquisition means is not displayed, so that only the search information related to the search target shown on the screen is displayed.

  In order to solve the above problems, an information search system according to the present invention is an information search system including a terminal having a screen display means for displaying search information related to a search target, and a search information providing device, The search information providing device includes search information holding means for holding search information related to the search target in association with the position information of the search target. The terminal includes a terminal position calculation means for calculating the position of the own terminal, and a screen display of the own terminal. A terminal direction calculating means for calculating a direction determined based on the means, a terminal posture calculating means for calculating the attitude of the own terminal, the position of the own terminal calculated by the terminal position calculating means, and the terminal direction calculating means Is the search information held by the search information holding means based on the direction determined based on the screen display means of the terminal and the attitude of the terminal calculated by the terminal attitude calculation means? Comprising a searched information display selecting means terminal selects the search information to be displayed, the screen display means displays the retrieval information selected by the searched information display selecting means, characterized in that.

  Accordingly, the user can display desired search information on the terminal by changing the attitude of the terminal, and can select search information to be displayed intuitively without setting. It becomes possible. Furthermore, since search information holding means is provided outside the terminal separately from the terminal, it is not necessary to hold all the search information in the terminal, and the terminal may hold only a part of the necessary search information. Usually, this is particularly effective because the storage capacity of the terminal is not large.

  The terminal according to the present invention further includes search information cache means for caching a part of information held in the search information holding means, and the search information cache means is predetermined from the position of the own terminal calculated by the terminal position calculation means. It is preferable to cache search information related to search objects existing at a distance of.

  As a result, the terminal caches only the search information related to the search target located at a predetermined distance from the own terminal, and the storage capacity can be used effectively.

  In order to solve the above-described problem, an information search method according to the present invention is an information search method for displaying search information related to a search target on a screen display means of a terminal, a terminal position calculating step for calculating the terminal position, The terminal direction calculation step for calculating the direction determined based on the screen display means, the terminal posture calculation step for calculating the terminal posture, the terminal position calculated in the terminal position calculation step, and the terminal direction calculation step A search information display selection step for selecting search information to be displayed by the terminal based on the direction determined based on the screen display means of the terminal and the terminal posture calculated in the terminal posture calculation step, and a search information display selection step A screen display step for displaying the search information selected in the above on the screen display means of the terminal. Characterized in that it is.

  As a result, the user can display desired search information on the terminal by changing the attitude of the terminal, and can select search information to be displayed intuitively without setting. Become.

  In order to solve the above problems, a terminal according to the present invention is a terminal provided with screen display means for displaying search information related to a search target, and includes a terminal position calculation means for calculating the position of the own terminal, and a screen display means for the own terminal. Terminal direction calculating means for calculating the direction determined based on the terminal, terminal posture calculating means for calculating the attitude of the own terminal, the position of the own terminal calculated by the terminal position calculating means, and the own terminal calculated by the terminal direction calculating means Search information display selection means for selecting, from an external server, search information to be displayed by the terminal based on the direction determined based on the screen display means and the attitude of the terminal calculated by the terminal attitude calculation means. The screen display means displays the search information selected by the search information display selection means.

  As a result, the user can display desired search information on the terminal by changing the attitude of the terminal, and can select search information to be displayed intuitively without setting. Become.

  According to the present invention, since the search information to be displayed is selected based on the attitude of the terminal, the user can display desired search information on the terminal by changing the attitude of the terminal. It is possible to select search information that is not necessary and intuitively displayed.

It is a figure which shows the function structure of the information search system in this invention. It is a figure for demonstrating typically the attitude | position of a terminal. It is a figure which shows the example of the data structure in the search information cache part shown in FIG. 1, and a search information holding part. It is a figure which shows the hardware constitutions of the terminal in this invention. It is a figure for demonstrating the method of selecting the search information by the search information display selection part shown in FIG. It is a figure for demonstrating the method of selecting the search information by the search information display selection part shown in FIG. It is a figure for demonstrating the method of selecting the search information by the search information display selection part shown in FIG. It is a figure which shows the flow of a process in the terminal and information search system which are shown in FIG. It is a figure which shows the flow of a process of selection of the search information according to the attitude | position of the terminal shown in FIG. It is a figure which shows the flow of a process which judges whether the extracted search object shown in FIG. 9 is visible. It is a figure for demonstrating the judgment method of whether the extracted search object is visible. It is a figure which shows the flow of a process of the display of the selected search information shown in FIG.

  An information search system 1 according to an embodiment of the present invention will be described with reference to the drawings. In the description, the same reference numerals are used for the same elements or elements having the same function, and a duplicate description is omitted.

[About functional configuration]
FIG. 1 is a diagram showing an example of a functional configuration of an information search system 1 according to the present invention. As shown in FIG. 1, the information search system 1 according to the present invention includes a terminal 10 and a search information providing device 30. In the present embodiment, the matching of feature points and the calculation of the direction, posture, and position are performed by the terminal 10, but may be performed by the search information providing device 30 or other network-side devices.

  The terminal 10 can be connected to the search information providing device 30 through a network. Specifically, the terminal data communication unit 11, a terminal position calculation unit (terminal position calculation means) 12, a terminal position transmission unit 13, a search information acquisition unit 14, search information cache unit 15, sensor information acquisition unit 16, terminal attitude calculation unit (terminal attitude calculation unit) 17, search information display selection unit (search information display selection unit) 18, terminal direction calculation unit (terminal direction calculation unit) 19 includes a screen display unit (screen display unit) 20 and an image acquisition unit (image acquisition unit) 21.

  In the present embodiment, a mobile phone is used as an example of the terminal 10. However, the terminal 10 is not limited to a mobile phone, but a simple mobile phone (PHS: Personal Handy-phone System), a portable information terminal (PDA: Personal Digital Assistant) having a communication function, or a portable personal computer (PC: Personal Computer) or the like.

  The terminal data communication unit 11 provides a data communication function between the terminal 10 and the search information providing device 30.

  The terminal position calculation unit 12 has a function of calculating the position of the terminal 10. Specifically, a positioning method using GPS (Global Positioning System), which is a known technique, or a technique using the intensity of radio waves from a base station can be applied. However, there is no intention to limit to these technologies, and any technology that can measure the current position of the terminal 10 can be used. The data calculated by the terminal position calculation unit 12 can use information indicating the position of the terminal 10 in longitude, latitude, and altitude. Alternatively, the ground surface may be divided into grids, and the position of the terminal 10 may be displayed in the Y coordinate, X coordinate, and altitude. The terminal position calculation unit 12 outputs the calculated position of the terminal 10 to the search information display selection unit 18.

  The terminal location transmission unit 13 has a function of transmitting the location of the terminal 10 calculated by the terminal location calculation unit 12 to the search information providing apparatus 30 via the terminal data communication unit 11.

  The search information acquisition unit 14 has a function of acquiring search information and feature point patterns from the search information providing device 30 via the terminal data communication unit 11. Specifically, all or a part of the information held in the search information holding unit 34 is transferred (copied). The search information acquisition unit 14 outputs the acquired search information to the search information cache unit 15.

  The search information cache unit 15 has a function of inputting search information and feature point patterns from the search information acquisition unit 14 and caching the input search information and feature point patterns. In the present embodiment, as will be described later, the search information cache unit 15 caches search information and feature point patterns related to a search target located within a circle having a predetermined radius centered on the position of the terminal 10. In general, compared to the movement of the terminal 10, the direction determined based on the screen display unit 20 of the terminal 10 and the change in the attitude of the terminal 10 are abrupt (that is, the appropriate search information is changed according to the change). The amount of change to change the selection is relatively large). In the present embodiment, the search information cache unit 15 preliminarily caches search information related to search objects existing in the vicinity based on the position of the terminal 10, and thus is determined based on the screen display unit 20 of the terminal 10. It is possible to select search information in response to changes in the direction and the attitude of the terminal 10 and to compare feature point patterns to be described later.

  An example of the data structure of the search information cache unit 15 is shown in FIG. FIG. 3 is also a diagram showing an example of a data structure in the search information holding unit 34 described later. The information cached by the search information cache unit 15 may have the same attributes as the search information holding unit 34, or information including only some attributes of the search information holding unit 34 as attributes may be cached. .

  The sensor information acquisition unit 16 has a function of acquiring information from various sensors included in the terminal 10 as a physical configuration. The sensor information acquisition unit 16 outputs the acquired information to the terminal position calculation unit 12, the terminal posture calculation unit 17, and the terminal direction calculation unit 19.

  The terminal attitude calculation unit 17 has a function of inputting acceleration / reverse / left / right / upper / lower three-direction acceleration and information on the triaxial geomagnetic sensor from the sensor information acquisition unit 16 and calculating the attitude of the terminal 10 from the input information. . Here, the attitude of the terminal 10 indicates an inclination of the terminal 10 when the terminal 10 is tilted in the horizontal direction from a reference position (for example, a position where the longitudinal direction of the screen display unit 20 is vertical). Here, the angle A or the angle B schematically shown in FIG. If the vertical direction in FIG. 2 is the vertical direction and the horizontal direction in FIG. 2 is the horizontal direction, the state indicated by Y in FIG. 2 is expressed as “the longitudinal direction of the screen display unit 20 is the vertical direction” in this specification. Further, in this specification, the state indicated by X in FIG. 2 is expressed as “the longitudinal direction of the screen display unit 20 is the horizontal direction”. The terminal attitude calculation unit 17 outputs the calculated attitude of the terminal 10 to the search information display selection unit 18.

  The search information display selection unit 18 inputs the attitude of the terminal 10 from the terminal attitude calculation unit 17, and the longitudinal direction of the screen display unit 20 is the vertical direction or the longitudinal direction is the horizontal direction from the input attitude of the terminal 10. The search information cache unit 15 caches according to the determination, the direction of the terminal 10 calculated by the terminal direction calculation unit 19, and the feature point pattern held in the search information cache unit 15. The search information to be displayed is selected from the search information, and the selected search information is output to the screen display unit 20. Returning to FIG. 2 again, for example, when the angle A is 0 degree or more and less than 45 degrees, the search information display selection unit 18 determines that the longitudinal direction of the screen display unit 20 is the vertical direction, and the angle B is 45. When the angle is not less than 90 degrees and not more than 90 degrees, the search information display selection unit 18 determines that the longitudinal direction of the screen display unit 20 is the horizontal direction. Note that the determination is not limited to this, and the determination may be made based on an angle that can be generally determined to be generally horizontal or vertical.

  The terminal direction calculation unit 19 has a function of calculating a direction determined based on the screen display unit 20. Specifically, the screen display unit 20 calculates the direction in which the surface opposite to the surface disposed on the terminal 10 faces. As a result, the user of the terminal 10 looks at the screen display unit 20 arranged on the terminal 10 and directs the search target to search for the terminal 10, so that the user can see the terminal 10 over the screen display unit 20. The search information related to the search object that is or should be visible is displayed.

  Note that this is an example, and in addition, a direction in which the surface of the terminal 10 on which the image acquisition unit 21 such as a camera is provided faces may be calculated.

  The screen display unit 20 has a function of displaying the search information selected by the search information display selection unit 18.

  The image acquisition unit 21 has a function of shooting a video. Specifically, it is a camera. The image acquisition unit 21 outputs the acquired video to the search information display selection unit 18.

  The search information providing device 30 is a device that provides search information to the terminal 10, specifically, a data communication unit 31, a terminal location management unit 32, a search information management unit 33, a search information holding unit 34, and a search The information transmission unit 35 is included.

  The data communication unit 31 provides a data communication function between the terminal 10 and the search information providing device 30.

  The terminal location management unit 32 has a function of managing the location of the terminal 10. Specifically, the terminal location management unit 32 receives the location of the terminal 10 via the data communication unit 31. The terminal location management unit 32 outputs the received location of the terminal 10 to the search information management unit 33.

  The search information management unit 33 inputs the position of the terminal 10 from the terminal position management unit 32, and from the search information held by the search information holding unit 34, the search information related to the search target at a predetermined distance from the position of the terminal 10 And a feature point pattern, and outputs the selected search information and feature point pattern to the search information transmission unit 35. The predetermined distance can be freely set, for example, 1 km. When the predetermined distance is increased, it is possible to reduce the number of times new search information is transmitted by moving the terminal 10. In addition, when the predetermined distance is shortened, the amount of information cached by the search information cache unit 15 can be reduced.

  The search information holding unit 34 has a function of holding search information and feature point patterns as detailed information related to the search target in association with the position information of the search target.

  FIG. 3 shows an example of information held by the search information holding unit 34. As shown in FIG. 3, the search information holding unit 34 includes “genre”, “name”, “business hours”, “address”, “contact”, “building” as search information that is detailed information related to the search target. And the “feature point pattern” are stored in association with the position information (“longitude”, “latitude”, and “height”) to be searched.

  Here, “building” refers to a building in which a search target is entered. If the search target itself is a single building, information indicating that is input to the value of “building”. In the example shown in the figure, “-” is entered. The “feature point pattern” represents a pattern of a characteristic part to be searched, and refers to, for example, a raster data pattern.

  The search information transmission unit 35 has a function of inputting search information and feature point patterns from the search information management unit 33 and transmitting the input search information and feature point patterns to the terminal 10 via the data communication unit 31.

[Hardware configuration]
Next, the hardware configuration of the terminal 10 in this embodiment will be described with reference to FIG.

  FIG. 4 is a diagram illustrating a hardware configuration of the terminal 10. As shown in FIG. 4, the terminal 10 physically includes a control device 101 such as a CPU (Central Access Memory), a memory 102 such as a volatile semiconductor such as a RAM (Random Access Memory), a communication device 103 that controls communication, and a flash memory. , Etc., an input device 105 such as a numeric keypad, an output device 106 such as an LCD (Liquid Crystal Display) or an organic EL display, a 6-axis sensor 107, an image input device 108 such as a camera, a GPS receiver, etc. The position calculation device 109 is provided.

  The correspondence between the hardware configuration and the functional configuration is shown below. With regard to the terminal 10, the functions of the terminal data communication unit 11 are realized by the communication device 103 as a physical component. The functions of the terminal position transmission unit 13, the search information acquisition unit 14, the search information cache unit 15, the sensor information acquisition unit 16, the search information display selection unit 18, and the screen display unit 20 are as follows. 101, by loading predetermined software on hardware such as the memory 102, the communication device 103, the output device 106, and the input device 105 are operated under the control of the control device 101, and the memory 102 and the auxiliary storage unit This is realized by reading and writing data in 104.

  The functions of the terminal position calculation unit 12 are realized by the position calculation device 109 as a physical component. The functions of the terminal attitude calculation unit 17 and the terminal direction calculation unit 19 are realized by a 6-axis sensor 107 as a physical component. The functions of the image acquisition unit 21 are realized by the image input device 108 as a physical component.

[Select Search Information]
Here, a method in which the search information display selection unit 18 selects search information to be displayed from the search information cached by the search information cache unit 15 will be described.

  In the present embodiment, the search information cache unit 15 caches search information related to a search target located within a circle having a predetermined radius centered on the position of the terminal 10. The search information display selection unit 18 selects appropriate search information from the search information cached by the search information cache unit 15 according to whether the longitudinal direction of the screen display unit 20 is the vertical direction or the horizontal direction. select.

  When the longitudinal direction of the screen display unit 20 is the vertical direction, the search information display selection unit 18 selects search information related to a search target that is narrow and far away. The position of the search target can be obtained from “position information (longitude, latitude, height)” shown in FIG.

  On the other hand, when the longitudinal direction of the screen display unit 20 is the horizontal direction, the search information display selection unit 18 selects search information relating to a search target that is wide and located nearby.

  This state is shown in FIGS. Now, it is assumed that the search information cache unit 15 of the terminal 10 has cached search information related to a search target located within a circle with a radius of 1 km centered on the position of the terminal 10. It is assumed that the direction determined based on the screen display unit 20 of the terminal 10 is the upward direction in FIG. 5 (that is, the user of the terminal 10 is facing the upward direction in FIG. 5). When the longitudinal direction of the screen display unit 20 is the vertical direction, the search information display selection unit 18 searches the search information cached in the search information cache unit 15 and searches for the search target located in the area A in FIG. Select. The central angle of the region A is smaller than the central angle of the region B (that is, the width is narrow), and the sector-shaped radius that configures the region A is larger than the sector-shaped radius that configures the region B (that is, It is formed so as to be far away.

  Specifically, using the “position information (longitude, latitude, height)” of the information shown in FIG. 3 and the position of the terminal 10 calculated by the terminal position calculation unit 12, the distance from the terminal 10 to the search target and the terminal The direction (the angle from the direction determined based on the screen display unit 20) to the search target based on the direction determined based on the 10 screen display units 20 is calculated. If these calculated values are below a predetermined value, the search information display selection unit 18 selects the search information.

  On the other hand, when the longitudinal direction of the screen display unit 20 is the horizontal direction, the search information display selection unit 18 relates to the search target located in the area B in FIG. 5 from the search information cached in the search information cache unit 15. Select search information.

  FIG. 6 schematically shows a display example of the screen display unit 20. As shown in FIG. 6A, it is assumed that there are a plurality of (seven in this example) buildings in the direction in which the user is facing. Each building is a search target in this specification. FIG. 6B shows a display example of the screen display unit 20 when the longitudinal direction of the screen display unit 20 is the horizontal direction. In this case, search information relating to a search target that is wide and located near the terminal 10 is displayed on the screen display unit 20. In FIG. 6B, search information is displayed in a balloon, and the contents are omitted. Note that the root of the balloon is a search target corresponding to the search information.

  FIG. 6C shows a display example of the screen display unit 20 when the longitudinal direction of the screen display unit 20 is the vertical direction. In this case, the search information related to the search target that is narrow in width and far from the terminal 10 is displayed on the screen display unit 20.

  Next, another method of selecting search information will be described with reference to FIG. In this method, when the longitudinal direction of the screen display unit 20 is the vertical direction, the search information display selection unit 18 selects the search information existing in the building from the search information cached in the search information cache unit 15. select.

  FIG. 7 schematically shows a display example of the screen display unit 20. As shown in FIG. 7A, it is assumed that there are three buildings in the direction in which the user is facing. When the longitudinal direction of the screen display unit 20 is the horizontal direction, search information related to the search target that actually looks (appearance-like) is displayed as schematically shown in FIG. In the case where the longitudinal direction is the vertical direction, as schematically shown in FIG. 7C, search information relating to a search target existing inside the building, such as floor information, is displayed.

  Specifically, when it is determined that the longitudinal direction of the screen display unit 20 is the vertical direction, information indicating that the “building” illustrated in FIG. 3 is a building itself (“−” in the example of FIG. 3). ") Is displayed.

  When it is determined that the longitudinal direction of the screen display unit 20 is the vertical direction, the search information in which the building name is held in “building” shown in FIG. 3 is displayed. In this case, search information is displayed at the display position where the search target indicated by the building name held in “building” is displayed on the screen display unit 20.

  Note that the above two methods are not necessarily selective and can be combined. That is, when the longitudinal direction of the screen display unit 20 is the vertical direction, the search information display selection unit 18 selects a search target located far and narrow from the search information cached in the search information cache unit 15. Search information relating to a search target existing inside the search target that is not actually seen, such as floor information, may be selected. When the longitudinal direction of the screen display unit 20 is the horizontal direction, the search information display selection unit 18 selects a search target located near and wide from the search information cached in the search information cache unit 15 and actually Search information related to the search target (appearance-like) may be selected.

[Processing flow]
Next, the flow of processing of the information search system 1 in the present embodiment will be described with reference to FIGS.

  First, the overall processing flow will be described with reference to FIG. The image acquisition unit 21 of the terminal 10 is turned on (step S100). The terminal location transmitting unit 13 transmits the location of the terminal 10 calculated by the terminal location calculating unit 12 to the search information providing apparatus 30 via the terminal data communication unit 11 (step S101). Various methods can be applied to the method of calculating the position of the terminal 10 by the terminal position calculation unit 12. For example, a positioning method using GPS can be applied. The data that is actually transmitted may be data including information indicating the position of the terminal 10 in longitude, latitude, and altitude, for example.

  The terminal location management unit 32 of the search information providing device 30 receives the location of the terminal 10 transmitted by the terminal 10 via the data communication unit 31 and outputs the received location of the terminal 10 to the search information management unit 33. The search information management unit 33 refers to the search information holding unit 34 and is located at a predetermined distance from the position of the terminal 10 among the search information held in the search information holding unit 34 in association with the position information. The search information and feature point pattern are extracted, and the extracted search information and feature point pattern are output to the search information transmission unit 35. The search information transmission unit 35 transmits the search information and the feature point pattern extracted by the search information management unit 33 to the terminal 10 via the data communication unit 31 (step S102).

  The search information acquisition unit 14 of the terminal 10 receives the search information and the feature point pattern transmitted by the search information providing device 30 via the terminal data communication unit 11, and sends the received search information to the search information cache unit 15. Output. The search information cache unit 15 caches the search information and the feature point pattern output from the search information acquisition unit 14 (step S103).

  The terminal attitude calculation unit 17 calculates the terminal attitude using the information obtained via the sensor information acquisition unit 16, and outputs the calculated terminal attitude to the search information display selection unit 18 (step S104).

  The search information display selection unit 18 determines whether the longitudinal direction of the screen display unit 20 is the vertical direction or the horizontal direction from the attitude of the terminal 10 obtained from the terminal attitude calculation unit 17, and the result of the determination Based on the direction of the terminal 10 calculated by the terminal direction calculation unit 19, the search information to be displayed by the screen display unit 20 is selected from the search information cached by the search information cache unit 15 (step S105).

  The search information display selection unit 18 displays the selected search information on the screen display unit 20 (step S106).

  The terminal 10 repeats step S104 to step S107 until there is an instruction to end the service from the user (step S107).

  Next, search information selection (step S105) according to the attitude of the terminal 10 will be described with reference to FIG.

  The search information display selection unit 18 uses the orientation of the terminal 10 input from the terminal orientation calculation unit 17 and the information in the longitudinal direction of the screen display unit 20 according to the orientation of the terminal 10 held in advance. It is determined whether the longitudinal direction is vertical or horizontal (step S501).

  When it is determined that the longitudinal direction is horizontal (“longitudinal direction is horizontal” in step S501), the search information display selection unit 18 is determined based on the screen display unit 20 of the terminal 10 calculated by the terminal direction calculation unit 19. The search information relating to the search object located in a short distance and in a wide range with respect to the selected direction is extracted (step S502). Here, the direction determined based on the screen display unit 20 refers to the direction in which the surface opposite to the surface of the screen display unit 20 provided in the terminal 10 faces. Thereby, it becomes possible for the user to obtain search information about the search target located over the terminal 10 in the direction in which the user is facing while viewing the screen display unit 20.

  When it is determined that the longitudinal direction is vertical (“longitudinal direction is vertical” in step S501), the search information display selection unit 18 is determined based on the screen display unit 20 of the terminal 10 calculated by the terminal direction calculation unit 19. The search information relating to the search object located in a long distance and a narrow range with respect to the selected direction is extracted (step S503).

  The search information display selection unit 18 determines whether or not the search target corresponding to the extracted search information is visible (step S504). Thereby, it becomes possible to select only the search information related to the search target actually displayed on the screen display unit 20. Note that step S504 is not always necessary. In other words, it is not intended that the search information for all search targets actually included in the screen display unit 20 must be selected. At the same time, search information for a search target that is not actually included in the screen display unit 20 may be selected. This case also has two meanings, and one may display search information related to a search target that is invisible due to a shield in front. Secondly, search information related to a search target located outside the range actually displayed on the screen display unit 20 may be selected.

  The search information display selection unit 18 selects search information related to a search target that is visible from the search information extracted in step S502 or S503 (step S505). When step S504 is omitted, the search information display selection unit 18 selects the search information extracted in step S502 or step S503.

[Determining whether or not the extracted search target is visible]
Next, the determination of whether or not the extracted search target is visible (step S504) will be described with reference to FIGS.

  FIG. 10 is a diagram showing a flow of processing for determining whether or not a search target is visible. This will be described with reference to FIG.

  Here, a certain search target (here, a coffee shop on the 30th floor of the building (hereinafter referred to as search target B) at the position indicated by B in FIG. 11A) or C in FIG. For example, a restaurant on the fifth floor of the building (which will be described as a search target C hereinafter) at the indicated position is another building (here, FIG. 11A and FIG. 11B). A method for determining whether or not the building is blocked by the building indicated by A (hereinafter referred to as another building A) will be described.

  The search information display selection unit 18 extracts the distance y2 and the height x2 in FIG. 11 (step S601). y2 can be obtained from the position information of the search target B or the search target C held by the search information holding unit 34 or the search information cache unit 15 and the position information of the terminal 10 calculated by the terminal position calculation unit 12, x2. Can be obtained by subtracting the height of the terminal 10 from the height of the search target B or the search target C held by the search information holding unit 34 or the search information cache unit 15. In addition, when using GPS, it is known that the measurement accuracy of altitude is lower than the measurement accuracy of longitude and latitude. Therefore, in general, the average height (for example, 1 centimeter and 60 centimeters) of the terminal 10 when a human operates the terminal 10 is the height of the search target B held by the search information holding unit 34 or the search information cache unit 15. You may subtract from it.

  Similarly, the search information display selection unit 18 extracts the distance y1 and the height x1 (step S602). Specifically, the building A existing in the direction facing the position and direction of the terminal 10 is specified, and x1 and y1 are calculated in the same procedure as described above. It is also possible to analyze the feature points of the building, identify from which direction and position the building A is viewed, and correct the position of the terminal itself.

  The search information display selection unit 18 determines whether the search target exists behind the other building (that is, the search target is hidden in the other building from the position of the terminal 10 when considered in a plane) (step S1). S603).

  If it is determined that the search target is not behind another building (“NO” in step S603), it is determined that the search target is visible in relation to the other building (step S604).

  If it is determined that the search target is the back of another building (“YES” in step S603), it is determined whether or not the search target is visible based on the magnitude relationship between θ1 and θ2 shown in FIG. 11 (step S605). In FIG. 11A, the search target B is visible from the position of the terminal 10 over another building A in front of it.

As shown in FIG. 11 (A), tan θ ₁ can be obtained by Equation 1, assuming that the difference x1 between the height of the terminal 10 and the height of another building A and the distance y1 from the terminal 10 to the search target A

Similarly, if the difference x2 between the height of the search target B and the height of the terminal 10 and the distance y2 from the terminal 10 to the search target B are assumed, tan θ ₂ can be obtained by Expression 2.

When the following Expression 3 is satisfied, it can be determined that the search target B is visible from the terminal 10.

  FIG. 11B schematically shows a state in which the search target C is hidden behind the search target A and cannot be viewed from the terminal 10.

As shown schematically in FIG. 11B, when Expression 4 is satisfied, it can be determined that the search target C is not visible from the terminal 10.

  When it is determined that the search target is invisible from the position of the terminal 10 by the above method (“NO” in step S605), the search information display selection unit 18 determines that the search target is invisible (step S606). ).

  When it is determined that the search target is visible from the position of the terminal 10 by the above method (“YES” in step S605), the search information display selection unit 18 determines that the search target is visible (step S607). .

  The search information display selection unit 18 may determine whether or not the search target is visible from the terminal 10 by the above method, and may not select the search information regarding the search target that is invisible.

[Displaying selected search information]
Next, display of the selected search information (step S106) will be described with reference to FIG. The search information display selection unit 18 acquires an image from the image acquisition unit 21 (step S700).

  The search information display selection unit 18 detects a feature point of the building from the acquired image (step S701). In addition, although the process of step S701 is performed by the search information display selection unit 18, it may be performed on a network. As a result, the load on the hardware resources of the terminal 10 can be reduced.

  The search information display selection unit 18 collates the detected feature points of the building with the feature point patterns held in the search information cache unit 15 (step S702).

  Specifically, for example, the raster data of the detected feature points of the building and the raster data of the feature point patterns held by the search information cache unit 15 are collated using a pattern matching method, and the most matched feature point pattern is determined. calculate.

  The search information display selection part 18 discriminate | determines about the building reflected in the image | video as a result of collation (step S703).

  As a result of the determination, the search information display selection unit 18 can accurately grasp in which part of the screen display unit 20 the search target is actually displayed. The search information display selection unit 18 determines a display position for displaying the search information on the screen display unit 20 based on the grasped part (step S704).

  The screen display unit 20 displays the search information at the display position determined by the search information display selection unit 18 (step S705). Since the building actually reflected in the image is discriminated from the image acquired by the image acquisition unit 21 using pattern matching, it is possible to more accurately specify the presence or absence of the shielding object. The search information display selection unit 18 may not display search information related to a search target that cannot be seen using the result of the pattern matching.

  Next, the operation and effect of the present invention will be described.

  The information search system 1 according to the present invention is an information search system 1 including a terminal 10 having a screen display unit 20 that displays search information related to a search target, and stores the search information in association with the corresponding position information of the search target. The search information holding unit 34, the terminal position calculation unit 12 that calculates the position of the terminal 10, the terminal direction calculation unit 19 that calculates a direction determined based on the screen display unit 20 of the terminal 10, and the attitude of the terminal 10 Terminal posture calculation unit 17 that calculates the position of the terminal 10 calculated by the terminal position calculation unit 12, the direction determined based on the screen display unit 20 of the terminal 10 calculated by the terminal direction calculation unit 19, and the terminal posture Search information display selection for selecting search information to be displayed by the terminal 10 from search information held by the search information holding unit 34 based on the attitude of the terminal 10 calculated by the calculation unit 17 18, includes a screen display unit 20, and displaying the retrieval information selected by the searched information display selection unit 18.

  As a result, the user can display desired search information on the screen display unit 20 by changing the attitude of the terminal 10, and can select search information to be displayed intuitively without setting. It becomes possible to do.

  Further, the search information display selection unit 18 determines whether the longitudinal direction of the screen display unit 20 is the vertical direction or the horizontal direction based on the attitude of the terminal 10 calculated by the terminal attitude calculation unit 17, and the longitudinal direction Is determined to be a vertical direction, search information related to a search target located at a location relatively distant from the position of the terminal 10 is selected, and if it is determined that the longitudinal direction is a horizontal direction, the terminal 10 The search information related to the search object located at a location relatively close to the position is selected.

  As a result, when it is desired to search nearby information over a wide range, or to search distant information within a narrow range, or to perform switching, this can be done by changing the attitude of the terminal 10. In addition, when the longitudinal direction of the screen is the vertical direction, search information related to the search target that is relatively far away is displayed, and when the longitudinal direction of the screen display unit 20 is the horizontal direction, the search target that is relatively close The search information on the screen is displayed and switching is intuitive. Therefore, the user can select search information to be displayed intuitively without setting.

  Further, when the search information display selection unit 18 determines that the longitudinal direction of the screen display unit 20 is the vertical direction, the search information is associated with the floor number and the internal information, and is displayed on the corresponding floor number. Is done. In addition, you may display the information inside a building for every height (hierarchy).

  Thereby, when it is desired to display search information related to a search target located inside a tall search target such as a building, the display is changed by changing the attitude of the terminal 10. In addition, when the longitudinal direction of the screen display unit 20 is the vertical direction, the search information related to the search target located inside the tall search target is displayed, and the change is intuitive. Therefore, the user can select search information to be displayed intuitively without changing the setting.

  Further, the terminal 10 includes an image acquisition unit 21 that acquires an image, and the search information display selection unit 18 displays the search information included in the search target included in the image captured by the image acquisition unit 21. The search information to be selected is selected.

  Thereby, the search information to be displayed is selected from the search targets included in the image actually captured by the image acquisition unit 21, and the user can select the search target more easily. It becomes possible.

  The search information display selection unit 18 detects feature points of the subject from the image captured by the image acquisition unit 21, and information on the detected feature points and feature point patterns held by the search information holding unit 34. Based on the above, the display position of the search target is determined.

  Thereby, since the display position of the search target is determined based on the image actually acquired by the image acquisition unit 21, the search information can be displayed at a more accurate display position.

  The search information display selection unit 18 detects feature points of the subject from the image captured by the image acquisition unit 21, and information on the detected feature points and feature point patterns held by the search information holding unit 34. Based on the above, the search target shown in the image is determined, and when the search target is not shown in the image, the search information regarding the search target is not displayed.

  Thereby, since the search information related to the search target that is not shown on the screen is not displayed, it is possible to display only the search information related to the search target shown on the screen.

  Further, the terminal 10 in the present invention includes a search information cache unit 15 that caches a part of the information held in the search information holding unit 34, and the search information acquisition unit 14 includes the terminal 10 calculated by the terminal position calculation unit 12. The search information related to the search target existing at a predetermined distance from the position is received from the search information holding unit 34, and the search information cache unit 15 caches the search information received by the search information acquisition unit 14.

  As a result, the terminal 10 caches only the search information related to the search target located at a predetermined distance from the position of the terminal itself, and the storage capacity can be used effectively.

  Next, a modification of this embodiment will be described. In this embodiment, the search information display selection unit 18 selects the search information depending on whether the longitudinal direction of the screen display unit 20 is the vertical direction or the horizontal direction. May be selected. In this case, as the zoom magnification is increased, search information relating to a search object that is narrow and far away is selected, and as the zoom magnification is reduced, search information relating to a search object existing in a wide range and near is selected.

  Next, as another modification of the present embodiment, the terminal 10 is moved in the depth direction (the direction in which the terminal 10 moves and the direction in which the terminal 10 moves away from the user who operates the terminal 10), or the front direction. Select search information to be displayed on the screen display unit 20 by moving (motion gesture) in the direction in which the terminal 10 moves (the direction in which the terminal 10 moves closer to the user operating the terminal 10). An embodiment to be described will be described.

  In this case, when the terminal 10 moves in the depth direction, the search information related to the search target existing relatively far from the position of the terminal 10 is selected, and when the terminal 10 moves forward, the terminal 10 Search information relating to a search object existing relatively close to the position of is selected.

  The sensor information acquisition unit 16 of the terminal 10 acquires the acceleration of the terminal 10 from the 6-axis sensor 107 physically provided in the terminal 10, and the sensor information acquisition unit 16 acquires the terminal acceleration calculation unit (not shown) provided in the terminal 10. Based on the acceleration of the terminal 10, the movement of the terminal 10 in the depth direction or the front direction is calculated.

  The search information display selection unit 18 of the terminal 10 selects search information to be displayed by the screen display unit 20 based on the movement of the terminal 10 in the depth direction or the front direction calculated by a terminal acceleration calculation unit (not shown). The other selection processing flow may be the same as that described above.

  Accordingly, it is possible to select search information to be displayed intuitively in the same manner as zooming with a simple operation compared to the case of using the zoom function.

  The start timing for controlling the selection of search information based on the movement of the terminal 10 in the depth direction or the front direction is determined by touching the screen display unit 20 with a finger (screen touch), pressing a button, voice input, or the like. A configuration that can be specified by the user is preferable.

  Thus, the user can specify the start timing for controlling the selection of search information based on the movement of the terminal 10 in the depth direction or the forward direction.

  According to the present invention, the user can display desired search information on the screen display unit 20 by changing the attitude of the terminal 10, and the search information to be displayed intuitively without setting. It is possible to provide an information search system, an information search method, and a terminal that can be selected.

DESCRIPTION OF SYMBOLS 1 ... Information search system, 11 ... Terminal data communication part, 12 ... Terminal position calculation part, 13 ... Terminal position transmission part, 14 ... Search information acquisition part, 15 ... Search information cache part, 16 ... Sensor information acquisition part, 17 ... Terminal posture calculation unit, 18 ... Search information display selection unit, 19 ... Terminal direction calculation unit, 20 ... Screen display unit, 21 ... Image acquisition unit, 30 ... Search information providing device, 31 ... Data communication unit, 32 ... Terminal position management Reference numeral 33: Search information management section 34: Search information holding section 35: Search information transmission section

Claims (10)

An information search system comprising a terminal having screen display means for displaying search information related to a search target,
Search information holding means for holding search information in association with the corresponding position information of the search target;
Terminal position calculation means for calculating the position of the terminal;
Terminal direction calculating means for calculating a direction determined based on the screen display means of the terminal;
Terminal attitude calculating means for calculating the attitude of the terminal;
Based on the terminal position calculated by the terminal position calculating means, the direction determined based on the screen display means of the terminal calculated by the terminal direction calculating means, and the terminal attitude calculated by the terminal attitude calculating means Search information display selection means for selecting search information to be displayed by the terminal from the search information held by the search information holding means,
The screen display means displays the search information selected by the search information display selection means. The search information display selection unit determines whether the longitudinal direction of the screen display unit is a vertical direction or a horizontal direction based on the terminal posture calculated by the terminal posture calculation unit,
If it is determined that the longitudinal direction is the vertical direction, select search information related to the search object located in a location relatively far from the position of the terminal,
2. The information search system according to claim 1, wherein when it is determined that the longitudinal direction is a horizontal direction, search information related to a search object located at a location relatively close to the position of the terminal is selected. The search information display selection unit determines whether the longitudinal direction of the screen display unit is a vertical direction or a horizontal direction based on the terminal posture calculated by the terminal posture calculation unit,
2. The information search system according to claim 1, wherein when it is determined that the longitudinal direction is a vertical direction, search information relating to a search target located inside the search target is selected. The terminal further includes image acquisition means for acquiring an image,
The search information display selection unit selects search information to be displayed by the terminal from search targets included in an image captured by the image acquisition unit.
The information search system according to claim 1, wherein:   The search information display selection unit detects a feature point of the subject from the image captured by the image acquisition unit, the detected feature point, and feature point pattern information held by the search information holding unit, The information search system according to claim 4, wherein the display position of the search information is determined based on the information.   The search information display selection unit detects a feature point of the subject from the image captured by the image acquisition unit, the detected feature point, and feature point pattern information held by the search information holding unit, 5. The information search system according to claim 4, wherein a search target that is included in the image is determined based on the search information, and search information related to the search target is not displayed when the search target is not included in the image. . An information search system comprising a terminal having a screen display means for displaying search information related to a search target, and a search information providing device,
The search information providing device includes search information holding means for holding search information related to a search target in association with position information of the search target,
The terminal includes a terminal position calculating means for calculating the position of the terminal;
Terminal direction calculation means for calculating a direction determined based on the screen display means of the terminal itself;
Terminal attitude calculation means for calculating the attitude of the own terminal;
The position of the terminal calculated by the terminal position calculation unit, the direction determined based on the screen display unit of the terminal calculated by the terminal direction calculation unit, and the attitude of the terminal calculated by the terminal posture calculation unit; Search information display selection means for selecting search information to be displayed by the terminal from the search information held by the search information holding means based on
The screen display means displays the search information selected by the search information display selection means;
An information retrieval system characterized by that. The terminal further comprises search information cache means for caching a part of information held in the search information holding means,
The search information cache means caches search information related to a search target existing at a predetermined distance from the position of the terminal calculated by the terminal position calculation means.
The information search system according to claim 7, wherein: An information search method for displaying search information related to a search target on a screen display means of a terminal,
A terminal position calculating step for calculating the position of the terminal;
A terminal direction calculating step for calculating a direction determined based on the screen display means of the terminal;
A terminal attitude calculation step of calculating the attitude of the terminal;
Based on the terminal position calculated in the terminal position calculating step, the direction determined based on the screen display means of the terminal calculated in the terminal direction calculating step, and the terminal attitude calculated in the terminal attitude calculating step A search information display selection step for selecting search information to be displayed by the terminal;
A screen display step for displaying the search information selected in the search information display selection step on the screen display means of the terminal;
An information search method comprising: A terminal comprising screen display means for displaying search information related to a search target,
A terminal position calculating means for calculating the position of the own terminal;
Terminal direction calculation means for calculating a direction determined based on the screen display means of the terminal itself;
Terminal attitude calculation means for calculating the attitude of the own terminal;
The position of the terminal calculated by the terminal position calculation unit, the direction determined based on the screen display unit of the terminal calculated by the terminal direction calculation unit, and the attitude of the terminal calculated by the terminal posture calculation unit Search information display selection means for selecting, from an external server, search information to be displayed by the terminal based on,
The screen display means displays the search information selected by the search information display selection means;
A terminal characterized by that.

Images