JP5664234B2 - Portable terminal device, information browsing program, server device, and browsing information providing program - Google Patents

Description

  The present invention relates to a portable terminal device such as a portable telephone, and particularly to a technique for browsing information provided corresponding to position information based on the current position of the terminal device and its posture information.

  In recent years, with the advancement of portable terminal devices such as portable telephones, the current position of the terminal device is specified in conjunction with a function for recognizing the current position such as GPS (Global Positioning System), and is fixed in place. A technique for displaying the added additional information (characters / images / sounds) superimposed on the captured image of the real space is becoming widespread. For example, as a portable terminal device having this display function, while using a built-in camera function, and capturing a predetermined direction at a predetermined location, while recognizing the current position and imaging direction of the portable terminal device, A captured moving image is displayed on the display panel, and additional information is displayed on the displayed moving image.

  On the other hand, in recent years, navigation devices mounted on vehicles or mobile phones have become common. In particular, recently, a navigation device that has a device that extracts a user's trend such as a visit pattern for a specific place in a moving body such as a human or a vehicle, a user's preference, and other user characteristics, and uses the extracted information. Known (for example, Patent Document 1).

JP 2000-155757 A

  However, the extraction device described in Patent Document 1 merely extracts user characteristics, and does not select and provide information that the user is interested in, that is, information desired by the user. Therefore, there is room for further study from the viewpoint of using the extracted information.

  The present invention has been made in order to solve the above-described problem, and its purpose is that a user who is browsing content information associated with position information based on the current position is interested by the user. Information browsing terminal device and information browsing capable of providing relevant information accurately to the assumed content information and realizing effective information provision by improving the number of browsing of the information provided thereby Is to provide programs and the like.

  (1) In order to solve the above-described problem, the portable terminal device of the present invention is portable for allowing a user to browse content information provided in association with a position in the real space and related information related to the content information. A terminal device, a current position detecting means for detecting a current position in the real space; a display means having a predetermined image display area; and a direction in which the portable terminal device is directed in the real space as a terminal direction. Based on the detected direction, detecting means for acquiring the content information and the content feature amount of the content information from another communication device or recording means based on the detected current position, and the detected terminal direction While associating the detected current position with the position in the real space of the acquired content information, Display control means for displaying the acquired content information existing in the end direction in the image display area, and at least one of the detected terminal direction or the display position of the content information displayed in the image display area Based on at least a weighting factor calculating means for calculating a weighting factor related to the content information displayed in the image display area, and a correction for correcting the content feature amount acquired together with the content information using the calculated weighting factor A degree of similarity for calculating the degree of similarity between the acquired content information and each related information based on the corrected content feature quantity and the related information feature quantity stored together with the related information in the storage means A calculating means and a selecting means for selecting relevant information based on the calculated similarity. , The display control means, the identification information for identifying the relevant information or the related information the is selected and has a configuration to be displayed on said display means.

  With this configuration, the portable terminal device according to the present invention can be used for the content information that the user has focused on based on the terminal direction toward the portable terminal device and the display position of the content information displayed in the image display area. The content feature amount can be corrected so that the weight for the content feature amount is increased. Therefore, since the portable terminal device of the present invention can take into account the degree of attention of the user when calculating the degree of similarity between the content information and the related information, the portable terminal device may be interested by a user such as an advertisement for a product or service. It is possible to provide information effectively and to realize effective information provision by improving the number of browsing of the information provided thereby.

  (2) Further, in the portable terminal device of the present invention, the direction detecting unit detects the direction of the portable terminal device as the terminal direction, and the weighting coefficient calculating unit detects the detected terminal direction. Based on the direction and the current position, the angle difference between the position of the acquired content information in the real space and the current position of the portable terminal device is calculated, and the content is calculated based on the calculated angle difference. It has the structure which calculates the weighting coefficient in information.

  With this configuration, the portable terminal device of the present invention may increase the weighting coefficient as the angle difference between the position of the acquired content information in the real space and the current position of the portable terminal device is smaller, for example. Therefore, the content information displayed at the center of the image display area can be handled as the content information that the user is paying more attention to. That is, since the content information focused on by the user is often displayed at the center of the image display area, the portable terminal device of the present invention uses this characteristic to accurately identify the content information focused on by the user. Can be extracted.

  (3) Further, in the portable terminal device of the present invention, the weighting coefficient calculating unit calculates the weighting coefficient in the content information so that the weighting coefficient increases as the calculated angle difference decreases. have.

  With this configuration, the portable terminal device of the present invention can increase the weighting coefficient as the angle difference between the position of the acquired content information in the real space and the current position of the portable terminal device is smaller. The content information displayed at the center of the image display area can be extracted as the content information that the user is paying more attention to.

  (4) Further, in the portable terminal device according to the present invention, the direction detecting unit detects an elevation angle with respect to the direction of the portable terminal device as the terminal direction, and the weighting coefficient calculating unit detects the detected angle. The weighting coefficient in the content information is calculated based on the elevation angle.

  With this configuration, the portable terminal device of the present invention operates the elevation angle of the portable terminal device, so that the user can obtain content information associated with a position far from the current position in the real space of the portable communication terminal device. When the user pays attention or when the user pays attention to the content information associated with the position around the current position, the weighting coefficient of the noticed content information can be adjusted.

  (5) Moreover, the information browsing terminal device according to the present invention is configured so that the weighting coefficient calculating unit has the portable terminal device when the portable terminal device is tilted upward from the horizontal plane based on the detected elevation angle. The weighting coefficient of the content information associated with a position far away in the real space from the device is made larger than the weighting coefficient of the content information associated with a near position in the real space, and the detected elevation angle is set to the detected elevation angle. When the portable terminal device is tilted downward from the horizontal plane, the weighting coefficient of the content information associated with the position near the portable terminal device in the real space is calculated in the real space. It is configured to be larger than the weight coefficient of the content information associated with a distant position.

  With this configuration, the portable terminal device of the present invention can be used when the user pays attention to content information associated with a position far from the current position in the real space of the portable communication terminal device or around the current position. When the user pays attention to the content information associated with the position, the weighting coefficient in the attentioned content information can be adjusted. Therefore, the portable terminal device of the present invention can accurately extract the content information noticed by the user regardless of the distance from the current position of the portable terminal device.

  (6) The portable terminal device according to the present invention further includes coordinate detection means for detecting coordinates of a display position in the image display area of the content information displayed in the image display area, and calculates the weighting coefficient. The means has a configuration for calculating the weighting factor based on the center of the image display area and the coordinate position of the displayed content information.

  With this configuration, the portable terminal device of the present invention can be used when the user pays attention to content information associated with a position far from the current position in the real space of the portable communication terminal device or around the current position. When the user pays attention to the content information associated with the position, the weighting coefficient in the attentioned content information can be adjusted.

  (7) Moreover, the portable terminal device of the present invention has a configuration in which the weighting coefficient calculation unit increases the weighting coefficient of the content information as the weighting coefficient calculation unit is displayed at a position closer to the center of the image display area. Yes.

  With this configuration, the portable terminal device of the present invention can increase the weighting coefficient as it is displayed at a position closer to the center of the image display area, so the content information displayed at the center of the image display area It can be extracted as content information that the user is paying more attention to.

  (8) Further, in the portable terminal device of the present invention, the weighting factor calculating means calculates a plurality of weighting factors for each piece of content information and adds the weighting factors in the calculated same content information, and the correction The means has a configuration for correcting the content feature amount in the corresponding content information based on the combined weight coefficient.

  With this configuration, the portable terminal device of the present invention calculates the weighting coefficient of each content information assuming the content information that the user is paying attention to from various elements, and adds the calculated weighting coefficients. Since the content feature amount can be corrected, the content information displayed at the center of the image display area can be extracted as the content information that the user is paying more attention to.

  (9) In the portable terminal device of the present invention, the content feature amount and the related information feature amount may be included in the content information or in each content information of a keyword constituting text information included in the related information. A feature quantity identified based on the appearance frequency in the related information.

  With this configuration, the portable terminal device of the present invention can calculate each content feature amount and related information feature amount based on the appearance frequency of the keyword, and thus accurately defines the content feature amount and the related information feature amount. be able to. Therefore, the portable terminal device of the present invention can accurately extract related information similar to content information.

  (10) In order to solve the above-described problem, the information browsing program of the present invention browses content information provided by a computer in association with a position in the real space and related information related to the content information to the user. An information browsing program applied by a portable terminal device to be detected, a current position detecting means for detecting a current position in the real space, a display means having a predetermined image display area, and the portable in the real space Direction detection means for detecting the direction of the terminal device as the terminal direction, and a computer mounted on the portable terminal device, based on the detected current position, the content information and the content characteristics of the content information Acquisition means for acquiring the amount from another communication device or recording means, in the detected terminal direction Accordingly, display control for displaying the acquired content information existing in the terminal direction in the image display area while associating the detected current position with the position in the real space of the acquired content information. Means for calculating a weighting factor for at least the content information displayed in the image display area based on at least one of the detected terminal direction and the display position of the content information displayed in the image display area Coefficient calculation means, correction means for correcting the content feature amount acquired together with the content information using the calculated weighting coefficient, the related information stored together with the related information in the corrected content feature amount and the storage means Based on the feature amount, the acquired content information and each related information Functioning as a similarity calculating means for calculating the degree of similarity and a selecting means for selecting relevant information based on the calculated similarity, and as the display control means, the selected related information or The display unit has a function of displaying specific information for specifying related information on the display unit.

  With this configuration, the information browsing program according to the present invention is based on the terminal direction directed to the portable terminal device and the display position of the content information displayed in the image display area. The content feature amount can be corrected so that the weight for the content feature amount is increased. Therefore, the information browsing program according to the present invention can take into account the degree of attention of the user when calculating the similarity between the content information and the related information. It is possible to provide information effectively and to realize effective information provision by improving the number of browsing of the information provided thereby.

  (11) In order to solve the above-described problem, the server device of the present invention is a server device that allows a portable terminal device having a function of imaging a real space to acquire content information and related information related to the content information so as to be viewable. For each content, content data that forms the content as data, position information indicating a position in the real space, and keyword data that forms a keyword included in the content as data are stored. And a second database in which feature data indicating feature data calculated from text included in the relevant information and formation data forming the relevant information is stored for each relevant information. Control means;

  Acquisition of acquiring the current position of the portable terminal device in the real space and the terminal direction of the portable terminal device in the real space by executing data communication with the corresponding portable terminal device Based on the detected direction of the terminal and the detected terminal direction, the detected current position and the position in the real space of the acquired content information are associated with each other and displayed in the image display area of the portable terminal device Therefore, based on at least one of the providing means for providing the acquired content information existing in the terminal direction, and the display position of the content information displayed in the detected terminal direction or the image display area A weighting factor calculation for calculating a weighting factor for at least the content information displayed in the image display area. Means for correcting the content feature amount of the content information using the calculated weighting factor, and the related information feature amount stored together with the related information in the corrected content feature amount and the storage means A similarity calculation unit that calculates the similarity between the acquired content information and each related information, and a selection unit that selects relevant information based on the calculated similarity. The providing means provides the portable terminal device with the selected related information or specific information for specifying the related information.

  With this configuration, the server device according to the present invention enables content features regarding content information that the user is paying attention to based on the terminal direction toward the portable terminal device and the display position of the content information displayed in the image display area. The content feature amount can be corrected so that weighting for the amount is increased. Therefore, the server device of the present invention can take into account the degree of attention of the user when calculating the similarity between the content information and the related information. Providing accurately and improving the number of browsing of information provided thereby can realize effective information provision.

  (12) In order to solve the above-described problem, the information providing program of the present invention allows a computer to view content information and related information related to the content information on a portable terminal device having a function of imaging a real space. A browsing information providing program to be acquired, wherein the computer includes, for each content, content data forming the content as data, position information indicating a position in the real space, and a keyword included in the content First amount database storing keyword data formed as data, and feature amount data indicating feature amounts calculated from formation data forming the relevant information and text included in the relevant information for each of the related information Control means for controlling the stored second database; Obtaining means for acquiring a current position of the portable terminal device in the real space and a terminal direction of the portable terminal device in the real space by executing data communication with the portable terminal device In order to display the detected current position on the image display area of the portable terminal device while associating the detected current position with the position in the real space of the acquired content information based on the detected terminal direction. Providing means for providing the acquired content information existing in the terminal direction, based on at least one of the detected terminal direction or the display position of the content information displayed in the image display area, at least Weight coefficient calculation means for calculating a weight coefficient for content information displayed in the image display area Correction means for correcting the content feature quantity of the content information using the calculated weighting factor, based on the corrected content feature quantity and the related information feature quantity stored together with the related information in the storage means , Functioning as similarity calculation means for calculating the similarity between the acquired content information and each related information, and selection means for selecting relevant information based on the calculated similarity As a means, the portable terminal device has a function of providing the selected related information or specific information for specifying the related information to the portable terminal device.

  With this configuration, the information providing program according to the present invention enables the content information that the user is paying attention to based on the terminal direction toward the portable terminal device and the display position of the content information displayed in the image display area. The content feature amount can be corrected so that the weight for the content feature amount is increased. Accordingly, the information providing program of the present invention can take into account the degree of user attention when calculating the similarity between the content information and the related information. It is possible to provide information effectively and to realize effective information provision by improving the number of browsing of the information provided thereby.

  The portable terminal device, the server device, the information browsing program, and the information browsing program of the present invention can take into account the user's attention when calculating the similarity between the content information and the related information. Alternatively, it is possible to provide information that is interesting by the user, such as service advertisements, and to effectively provide information by improving the number of browsing of the information provided thereby.

1 is a system configuration diagram in an embodiment of a network system according to the present invention. FIG. It is an example of the data structure of the content information in one embodiment. It is a figure for demonstrating the content feature-value in content information. It is an example of the data structure of the relevant information in one embodiment. It is a block diagram which shows the structure of the portable communication terminal device in one Embodiment. In one embodiment, it is a figure for demonstrating the detection of the content information based on a present position. In one embodiment, a diagram for explaining a relationship between a direction in a terminal direction in a portable communication terminal device and acquired content information C, and content information displayed in an image display area based on the direction. FIG. In one embodiment, a diagram (part 1) illustrating the relationship with acquired content information C when the direction in the terminal direction changes, and content information displayed in the image display area based on the direction are described. FIG. In one embodiment, a diagram (part 2) illustrating the relationship with acquired content information C when the direction of the terminal direction changes, and content information displayed in the image display area based on the direction are described. FIG. In one embodiment, a diagram (part 1) illustrating the relationship with acquired content information C when the elevation angle in the terminal direction changes, and content information displayed in the image display area based on the direction will be described. FIG. In one embodiment, a diagram (part 1) illustrating the relationship with acquired content information C when the elevation angle in the terminal direction changes, and content information displayed in the image display area based on the direction will be described. FIG. In one embodiment, it is a figure for demonstrating the relationship between the image display area when the content information currently displayed on the image display area is expanded, and the content information displayed. In one embodiment, it is a figure for explaining recommendation information displayed on an image display field. It is a flowchart which shows the operation | movement of the information provision process in the portable communication terminal device of one Embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The embodiment described below is directed to a portable communication terminal device such as a portable telephone or a server device via a network, or to a server device. It is an embodiment when the apparatus and the program for providing information are applied.

<Overview of network system>
First, a schematic configuration of the network system 10 according to the present embodiment will be described with reference to FIG. FIG. 1 is a system configuration diagram showing the configuration of the network system 10.

  As shown in FIG. 1, the network system 10 according to the present embodiment includes a plurality of pieces of content information C and books, articles, or facilities that are associated with positions in a real space including documents or images such as advertisements or information about facilities in a store. A database 100 in which a plurality of related information R related to the content information C is stored in advance, and a server device 200 that controls the database 100 and manages the content information C and the related information R.

  The network system 10 includes a plurality of communication terminal devices (hereinafter referred to as “portable communication terminal devices”) 300 that are individually owned and carried by the user. Each portable communication terminal device 300 displays content information C in the image display area DA so that it can be viewed by the user. Each portable communication terminal device 300 is connected to the database 100 and the server device 200 and another portable communication terminal device 300 via the base station BS or the network N such as the Internet or a public telephone line network, or Not connected to other communication devices.

  In particular, each portable communication terminal apparatus 300 has a predetermined image display area DA, and is based on the current position (hereinafter simply referred to as “current position”) P of each portable communication terminal apparatus 300 in the real space. The content information C acquired from the database 100 is displayed in the image display area DA. Specifically, each portable communication terminal device 300 has a terminal direction in which each portable communication terminal device 300 is directed by the user, that is, a direction in which the portable communication terminal device 300 faces (hereinafter, simply “ Direction ") AG and an elevation angle with respect to the direction AG (hereinafter simply referred to as" elevation angle ") EA is detected, and the direction in which each portable communication terminal device 300 is directed based on the detected direction AG and elevation angle EA. The content information C existing within a predetermined distance from the current position in the real space of each portable communication terminal device 300 is displayed in the image display area DA.

  Each portable communication terminal apparatus 300 acquires the feature amount of each content information C calculated in advance and stored in the database 100 (hereinafter referred to as “content feature amount”) together with the content information C, and each of the portable communication terminal devices 300 acquires the feature information. Each content feature amount is corrected based on the direction AG to which the communication terminal device 300 is directed and the elevation angle EA with respect to the direction AG. At this time, when the display of the content information C displayed in the image display area DA is enlarged, each portable communication terminal device 300 corrects each content feature amount based on the enlargement rate.

  Furthermore, the portable communication terminal device 300 uses each of the corrected content feature amount and the feature amount calculated and stored in advance for each related information R (hereinafter referred to as “related information feature amount”). The degree of similarity between the content information C and the related information R is calculated, and related information R (hereinafter also referred to as “recommended information”) that is assumed to be related to the content information C displayed in the image display area DA. Select. Then, the portable communication terminal device 300 displays the selected related information (that is, recommended information) R together with the content information C in the image display area DA.

  With this configuration, each portable communication terminal device 300 according to the present embodiment is directed to the direction in which the portable communication terminal device 300 faces, that is, the direction AG and the elevation angle EA, and the content information C displayed in the image display area DA. The content information C that is assumed to be noticed by the user is identified based on the enlargement ratio. Then, each portable communication terminal device 300 calculates a weighting coefficient for weighting the content feature amount of the content information C assumed to be noticed by the user, and based on the calculated weighting coefficient, The recommendation information to be selected is calculated by calculating the similarity between the feature amount and the related information feature amount in the related information R that is information to be recommended. Therefore, each portable communication terminal device 300 provides related information R related to the content information C that the user is interested in, such as advertisements for goods or services, and improves the number of browsing of the information provided thereby. Effective information provision can be realized.

<Database>
Next, the database 100 of the present embodiment and the content information C and the related information R stored in the database 100 will be described with reference to FIGS.

  2 shows an example of a data structure in the content information C in the present embodiment, and FIG. 3 is a diagram for explaining content feature amounts calculated in advance based on each information included in the content information C. It is. FIG. 4 is an example showing a data structure in the related information R in the present embodiment.

  In the database 100 of this embodiment, content information C is recorded with a predetermined data structure by resource data for the WWW system (hereinafter also referred to as “Web page data”). Each content information C uses HTML (Hyper Text Markup Language) or XML (Extensible Markup Language) or HTML (Hyper Text Markup Language), using an identifier called a tag for a plurality of components having different types and contents such as advertisements, images, texts, or a group of sentences It is composed of markup languages such as

  For example, each piece of content information C is content information C for introducing a store or a place. As shown in FIG. 2, the content ID for identifying each piece of content information C and coordinates indicating the coordinates of the real space Information, title information indicating the title of the content information C as text, and provision information indicating the content of the content information C.

  The content ID is information for identifying a storage location in the database 100 called a unique URL (Uniform Resource Locator) (hereinafter referred to as “URL”) and other content information C such as a unique combination of characters. is there. The coordinate information is coordinate information associated with a real space composed of latitude and longitude. The title information is text information such as a store name, category, place name or type, and the provided information is a feature of the store or place, or information to be recommended in the store or place. For example, in the present embodiment, as shown in FIG. 3A, the first content information C1 is displayed in the image display area DA of the portable communication terminal device 300.

  Each content information C includes a content feature amount indicating a feature amount calculated in advance. The content feature amount is a keyword that is extracted by performing morphological analysis on title information and provided information to decompose unnecessary parts of speech while disassembling into parts of speech, and a keyword that completely matches a keyword included in a predetermined keyword dictionary Or a document vector calculated based on a keyword extracted by a provider who provides the content information C or a system administrator. Specifically, the document vector is a TF-IDF (Term Frequency-Inverse Document Frequency) indicating the appearance frequency of the keywords extracted in the title information and the provided information and the appearance frequency appearing in one content information C for each keyword. Formed by.

For example, as shown in FIG. 3 (b), the content feature amount in the first content information C 1, that is, the content ID “info001” is the title information “coffee shop” and the provided information “real coffee Appearance frequency “TF” in the first content information C and all the content information C (for example, for each keyword “coffee”, “bean”, and “store” extracted by executing morphological analysis from The document vector (T _j ) of “TF-IDF (= TF / DF)” for each keyword calculated based on the appearance frequency “DF” in the first content information C1 to the tenth content information C10). The document vector (T _j ) is a vector as shown in (Expression 1).

Note that, in (Formula 1), "j" indicates a content ID, "Key1" - "Keym" indicates the text of the keywords detected by the morphological analysis, _{"t j} ^1", "-" _t ^{j m} "Indicates the calculated TF-IDF value of each keyword.

  On the other hand, in the database 100, related information (hereinafter also referred to as “related candidate information” or “recommended candidate information”) R to be a candidate for recommended information in a predetermined format is stored with a predetermined data structure. ing. For example, as shown in FIG. 4, each related information R includes an ID for identifying the related information R and provision information such as title information, text, or an image of each related information R.

  The ID is information for distinguishing from other content information C such as an address (hereinafter referred to as “URL”) indicating a storage location in the database 100 called a unique URL (Uniform Resource Locator) or a unique combination of characters. . The title information is text information such as a name, category or type in the related information R, and the provided information is information for explaining the related information R.

  Each related information R includes a related information feature amount calculated in advance. For example, the related information feature quantity is a keyword extracted by removing unnecessary parts of speech while performing morphological analysis on title information and provided information and decomposing them into parts of speech, similar to the content feature quantity, a predetermined keyword dictionary Is a document vector “S” calculated based on a keyword that completely matches a keyword included in the URL or a keyword extracted by a provider or a system administrator who provides the content information C. Further, the document vector “S” of the related information R appears in the single related information R in each keyword and the appearance frequency of the keyword extracted in the title information and the provided information, similarly to the content feature amount (formula 2 TF-IDF indicating the appearance frequency shown in FIG.

As in (Expression 1), in (Expression 2), Key1 to Keym indicate keyword texts, and “s _j ¹ ” to “s _j ^m ” indicate TF− of each keyword in each related information R. IDF value.

<Server device>
Next, the server apparatus 200 of this embodiment is demonstrated.

  The server device 200 is mainly composed of a CPU, a ROM, a RAM, and a hard disk, and includes a communication function for transferring data to and from the portable communication terminal device 300, management of the database 100, and each content information C and The related information R is managed. For example, control information for executing each function is recorded in the ROM, and various programs such as a control program or an OS (Operating System) are recorded in the hard disk. In addition, the CPU implements the various functions described above by executing a program recorded on the hard disk, and the RAM is used as a work area. In particular, as a communication function, the server device 200 establishes a communication line with the portable communication terminal device 300 when receiving a transmission request for content information C or related information R from each portable communication terminal device 300. Then, the requested data is transmitted to the portable communication terminal device 300.

<Portable communication terminal device>
1. Configuration of Portable Communication Terminal Device Next, the configuration of each portable communication terminal device 300 according to the present embodiment will be described with reference to FIG. FIG. 5 is a block diagram illustrating a configuration of each portable communication terminal device 300 according to the present embodiment.

  Each portable communication terminal device 300 is, for example, a portable communication terminal such as an electronic book reading / playback device (electronic book reader), a game machine, a PDA (Personal Digital Assistants), a portable telephone, or a portable tablet communication terminal device. Device. Each portable communication terminal apparatus 300 has an image display area DA and a browser function for reading resource data and displaying the content information C in the image display area DA.

In addition, each portable communication terminal device 300 cooperates with various hardware included in each portable communication terminal device 300 and recommends that are assumed necessary for the user together with the content information C acquired based on the current position P. A program (hereinafter referred to as “information providing program”) for executing an information providing process for providing related information R to be performed as recommendation information is executed. In particular, as a process executed by the information providing program,
(1) Detection control processing for controlling detection of the current position P of the portable communication terminal device 300 and the terminal direction (direction AG and elevation angle EA) to which the portable communication terminal device 300 is directed,
(2) Based on the detected current position P, an acquisition process for acquiring content information C associated with positions around the portable communication terminal device 300 from the database 100,
(3) Display control processing for displaying the acquired content information C in the image display area DA (4) On the image display area DA of the detected direction AG and elevation angle EA and the content information C displayed in the image display area DA Weighting calculation processing for calculating a weighting coefficient of each content information C displayed in the image display area DA based on the coordinates at
(5) Correction processing for correcting the content feature amount included in each acquired content information C with the calculated weighting factor,
(7) One search formula is generated based on the corrected content feature amount, each related information feature amount acquired from the database 100 in advance based on the generated search formula, a corrected content feature amount corrected, Similarity calculation processing for calculating the similarity of
(8) A providing process of selecting relevant information R corresponding to each calculated similarity, displaying the selected relevant information R in the image display area DA, and providing the user with information related to the relevant information R is included. It is.

  Specifically, each portable communication terminal device 300 includes a communication control unit 310 that communicates with the database 100, the server device 200, and other communication devices, a data processing unit 320 that performs each process in the information providing process, A current position detection unit 330 that detects the current position P in the portable communication terminal device 300 that detects the position P; and a posture detection unit 340 that detects the terminal direction to which the portable communication terminal device 300 is directed. doing.

  Each portable communication terminal device 300 includes a display unit 360 having a predetermined image display area DA, a drawing control unit 350 that controls various drawing operations on the display unit 360, and an operation unit for inputting user operations. 370, a terminal management control unit 380 that controls the whole, an information providing program and a control program for the terminal management control unit 380 to control each member, and a memory used when the control program is executed And a ROM / RAM 390 having a function.

  For example, when the portable communication terminal apparatus 300 has a mail function such as a telephone function and an e-mail, the portable communication terminal apparatus 300 includes various necessary members such as a microphone, a speaker, and an e-mail transmission / reception function. Further, the above-described units are connected to each other by a bus B, and exchange of data is executed.

  For example, the data processing unit 320 constitutes an acquisition unit, a display control unit, a weight coefficient calculation unit, a correction unit, a similarity calculation unit, and a selection unit of the present invention. Further, for example, the current position detection unit 330 of the present embodiment constitutes a current position detection unit of the present invention, and the posture detection unit 340 constitutes a direction detection unit of the present invention.

  The communication control unit 310 establishes a communication line with the server apparatus 200 and the database 100 via the base station BS connected to the network N under the control of the data processing unit 320, and acquires the content information C or the related information R Various data are exchanged.

  The data processing unit 320 realizes information providing processing executed by the information providing program. For example, the data processing unit 320 executes various control programs for controlling each unit of the portable communication terminal device 300 with the information providing program recorded in the ROM / RAM 390, and the communication control unit 310 and the drawing control unit 350. The various processes described above are executed in conjunction with or under control.

  Specifically, the data processing unit 320 starts up the information providing program, and as illustrated in FIG. 5, the detection control unit 321 that executes the detection control process, the acquisition processing unit 322 that executes the acquisition process, Provided are a display control processing unit 323 that displays the content information C in the image display area DA, a weighting factor calculation processing unit 324 that performs weighting calculation processing and correction processing, a similarity calculation processing unit 325 that performs similarity calculation processing, and the like. A providing processing unit 326 that executes processing is constructed.

  For example, the acquisition processing unit 322 of the present embodiment constitutes an acquisition unit of the present invention, and the display control processing unit 323 constitutes a display control unit of the present invention. Further, for example, the weighting factor calculation processing unit 324 of this embodiment constitutes a weighting factor calculation unit and a correction unit, and the similarity calculation processing unit 325 constitutes a similarity calculation unit. Further, for example, the provision processing unit 326 of the present embodiment constitutes a provision unit of the present invention.

  The current position detection unit 330 recognizes the position of a GPS (Global Positioning System) satellite via the network N under the control of the data processing unit 320 when the information providing program is started, and transmits a satellite transmitted from the GPS satellite. A signal (GPS signal) is detected, and a coordinate value indicated by the latitude and longitude of the current position P of the portable communication terminal device 300 is calculated (that is, detected) based on the detected GPS signal. The current position detector 330 provides the calculated coordinate value to the data processor 320 as position information.

  When the portable communication terminal device 300 has a telephone function, the current position of the portable communication terminal device 300 is determined based on the direction AG and the radio wave intensity received at the telephone base station. P may be calculated (detected).

  The posture detection unit 340 is formed of a magnetic sensor that detects weak geomagnetism and an acceleration sensor that detects the direction of gravity. At the time of starting the information providing program, under the control of the data processing unit 320, the terminal direction, That is, the direction AG to which the portable communication terminal device 300 is directed (that is, east, west, north and south) and the elevation angle EA with respect to the direction AG (an angle formed by the horizontal plane and the direction in which the portable communication terminal device 300 is directed). And the detected direction AG and elevation angle EA are provided to the data processing unit 320 as direction AG information or elevation angle EA information.

  The display unit 360 has an image display area DA of a predetermined size (for example, W320 × H400 pixels), and is configured by, for example, a panel of liquid crystal elements or EL (Electro Luminescence) elements, and is generated by the drawing control unit 350. A predetermined image is displayed based on the display data. In particular, in the present embodiment, the display unit 360 displays the content information C in conjunction with the operation unit 370 when the information providing program is being executed.

  The drawing control unit 350 generates drawing data necessary to cause the display unit 360 to draw a predetermined image under the control of the terminal management control unit 380 or the control of the data processing unit 320. The generated drawing data is output to the display unit 360.

  The operation unit 370 includes various confirmation buttons, operation buttons for inputting operation commands, a number of keys such as a numeric keypad, and a touch sensor provided on the display unit 360, and is used when performing each operation. It has become. Specifically, the operation unit 370 is used when performing operations for executing the various processes described above when the information providing program is started.

  The terminal management control unit 380 is mainly configured by a central processing unit (CPU) and includes various input / output ports such as a key input port and a display control port. The overall function for executing the information providing program is comprehensively controlled.

  Various control programs for functioning as the portable communication terminal device 300 are recorded in the ROM / RAM 390, and an information providing program including a browser function for browsing the content information C or related information R is recorded. ing. The ROM / RAM 390 is used as a work area when various processes are executed.

2. Details of Data Processing Unit Next, the configuration and operation of each unit in the data processing unit 320 of the present embodiment will be described in detail with reference to FIGS.

  6 is a diagram for explaining the detection of the content information C based on the current position P, and FIG. 7 is a relationship between the terminal direction direction AG and the acquired content information C in the portable communication terminal device 300. FIG. 4 is a diagram for explaining the content information C displayed in the image display area DA based on the direction AG.

  FIG. 8 is a diagram (part 1) illustrating the relationship with the acquired content information C when the direction AG in the terminal direction changes, and content information displayed in the image display area DA based on the direction AG. FIG. 9 is a diagram for explaining the relationship with the acquired content information C when the direction AG in the terminal direction changes (part 2), and image display based on the direction AG. It is a figure for demonstrating the content information C displayed on the area | region DA.

  Further, FIG. 10 is a diagram (part 1) for explaining the relationship with the acquired content information C when the elevation angle EA in the terminal direction changes, and the content information displayed in the image display area DA based on the direction AG. FIG. 11 is a diagram for explaining the relationship with the acquired content information C when the elevation angle EA in the terminal direction changes (part 1), and image display based on the direction AG. It is a figure for demonstrating the content information C displayed on the area | region DA.

  FIG. 12 is a diagram for explaining the relationship between the image display area DA and the displayed content information C when the content information C displayed in the image display area DA is enlarged. These are the figures for demonstrating the recommendation information displayed on image display area DA.

  The detection control unit 321 includes an acceleration sensor and a timer, and detects at the current position P, the direction AG, and the elevation angle EA in conjunction with the current position detection unit 330 and the posture detection unit 340 while the information providing program is activated. Specifically, the detection control unit 321 detects whether the portable communication terminal device 300 is stationary for a predetermined time (for example, 3 seconds) using an acceleration sensor and a timer, and determines that the mobile communication terminal device 300 is stationary for the predetermined time. If detected, the current position P, direction AG, and elevation angle EA are detected and stored in the ROM / RAM 390.

  The acquisition processing unit 322 acquires predetermined content information C from the database 100 based on the detected current position P under the control of the server device 200 in conjunction with the communication control unit 310. For example, when the current position P (for example, latitude = 35.628367 degrees, longitude = 139.1886992 degrees) is detected as illustrated in FIG. 6A, the acquisition processing unit 322 illustrated in FIG. 6B. Thus, the content information C of “9” having position information of a predetermined radius region r (for example, radius r = 1 km) around the current position P detected regardless of the imaging direction is detected from the database 100, and the corresponding. Content information C is acquired.

  Further, the acquisition processing unit 322 acquires the related information R together with the related information feature amount from the database 100 at the start of execution of the information providing program, and stores it in the ROM / RAM 390.

  The display control processing unit 323 cooperates with the drawing control unit 350 and the detection control unit 321, and from the content information C acquired based on the current position P, the portable communication terminal device 300 based on the detected direction AG and elevation angle EA. Is displayed in the image display area DA of the display unit 360.

  Specifically, the display control processing unit 323 determines the current position P of the portable communication terminal device 300 in the real space, the position of the content information C, and the direction recognition range (that is, the viewing angle (for example, −15) of the portable communication terminal device. Titles included in each content information C in a three-dimensional virtual space with a sense of depth, such as a three-dimensional map (that is, a bird's-eye view) based on a distance recognition range (for example, 0 m to 500 m). Is displayed in the image display area DA so that there is. At this time, the display control processing unit 323 displays a scale in order to facilitate visual recognition of the distance difference between the portable communication terminal device 300 and the content information C in the real space.

  For example, as illustrated in FIG. 6B, the display control processing unit 323 acquires “9” content information C associated with a position in the real space, and the direction AG is “ When “0 degree (north = 0 degree)” and the elevation angle EA is “0 degree (horizontal = 0 degree)”, as shown in FIG. 7, the first content information C1 to the fourth content information C4 “ Title information and provision information included in the content information C of “4” are displayed in the image display area DA.

  Here, the horizontal means that the surface of the portable communication terminal device 300 on which the image display area DA is formed is perpendicular to the ground. Further, the display control processing unit 323 recognizes the recognizable angle formed based on the size of the image display area DA set in advance, the predetermined recognition distance 21 and the detected direction AG together with the direction AG and the elevation angle EA. The content information C within the viewing range 20 formed based on the (recognition angle) 22 is selected, and the title information and provision information are displayed together with the three-dimensional virtual image in the image display area DA. In particular, in FIG. 7B, each piece of content information C is displayed by a content ID, but is actually displayed by title information and provision information. And the magnitude | size of the content information displayed according to the distance from the real space of the portable communication terminal device 300 is also changed and displayed.

  In addition, when the terminal direction in which the portable communication terminal device 300 is directed is changed by the user, the display control processing unit 323 directs the portable communication terminal device 300 according to the detected direction AG sequentially in response to the change. The content information C associated with the position in the terminal direction is displayed in the image display area DA of the display unit 360.

  For example, the display control processing unit 323, as shown in FIG. 8, when the user rotates only the direction AG in the terminal direction in the portable communication terminal device 300 by “30 degrees” clockwise from the state of FIG. Displays the title information and provision information of the fourth content information C4 and the fifth content information C5 belonging to the viewing range 20 in the image display area DA. Then, as shown in FIG. 9, the display control processing unit 323 is rotated by “30 degrees” only in the terminal direction direction AG in the portable communication terminal device 300 from the state of FIG. 7 counterclockwise. In this case, only the title information and provision information of the first content information C1 and the third content information C3 belonging to the viewing range 20 are displayed in the image display area DA.

  On the other hand, when the terminal direction of the portable communication terminal device 300 is directed upward or downward by the user and the elevation angle AE is detected by the user, the display control processing unit 323 determines the position of the real space of the portable communication terminal device 300. Only content information in the vicinity or in the distance is displayed on the image display area DA. That is, as the elevation angle EA increases upward from the horizontal, the display control processing unit 323 focuses on the image display area DA so that the content information C existing far from the portable communication terminal device 300 in the real space is focused. The content information is displayed, and the content information is displayed in the image display area DA so as to focus on the content information C existing around the portable communication terminal device 300 in the real space as the elevation angle EA increases downward from the horizontal. To do.

  Specifically, when the elevation angle EA in the terminal direction is tilted upward (plus) with respect to the horizontal plane, the display control processing unit 323 is positioned far from the current position of the portable communication terminal device 300 in the real space. Display control of the content information C is performed so that only the content information C existing in the image display area DA is displayed. Further, when the elevation angle EA in the terminal direction is tilted downward (minus) with respect to the horizontal plane, the display control processing unit 323 exists closer to the real space than the current position of the portable communication terminal device 300. Display control of the content information C is performed so that only the content information C is displayed in the image display area DA. In particular, the display control processing unit 323 of the present embodiment executes (Equation 3) and (Equation 4), sets a distance recognition range for display in the image display area DA, and falls within the set distance recognition range. Is displayed in the image display area DA.

  In (Expression 3) and (Expression 4), “X” is a constant for adjusting the scale in the image display area DA, and is “10 m”, for example. If the minimum value or the maximum value of the distance recognition range is “0” or less, the distance recognition range is regarded as “0”.

  For example, the display control processing unit 323 is a case where the elevation angle EA is 0 degree and the distance recognition range is 0 m to 500 m, and the terminal direction of the portable communication terminal device 300 is “30 degrees” upward by the user. When tilted, the distance recognition range is set to 300 m to 800 m, and the third content information C3 existing in the distance recognition range 300 m to 800 m from the portable communication terminal device 300 in the real space as shown in FIG. The title information and provision information of the fourth content information C4 are enlarged and displayed on the image display area DA.

  Further, for example, the display control processing unit 323 is a case where the elevation angle EA is 0 degree and the distance recognition range is 0 m to 500 m, and the user changes the terminal direction of the portable communication terminal device 300 downward by “30”. When the angle is tilted, the distance recognition range is set to 0 m to 300 m, and the first content information C1 existing in the distance recognition range 0 m to 300 m from the portable communication terminal device 300 in the real space as shown in FIG. The title information and provision information of the second content information C2 are enlarged and displayed in the image display area DA.

  On the other hand, the display control processing unit 323 changes the enlargement ratio of the content information C with respect to the three-dimensional virtual space displayed in the image display area DA based on an instruction from the operation unit 370 while interlocking with the drawing control unit 350. Display control.

  For example, as illustrated in FIG. 12A, the display control processing unit 323 uses the operation unit 370 to issue an instruction (doubled) for performing an enlarged display on the area (instruction area) around the third content information C3. 12 (b), the size of the three-dimensional virtual space region is changed (for example, from W400 × H320 pixels to W200 × H160 pixels), as shown in FIG. Display control is performed to enlarge the area for displaying the content information C3, that is, the area for displaying the title information and the provided information. However, in this case, the display control processing unit 323 changes only the size of the displayed three-dimensional virtual space area without changing each information of the direction recognition range and the distance recognition range.

  The weighting factor calculation processing unit 324 calculates a weighting factor for digitizing the degree of attention of the user for each content information C acquired from the database 100. In general, the content information C displayed in association with the position in the real space is displayed in the image display area DA with respect to the content information C noted by the user. In particular, it can be said that the higher the image is displayed in the image display area DA and near the center of the image display area DA, the higher the degree of attention by the user. Therefore, the weight coefficient calculation processing unit 324 according to the present embodiment performs a user operation on the content information C displayed at the center of the image display area DA and the content information C displayed largely on the image display area DA. The weighting coefficient for increasing the numerical value of the content feature amount in the content information C is calculated. Note that the weighting factor calculation process 324 of the present embodiment executes the weighting factor calculation process not only for the content information C displayed in the image display area DA but also for all the content information C acquired based on the current position.

  First, the weight coefficient calculation processing unit 324 determines the position of the acquired content information C in the real space based on the detected direction AG in the terminal direction and the current position P, and the portable communication terminal device 300. An angle difference with the current position P is calculated, and a weighting factor in the content information C is calculated based on the calculated angle difference.

  Specifically, the weighting factor calculation processing unit 324 performs the calculation of (Equation 5), and sets the weighting factor WA in the corresponding content information C so that the weighting factor increases as the calculated angle difference decreases. calculate. However, if the denominator variable (AG-B) is less than “1” in (Expression 5), the weighting factor calculation processing unit 324 executes (Expression 6) to calculate the weighting factor WA. This is because when the denominator variable approaches “0”, the value changes abruptly, and when it becomes “0”, it diverges and an error occurs in the calculation result.

  In (Expression 5), “AG” indicates the direction AG (north = 0 °) in the terminal direction of the portable communication terminal device 300, and “B” indicates the portable communication terminal device 300 in the real space. This is the absolute direction of the content information C with respect to the portable communication terminal device 300 calculated based on the current position P and the direction AG in the terminal direction and the position of the content information C in the real space. “Α” is a predetermined constant.

  Secondly, the weighting factor calculation processing unit 324 determines the distance difference between the position of the acquired content information C in the real space and the current position P of the portable communication terminal device 300 based on the detected current position P. And a weighting coefficient based on the calculated distance difference is calculated based on the detected magnitude of the elevation angle EA.

  Specifically, the weighting factor calculation processing unit 324 performs the calculation of (Expression 7) or (Expression 8) depending on the value of the elevation angle EA, and the portable communication terminal device 300 is above the horizontal plane (θ = 0 degrees). The weighting coefficient of the content information C associated with a position far away in the real space from the portable communication terminal device 300 is associated with a near position in the real space. When the portable communication terminal device 300 is larger than the weight coefficient of the content information C and tilts downward from the horizontal plane, the portable communication terminal device 300 is associated with a nearby position in the real space. The weighting coefficient WB is calculated so that the weighting coefficient of the content information C is larger than the weighting coefficient of the content information C associated with a distant position in the real space. . However, when the variable “L” in the denominator is less than “1” in (Expression 8), the weight coefficient calculation processing unit 324 executes (Expression 9) to calculate the weight coefficient WB. This is because when the denominator variable “L” approaches “0”, the value suddenly changes, and when it becomes “0”, it diverges and an error occurs in the calculation result.

  In (Expression 7) and (Expression 8), “L” indicates the Eugrid distance between the portable communication terminal device 300 and the position where the content information C is associated in the real space. Here, the Eugrid distance is a distance calculated by the three-square theorem between two points based on the position in the real space. “Β” is a predetermined constant.

  Third, the weighting coefficient calculation processing unit 324 calculates the weighting coefficient based on the position of the content information C (the displayed title information and the center coordinates of the provided information) in the three-dimensional virtual space displayed in the image display area DA. calculate.

Specifically, the weight coefficient calculation processing unit 324 performs the calculation of (Equation 10) so that the weight coefficient of the content information C increases as the position is displayed closer to the center of the image display area DA. The weight coefficient WC is calculated. However, when the denominator variable (Y _i −Y _C ) is less than “1” in (Expression 10), the weighting coefficient calculation processing unit 324 executes (Expression 11) to calculate the weighting coefficient WC. To do. This is because when the denominator variable approaches “0”, the value changes abruptly, and when it becomes “0”, it diverges and an operation error occurs.

In (Equation 10), the Y coordinate is used as the coordinate value, “Y _i ” indicates the Y coordinate in the image display area DA in the title information and provided information of the content information C, and “Y _C ” The Y coordinate of the center of the image display area DA is shown. “P” represents an enlargement ratio (%), and is an enlargement ratio or reduction ratio when the enlargement ratio at a predetermined standard time (for example, FIGS. 7 to 9) is set to “100%”. Further, “γ” is a predetermined constant. However, the weight coefficient calculation unit 324 calculates the weight coefficient WC only for the content information displayed in the image display area DA.

  The correction processing unit adds the weighting factors WA, WB, and WC of each content information C calculated by the weighting factor calculation processing unit 324 for each content information C, and the content feature amount of the content information C, that is, the content The value (D) of TF-IDF of information C is multiplied by the corresponding combined weight coefficient.

The similarity calculation processing unit 325 generates a single search expression “Q” by vector addition of the corrected content feature amounts in each content information C. Then, the similarity calculation processing unit 325 performs a generated vector search expression “for the related information feature amount (that is, the document vector S shown in (Expression 2)) in each related information R acquired in advance from the database 100. Q ”is compared with the document vector (S _j ) of the acquired related document, and the similarity (sim) between the search expression and each related information R is calculated using (Expression 12) using the vector space model. It has become.

The document vector “S” refers to (Expression 2), and the search expression “Q” is expressed in (Expression 13). In (Expression 13), as in (Expression 1) and (Expression 2), Key1 to Keym indicate keyword texts, and “q ₁ ” to “q _m ” are corrections in all content information C. The TF-IDF value of each keyword is shown.

  The provision processing unit 326 cooperates with the drawing control unit 350 to select relevant information R corresponding to each calculated similarity, and the selected relevant information R (recommended information) together with title information and provision information. Displayed in the image display area DA. For example, as illustrated in FIG. 13, the provision processing unit 326 displays the title “item001” of the selected recommendation information and the provision information at the bottom of the image display area DA.

<Information provision processing>
Next, the operation of the information providing process in the portable communication terminal device 300 of this embodiment will be described using FIG. FIG. 14 is a flowchart showing the operation of the information providing process in the portable communication terminal device 300 of this embodiment.

  In this operation, a plurality of content information C and related information R are stored in the database 100, and document vectors are already generated and stored in each content information C and each related information R. Shall. In addition, the server device 200 appropriately transmits the content information C and each related information R to the portable communication terminal device 300 while controlling the database 100 based on an instruction from the portable communication terminal device 300.

  First, when the terminal management control unit 380 detects an instruction to start information provision processing input to the operation unit 370 (step S101), the information provision processing program is activated to perform predetermined initial settings (step S102). At this time, the acquisition processing unit 322 acquires the related information R and the related information feature amount of the related information R from the database 100 and stores them in the ROM / RAM 390.

  Next, the detection control unit 321 determines whether or not the portable communication terminal device 300 is stationary at a certain position and a predetermined time has elapsed from when the portable communication terminal device 300 is stationary (that is, whether or not it is a detection timing) (step). S103) When it is determined that a predetermined time has elapsed, the current position detection unit 330 and the posture detection unit 340 include the current position P, the direction AG, and the elevation angle EA in the real space of the portable communication terminal device 300. The terminal direction is detected (step S104). At this time, if the detection control unit 321 determines that a predetermined time has elapsed from the start of the timer count, the detection control unit 321 resets the timer count and starts re-counting.

  Next, the acquisition processing unit 322 acquires the content information C around the current position P and the content feature amount thereof from the database 100 based on the detected current position P via the communication control unit 310 (step S105). However, the acquisition processing unit 322 has already acquired the content information C stored in the ROM / RAM 390 from the database 100 and performs each process of deleting the unnecessary content information C.

  Next, the display control processing unit 323 determines whether an enlargement ratio for displaying the content information C in the image display area DA is instructed by the operation unit 370 (step S106).

  At this time, when the enlargement factor is instructed by the operation unit 370, the display control processing unit 323 detects the enlargement factor and the detected current position P of the portable communication terminal 300 and the detected direction AG. The title information and provision information of the content information C acquired in the three-dimensional virtual space displayed in the image display area DA based on the elevation angle EA are displayed (step S107).

  On the other hand, when the enlargement ratio is not instructed by the operation unit 370, the display control processing unit 323, the detected current position P of the portable communication terminal device 300, the detected direction AG and elevation angle EA, The title information and provision information of the acquired content information C are displayed in the three-dimensional virtual space displayed in the image display area DA based on (Step S108).

  Next, the weighting factor calculation processing unit 324 calculates the weighting factors WA, WB, and WC in each piece of information of the acquired content information C, specifically, each piece of content information C stored in the ROM / RAM 390 (Step S109). ).

  Next, the correction processing unit multiplies each content feature amount by the weighting factor calculated for the content feature amount in the acquired content information C to correct the content feature amount (step S110).

  Next, the similarity calculation processing unit 325 generates a single search expression (document vector) by adding the corrected content feature amounts for each keyword based on the corrected content feature amount of each content information C ( Step S111).

  Next, the similarity calculation processing unit 325 compares the related information feature quantity (document vector) stored in the processing of step S102 with the generated search formula, and sets the search formula, each content information C, and each related information R. Is calculated (step S112).

  Next, the provision processing unit 326 selects the related information R having the calculated maximum value of each similarity as recommendation information, causes the title information and provision information of the recommendation information to be displayed in the image display area DA, and allows the user to It is provided so that it can be browsed (step S111).

  Finally, the terminal management control unit 380 determines whether or not an end instruction input from the operation unit 370 is detected (step S112). If the end instruction is not detected, the terminal management control unit 380 proceeds to the process of step S103. Repeat this operation. On the other hand, when the terminal management control unit 380 detects an end instruction input from the operation unit 370, the terminal management control unit 380 ends the operation.

<Effect>
The portable communication terminal device 300 according to the present embodiment is a content that the user is paying attention to based on the terminal direction toward the portable communication terminal device 300 and the display position of the content information C displayed in the image display area DA. The content feature amount can be corrected so that the weighting of the content feature amount regarding the information C is increased. Therefore, since the portable communication terminal device 300 can take into account the degree of attention of the user when calculating the similarity between the content information and the related information, information that is of interest to the user, such as advertisements for products or services. Can be provided accurately, and the number of browsing of the information provided thereby can be improved to realize effective information provision.

  In addition, the portable communication terminal device 300 according to the present embodiment, for example, the weighting coefficient as the angle difference between the position of the acquired content information C in the real space and the current position P of the portable communication terminal device 300 is smaller. Therefore, the content information C displayed at the center of the image display area DA can be handled as the content information C that the user is paying more attention to. That is, since the content information C that the user is paying attention is often displayed at the center of the image display area DA, the portable communication terminal device 300 uses this characteristic to obtain the content information C that the user pays attention to. Can be accurately extracted.

  Further, the portable communication terminal device 300 of the present embodiment is associated with a position farther from the current position P in the real space of the portable communication terminal device 300 by operating the elevation angle EA of the portable communication terminal device 300. When the user pays attention to the given content information C, or when the user pays attention to the content information C associated with the position around the current position P, the weighting coefficient of the noticed content information C is adjusted. be able to. Therefore, the portable communication terminal device 300 can accurately extract the content information C noticed by the user regardless of the distance from the current position P of the portable communication terminal device 300.

  In addition, the portable communication terminal device 300 according to the present embodiment is used when the user pays attention to the content information C associated with a position far from the current position P in the real space of the portable communication terminal device 300, or When the user pays attention to the content information C associated with the position around the current position P, the weighting coefficient in the content information C noted can be adjusted.

  In addition, the portable communication terminal device 300 according to the present embodiment calculates the weight coefficient of each content information C assuming the content information C that the user is paying attention to from various elements, and calculates the calculated weight coefficients. Since the content feature amount can be corrected by adding the content information C, the content information C displayed at the center of the image display area DA can be extracted as the content information C that the user is paying more attention to.

  In addition, since the portable communication terminal device 300 according to the present embodiment can calculate each content feature quantity and related information feature quantity based on the appearance frequency of the keyword, the content feature quantity and the related information feature quantity are accurately defined. can do. Therefore, the portable communication terminal device 300 can accurately extract the related information R similar to the content information C.

<Modification>
The portable communication terminal device 300 of the present embodiment is configured to display content information C in a superimposed manner while displaying a map or other three-dimensional virtual space imitating a real space in the image display area DA. The content information C may be displayed in the real space imaged by the imaging camera unit. In this case, as described above, the current position, the direction AG, and the elevation angle EA may be calculated at each predetermined timing by counting with a timer provided in the detection control unit, or the captured reality The current position, the direction AG, and the elevation angle EA may be calculated for each frame in the space.

  In the present embodiment, the content information C and the related information R are acquired from the database 100 under the control of the server device 200. Alternatively, it may be acquired by reading from an external storage medium such as a hard disk, or a hard disk provided inside or an internal storage medium such as the ROM / RAM 390 described above. In these cases, the external storage medium or the internal storage medium constitutes the storage means of the present invention, for example.

  In the present embodiment, TF-IDF indicating the appearance frequency of each keyword is used as the feature amount of each keyword included in the related information R and the specific component. However, the number of appearance frequencies of the keyword is simply counted. However, it is only necessary to be able to calculate the feature amount of each keyword in the related information R and the specific component, such as using the count number as the feature amount.

  Further, in the present embodiment, the related information R is provided by displaying the relevant information R in the image display area DA. The related information R may be displayed in the image display area DA, or a list capable of selectively displaying the related information R having a high degree of similarity may be displayed. Further, instead of displaying the related information R in the image display area, the related information R is transmitted as data to a predetermined e-mail address, or the predetermined related information R is provided in the image display area DA. The related information R or the information related to the related information R may be indirectly provided by displaying the URL to be displayed.

  In the present embodiment, the detection control process, the display control process, the weighting factor calculation process, the correction process, the similarity calculation process, and the provision process are performed in the portable communication terminal apparatus 300. However, the portable communication terminal apparatus Various processes may be performed by either the server 300 or the server apparatus 200. In this case, necessary data can be exchanged by sequential communication between the server device 200 and the portable communication terminal device 300.

  That is, the portable communication terminal apparatus 300 detects only the current position P, the direction AG, and the elevation angle EA, executes various calculations and processes in the server apparatus 200, and displays the content information C on the received three-dimensional virtual space. However, only the specified recommendation information may be displayed, or in addition to these processes, necessary processes such as a process related to the display control process and a weight coefficient calculation process may be executed as appropriate.

  In addition, if various types of data processing can be performed by the server device 200 as described above, processing similar to that of the above-described embodiment can be performed, and the processing load on the portable communication terminal device 300 can be reduced.

  The network system 10 of the present invention can be applied to a system for browsing information such as newspapers, magazines, books or papers using a network N such as the Internet.

B ... Bus C ... Content information R ... Related information AG ... Direction EA ... Elevation angle DA ... Image display area WA, WB, WC ... Weighting factor 10 ... Network system 100 ... Database device 200 ... Server device 300 ... Portable communication terminal device 310 ... Communication control unit 320 ... Data processing unit 321 ... Detection control unit 322 ... Acquisition processing unit 323 ... Display control processing unit 324 ... Weight coefficient calculation processing unit 325 ... Similarity calculation processing unit 326 ... Provision processing unit 330 ... Current position detection unit 340 ... posture detection unit 350 ... drawing control unit 360 ... display unit 370 ... operation unit 380 ... terminal management control unit 390 ... ROM / RAM

Claims (11)

A portable terminal device that allows a user to browse content information provided in association with a position in a real space and related information related to the content information,
Current position detecting means for detecting a current position in the real space;
Display means having a predetermined image display area;
Direction detecting means for detecting the direction of the portable terminal device in the real space as the terminal direction;
An acquisition means for acquiring, from another communication device or recording means, a content feature amount obtained by vectorizing an appearance frequency of a predetermined keyword for the content information and text information included in the content information based on the detected current position;
Based on the detected terminal direction, the acquired content information existing in the terminal direction is correlated with the detected current position and the position in the real space of the acquired content information. Display control means for displaying in the display area;
Based on at least one of the detected terminal direction and the display position of the content information displayed in the image display area, a weight coefficient calculation that calculates at least a weight coefficient related to the content information displayed in the image display area Means,
Correction means for correcting the content feature amount acquired together with the content information using the calculated weighting factor;
A vector search formula is generated based on the corrected content feature amount , the generated vector search formula and the related information are stored in the storage unit together with the related information, and the appearance of the predetermined keyword for the text information included in the related information A similarity calculation means for calculating a similarity with each related information feature quantity obtained by vectorizing the frequency ;
Selection means for selecting relevant information based on the calculated similarity;
With
The portable terminal device, wherein the display control means causes the display means to display the selected related information or specific information for specifying the related information. The portable terminal device according to claim 1,
The direction detection means detects the direction of the portable terminal device as the terminal direction,
The weighting coefficient calculation means calculates an angle difference between the position of the acquired content information in the real space and the current position of the portable terminal device based on the detected direction of the terminal direction and the current position. A portable terminal device that calculates a weighting factor in the content information based on the calculated angle difference. The portable terminal device according to claim 2,
The portable terminal device, wherein the weighting coefficient calculation means calculates the weighting coefficient in the content information so that the weighting coefficient becomes larger as the calculated angle difference is smaller. The portable terminal device according to any one of claims 1 to 3,
The direction detection means detects an elevation angle with respect to the direction of the portable terminal device as the terminal direction,
The portable terminal device, wherein the weighting coefficient calculating means calculates a weighting coefficient in the content information based on the detected elevation angle. The portable terminal device according to claim 4, wherein
The weighting coefficient calculating means is
When the portable terminal device is tilted upward from the horizontal plane based on the detected elevation angle, the weighting coefficient of content information associated with a position far from the portable terminal device in the real space is set. , Larger than the weighting factor of the content information associated with a nearby position in the real space,
When the portable terminal device is tilted downward from the horizontal plane based on the detected elevation angle, the weighting factor of the content information associated with a nearby position in the real space from the portable terminal device Is larger than the weighting coefficient of the content information associated with a distant position in the real space. The portable terminal device according to any one of claims 1 to 5,
Coordinate detecting means for detecting coordinates of a display position in the image display area of the content information displayed in the image display area;
The portable terminal device, wherein the weighting coefficient calculating means calculates the weighting coefficient based on the center of the image display area and the coordinate position of the displayed content information. The portable terminal device according to claim 6,
A portable terminal device that increases the weighting coefficient of content information as the weighting coefficient calculating means is displayed at a position closer to the center of the image display area. The portable terminal device according to any one of claims 1 to 7,
The weighting factor calculating means calculates a plurality of weighting factors for each piece of content information and adds the weighting factors in the calculated same content information,
The portable terminal device, wherein the correction unit corrects the content feature amount in the corresponding content information based on the combined weighting factor. An information browsing program applied by a portable terminal device that allows a user to browse content information provided in association with a position in a real space and related information related to the content information by a computer,
Current position detection means for detecting a current position in the real space; display means having a predetermined image display area; and direction detection means for detecting a direction in which the portable terminal device is directed in the real space as a terminal direction; A computer mounted on a portable terminal device having
An acquisition unit that acquires, based on the detected current position, a content feature amount obtained by vectorizing an appearance frequency of a predetermined keyword for the content information and text information included in the content information from another communication device or a recording unit;
Based on the detected terminal direction, the acquired content information existing in the terminal direction is correlated with the detected current position and the position in the real space of the acquired content information. Display control means for displaying in the display area;
Based on at least one of the detected terminal direction and the display position of the content information displayed in the image display area, a weight coefficient calculation that calculates at least a weight coefficient related to the content information displayed in the image display area means,
Correction means for correcting the content feature amount acquired together with the content information using the calculated weighting factor;
A vector search formula is generated based on the corrected content feature amount , the generated vector search formula and the related information are stored in the storage unit together with the related information, and the appearance of the predetermined keyword for the text information included in the related information A similarity calculation means for calculating the similarity with each related information feature quantity obtained by vectorizing the frequency ; and
Selection means for selecting relevant information based on the calculated similarity,
Function as
An information browsing program comprising a function for causing the display means to display the selected related information or specific information for specifying the related information as the display control means. A server device that allows a portable terminal device having a function of imaging a real space to acquire content information and related information related to the content information so as to be viewable.
The content information, the position information indicating the position in the real space for each content information, and the content feature amount obtained by vectorizing the appearance frequency of a predetermined keyword for the text information included in the content information are stored. A second database in which the related information and the related information feature amount obtained by vectorizing the appearance frequency of the predetermined keyword for the text information included in the related information for each related information are stored; Control means for controlling;
Acquisition of acquiring the current position of the portable terminal device in the real space and the terminal direction of the portable terminal device in the real space by executing data communication with the corresponding portable terminal device Means,
An acquisition unit configured to acquire the content information and the content information from another communication device or a recording unit based on the detected current position;
In order to display the detected current position on the image display area of the portable terminal device while associating the detected current position with the position in the real space of the acquired content information based on the detected terminal direction. Providing means for providing content information existing in the terminal direction;
Based on at least one of the detected terminal direction and the display position of the content information displayed in the image display area, a weight coefficient calculation that calculates at least a weight coefficient related to the content information displayed in the image display area Means,
Correction means for correcting a content feature amount of the content information using the calculated weighting factor;
A similarity calculation that generates a vector search expression based on the corrected content feature quantity and calculates a similarity between the generated vector search expression and each related information feature quantity stored together with the related information in the storage unit Means,
Selection means for selecting relevant information based on the calculated similarity;
With
The server device, wherein the providing means provides the selected related information or specific information for specifying the related information to the portable terminal device. A browsing information providing program for causing a portable terminal device having a function of imaging a real space by a computer to acquire content information and related information related to the content information so as to be browseable,
The computer,
The content information, the position information indicating the position in the real space for each content information, and the content feature amount obtained by vectorizing the appearance frequency of a predetermined keyword for the text information included in the content information are stored. A second database in which the related information and the related information feature amount obtained by vectorizing the appearance frequency of the predetermined keyword for the text information included in the related information for each related information are stored; Control means for controlling,
Acquisition of acquiring the current position of the portable terminal device in the real space and the terminal direction of the portable terminal device in the real space by executing data communication with the corresponding portable terminal device means,
In order to display the detected current position on the image display area of the portable terminal device while associating the detected current position with the position in the real space of the acquired content information based on the detected terminal direction. Providing means for providing the acquired content information existing in the terminal direction;
Based on at least one of the detected terminal direction and the display position of the content information displayed in the image display area, a weight coefficient calculation that calculates at least a weight coefficient related to the content information displayed in the image display area means,
Correction means for correcting a content feature amount of the content information using the calculated weighting factor;
A similarity calculation that generates a vector search expression based on the corrected content feature quantity and calculates a similarity between the generated vector search expression and each related information feature quantity stored together with the related information in the storage unit Means and
Selection means for selecting relevant information based on the calculated similarity,
Function as
A browsing information providing program comprising a function of providing the portable terminal device with the selected related information or specific information for specifying the related information as the providing means.

Images