JP5644379B2 - Electronic bulletin board system, server device, and portable terminal - Google Patents

Description

  The present invention relates to augmented reality technology that superimposes in real time computer graphics that are artificially created using computer technology, and more specifically, the contents of electronic bulletins where reviews are posted. The present invention relates to a technique for superimposing real-time video obtained from real space in real time.

  A service using Augmented Reality, which superimposes computer graphics created artificially using computer technology in real time on live-action video obtained from real space, is attracting attention.

  As a service using augmented reality, as shown in Non-Patent Document 1, three-dimensional computer graphics corresponding to a marker included in an image photographed by a digital camera can be displayed on the image according to the direction of the marker. Although it is considered, it is also considered to present the information registered in the computer to the user in accordance with the live-action video obtained from the real space.

  For example, in Patent Document 1, a user uses specific information (for example, an object ID or a position in the real world) that identifies a real-world situation photographed by a camera using a wearable computer worn by the user. The assigned data (image data, text data, audio data, etc.) is transmitted to the server, and the server stores the data to which the specific information is added in the database, and transmits from the data stored in the database from the wearable computer. An invention is disclosed in which data related to the situation in the real world is transmitted to the wearable computer that has transmitted the specific information by returning data transmitted from another wearable computer in response to the specified information.

  In addition, although it may not be directly related to augmented reality, in Patent Document 2, it is treated like a pointing device on a mobile terminal, and information related to an object (for example, a building) pointed to by the mobile terminal is stored in the user. A system that can be provided is disclosed.

  Furthermore, an augmented reality service for displaying information related to an object (for example, a building) included in a live-action image on a real-image image taken by a digital camera built in the mobile terminal is already available in the mobile terminal. It has been developed for some models.

  For example, NearestWiki, which is one of the applications for iPhone (registered trademark) provided by acrossair, uses Wikipedia, an encyclopedia on the Internet as a data resource, and can be obtained by using location information obtained by GPS or an electronic compass. Orientation information is used, and data related to the vicinity of the point where the user is located is displayed on the display.

  In addition, Sekai Camera, one of the applications for the iPhone (registered trademark) provided by Tonchi Dot, is called “air tag” and has additional information (characters and characters) with location data obtained by GPS etc. (Image / sound) can be stored in the server, and additional information (characters / images / sound) related to this point is displayed superimposed on the real image taken by the digital camera.

JP 2000-194726 A JP-T-2004-531791

Kato, H., Billinghurst, M. (1999) Marker Tracking and HMD Calibration for a video-based Augmented Reality Conferencing System. In Proceedings of the 2nd International Workshop on Augmented Reality (IWAR 99). October, San Francisco, USA.

  As described above, there are various methods for presenting information registered in a computer to a user in accordance with live-action video obtained from real space, but the user possesses using augmented reality technology. The contents of the electronic bulletin board established on the Internet could not be displayed on the mobile terminal according to the video shot on the mobile terminal.

  In addition, when presenting information registered in a computer to a user in accordance with a live-action video obtained from a real space, the position information of a point that is the target of information registered in the computer (for example, a store) is shifted. In some cases, the information (for example, the air tag of the Sekai camera) displayed on the video captured by the camera is displayed with a deviation from the target video corresponding to the information.

  Accordingly, the present invention provides an electronic bulletin board system that uses augmented reality technology and can display the contents of an electronic bulletin board established on the Internet on a portable terminal in accordance with video captured by a portable terminal possessed by a user. An object of the present invention is to provide a server device and a portable terminal that constitute the electronic bulletin board system, and further, it is possible to correct position information of a point that is a target of information registered in a computer (for example, a store).

A first invention for solving the above-described problem is an electronic bulletin board system that can display the contents of an electronic bulletin board established on the Internet on a portable terminal, a server device in which the electronic bulletin board is operated, and an electronic payment function. wherein the user of the electronic bulletin board is at least composed of a mobile terminal possessed, the server device, the each erected threads on the electronic bulletin board, in association with the identifier of the thread, the position of the thread Information and at least word-of-mouth information posted to the thread, and when a thread transmission request including the position information of the mobile terminal is received from the mobile terminal, within an extraction range uniquely determined by the position information included in the thread transmission request The thread including the position information is extracted, and the word-of-mouth information of the extracted thread is After the absence red information to display generated for each said thread comprises a thread transmission means for transmitting said thread information added to the position information and the thread identifier was based of the thread information to the mobile terminal, The portable terminal is configured to send a position measurement unit that measures position information of a location where the portable terminal is located, a photographing unit that captures an image of a real space, and the thread transmission request including the position information acquired from the position measurement unit. When the thread information is received from the server device and the thread information is received from the server device, the position information added to the thread information to the coordinates of the field of view coordinate system of the photographing unit with the position information of the point where the portable terminal is present as the origin Is converted to the thread information in which the coordinates of the visual field coordinate system are included in the visual field range of the photographing means, and the identified thread information Wherein a thread display means for displaying the thread information on the image so as to correspond to the visual field coordinate system of coordinates, the execution of the electronic payment process using the portable terminal, upon detecting as an event to post the reviews, the The position information at the time of posting is acquired from the position measuring means, and the thread information including the position information acquired from the position measuring means within the postable range uniquely determined by the position information added to the thread information, After identifying the thread information displayed on the mobile terminal, the word-of-mouth information is acquired from the user, the thread identifier added to the identified thread information, and the position information acquired from the position measuring means A posting means for transmitting a word-of-mouth registration request including the word-of-mouth information added with the server information to the server device, When the word-of-mouth registration request is transmitted from a mobile terminal, word-of-mouth registration means for storing the word-of-mouth information included in the word-of-mouth registration request as the word-of-mouth information of the thread specified by the identifier included in the word-of-mouth registration request equipped and wherein the Rukoto.

Further, a second invention, in the electronic bulletin board system of the first invention, so that it can correct the position information of the threads, the reviews registering unit of the server apparatus was added location information of the specified the thread information After storing the word-of-mouth information in a state, the center position of the position information added to the word-of-mouth information of the thread corresponding to the word-of-mouth registration request is calculated, and the position information of the thread is corrected to the position of the center of gravity. It is characterized by that.

Furthermore, the third invention, in the first invention or the electronic bulletin board system according to the second inventions, as can be reserved posts of the reviews, the post means of said portable terminal, the review from a user If an operation for reserving the posting of the word of mouth information is detected before acquiring the information, the posting reservation information including the identifier added to the identified thread information and the position information acquired from the position measuring means is stored, Upon detecting an operation that uses posting reservation information, the server device is notified of a word-of-mouth registration request including the word-of-mouth information acquired by acquiring the word-of-mouth information from a user and adding the identifier and location information of the thread included in the posting reservation information. It is characterized by transmitting.

Further, a fourth invention is the electronic bulletin board system according to any one of the first to third inventions, wherein the portable terminal is configured so that a user can newly set the thread on the electronic bulletin board. , Upon detecting an operation to newly launch the thread on the electronic bulletin board, after acquiring the position information at this time from the position measurement means, a thread generation request for transmitting a thread generation request including the position information to the server device When the thread generation request is received from the mobile terminal, the server device generates an identifier of the thread corresponding to the thread generation request, and then associates the thread with the generated identifier of the thread. Thread generation means for storing position information included in the generation request is provided.

Further, the fifth invention, a server apparatus constituting the electronic bulletin board system according to any one of the first to fourth inventions of the present invention, also, a sixth aspect of the present invention, first the first aspect of the present invention 4 It is a portable terminal which comprises the electronic bulletin board system as described in any one of this invention.

  As described above, according to the present invention, the contents of the electronic bulletin board established on the Internet can be displayed on the mobile terminal according to the video captured by the mobile terminal possessed by the user by using the augmented reality technology. It is possible to provide an electronic bulletin board system, a server device and a portable terminal that constitute the electronic bulletin board system, and further, it is possible to correct position information of a point that is a target of information registered in the computer (for example, a store).

The figure explaining the electronic bulletin board system in this embodiment. The figure explaining the hardware with which the portable terminal was equipped. The figure explaining the function with which the portable terminal was equipped. The flowchart explaining the process which the thread | sled display means of a portable terminal performs. The figure explaining the information displayed on a portable terminal. The flowchart explaining the process which the posting means of a portable terminal performs. The flow figure which showed the procedure when it contributes to the thread which reserved posting. The flowchart which showed the procedure which sets a thread | sled on an electronic bulletin board newly. The figure explaining the hardware with which the server apparatus was equipped. The figure explaining the function with which the server apparatus was equipped. The figure explaining a thread table. The figure explaining a word-of-mouth table. The flowchart which showed the procedure which the thread | sled transmission means of a server apparatus performs. The flowchart which showed the procedure which the thread production | generation means of a server apparatus performs. The flowchart which showed the procedure which the word-of-mouth information registration means of a server apparatus performs. The figure explaining the correction effect of position information on a thread.

  From this point, an embodiment of the present invention will be described to the extent that a person skilled in the art of the present invention can understand the contents of the present invention and implement the present invention. The embodiment described below is only an example, and various modifications and changes are possible without being limited to the embodiment described below.

  FIG. 1 is a diagram for explaining an electronic bulletin board system 1 according to the present embodiment. The electronic bulletin board system 1 illustrated in FIG. 1 is a system using augmented reality. The electronic bulletin board system 1 illustrated in FIG. 1 includes a server apparatus 3 in which an electronic bulletin board 300 using augmented reality is operated, and an electronic bulletin board. A mobile terminal 2 (for example, a smartphone) possessed by the user of the system 1 is included as a device, and a public wireless network 4b and the Internet 4a for the mobile terminal 2 are included as a network. In FIG. 1, the mobile terminal 2 is described as one unit, but actually, the mobile device 2 is configured to be accessible from many mobile terminals 2.

  The electronic bulletin board 300 operated by the server device 3 is a thread float type bulletin board. The user can set a thread on an arbitrary target (for example, a store or a place), and a new thread is set on the electronic bulletin board 300. Then, a data table for storing the attribute information of the newly established thread and the word-of-mouth information posted to the thread is generated in the server device 3.

  The thread attribute information includes the thread identifier, name and position information (latitude / longitude), that is, the name of the target of the thread and the position information of the point where the target actually exists. With this position information, the thread is associated with a point in the real space corresponding to the position information.

  The mobile terminal 2 possessed by the user includes a device that measures the position of a certain point of the mobile terminal 2, a device that measures the azimuth angle of the reference line of the mobile terminal 2, and the three-axis acceleration of the mobile terminal 2. An electronic bulletin board application 200 that includes a device for detecting, and further includes a function for displaying word-of-mouth information posted on the electronic bulletin board 300 operated by the server device 3 and a function for posting word-of-mouth information on the electronic bulletin board 300. Has been implemented.

  When the server apparatus 3 receives a thread transmission request including the position information of the portable terminal 2 from the portable terminal 2 on which the electronic bulletin board application 200 is operating, the server apparatus 3 is within an extraction range uniquely determined by the position information included in the thread transmission request ( For example, a thread whose position information is set within a predetermined radius centered on the position information is extracted, and the content of the thread (for example, part or all of the word-of-mouth information posted to the thread is extracted for each extracted thread. ) Is generated, and the thread information is transmitted to the mobile terminal 2 that has transmitted the thread transmission request.

  The thread information transmitted from the server device 3 to the mobile terminal 2 is added with a thread ID, which is a thread identifier corresponding to the thread information, the thread name, the thread position information, and the like, and operates on the mobile terminal 2. When the electronic bulletin board application 200 receives the thread information from the server device 3, the electronic bulletin board application 200 refers to the shooting azimuth angle which is the azimuth angle shot by the camera, and includes thread information including position information in the video shot by the camera. The position on the video corresponding to the position information of the thread information is specified, and the thread information is displayed on the video in correspondence with the specified position on the video.

  In this way, by adding position information to the thread set up on the electronic bulletin board 300, the user who uses the electronic bulletin board 300 is related to the object in the vicinity of the point where the user carrying the mobile terminal 2 is located. Since word-of-mouth information can be provided to the user, even if the user visits a place with no knowledge, the target object and the topic content in the vicinity of the place can be understood.

  If the user can set a thread on an arbitrary target, the position information of the thread becomes the position information measured by the mobile terminal 2 possessed by the user when the thread is set up. Since the position information may have an error of about 10 to several hundreds of meters compared to the actual value, if the thread position information has an error, the display position of the thread information on the mobile terminal 2 may be different from the actual position. In a place where buildings are densely populated, thread information related to one building may be displayed on the video of another building, so the server device 3 includes the thread attribute information. A function for correcting the position information is provided.

  Specifically, in the electronic bulletin board system 1 illustrated in FIG. 1, the location information is added to the word-of-mouth information posted by the user on the mobile terminal 2 side, and the word-of-mouth information is posted on the server device 3 side. Each time it is posted to the thread, the position information included in the thread attribute information is corrected by obtaining the barycentric position of the position information added to the word-of-mouth information posted to the thread.

  Since the review information related to the object corresponding to the thread is gathered in the thread, the barycentric position of the position information added to the review information is included in the attribute information of the thread because the object corresponding to the thread is closer to the actual position. The error of position information can be reduced.

  From here, the portable terminal 2 which comprises the electronic bulletin board system 1 which illustrated FIG. 1 is demonstrated in detail. FIG. 2 is a diagram illustrating hardware provided in the mobile terminal 2, and FIG. 3 is a diagram illustrating functions provided in the mobile terminal 2.

  As shown in FIG. 2, the portable terminal 2 is responsible for a wireless communication antenna 2 j used for wireless communication, a wireless communication circuit 2 a that performs high-frequency processing related to wireless communication, and various processes related to the portable terminal 2. The baseband circuit 2b, the position measurement circuit 2c for measuring the position information (latitude / longitude) of the portable terminal 2 using the intensity of the radio wave received from the relay point of the public wireless network 4b, and the reference position of the portable terminal 2 are suitable. Functions of an electronic compass circuit 2d for measuring the azimuth angle, a triaxial acceleration measurement circuit 2e for measuring the acceleration of the portable terminal 2, a camera circuit 2f having an image element in addition to an optical system such as a lens, a display device and an operation panel. The touch panel 2g also has a touch panel control circuit 2h that controls the touch panel 2g, a clock circuit 2i that measures time, and the like.

  The baseband circuit 2b mounted on the portable terminal 2 is a circuit on which an arithmetic processor, a ROM, a RAM, and the like are mounted. The electronic bulletin board application 200 described above is mounted as one of applications that operate on the baseband circuit 2b. Has been.

  The means shown in FIG. 3 indicate functions provided in the mobile terminal 2 by the electronic bulletin board application 200 installed in the mobile terminal 2. When the electronic bulletin board application 200 is activated on the mobile terminal 2, the mobile terminal 2 Includes a position measuring unit 20 that measures position information of a point where the mobile terminal 2 exists, a photographing unit 21 that captures an image of real space, and an azimuth for measuring the azimuth angle at which the reference position of the mobile terminal 2 is directed. From the measurement means 22, the motion detection means 23 for detecting the motion of the mobile terminal 2, and a thread transmission request to the server device 3, the shooting azimuth that is taken by the camera and the position information of the thread information, The thread display means 24 for obtaining the thread information to be displayed on the portable terminal 2 and the position on the screen and displaying the thread information on the portable terminal 2; A post means 25 for actuating the distribution bother to post the electronic bulletin board 300, a thread generation request section 26 that operates when the user launches the thread on the electronic bulletin board 300 is provided.

  The position measuring means 20 provided in the portable terminal 2 is means for measuring position information (latitude / longitude) of this point using the position measuring circuit 2c of the portable terminal 2. The position information of the mobile terminal 2 can be measured by using a GPS (Global Positioning System) artificial satellite or the position information in the mobile terminal 2 according to the communication time with a relay point where the mobile terminal 2 can perform wireless communication. There is a method for measuring the value, and any method may be used.

  The photographing means 21 provided in the portable terminal 2 is a means for operating the camera circuit 2f of the portable terminal 2 and acquiring an image photographed by the camera circuit 2f, and for measuring the azimuth angle of the portable terminal 2. Is means for obtaining the azimuth angle at which the reference position of the portable terminal 2 is directed from the electronic compass circuit 2d of the portable terminal 2.

  The motion detection unit 23 detects the displacement amount and the rotation of the mobile terminal 2 as the motion of the mobile terminal 2 based on the acceleration obtained from the triaxial acceleration measurement circuit 2e of the mobile terminal 2 as the motion of the mobile terminal 2. Means. The amount of displacement related to the position of the mobile terminal 2 is obtained by temporally double integrating the biaxial acceleration related to the position of the mobile terminal 2, and the rotation of the mobile terminal 2 is determined by the position direction of the mobile terminal 2. From the two-axis acceleration related to the above, it is obtained depending on whether the axis related to the rotation of the mobile terminal 2 is rotating.

  The thread display means 24 provided in the portable terminal 2 activates the photographing means 21 and executes a process for displaying the video photographed by the camera circuit 2f on the touch panel 2g in real time, and then sends a thread transmission request to the server device 3. When the thread information is received from the server device 3, the shooting azimuth, which is the azimuth angle captured by the camera, is referred to, and the thread information including the position information in the video captured by the camera and the thread information This is a means for specifying a position on the video corresponding to the position information and displaying thread information on the video in correspondence with the specified position on the video.

  FIG. 4 is a flowchart for explaining processing executed by the thread display unit 24 of the mobile terminal 2. When the electronic bulletin board application 200 is activated on the portable terminal 2, the thread display means 24 of the portable terminal 2 is automatically activated (S1), and displays a login screen on the electronic bulletin board 300 operated by the server device 3. A login request, which is a message including the user name of the user who logs in and an authentication code (for example, a passphrase), is transmitted to the URL of the server device 3 for logging in to the electronic bulletin board 300 (S2).

  When the message indicating that the login is successful is received from the server device 3, the thread display means 24 of the mobile terminal 2 activates the image capturing means 21 of the mobile terminal 2 to start image capturing, and the camera circuit 2f The process of displaying the video being shot on the touch panel 2g of the mobile terminal 2 in real time is started (S3).

  When the process of displaying the video imaged by the camera circuit 2f on the touch panel 2g of the mobile terminal 2 is executed, the thread display means 24 of the mobile terminal 2 uses the position measuring means 20 to detect the mobile terminal 2 at this time. A thread transmission request that is a message including the position information of the portable terminal 2 is transmitted to the URL of the server device 3 for acquiring and holding the position information and requesting transmission of thread information (S4).

  When the thread display means 24 of the portable terminal 2 receives the thread information from the server device 3 after making a thread transmission request (S5), the thread display means 24 acquires the azimuth angle from the azimuth measuring means 22 to display the thread information. A photographing azimuth angle is obtained using an angle difference between the reference line of the terminal 2 and the reference line of the optical system of the camera circuit 2f (S6), and the field of view of the photographing means with the position information of the point where the portable terminal 2 exists as the origin. After converting the position information added to the thread information to the coordinates of the coordinate system, the thread information including the coordinates of the visual field coordinate system within the visual field range of the camera circuit 2f is extracted (S7).

  Then, the thread display unit 24 of the portable terminal 2 makes the thread information correspond to the coordinates of the identified thread information in the visual field coordinate system and displays the thread information on the video acquired from the camera circuit 2f by the photographing unit 21 (S8). When a plurality of pieces of thread information are overlapped, the thread information that is close to the mobile terminal 2 is displayed in the foreground, and the thread information is displayed so that a part of the thread information on the rear side can be seen.

  When the thread display unit 24 of the portable terminal 2 displays the thread information transmitted from the server device 3, the thread detection unit 23 monitors the displacement amount for each of the three axes measured by the motion detection unit 23 (S9). The processing is branched according to the detected motion of the mobile terminal 2 (S10).

  If the amount of displacement related to the position of the mobile terminal 2 is greater than or equal to the upper limit value, it is determined that the user has moved to a point away from the point where the thread transmission request is made, and the process returns to S3 to send the thread transmission request to the server device 3 And display the thread information. Further, when the amount of displacement related to the position of the mobile terminal 2 is greater than or equal to the lower limit value / lower limit value, or when the mobile terminal 2 is rotated, the thread display means 24 of the mobile terminal 2 executes the process of S7. The thread information is displayed.

  When the electronic bulletin board application 200 ends on the portable terminal 2 (S11), the procedure illustrated in FIG. 4 ends.

  FIG. 5 is a diagram for explaining information displayed on the portable terminal 2. FIG. 5 (a) is an image taken by the camera circuit 2f, and FIG. 5 (b) is an image on which thread information is displayed. is there. When the procedure described with reference to FIG. 4 is executed, as illustrated in FIG. 5B, the image of FIG. 5A captured by the camera circuit 2 f is displayed on the touch panel 2 g of the mobile terminal 2. The three pieces of thread information 6a, b, c transmitted from the server device 3 are combined and displayed.

  In FIG. 5B, three pieces of thread information 6a, b, and c correspond to Shop_A to C shown in FIG. The thread information 6a, b, c is displayed in the form of a speech bubble, and the position on the video corresponding to the thread information 6a, b, c is linked by the vertex of the speech bubble.

  Further, as illustrated in FIG. 5A, Shop_A is in front of Shop_B, and therefore thread information 6a corresponding to Shop_A is displayed in front of thread information 6b corresponding to Shop_B.

  Next, the posting means 25 provided in the mobile terminal 2 will be described. The posting means 25 provided in the portable terminal 2 is means for posting user's word-of-mouth information to a thread corresponding to the location where the user is.

  As can be seen from the description so far, the content of the thread whose position information is set in the vicinity of the point where the user is present is displayed on the touch panel 2g of the portable terminal 2 possessed by the user. Threads that can be posted are limited to threads whose location information is set at the point where the user is.

  FIG. 6 is a flowchart for explaining processing executed by the posting unit 25 of the mobile terminal 2. When the electronic bulletin board application 200 detects the occurrence of an event for posting word-of-mouth information, such as when the user taps an icon (for example, the icon 6d in FIG. 5) displayed on the touch panel 2g (S20), The posting means 25 is activated, and the posting means 25 starts processing related to posting of word-of-mouth information.

  When the posting means 25 of the portable terminal 2 is activated, the posting means 25 of the portable terminal 2 acquires the position information of the portable terminal 2 at this time from the position measuring means 20 (S21), and the thread displayed on the portable terminal 2 Among the information, the thread information in which the location information of the mobile terminal 2 is included in the posting possible range uniquely determined by the location information of the thread information (for example, within a predetermined radius centered on the location information) It is specified as thread information that can be posted (S22).

  When the thread information that can be posted by the word-of-mouth information is specified, the posting means 25 of the portable terminal 2 displays a screen that allows the user to select execution of posting word-of-mouth information or posting reservation (S23), and depending on the content selected by the user The process is branched (S24).

  When the user selects execution of posting word-of-mouth information, the posting means 25 of the portable terminal 2 displays a software keyboard on the touch panel 2g, and acquires text input by the user using the software keyboard as word-of-mouth information (S25). ).

  When the posting means 25 of the portable terminal 2 acquires the word-of-mouth information, it sends a word-of-mouth posting request which is a message including the thread ID added to the thread information specified in S22 and the word-of-mouth information added with the position information acquired in S21. It transmits with respect to URL of the server apparatus 3 for submitting a review information (S26), and complete | finishes this procedure.

  In S24, when the user selects the wording information posting reservation, the posting unit 25 of the mobile terminal 2 displays the position information of the mobile terminal 2 acquired in S21 without displaying the software keyboard on the touch panel 2g. Posting reservation information including the thread ID of the thread information specified in S22 is stored in the memory of the portable terminal 2 (S27), and this procedure is terminated.

  FIG. 7 is a flowchart showing a procedure for posting to a thread reserved for posting. The electronic bulletin board application 200 running on the mobile terminal 2 detects the occurrence of an event using post reservation information, such as a user tapping an icon (for example, the icon 6b in FIG. 5) displayed on the touch panel 2g. Then, the posting means 25 of the portable terminal 2 displays a list of posting reservation information stored in the memory of the portable terminal 2 and allows the user to select posting reservation information (S31), and then on the touch panel 2g. The software keyboard is displayed, and the text input by the user using the software keyboard is acquired as word-of-mouth information (S32).

  When the word-of-mouth information is acquired, the posting means 25 of the mobile terminal 2 adds the thread ID included in the posting reservation information selected by the user in S31 and the location information included in the posting reservation information selected by the user. A word-of-mouth registration request including information is transmitted to the URL of the server device 3 for posting word-of-mouth information (S33), and this procedure is terminated. Since the posting reservation can be performed, the user can post the word-of-mouth information later without registering the word-of-mouth information in the vicinity of the position of the posting thread.

  FIG. 8 is a flowchart showing a procedure for newly setting a thread on the electronic bulletin board 300. An event in which the electronic bulletin board application 200 running on the portable terminal 2 newly sets a thread on the electronic bulletin board 300, such as when the user taps an icon (for example, the icon 6c in FIG. 5) displayed on the touch panel 2g. When the occurrence is detected (S40), the position information of the portable terminal 2 at this time is acquired from the position measuring means 20 as the position information of the thread newly set on the electronic bulletin board 300 (S41).

  When the position information of the newly set thread is acquired, the thread generation requesting means 26 of the portable terminal 2 displays a screen for inputting the name of the thread and the word of mouth information on the electronic bulletin board 300 on the touch panel 2g, and then the user uses the software keyboard. The text input to the screen as a thread name is acquired as the thread name (S42), and the first word-of-mouth information of the thread for newly setting the text input to the screen as the word-of-mouth information by the user using the software keyboard (S43), a thread generation request that is a message including at least the name of the thread acquired from the user in S42, the first word-of-mouth information acquired in S43 and the location information of the mobile terminal 2 acquired in S41, For the URL of the server device 3 to stand (S44), and this procedure is terminated.

  Next, the server device 3 constituting the electronic bulletin board system 1 shown in FIG. 1 will be described. FIG. 9 is a diagram for explaining hardware provided in the server device 3, and FIG. 10 is a diagram for explaining functions provided in the server device 3.

  The server apparatus 3 is realized by a general-purpose web server. As shown in FIG. 9, the server apparatus 3 includes a CPU 3a (CPU: Central Processing Unit) and a ROM 3b (ROM: Read) in which a BIOS is mounted as hardware. -Only Memory), RAM 3c (RAM: Random Access Memory) which is the main memory of the computer, a large-capacity data storage device 3d (for example, a hard disk) as an external storage device, and input / output for data communication with the external device An interface 3e, a network interface 3f for network communication, a display 3g, a character input device 3h, a pointing device 3i, a clock circuit 3j for measuring time, and the like are provided. The data storage device 3d includes an electronic bulletin board 300. A computer program for realizing the functions required for Is, further, a plurality of databases (DB: DataBase) is provided.

  Each means shown in FIG. 10 indicates a function provided in the server device 3 by a computer program for realizing a function necessary for the electronic bulletin board 300, and the server device 3 receives a thread transmission request from the mobile terminal 2. When the thread transmission means 30 for transmitting the thread information corresponding to the thread transmission request to the portable terminal 2 and the thread generation request for setting the thread from the portable terminal 2 are received, the thread that has received the thread generation request is set on the electronic bulletin board 300. Thread generation means 31, word-of-mouth information registration means 32 for registering word-of-mouth information received from portable terminal 2 in server device 3, user authentication means 33 for authenticating a user who logs in to electronic bulletin board 300, and server device 3 is a table for storing information related to the electronic bulletin board 300. As a thread table 34 for storing the thread attribute information, reviews the table 35 for storing review information that the user has posted is provided for each thread.

  First, each table provided in the server device 3 will be described. FIG. 11 is a diagram for explaining the thread table 34 provided in the server device 3.

  As shown in FIG. 11, the thread table 34 is provided with a record 34a for storing thread attribute information for each thread set up on the electronic bulletin board 300. The record 34a includes a thread that is a thread identifier. Stores ID, thread name, thread location information, number of reviews indicating the number of reviews posted to the thread, thread creation date and time when the thread was created, and update date and time when attribute information was updated A column is provided.

  When a thread generation request is received from the mobile terminal 2, a record 34a corresponding to the thread generation request is newly added to the thread table 34. The thread ID of the newly added record 34a is the server device when the thread generation request is received. 3 is a character string generated, and the thread generation date and time of the newly added record 34a is the date and time when the thread generation request is received.

  Further, the name of the thread of the newly added record 34a is the name of the thread included in the thread generation request, and the position information of the newly added record 34a is the position information of the thread included in the thread generation request. The number of reviews of the record 34a added to “0” is “0”, and the initial value of the update date and time of the newly added record 34a is the date and time when the thread generation request is received.

  When the word-of-mouth information is posted to the thread, the position information of the thread table 34 of the thread to which the word-of-mouth information is posted is the position information added to the word-of-mouth information stored in the word-of-mouth table 35 corresponding to the thread. The centroid position is updated, the number of reviews in the thread table 34 is incremented by 1, and the update date and time of the thread table 34 is updated to the date and time when the review information is posted.

  FIG. 12 is a diagram illustrating the word-of-mouth table 35 provided in the server device 3. As illustrated in FIG. 12, the word-of-mouth table 35 is provided in the server device 3 for each thread set up on the electronic bulletin board 300. The review table 35 is provided with a record 35a for storing the review information for each review information posted to the thread corresponding to the review table 35. The record 35a includes a review ID that is an identifier of the review information, and a review table. Review information posted to the thread corresponding to 35, location information added to the review information, date and time when the review information was posted, user name of the user who posted the review information (login to the electronic bulletin board 300) Column for storing the user name of the selected user.

  When the word-of-mouth information is posted from the mobile terminal 2, a record 35a is newly added to the word-of-mouth table 35 corresponding to the thread to which the word-of-mouth information is posted. The word-of-mouth ID of the word-of-mouth table 35 is a character string generated by the server device 3 when a thread generation request is received, and the posting date and time of the word-of-mouth table 35 is the date and time when the word-of-mouth information is posted.

  Further, the word-of-mouth information of the newly added record 35a becomes the word-of-mouth information included in the word-of-mouth registration request received from the mobile terminal 2. Further, the position information of the newly added record 35 a is position information added to the word-of-mouth information included in the word-of-mouth registration request received from the mobile terminal 2. Furthermore, the user name of the newly added record 35 a is the user name when the user logs in to the electronic bulletin board 300.

  Next, the user authentication means 33 provided in the server device 3 will be described. When the user authentication means 33 provided in the server device 3 receives a login request from the mobile terminal 2, the user authentication means 33 authenticates the user who made the login request. When the authentication code included in the login request is successfully authenticated, the user authentication means 33 Other sessions between the server devices 3 are permitted. Although the detailed contents of the user authentication means 33 provided in the server device 3 are not described, in this embodiment, an authentication code included in the login request is referred to by referring to a database storing a reference code in association with the user name. As a means to authenticate.

  Next, the thread transmission means 30 provided in the server device 3 will be described. The thread transmission means 30 of the server device 3 is a means for executing a session for transmitting thread information to the mobile terminal 2. When a thread transmission request is received from the mobile terminal 2, thread information corresponding to the thread transmission request is sent to the mobile terminal 2. To send, perform the procedure described below.

  FIG. 13 is a flowchart showing a procedure executed by the thread transmission unit 30 of the server device 3. When the thread transmission means 30 provided in the server device 3 receives a thread transmission request from the mobile terminal 2, the thread transmission means 30 starts processing to transmit thread information to the mobile terminal 2 (S50).

  When the thread transmission means 30 of the server device 3 receives the thread transmission request from the portable terminal 2, the thread transmission means 30 extracts the extraction range uniquely determined by the position information of the thread transmission request received from the portable terminal 2 (for example, a predetermined radius centered on the position information). (S51), and as a thread whose position information is included in the calculated extraction range, each record 34a of the thread table 34 is referred to, and all the records 34a whose position information is included in the extraction range are extracted. (S52).

  When a thread whose position information is included in the extraction range is extracted, the thread transmission unit 30 of the server device 3 executes loop processing (L1) on the extracted thread, that is, the record 34a extracted from the thread table 34. Thus, for each extracted thread, thread information to be transmitted to the portable terminal 2 that has requested thread transmission is generated.

  In the loop process (L1), the thread transmission means 30 of the server device 3 stores the contents of the word-of-mouth information posted to the thread that is the target of the loop process (L1), that is, the record 34a that is the target of the loop process (L1). Thread information for displaying the content of the word-of-mouth information stored in the word-of-mouth table 35 corresponding to the stored thread ID on the portable terminal 2 is generated (S53).

  The thread information for displaying the contents of the thread may be arbitrary. However, as a measure for which the target object is a topic, the number of reviews in the word-of-mouth table 35 is included in the thread information, and is stored in the word-of-mouth table 35 as the topic content. It is preferable to include all or a part of the word-of-mouth information, and negative / positive determination result of the word-of-mouth information, in the thread information. The negative / positive determination can be made by preparing negative expressions, positive expressions, and respective dictionaries, and determining which expression is included in the word-of-mouth information.

  When the thread transmission means 30 of the server apparatus 3 generates thread information of a thread that is a target of loop processing (L1), position information of a thread that is a target of loop processing (L1), that is, a target of loop processing (L1) The position information stored in the record 34 is added to the thread information and stored (S54), and all the threads whose position information is included in the extraction range, that is, all the records 34a extracted from the thread table 34 are stored. When the loop process (L1) is executed, the loop process (L1) ends.

  When the thread transmission unit 30 of the server device 3 generates the thread information with the position information added to all the threads whose position information is included in the extraction range by executing the loop process (L1), the position information is added. All the thread information is transmitted to the portable terminal 2 (S55), and this procedure ends.

  Next, the thread generation means 31 provided in the server device 3 will be described. The thread generation unit 31 of the server device 3 is a unit that executes a session for creating a thread. In the present embodiment, the thread 34 that has received the thread generation request is set on the electronic bulletin board 300 by adding to the thread table 34 a record 34 a that stores the attribute information of the thread that has been requested to generate the thread from the mobile terminal 2. Therefore, the thread generation means 31 provided in the server device 3 executes the procedure described below in order to place the thread that has received the thread generation request on the electronic bulletin board 300.

  FIG. 14 is a flowchart showing a procedure executed by the thread generation unit 31 of the server device 3. When a thread generation request is transmitted to the URL of the server apparatus 3 for setting up a thread, the thread generation means 31 provided in the server apparatus 3 starts a process of setting up a thread on the electronic bulletin board 300 (S60).

  When the thread generation means 31 of the server device 3 receives the thread generation request from the portable terminal 2, the thread generation means 31 stores the attribute information of the thread corresponding to the thread generation request by storing the record 34a in which each column value is an initial value. A new value is added to the table 34 (S61), the thread ID value of the newly added record 34a is generated by a predetermined algorithm (for example, serial number), and the generated value is added to the corresponding column of the record 34a. (S62).

  Next, the thread generation means 31 of the server device 3 writes the thread name and position information included in the thread generation request received from the mobile terminal 2 in the corresponding column of the record newly added to the thread table 34. (S63), the date and time when the thread generation request is received from the mobile terminal 2 is written in the corresponding column of the record newly added to the thread table 34 as the generation date and time (S64).

  When the thread generation means 31 of the server apparatus 3 writes the record 34a storing the attribute information of the newly established thread in the thread table 34, a new word-of-mouth table 35 corresponding to the thread ID generated in S62 is generated (S65). The word-of-mouth ID value of the first record 35a of the word-of-mouth table 35 is generated by a predetermined algorithm (for example, serial number), and the generated value is written in the corresponding column of the first record 35a (S66).

  Next, the thread generation means 31 of the server device 3 writes the word-of-mouth information included in the thread generation request to the corresponding column of the first record 35a (S67), and the position information included in the thread generation request of the first record 35a. Write to the corresponding column (S68), write the date and time at the time when the thread generation request is sent as the posting date and time, write to the corresponding column of the first record 35a, and end this procedure (S69).

  Next, the word-of-mouth information registration means 32 provided in the server device 3 will be described. The word-of-mouth information registration means 32 of the server device 3 is a means for executing a session for registering word-of-mouth information. When a word-of-mouth registration request is received from the mobile terminal 2, the word-of-mouth information registration means 32 stores the word-of-mouth information included in the word-of-mouth registration request. Perform the steps described.

  FIG. 15 is a flowchart showing a procedure executed by the word-of-mouth information registration unit 32 of the server device 3. The word-of-mouth information registration means 32 provided in the server device 3 performs a process of registering the word-of-mouth information transmitted from the mobile terminal 2 when a word-of-mouth registration request is transmitted from the mobile terminal 2 to the URL for registering the word-of-mouth information. Start (S70).

  The word-of-mouth information registration means 32 of the server device 3 receives the word-of-mouth information transmitted from the portable terminal 2 based on the word-of-mouth table 35 corresponding to the thread ID included in the word-of-mouth registration request when the word-of-mouth registration request is transmitted from the portable terminal 2. It is specified as the word-of-mouth table 35 to be registered (S71).

  The word-of-mouth information registration means 32 of the server device 3 newly adds a record 35a whose column values are initial values to the specified word-of-mouth table 35 (S72), and sets the word-of-mouth ID value of the newly added record 35a as a predetermined value. Generated by an algorithm (for example, serial number), and writes the generated value to the corresponding column of the newly added record 35a (S73).

  Next, the word-of-mouth information registration means 32 of the server device 3 writes the word-of-mouth information included in the word-of-mouth registration request into the corresponding column of the newly added record 35a (S74), and the position information added to the word-of-mouth information is newly written. Is written in the corresponding column of the record 35a added to (S75), and the date and time when the word-of-mouth information is transmitted is written as the posting date and time in the corresponding column of the newly added record (S76).

  When the word-of-mouth information registration unit 32 of the server device 3 updates the word-of-mouth table 35, the record 34a specified by the thread ID included in the word-of-mouth registration request is selected from the records 34a provided in the thread table 34. It is specified as a record 34a for updating attribute information (S77).

  The word-of-mouth information registration means 32 of the server apparatus 3 increments the number of word-of-mouth information of the specified record 34a, thereby updating the number of word-of-mouth information of the attribute information of the thread to which the word-of-mouth information is posted (S78), and then specifying at S61 The centroid positions of all the position information stored in the word-of-mouth table 35 are calculated by a predetermined algorithm (S79).

  The word-of-mouth information registration means 32 of the server device 3 rewrites the position information of the record 34a specified in S66 to the calculated position of the center of gravity when calculating the position of the center of gravity of all the position information stored in the word-of-mouth table 35 specified in S61. Thus, after updating the position information of the attribute information of the thread to which the review information is posted (S80), the update date and time of the record is rewritten to the date and time at this time, so that the attribute information of the thread to which the review information is posted is updated. The update date is updated (S81), and this procedure is terminated.

  FIG. 16 is a diagram for explaining the effect of correcting the thread position information. A point P0 in FIG. 16 is a point where the thread is launched, and each of the point P1 and the point P2 is a point where the first and second word-of-mouth information is posted.

  In FIG. 16, SP0 is the position of the thread when the thread is launched, and SP0, which is the position of the thread when the thread is launched, is the same as the point PO. SP1 is the position of the thread after the first posting, and is the center of gravity of the point P0 and the point P1. Furthermore, SP2 is the position of the thread after the second posting, and becomes the center of gravity of the point P0, the point P1, and the point P2.

  In this way, even if the position of each point varies, the thread gathers the word-of-mouth information related to the object corresponding to the thread, so the center of gravity of the position information added to all the word-of-mouth information posted to the thread. By calculating the position, the error of the position information measured by the portable terminal 2 can be reduced, and the position information of the object corresponding to the thread can be accurately obtained.

(Modification)
From here, the modification of embodiment mentioned above is demonstrated. In the above-described embodiment, the event for posting the word-of-mouth information to the server device 3 is described as a tap of an icon (for example, the icon in FIG. 5) displayed on the touch panel 2g. However, the electronic payment function is provided. In the case of the portable terminal 2, the electronic bulletin board application 200 mounted on the portable terminal 2 is set to a specification linked with the electronic function of the portable terminal 2, and the execution of the electronic payment processing in the store is an event for posting the word-of-mouth information to the server device 3. If this is the case, the location where the terminal capable of electronic payment is installed is fixed, so that the position of the thread target (here, the store) can be set to a more accurate value.

  In the modified example, the hardware provided in the portable terminal 2 is almost the same as that in FIG. 2 and will not be described. However, in addition to FIG. 2, hardware necessary for electronic payment (for example, an FeliCa (registered trademark) IC chip) is omitted. ) Is provided in the portable terminal 2.

  In the modified example, when execution of electronic payment processing is an event for posting word-of-mouth information to the server device 3, if electronic payment processing occurs in the mobile terminal 5 when the electronic bulletin board application 200 is activated, the mobile terminal 2 The posting means 24 is automatically activated, and the posting means 24 starts processing related to posting word-of-mouth information, and executes the procedure shown in FIG. 4 from S21 in FIG.

DESCRIPTION OF SYMBOLS 1 Electronic bulletin board system 2 Portable terminal 20 Position measurement means 21 Image | photographing means 22 Direction measurement means 23 Motion detection means 24 Thread display means 25 Posting means 26 Thread generation request means 3 Server apparatus 30 Thread transmission means 31 Thread generation means 32 Word-of-mouth information registration means 33 User authentication means 34 Thread table 35 Word-of-mouth table 4a Public wireless network 4b Internet

Claims (6)

An electronic bulletin board system comprising at least a server device on which an electronic bulletin board is operated, and a portable terminal possessing an electronic payment function and possessed by a user who uses the electronic bulletin board,
The server device stores at least the thread position information and the word-of-mouth information posted to the thread in association with the thread identifier for each thread set on the electronic bulletin board, and the mobile terminal position information. Is received from the mobile terminal, the thread whose position information is included in the extraction range uniquely determined by the position information included in the thread transmission request is extracted, and the word-of-mouth information of the extracted thread is extracted. after the absence red information is displayed on the portable terminal to generate for each said thread, the thread sending means for sending the thread information added to the identifier and position information of the thread became group of the thread information to the mobile terminal With
The portable terminal is configured to send a position measurement unit that measures position information of a location where the portable terminal is located, a photographing unit that captures an image of a real space, and the thread transmission request including the position information acquired from the position measurement unit. When the thread information is received from the server device and the thread information is received from the server device, the position information added to the thread information to the coordinates of the field of view coordinate system of the photographing unit with the position information of the point where the portable terminal is present as the origin Is converted, the thread information whose coordinates of the visual field coordinate system are included in the visual field range of the photographing unit is identified, and the thread information is associated with the coordinates of the visual field coordinate system of the identified thread information. and thread display means for displaying on a video, the execution of electronic payment processing using the portable terminal, when it is detected as an event to post the reviews, before The position information at the time of posting is acquired from the position measuring means, and the thread information including the position information acquired from the position measuring means within the postable range uniquely determined by the position information added to the thread information, After identifying the thread information displayed on the mobile terminal, the word-of-mouth information is acquired from the user, the thread identifier added to the identified thread information, and the position information acquired from the position measuring means A posting means for transmitting a word-of-mouth registration request including the word-of-mouth information added to the server device;
When the word-of-mouth registration request is transmitted from the mobile terminal, the server device uses the word-of-mouth information included in the word-of-mouth registration request as the word-of-mouth information of the thread specified by the identifier included in the word-of-mouth registration request. With word-of-mouth registration means to remember,
An electronic bulletin board system characterized by that. The word-of-mouth registration means of the server device stores the word-of-mouth information with the location information of the identified thread information added, and then is added to the word-of-mouth information of the thread corresponding to the word-of-mouth registration request calculating a center of gravity position of the position information, and corrects the positional information of the thread centroid position, the electronic bulletin board system according to claim 1. When the posting means of the portable terminal detects an operation for reserving the posting of the word of mouth information before acquiring the word of mouth information from the user, the posting means acquires the identifier added to the identified thread information and the position measuring means. The posting reservation information including the position information is stored, and when the operation using the posting reservation information is detected, the word-of-mouth information is acquired from the user, and the thread identifier and the position information included in the posting reservation information are added. The electronic bulletin board system according to claim 1 or 2 , wherein a review registration request including the review information is transmitted to the server device. When the portable terminal detects an operation of newly starting the thread on the electronic bulletin board, the portable terminal acquires the position information at this time from the position measuring unit, and then transmits a thread generation request including the position information to the server apparatus. Thread generation request means to
When the server device receives the thread generation request from the mobile terminal, the server device generates an identifier of the thread corresponding to the thread generation request, and then associates the generated thread identifier with the generated thread identifier. The electronic bulletin board system according to any one of claims 1 to 3 , further comprising thread generation means for storing position information to be stored. The server apparatus contained in the electronic bulletin board system as described in any one of Claims 1-4 . The portable terminal contained in the electronic bulletin board system as described in any one of Claims 1-4 .

Images