JP2010263482A - Positioning system, mobile terminal, positioning server, and positioning method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To identify the position of a user of a mobile terminal. <P>SOLUTION: A mobile terminal 100 extracts a watermark ID from a captured image, and sends the extracted watermark ID and a user ID to a positioning server 200. The positioning server 200 collates watermark IDs with position specification information stored in advance, based on the received watermark ID and the user ID, to determine the location of the user of the mobile terminal 100. It is preferable to determine whether a user identified by the user ID exists at a specified place. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a position positioning system, a portable terminal, a position positioning server, and a position positioning method.

  Conventionally, positioning by GPS has been realized as a positioning method for mobile phones. However, indoor or underground communication with a satellite becomes difficult, so GPS positioning is not always successful. As a method for solving this problem, a method of positioning by means of communication means such as an RFID tag, infrared rays, and Bluetooth has been proposed. However, in these cases, there is a further problem that a special device is required. . In addition, it seems that indoor position positioning by video processing such as barcode and QR code is also possible, but in these cases, there is a limit on the distance between the subject where the code information is described and the camera, and the subject is the camera There is a problem that it cannot be used when it is installed at a location far from the user and cannot be reached by the user.

  Conventionally, as shown in Non-Patent Documents 1 and 2, for example, a mobile digital watermark technology that links an analog image and digital information using a camera-equipped mobile phone is known.

Nakamura Takao et al., Mobile Watermarking for Video Based on SFPSS Method, IPSJ Transactions, Vol.49, No.6, pp.1885-1895, June 2008 Nakamura Takao et al., Mobile Watermarking for Real-Time Detectable Video, 13th Multimedia Communication and Distributed Processing Workshop, November 2005

  In the prior arts such as Non-Patent Documents 1 and 2, it is not possible to specify an individual user of the mobile phone. For this reason, when the conventional mobile digital watermark technology is used, even if the digital information linked to the analog image is acquired, it is impossible to grasp the position of the individual user of the mobile phone.

  Therefore, the present invention has been made in view of the above, and an object thereof is to provide a position positioning system, a portable terminal, a position positioning server, and a position positioning method capable of grasping the position of a user of a portable terminal. .

  In order to solve the above problems, a position positioning system of the present invention is a position positioning system including a mobile terminal and a position positioning server for determining a position of a user of the mobile terminal, wherein the mobile terminal is An imaging unit that captures an image in which invisible watermark information is embedded in advance, an extraction unit that extracts the watermark information from the image captured by the imaging unit, the watermark information extracted by the extraction unit, and the Transmitting means for transmitting user specifying information for specifying the user of the portable terminal to the positioning server, wherein the positioning server includes the watermark information, location specifying information for specifying a predetermined location, Storing means associated with each other, receiving means for receiving the watermark information and the user specifying information from the transmitting means of the portable terminal, Based on the watermark information and the user specifying information received by the receiving means, the watermark information and the location specifying information stored in association with the storage means are collated to determine the location of the user. And a judging means.

  Further, the portable terminal of the present invention is the portable terminal in the position measurement system, and includes an imaging unit that captures an image in which invisible watermark information is embedded in advance, and the image captured by the imaging unit. Extraction means for extracting watermark information; and transmission means for transmitting the watermark information extracted by the extraction means and user specifying information for specifying the user of the mobile terminal to the position measurement server. Features.

  The position positioning server of the present invention is the position positioning server in the position positioning system, wherein the watermark information and the location specifying information for specifying a predetermined location are stored in association with each other. And receiving means for receiving the watermark information and the user specifying information from the transmitting means of the portable terminal, and the storing means based on the watermark information and the user specifying information received by the receiving means. And determining means for determining the location of the user by collating the watermark information and the location specifying information stored in this manner.

  Further, the position positioning method of the present invention is a position positioning method in the position positioning system, and the storage means of the position positioning server corresponds to invisible watermark information and place specifying information for specifying a predetermined place. The image capturing unit of the mobile terminal captures an image in which the watermark information is embedded in advance, and the extraction unit of the mobile terminal uses the image captured by the image capturing unit. An extraction step for extracting the watermark information; and transmission means of the portable terminal sends the watermark information extracted by the extraction means and user specifying information for specifying the user of the portable terminal to the positioning server. A transmission step of transmitting, and a receiving unit of the positioning server from the transmitting unit of the mobile terminal, the watermark information and the user specifying information. And receiving means for receiving the watermark information stored in association with the storage means based on the watermark information and the user specifying information received by the receiving means, A determination step of determining the location of the user by collating the location specifying information.

  According to such a position positioning system, a portable terminal, a position positioning server, and a position positioning method of the present invention, the portable terminal extracts watermark information from the captured image and transmits it to the position positioning server together with the user specifying information. Then, the position measurement server determines the location of the user of the mobile terminal by collating the watermark information and the location specifying information stored in advance based on the received watermark information and the user specifying information.

  In this case, the determination means searches the storage means for watermark information that matches the watermark information received from the reception means, and extracts location specifying information stored in association with the searched watermark information. It is preferable to determine that the user specified by the user specifying information received from the receiving unit exists at the predetermined location specified by the extracted location specifying information.

  As described above, even when the location of the user is indoors or underground, the location of the user can be appropriately determined after specifying the user. Further, without providing a special device in communication means such as an RFID tag, infrared rays, and Bluetooth, it is possible to appropriately determine the location of the user after specifying the user.

  In the present invention, the imaging means captures the image on the display installed at the location of the user by the user's operation, and the location specifying information is the location where the display is installed. Preferably, the determination means determines that the user exists at a place where the display is installed.

  According to this invention, an image picked up by a user's operation is displayed on a display installed at the user's location. In addition, since the invisible watermark information embedded in advance in the image is stored in association with the location specifying information for specifying the location where the display is installed, the determination unit is provided with the display installed. It can be determined that the user exists at the place.

  In the present invention, the display is installed in a predetermined transportation means, and the storage means stores transportation means specifying information for specifying the predetermined transportation means in association with the watermark information. The judging means collates the watermark information and the transportation means specifying information stored in association with the storage means based on the watermark information and the user specifying information received from the receiving means. Accordingly, it may be determined that the user exists in the predetermined transportation means.

  According to the present invention, the determination means can determine that the user exists in the predetermined transportation means.

  Further, in the present invention, the display is installed at a departure place in a predetermined transportation means, and the transmission means specifies the time when the image is captured together with the watermark information and the user specifying information. The time specifying information is transmitted to the positioning server, and the storage means is departed from the departure place, the transportation means specifying information for specifying the predetermined transportation means, the departure place specifying information for specifying the departure place, and the departure place. Departure time specifying information for specifying a departure time of the predetermined transportation means and destination specifying information for specifying a destination of the predetermined transportation means starting from the departure place are stored in association with the watermark information. The receiving means receives the imaging time specifying information together with the watermark information and the user specifying information from the transmitting means of the portable terminal. The determining means is based on the watermark information, the user specifying information, and the imaging time specifying information received from the receiving means, the watermark information stored in association with the storing means, and the transportation means specifying information. By comparing the departure place specifying information, the departure time specifying information, and the destination specifying information, the user can move from the departure place to the destination at the departure time. You may determine that you are going to board.

  According to the present invention, the determination means can determine that the user is scheduled to board a transportation means at a predetermined departure place, destination, and departure time.

  In the present invention, the image may be a moving image.

  The idea of the present invention can be applied when an image in which invisible watermark information is embedded in advance is a moving image.

  In the present invention, the image may be a still image.

  The idea of the present invention can be applied when an image in which invisible watermark information is embedded in advance is a still image.

  According to the present invention, even when the user's location is indoors or underground, and without providing a special device in communication means such as an RFID tag, infrared rays, and Bluetooth, the user is identified and specified. It is possible to provide a position positioning system, a portable terminal, a position positioning server, and a position positioning method capable of appropriately determining the presence position of the.

1 is a schematic configuration diagram of a position positioning system 1. FIG. 2 is a hardware configuration diagram of a mobile terminal 100 and a position positioning server 200. FIG. 1 is a schematic configuration diagram of a mobile terminal 100. FIG. It is a figure which shows a mode that watermark ID is embedded in the image currently flowing on the display 400 (FIG. 4 (A)), and a mode that watermark ID is extracted from the said image (FIG. 4 (B)). 2 is a schematic configuration diagram of a position positioning server 200. FIG. In the present embodiment, the state of information stored in the storage unit 210 of the position measurement server 200 is shown. In the present embodiment, the state of information stored in the storage unit 210 of the position measurement server 200 is shown. 4 is a flowchart showing an operation performed by the position positioning system 1. In the application example 1, the state of information stored in the storage unit 210 of the position measurement server 200 is shown. In application example 2, a state of information stored in the storage unit 210 of the position positioning server 200 is shown.

  Hereinafter, preferred embodiments of a position positioning system, a portable terminal, a position positioning server, and a position positioning method according to the present invention will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant description is omitted.

(Overall configuration of the positioning system 1)
First, an overall configuration of a position positioning system 1 according to an embodiment of the present invention will be described with reference to FIG. FIG. 1 is a schematic configuration diagram of a position positioning system 1. As shown in FIG. 1, the position positioning system 1 includes a mobile terminal 100 and a position positioning server 200. The mobile terminal 100 and the position positioning server 200 are communicably connected to each other via a communication network 300 such as the Internet. Has been. The mobile terminal 100 is, for example, a mobile phone, PDF, notebook computer, or the like operated by the user, and the position measurement server 200 is for determining the position of the user of the mobile terminal 100. In the positioning system 1, as will be described in detail below, when the user captures the screen of the display 400 using the mobile terminal 100, the positioning server 200 grasps the position of the user of the mobile terminal 100. Is possible. The display 400 is a generic term for a plurality of displays 400A, a display 400B, and the like. Hereinafter, each component of the positioning system 1 will be described in detail.

(Configuration of mobile terminal 100)
First, the mobile terminal 100 will be described in detail. FIG. 2 is a hardware configuration diagram of the mobile terminal 100. As shown in FIG. 2, the portable terminal 100 physically includes a CPU 11, a ROM 12 and a RAM 13 that are main storage devices, an input device 14 such as an operation button, an output device 15 such as an LCD or an organic EL display, and a positioning server. A communication module 16 that transmits and receives data to and from the memory 200 and an auxiliary storage device 17 such as a memory device are provided. Each function of the portable terminal 100 to be described later operates the input device 14, the output device 15, and the communication module 16 under the control of the CPU 11 by reading predetermined software on hardware such as the CPU 11, the ROM 12, and the RAM 13. At the same time, it is realized by reading and writing data in the main storage devices 12 and 13 and the auxiliary storage device 17.

  FIG. 3 is a schematic configuration diagram of the mobile terminal 100. As shown in FIG. 3, the mobile terminal 100 functionally includes a camera 110 (corresponding to “imaging means” in the claims) and a screen capture application 120 (corresponding to “extraction means” in the claims). And a transmission unit 130 (corresponding to “transmission means” in the claims).

  The camera 110 is an imaging device attached to the mobile terminal 100. The camera 110 captures an image on the display 400 shown in FIG. 1 by a user operation. As shown in FIG. 1, the display 400 is installed at a user's location. An invisible watermark ID (corresponding to “watermark information” in the claims) is embedded in the image displayed on the display 400 in advance. The image may be a moving image or a still image. The camera 110 outputs the captured image data to the screen capture application 120. Although not shown, the camera 110 may be an imaging device in the mobile terminal 100 or may be an imaging device installed outside the mobile terminal 100 and connected to the mobile terminal 100 so as to be communicable.

  When image data is input from the camera 110, the screen capture application 120 extracts a watermark ID from the image data. The screen capture application 120 outputs the extracted watermark ID to the transmission unit 130.

  FIG. 4 shows a state in which a watermark ID is embedded in an image (in this case, a moving image) flowing on the display 400 (FIG. 4A) and a state in which a watermark ID is extracted from the image (FIG. 4B). FIG. As shown in FIG. 4A, the watermark ID is subjected to error correction and detection coding, the codeword is subjected to spread spectrum modulation, and then converted to a two-dimensional pattern to generate watermark patterns S1, S2, S3, S4, and the like. Then, the watermark patterns S1, S2, S3, S4, etc. are amplified with the watermark strength that controls the degree of deterioration and the balance of tolerance, and are superimposed and embedded on each frame F1, F2, F3, F4, etc. of the moving image. Do. Each watermark pattern S1, S2, S3, S4, etc. has a value of “001”, for example. As shown in FIG. 4B, for example, a rectangular area extraction algorithm capable of high-speed processing is applied to capture frame images C1, C2, and the like continuously obtained by moving image capture by the camera 110, so that the display area of the display device Are extracted from the capture frame image as the detection target region K1 and the like. Then, for example, a watermark ID having a value of “001” is extracted from the detection target area K1 and the like.

  Returning to FIG. 3, the transmission unit 130 inputs the watermark ID from the screen capture application 120, and sends it to the positioning server 200 together with the user ID of the user of the mobile terminal 100 (corresponding to “user identification information” in the claims). To be sent. The user ID is information for identifying the user of the mobile terminal 100, and for example, for each user of the mobile terminal 100 by prior user registration with a mobile communication provider (not shown) or the position positioning server 200. It is provided in advance and stored in advance in storage means (not shown) in the mobile terminal 100. Note that the above-described screen capture application 120 is also provided in advance to the mobile terminal 100 by the above-described prior user registration.

(Configuration of the positioning server 200)
Next, the position positioning server 200 will be described in detail. FIG. 2 is a hardware configuration diagram of the positioning server 200. As shown in FIG. 2, the positioning server 200 is physically connected to a main storage device such as a CPU 21, a ROM 22 and a RAM 23, an input device 24 such as a keyboard and a mouse, an output device 25 such as a display, and a portable terminal 100. It is configured as a normal computer system including a communication module 26 that transmits and receives data between them, an auxiliary storage device 27 such as a hard disk, and the like. Each function of the positioning server 200 to be described later allows the input device 24, the output device 25, and the communication module 26 to be controlled under the control of the CPU 21 by reading predetermined computer software on the hardware such as the CPU 21, the ROM 22, and the RAM 23. This is realized by operating and reading and writing data in the main storage devices 22, 23 and the auxiliary storage device 27.

  FIG. 5 is a schematic configuration diagram of the positioning server 200. As shown in FIG. 5, the positioning server 200 is functionally equivalent to a storage unit 210 (corresponding to “storage means” in claims) and a reception unit 220 (corresponding to “reception means” in claims). ), And a determination unit 230 (corresponding to “determination means” in the claims).

  The storage unit 210 stores the watermark ID and the location specifying information in association with each other. The location specifying information is information for specifying a predetermined location. FIG. 6 shows the state of information stored in the storage unit 210. As shown in FIG. 6, for example, the watermark ID “001” is embedded in the video “golf” and is stored in association with the location specifying information specifying “Yokohama underground shopping street entrance”. Further, for example, the watermark ID “002” is embedded in the video “Sea” and is stored in association with the location specifying information for specifying “Yokohama underground shopping center”. The location specifying information indicating “Yokohama underground shopping center entrance” or “Yokohama underground shopping center” is the place where the display 400 is installed, that is, the image of “golf” or “sea” in which watermark IDs “001” and “002” are embedded. Identify where it is flowing.

  The storage unit 210 stores a user management database as shown in FIG. That is, as shown in FIG. 7, the user management database stores user IDs and related information in association with each other. For example, a user with a user ID “UID001” is a user with a name “Taro Yamada” who has a gender “male” and uses a mail address “aaa@docomo.ne.jp”. Further, for example, the user with the user ID “UID002” is the user with the name “Hanako Yamada” who has the gender “female” and uses the mail address “bbb@docomo.ne.jp”.

  Returning to FIG. 5, the reception unit 220 receives the watermark ID and the user ID from the transmission unit 130 of the mobile terminal 100. The receiving unit 220 outputs the received watermark ID and user ID to the determining unit 230.

  Based on the watermark ID and user ID input from the receiving unit 220, the determination unit 230 collates the watermark ID and location specifying information (FIG. 6) stored in association with the storage unit 210, thereby determining the presence of the user. The position is determined. Specifically, the determination unit 230 first searches the storage unit 210 for a watermark ID that matches the watermark ID input from the reception unit 220. Next, the determination unit 230 extracts location specifying information stored in association with the searched watermark ID. Next, the determination unit 230 determines that there is a user specified by the user ID input from the reception unit 220 at a predetermined location specified by the extracted location specifying information.

  For example, it is assumed that the determination unit 230 inputs a watermark ID “001” and a user ID “UID001” from the reception unit 220. In this case, the determination unit 230 searches the correspondence table between the watermark ID and the location as shown in FIG. 6. If the watermark ID is “001”, the determination unit 230 associates it with the location specifying information that specifies “Yokohama underground shopping street entrance”. Make sure that Further, the determination unit 230 searches the user management database as shown in FIG. 7, and if the user is “UID001”, the gender is “male” and the mail address “aaa@docomo.ne.jp” is used. Confirm that the name is “Taro Yamada” user. Then, the determination unit 230 determines that the user “Taro Yamada” exists at the “Yokohama underground shopping street entrance”. As described above, the location specifying information indicating “Yokohama underground shopping street entrance” specifies the location where the display 400 running the “golf” image in which the watermark ID “001” is embedded is installed. For this reason, since the determination unit 230 inputs the watermark ID “001” and the user ID “UID001” as a set, the user “Taro Yamada” displays the screen of the display 400 installed at the “Yokohama underground shopping area entrance”. It can be determined that the image has been taken, that is, the location of the user “Taro Yamada” is “Yokohama underground shopping street entrance”.

  In the above description, the process of embedding the watermark ID in the image as shown in FIG. 4A may be performed on the position positioning server 200 side. Although not shown, a separate server for the watermark ID embedding process is used. An apparatus may be further provided. Alternatively, the watermark ID embedding process may be performed by a server device in a trader (for example, a broadcaster or a cable broadcaster) that plays video at each point. When the watermark ID embedding process is not performed on the position positioning server 200 side, it is necessary to notify the position positioning server 200 of the correspondence between the watermark ID and the place.

(Operation of the positioning system 1)
Next, an operation performed by the positioning system 1 (corresponding to the “positioning method” in the claims) will be described with reference to FIG. FIG. 8 is a flowchart showing operations performed by the position positioning system 1. In the following description of the operation, the watermark ID embedding process as shown in FIG. 4A is performed in advance, and the positioning server 200 shows the correspondence between the watermark ID and the location as shown in FIG. In addition, it is assumed that the correspondence between the user ID and the attribute has been grasped as shown in FIG.

  First, the camera 110 of the mobile terminal 100 captures an image on the display 400 by a user operation. As described above, an invisible watermark ID is embedded in the image displayed on the display 400 in advance. The camera 110 outputs the captured image data to the screen capture application 120 (step S1, corresponding to “imaging step” in the claims).

  Next, when the screen capture application 120 of the mobile terminal 100 inputs image data from the camera 110, a watermark ID is extracted from the image data. The screen capture application 120 outputs the extracted watermark ID to the transmission unit 130 (step S2, corresponding to “extraction step” in the claims).

  Next, the transmission unit 130 of the mobile terminal 100 inputs the watermark ID from the screen capture application 120 and transmits it to the positioning server 200 together with the user ID of the user of the mobile terminal 100 (step S3, “ Equivalent to “sending step”).

  Next, the receiving unit 220 of the positioning server 200 receives the watermark ID and the user ID from the transmitting unit 130 of the mobile terminal 100. The reception unit 220 outputs the received watermark ID and user ID to the determination unit 230 (step S4, corresponding to “reception step” in the claims).

  Next, based on the watermark ID and user ID input from the receiving unit 220, the determination unit 230 of the positioning server 200 uses the watermark ID and the location specifying information (FIG. 6) stored in association with the storage unit 210. By checking, the user's location is determined. Specifically, the determination unit 230 first searches the storage unit 210 for a watermark ID that matches the watermark ID input from the reception unit 220. Next, the determination unit 230 extracts location specifying information stored in association with the searched watermark ID. Next, the determination unit 230 determines that there is a user specified by the user ID input from the reception unit 220 at a predetermined location specified by the extracted location specification information (step S5, claim). Equivalent to the “judgment step” of the range).

(Operation and effect of the positioning system 1)
Then, the effect | action and effect in the position positioning system 1 of this embodiment are demonstrated. According to the position positioning system 1 of the present embodiment, the mobile terminal 100 extracts a watermark ID from the captured image and transmits it to the position positioning server 200 together with the user ID. Then, the positioning server 200 determines the location of the user of the mobile terminal 100 by collating the watermark ID and the location specifying information stored in advance based on the received watermark ID and user ID.

  In this case, the determination unit 230 searches the storage unit 210 for a watermark ID that matches the watermark ID received from the reception unit 220, extracts the location specifying information stored in association with the searched watermark ID, It is preferable to determine that the user specified by the user ID received from the receiving unit 220 exists at the predetermined location specified by the extracted location specifying information.

  As described above, even when the location of the user is indoors or underground, the location of the user can be appropriately determined after specifying the user. Further, without providing a special device in communication means such as an RFID tag, infrared rays, and Bluetooth, it is possible to appropriately determine the location of the user after specifying the user.

  Further, according to the present embodiment, an image captured by a user operation is displayed on the display 400 installed at the user's location. Further, the invisible watermark ID embedded in the image in advance is stored in association with the location specifying information for specifying the location where the display 400 is installed. It can be determined that the user exists at the installed location.

  Further, the present embodiment can be applied regardless of whether the image in which the invisible watermark ID is embedded in advance is a moving image or a still image.

(Application 1)
Next, application examples of the present embodiment will be described. In this application example, the display 400 is installed in a predetermined transportation means. The “predetermined transportation means” is, for example, a train, a train, a bus or the like. That is, the display 400 in this application example is a display device that plays an image such as an advertisement in a transportation means such as a train.

  The storage unit 210 of the positioning server 200 stores the transportation means specifying information for specifying the predetermined transportation means in association with the watermark ID. FIG. 9 shows the state of information stored in the storage unit 210. As shown in FIG. 9, for example, the watermark ID “001” is embedded in the video “Golf” and is used as transportation means specifying information for specifying “Tokyo departure train with Tokyo departure time 10:10”. Stored in association. Also, for example, the watermark ID “002” is embedded in the video of “the sea” and is stored in association with the transportation means specifying information for specifying “Shinagawa departure train from Shinagawa whose departure time is 12:00”. Has been. Note that the transportation means specifying information also corresponds to the place specifying information in the description of the above embodiment.

  Based on the watermark ID and user ID input from the receiving unit 220, the determination unit 230 of the positioning server 200 collates the watermark ID stored in association with the storage unit 210 and the transportation means specifying information (FIG. 9). Thus, it is possible to determine the location of the user, the transportation means the user is on, and other matters related to the transportation means. Specifically, the determination unit 230 first searches the storage unit 210 for a watermark ID that matches the watermark ID input from the reception unit 220. Next, the determination unit 230 extracts the transportation means specifying information stored in association with the searched watermark ID. Next, the determination unit 230 determines that the user specified by the user ID input from the reception unit 220 is on the predetermined transportation means specified by the extracted transportation means specifying information.

  For example, it is assumed that the determination unit 230 inputs a watermark ID “001” and a user ID “UID001” from the reception unit 220. In this case, the determination unit 230 searches the correspondence table between the watermark ID and the transportation means as shown in FIG. 9, and if the watermark ID is “001”, “Fukuoka departure from Tokyo with a Tokyo departure time of 10:10”. It is confirmed that it is associated with the transportation means specifying information for specifying the “train”. Further, the determination unit 230 searches the user management database as shown in FIG. 7, and if the user is “UID001”, the gender is “male” and the mail address “aaa@docomo.ne.jp” is used. Confirm that the name is “Taro Yamada” user. Then, the determination unit 230 determines that the user “Taro Yamada” is on the “Fukuoka train departing from Tokyo whose departure time is 10:10”. As described above, the transportation means specifying information indicating “Fukuoka train departing from Tokyo with a departure time of 10:10” is displayed on the display 400 in which the image of “golf” embedded with the watermark ID “001” is streamed. Identify the means of transportation installed. For this reason, since the determination unit 230 inputs the watermark ID “001” and the user ID “UID001” as a set, the user “Taro Yamada” has “Tokyo departure time is 10:10 to Fukuoka It is possible to determine that the screen of the display 400 installed in the “train” has been imaged, that is, the location where the user “Taro Yamada” exists is “Fukuoka train from Tokyo with a departure time of 10:10” it can.

(Application example 2)
Next, another application example of the present embodiment will be described. In this application example, the display 400 is installed at a departure place in a predetermined means of transportation. The “departure point in a predetermined transportation means” is, for example, an airport boarding gate, a train or train station platform, a bus terminal platform, or the like. That is, the display 400 in this application example is a display device that plays an image such as boarding information at a boarding gate of an airport, for example.

  When the watermark ID is input from the screen capture application 120, the transmission unit 130 of the portable terminal 100 uses the input watermark ID to identify the user ID of the user of the portable terminal 100 and the time when the image is captured. At the same time, it is transmitted to the positioning server 200.

  The storage unit 210 of the positioning server 200 includes transportation means specifying information for specifying the predetermined transportation means, departure place specifying information for specifying the departure place, and departure of the predetermined transportation means starting from the departure place. Departure time specifying information for specifying the time and destination specifying information for specifying the destination of the predetermined transportation means starting from the departure place are stored in association with the watermark ID. FIG. 10 shows the state of information stored in the storage unit 210. As shown in FIG. 10, for example, the watermark ID “001” is embedded in the video “Golf”, and transportation means specifying information for specifying “Airplane of Airline A”, “Haneda Airport boarding gate 10”. The information is stored in association with the specified departure place specifying information, the departure time specifying information specifying “10:10”, and the destination specifying information specifying “Chitose Airport”. Further, for example, the watermark ID “002” is embedded in the video of “the sea”, the transportation means specifying information for specifying “B airline airplane”, and the departure place specifying for specifying “Haneda Airport boarding gate 20”. The information is stored in association with the departure time specifying information specifying “11:45” and the destination specifying information specifying “Naha Airport”. The departure place specifying information also corresponds to the place specifying information in the description of the above embodiment.

  The receiving unit 220 of the positioning server 200 receives the imaging time specifying information together with the watermark ID and the user ID from the transmitting unit 130 of the mobile terminal 100. The receiving unit 220 outputs the received watermark ID, user ID, and imaging time specifying information to the determining unit 230.

  Based on the watermark ID, user ID, and imaging time specifying information input from the receiving unit 220, the determination unit 230 of the positioning server 200 includes a watermark ID stored in association with the storage unit 210, transportation means specifying information, By collating the departure place specifying information, the departure time specifying information, and the destination specifying information (FIG. 10), the user plans to board the transportation that departs from the departure place toward the destination at the departure time. Can be determined. Specifically, the determination unit 230 first searches the storage unit 210 for a watermark ID that matches the watermark ID input from the reception unit 220. Next, the determination unit 230 extracts the transportation means specifying information, the departure place specifying information, the departure time specifying information, and the destination specifying information stored in association with the searched watermark ID. Here, the determination unit 230 compares the imaging time specifying information input from the receiving unit 220 with the departure time specifying information stored in the storage unit 210, and the time according to the imaging time specifying information is earlier than the time according to the departure time specifying information. Only in this case, the extracted transportation means specifying information, departure place specifying information, departure time specifying information, and destination specifying information are recognized as valid. Next, the determination unit 230 inputs, from the receiving unit 220, the relevant transportation specified by the transportation means identification information, the departure place identification information, the departure time identification information, and the destination identification information that are recognized as legitimate. It is determined that the user specified by the user ID is scheduled to board.

  For example, it is assumed that the determination unit 230 inputs a watermark ID “001”, a user ID “UID001”, and imaging time specifying information “10:00” from the reception unit 220. In this case, the determination unit 230 searches the correspondence table between the watermark ID and the transportation means as shown in FIG. 10, and if the watermark ID is “001”, “Chitose Airport” from “Haneda Airport boarding gate 10”. Confirmed that it is associated with transportation means specifying information, departure place specifying information, departure time specifying information, and destination specifying information for specifying “Airline A Airlines” departing at “10:10” toward To do. Further, the determination unit 230 searches the user management database as shown in FIG. 7, and if the user is “UID001”, the gender is “male” and the mail address “aaa@docomo.ne.jp” is used. Confirm that the name is “Taro Yamada” user. Further, since “10:00” that is the imaging time is before “10:10” that is the departure time, the determination unit 230 determines that the above-mentioned transportation means specifying information, departure place specifying information, departure time specifying information, and purpose Extract the land identification information as valid. Then, the determination unit 230 confirms that the user “Taro Yamada” is going to board “A Airline Airplane” departing from “Haneda Airport Boarding Gate 10” toward “Chitose Airport” at “10:10”. Judging. As described above, the departure place specifying information for specifying “Haneda Airport boarding gate 10” specifies the place where the display 400 running the “golf” image in which the watermark ID “001” is embedded is installed. . For this reason, the determination unit 230 inputs the watermark ID “001”, the user ID “UID001”, and the imaging time specifying information “10:00” as a set, so that the user “Taro Yamada” That the screen of the display 400 installed at the airport boarding gate 10 is imaged, that is, the location of the user “Taro Yamada” is “the Haneda airport boarding gate 10”, and the user “Taro Yamada” From the airport boarding gate 10 ”, it can be determined that it is scheduled to board the“ A Airline Airplane ”departing at“ 10:10 ”toward“ Chitose Airport ”.

  As mentioned above, although preferred embodiment of this invention was described, it cannot be overemphasized that this invention is not limited to the said embodiment.

  For example, in the above embodiment, as shown in FIG. 6, an example in which an image is made different for each watermark ID has been shown. However, the present invention is not limited thereto, and the same image can be obtained by embedding different watermark IDs in the same image. Even when is displayed, a different place may be displayed.

DESCRIPTION OF SYMBOLS 1 ... Positioning system, 100 ... Portable terminal, 110 ... Camera, 120 ... Screen capture application, 130 ... Transmission part, 200 ... Positioning server, 210 ... Storage part, 220 ... Receiving part, 230 ... Judgment part, 300 ... Communication Network, 400 ... display.

Claims (11)

A position positioning system including a mobile terminal and a position positioning server for determining the position of a user of the mobile terminal,
The portable terminal is
Imaging means for imaging an image in which invisible watermark information is embedded in advance;
Extraction means for extracting the watermark information from the image captured by the imaging means;
Transmitting means for transmitting the watermark information extracted by the extracting means and user specifying information for specifying the user of the portable terminal to the location server;
With
The positioning server is
Storage means in which the watermark information and location specifying information for specifying a predetermined location are stored in association with each other;
Receiving means for receiving the watermark information and the user specifying information from the transmitting means of the portable terminal;
Based on the watermark information and the user specifying information received by the receiving unit, the watermark information and the location specifying information stored in association with the storing unit are collated to determine the location of the user. A judgment means to
A positioning system characterized by comprising: The determination means includes
Search the storage means for watermark information that matches the watermark information received from the receiving means,
Extracting the location specifying information stored in association with the searched watermark information,
Determining that the user specified by the user specifying information received from the receiving means exists in the predetermined location specified by the extracted location specifying information;
The position positioning system according to claim 1. The imaging means captures the image on a display installed at the presence position of the user by the user's operation,
The location specifying information specifies a location where the display is installed,
The determination means determines that the user exists at a place where the display is installed.
The position positioning system according to claim 1 or 2. The display is installed in a predetermined means of transportation,
The storage means stores traffic means specifying information for specifying the predetermined means of transportation in association with the watermark information,
The judging means collates the watermark information stored in association with the storage means and the transportation means specifying information based on the watermark information and the user specifying information received from the receiving means, Determining that the user is present in a given means of transportation;
The position positioning system according to claim 3. The display is installed at a departure place in a predetermined means of transportation,
The transmission means transmits imaging time specifying information for specifying the time when the image was imaged together with the watermark information and the user specifying information to the positioning server,
The storage means includes transportation means specifying information for specifying the predetermined transportation means, departure place specifying information for specifying the departure place, and a departure time for specifying a departure time of the predetermined transportation means starting from the departure place. The time specifying information and the destination specifying information for specifying the destination of the predetermined means of transportation departing from the starting place are stored in association with the watermark information,
The receiving means receives the imaging time specifying information together with the watermark information and the user specifying information from the transmitting means of the portable terminal,
The determining means is based on the watermark information, the user specifying information, and the imaging time specifying information received from the receiving means, the watermark information stored in association with the storing means, and the transportation means specifying information. By comparing the departure place specifying information, the departure time specifying information, and the destination specifying information, the user can move from the departure place to the destination at the departure time. Determine that you are going to board,
The position positioning system according to claim 3.   The position positioning system according to claim 1, wherein the image is a moving image.   The position positioning system according to claim 1, wherein the image is a still image. The portable terminal in a position positioning system including a portable terminal and a position positioning server for determining a position of a user of the portable terminal,
Imaging means for imaging an image in which invisible watermark information is embedded in advance;
Extraction means for extracting the watermark information from the image captured by the imaging means;
Transmitting means for transmitting the watermark information extracted by the extracting means and user specifying information for specifying the user of the portable terminal to the location server;
A portable terminal comprising: The position positioning server in a position positioning system including a portable terminal and a position positioning server for determining the position of a user of the portable terminal,
Storage means in which the watermark information and location specifying information for specifying a predetermined location are stored in association with each other;
Receiving means for receiving the watermark information and the user specifying information from the transmitting means of the portable terminal;
Based on the watermark information and the user specifying information received by the receiving unit, the watermark information and the location specifying information stored in association with the storing unit are collated to determine the location of the user. A judgment means to
A position positioning server comprising: A position positioning method in a position positioning system including a mobile terminal and a position positioning server for determining the position of a user of the mobile terminal,
In the storage device of the position positioning server, invisible watermark information and location specifying information for specifying a predetermined location are stored in association with each other,
An imaging step in which the imaging means of the portable terminal images an image in which the watermark information is embedded in advance;
An extraction step in which the extraction means of the portable terminal extracts the watermark information from the image captured by the imaging means;
A transmitting step in which the transmitting means of the mobile terminal transmits the watermark information extracted by the extracting means and user specifying information for specifying the user of the mobile terminal to the location server;
A receiving step for receiving the watermark information and the user specifying information from the transmitting means of the portable terminal by the receiving means of the position measurement server;
The determination means of the positioning server collates the watermark information and the location specifying information stored in association with the storage means based on the watermark information and the user specifying information received by the receiving means. A determination step of determining the location of the user;
A positioning method characterized by comprising: In the determination step, the determination means includes
Search the storage means for watermark information that matches the watermark information received from the receiving means,
Extracting the location specifying information stored in association with the searched watermark information,
Determining that the user specified by the user specifying information received from the receiving means exists in the predetermined location specified by the extracted location specifying information;
The position positioning method according to claim 10.