JP2009124539A - Photographic image providing server, photographic image providing system and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a server capable of automatically photographing a visitor and providing a photographic image, from which the target visitor is extracted, to the visitor. <P>SOLUTION: A photographic image providing server 10 includes a position calculating means 100 for calculating the position of an IC tag, on an absolute coordinate (tag absolute position) from radio wave strength data contained in tag detection data, when the tag detection data are received from a plurality of tag receivers 20, using three-point positioning; a photographic camera control means 110 which selects a CCD camera 40, including within its photographing range the tag absolute position, calculated by the position calculating means 100, issues instructions for photographing and captures a camera image from the CCD camera 40; and a photograph processing means which specifies the position of the IC tag within the camera image, by transforming the tag absolute position calculated by the position calculating means 100 into a coordinate system of the CCD camera 40, and performs trimming processing upon a range which includes the shape of a human figure, in the vicinity of the specified position. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a technique for automatically photographing a visitor who has visited a sightseeing spot or a tourist facility and providing the photographed image of the visitor to the visitor.

  In tourist spots and tourist facilities, a commemorative photo service is provided for visitors to tourist spots and tourist facilities. Previously, a dedicated photographer took a commemorative photo of a visitor who visited a spot for taking a commemorative photo, but a digital photo print system with a function to automatically photograph the visitor has also been devised. .

  For example, in Patent Document 1, a user who is a subject possesses a device (for example, an IC tag) that transmits shooting information at the time of shooting, and the device reader is used at the same time as or after the shooting of the user by the shooting device. An image photographing system is disclosed in which photographing information is read from this device before and after, the photographic image photographed by the photographing device is associated with the photographing information and stored in the storage device, and the photographic image is provided to the user collectively. Yes.

Furthermore, in Patent Document 2, when a digital camera is placed at a place where a theme park photo is taken, the user holds an electronic tag, and the user comes to the shooting location of the digital camera, the electronic tag held by the user , The person is photographed with a digital camera, and the photograph video is filed in the storage device for each tag number, and when the user leaves this theme park, the tag number of this electronic tag is stored in the storage device. A service system for accessing and providing a photograph of a user is disclosed.
Japanese Patent No. 3919437 JP 2002-41703 A

  Certainly, if the inventions disclosed in Patent Document 1 and Patent Document 2 are applied to tourist facilities, etc., it is possible to automatically take a photograph of a visitor visiting the tourist facility, and the visitor leaves the tourist facility. Sometimes, it is possible to obtain a photographed photographic image. In the inventions disclosed in Patent Document 1 and Patent Document 2, an object is selected from among photographic images photographed by a photographing device (such as a digital camera). It was not possible to provide visitors with a photographic image that extracted the visitors.

  In view of this, the present invention automatically shoots a visitor who has visited a sightseeing spot or a tourist facility, and provides a photographic image obtained by extracting a target visitor from the photographed image. It is an object to provide a server, a system, and a method that can be used.

A first invention for solving the above-described problem is a photo image providing server for providing a user with a photo image of a user photographed in a management area, and the photo providing server includes:
Identification data (device identification data) of the radio identification device, radio wave intensity data indicating the radio wave of the received radio wave, and identification of the receiver from a receiver that receives radio waves transmitted by the radio identification device worn by the user When device detection data including at least data (receiver identification data) is received from a plurality of the receivers, the position of the receiver that transmitted the device detection data and the radio wave included in the received device detection data Position calculation means for calculating a position on the absolute coordinates (device absolute position) in the management area of the wireless identification device specified by the device identification data included in the received device detection data from intensity data;
From the plurality of shooting cameras provided in the management area, select the shooting camera that includes the device absolute position calculated by the position calculation means in the shooting range, and instruct the selected shooting camera to perform shooting Then, a photographing camera control means for obtaining a photographic image (camera image) photographed by the photographing camera instructed to photograph,
By converting each of the device absolute positions on the absolute coordinates calculated by the position calculating means into a coordinate system of the shooting camera including the device absolute position in a shooting range, the shooting camera is provided for each camera image. The position of the wireless identification device (device photo position) in the photographed photo image is specified, the human image is recognized by performing image processing on the peripheral image of the device photo position, and the range including the recognized human shape is trimmed By processing, a photograph image (user image) of the user possessing the wireless identification device corresponding to the device photograph position is generated, and the generated user image is stored in a storage device for each user. And photographic processing means.

  According to the first invention described above, by using the radio wave strength data included in the device detection data received from the receiver, the photo image providing server uses the position of the receiver as a reference for the wireless identification device. Can be calculated, and the absolute position of the device can be specified from this distance.

  If the photographic image providing server can identify the absolute position of the device, the photographic image providing server can identify the photographing camera that photographs the user wearing the wireless identification device. If the photographing range of the photographing camera is fixed, the photographic image providing server can calculate the device photograph position by using the device absolute position as the coordinate system of the photographing camera.

  Since the user wearing the wireless identification device exists near the device photo position in the camera photo, the photo image providing server recognizes a person shape near the device photo position. Then, the user image obtained by extracting the user from the camera photograph can be generated.

  In the present invention, the wireless identification device is a device having a function of independently transmitting radio waves, and an active IC tag, a mobile phone, or a PDA (Personal Digital Assistant) is preferable.

  Further, a second invention is the photographic image providing server according to the first invention, wherein the photographic image providing server is associated with the device identification data and specified by the device identification data. Trimming conditions set by a user who possesses the image, and the photographic image processing means retrieves the trimming conditions from the device identification data included in the device detection data received by the position calculation means The camera image captured by the camera is trimmed according to the trimming condition.

  Furthermore, a third invention is the photographic image providing server according to the second invention, wherein the trimming condition includes data indicating a range of a person shape to be included in the user image, and the photographic image The processing means trims the camera image based on a human shape range indicated by the trimming condition.

  Furthermore, a fourth invention is the photographic image providing server according to the third invention, wherein the trimming condition includes the device identification data of the wireless identification device possessed by the user's companion. When the device photo position of the device identification data of the accompanying person is in the vicinity of the device photo position to be trimmed, the photograph image processing means is arranged at the device photo position of the device identification data of the accompanying person. Trimming processing is performed so as to include a person shape recognized based on the image.

  According to the second aspect described above, the user sets the trimming condition, so that the photographic image providing server can generate the user image according to the user's request. For example, as in the third aspect of the invention, if the trimming condition includes data indicating a range of a person shape (for example, upper body, whole body, etc.) included in the user image, only the upper body of the user is captured. A user image can be generated. Further, as in the fourth invention, if the device identification data of the wireless identification device worn by the user's companion is included in the trimming condition, the photograph image providing server The user image including can be generated.

  Further, a fifth invention is the photographic image providing server according to any one of the first invention to the fourth invention, wherein the position calculation means includes the receiver that has transmitted the same device identification data. When there are three or more, the device absolute position is calculated using a three-point positioning method using the device detection data acquired from each of the receivers.

  According to the fifth invention described above, the photographic image providing server can calculate the device absolute position with high accuracy by calculating the device absolute position using a three-point positioning method.

  Furthermore, a sixth invention is the photographic image providing server according to any one of the first to fifth inventions, wherein the photographic image providing server is the user stored in the storage device. Photographic image providing means for providing an image via a network is provided.

  According to the sixth invention described above, the user can acquire the user image by accessing the photo image providing server using a personal computer installed at home or the like. Become.

Furthermore, a seventh invention is a photographic image providing method for providing a photographic image of a user photographed in a management area to the user, wherein the photographic providing method comprises:
A server that provides a photographic image (user image) of the user receives identification data (device identification data) of the wireless identification device from a receiver that receives radio waves transmitted by the wireless identification device worn by the user. Receiving device detection data including at least radio wave intensity data indicating received radio waves and identification data (receiver identification data) of the receiver from a plurality of the receivers, and transmitting the device detection data Absolute coordinates in the management area of the wireless identification device identified by the device identification data included in the received device detection data from the position of the receiver and the radio wave intensity data included in the received device detection data Position calculator that performs the step of calculating the upper position (device absolute position) And,
The server selects, from among a plurality of shooting cameras provided in the management area, the shooting camera that includes the device absolute position calculated by the position calculation means in a shooting range, for the selected shooting camera A shooting camera control step in which shooting is instructed, and a step of acquiring a photographic image (camera image) taken by the shooting camera that has instructed shooting is performed;
For each camera image, the server converts each of the device absolute positions on the absolute coordinates calculated by the position calculating unit into a coordinate system of the photographing camera including the device absolute position in a photographing range. Identifying the position of the wireless identification device (device photo position) in the photographic image taken by the photographic camera, recognizing the human shape by performing image processing on a peripheral image at the device photo position, and recognizing the recognized human shape A step of generating the user image possessing the wireless identification device corresponding to the device photo position by trimming a range including the step of storing the generated user image in a storage device for each user And a photographic image processing step in which is executed.

  Further, an eighth invention is the photographic image providing method according to the seventh invention, wherein the server possesses the wireless identification device specified by the device identification data in association with the device identification data. Trimming conditions set by a user are stored, and in the photographic image processing step, the server calculates the trimming conditions from the device identification data included in the device detection data received by the server in the position calculation step. Searching and trimming the camera image taken by the photographing camera according to the searched trimming condition.

  Further, a ninth invention is the photographic image providing method according to the eighth invention, wherein the trimming condition includes data indicating a range of a person shape to be included in the user image, and the photographic image is provided. In the processing step, the server trims the camera image based on a person shape range indicated by the trimming condition.

  Furthermore, the tenth invention is the photographic image providing server according to the eleventh invention, wherein the trimming condition includes the device identification data of the wireless identification device possessed by the user's companion. In the photographic image processing step, when the device photo position of the device identification data of the companion is in the vicinity of the device photo position to be trimmed, the server includes the device identification data of the companion. A trimming process is performed so as to include a person shape recognized based on a device photograph position.

  The eleventh invention is the photographic image providing method according to any one of the seventh to tenth inventions, wherein, in the position calculating step, the server transmits the same device identification data. When there are three or more receivers, the device absolute position is calculated using a three-point positioning method using the device detection data acquired from each of the receivers.

  Furthermore, a twelfth aspect of the present invention is the photographic image providing method according to any one of the seventh to eleventh aspects, wherein the server includes the server via a network. A photographic image providing step of providing the user image stored in a storage device is provided.

  According to the seventh to twelfth inventions, the same effects as those of the first to sixth inventions can be obtained.

Furthermore, a thirteenth invention is a photographic image providing system for providing a photographic image of a user taken in a management area to the user.
The photographic image providing system includes a wireless identification device worn by the user, a receiver that receives radio waves transmitted by the wireless identification device, and a photographic image (user image) obtained by photographing the user. And a photographic image providing server to provide
The wireless identification device stores device identification data unique to each wireless identification device, and includes means for periodically transmitting radio waves encoded with the device identification data,
The receiver, when receiving a radio wave transmitted by the wireless identification device, means for decoding the received radio wave to obtain device identification data; means for generating radio wave intensity data indicating the radio wave of the received radio wave; Means for transmitting device detection data including at least the device identification data, the radio wave intensity data, and the receiver identification data (receiver identification data) to the photographic image providing server;
The photographic image providing server, when receiving the device detection data from a plurality of the receivers, the position of the receiver that transmitted the device detection data, and the radio wave intensity data included in the received device detection data, From the position calculation means for calculating the position (device absolute position) on the absolute coordinate in the management area of the wireless identification device specified by the device identification data included in the received device detection data,
From the plurality of shooting cameras provided in the management area, select the shooting camera that includes the device absolute position calculated by the position calculation means in the shooting range, and instruct the selected shooting camera to perform shooting Then, a photographing camera control means for obtaining a photographic image (camera image) photographed by the photographing camera instructed to photograph,
By converting each of the device absolute positions on the absolute coordinates calculated by the position calculating means into a coordinate system of the shooting camera including the device absolute position in a shooting range, the shooting camera is provided for each camera image. The position of the wireless identification device (device photo position) in the photographed photo image is specified, the human image is recognized by performing image processing on the peripheral image of the device photo position, and the range including the recognized human shape is trimmed By processing, a photograph image (user image) of the user possessing the wireless identification device corresponding to the device photograph position is generated, and the generated user image is stored in a storage device for each user. And photographic processing means.

  Furthermore, the fourteenth invention is the photographic image providing system according to the thirteenth invention, wherein the photographic image providing server is associated with the device identification data and specified by the device identification data. Trimming conditions set by a user who possesses the image, and the photographic image processing means retrieves the trimming conditions from the device identification data included in the device detection data received by the position calculation means The camera image captured by the camera is trimmed according to the trimming condition.

  Furthermore, the fifteenth aspect of the present invention is the photographic image providing system according to the fourteenth aspect of the present invention, wherein the trimming condition stored in the photographic image providing server indicates a range of person shapes included in the user image. Data is included, and the photographic image processing means of the photographic image providing server trims the camera image based on a range of a person shape indicated by the trimming condition.

  Furthermore, the sixteenth invention is the photographic image providing system according to the fifteenth invention, wherein the trimming condition stored in the photographic image providing server includes the wireless identification device possessed by the accompanying user. The device identification data is included, and the photographic image processing means of the photographic image providing server, when the device photo position of the device identification data of the accompanying person is in the vicinity of the device photo position to be trimmed, Trimming processing is performed so as to include a person shape recognized based on the device photo position of the device identification data of the accompanying person.

  Furthermore, the seventeenth invention is the photographic image providing system according to any one of the thirteenth to sixteenth inventions, wherein the position calculating means of the photographic image providing server is the same device identification data. The device absolute position is calculated using a three-point positioning method using the device detection data acquired from each of the receivers when there are three or more receivers that have transmitted.

  The eighteenth invention is the photographic image providing system according to any one of the thirteenth to seventeenth inventions, wherein the photographic image providing server stores the photographic image providing server in the storage device via a network. And a photographic image providing means for providing the user image.

  According to the thirteenth to eighteenth inventions described above, the same effects as in the first to sixth inventions described above can be obtained.

  Therefore, according to the present invention described above, a visitor who has visited a sightseeing spot or a tourist facility is automatically photographed, and a photograph image obtained by extracting the target visitor from the photographed photograph image is presented to the visitor. It becomes possible to provide a server, a system, and a method that can be provided.

  From here, the photographic image providing server 10, the photographic image providing system 1 in which the photographic image providing server 10 is arranged, and the photographic image providing method will be described in detail with reference to the drawings.

  FIG. 1 is a diagram for explaining a configuration of a photographic image providing system 1 in which a photographic image providing server 10 according to the present invention is arranged. The photographic image providing system 1 is a system suitable for large-scale tourist facilities such as theme parks and amusement parks and tourist spots. The present embodiment is an embodiment in which the photographic image providing system 1 is applied to a tourist facility. The management area of the photographic image providing server 10 is within the premises of the tourist facility, and the user of the photographic image providing system 1 is a tourist facility. Become a visitor who came to.

  The photographic image providing system 1 includes an IC tag 20 that is a wireless identification device worn by visitors of a tourist facility, a tag receiver 30 that communicates with the IC tag 20, and a CCD camera 40 that is a photographing camera that photographs the visitors. The photographic image providing server 10 that processes and stores photographic images taken by the CCD camera 40 and a personal computer (hereinafter, referred to as “PC”) installed at a visitor's home or the like. Has been.

  The tag receiver 30 and the CCD camera 40 are connected to a photographic image providing server 10 via a LAN 60 (LAN: Local Area Network), and the photographic image providing server 10 used by a visitor is connected via the Internet 61. .

  The IC tag 20 worn by the visitor is an active tag with a built-in battery and capable of long-distance communication. Different tag identification data is stored for each IC tag 20.

  There are many tag receivers 30 that are devices that communicate with IC tags 20 worn by visitors in the area of the tourist facility, centering on the commemorative photo spot. Many CCD cameras 40 for photographing visitors are installed, and the photographing range of the CCD camera 40 is fixed.

  When the tag receiver 30 receives a radio wave transmitting tag identification data from the IC tag 20, the tag receiver 30 includes at least tag identification data transmitted from the IC tag 20 and radio wave intensity data indicating the strength of the radio wave transmitted from the IC tag 20. The tag detection data is transmitted to the photo image providing server 10 in real time.

  The photograph image providing server 10 stores map data indicating absolute coordinates in the tourist facility described in absolute coordinates, and the map data includes data indicating the position in the tourist facility where the tag receiver 30 is disposed ( Hereinafter, it is referred to as “reader position data”).

  When the photograph image providing server 10 receives the tag detection data from the plurality of tag receivers 30 at the same time, the position in the absolute coordinates of the IC tag 20 corresponding to the tag identification data received by the tag receiver 30 is determined using the three-side positioning method. By calculating the indicated data (hereinafter referred to as “tag absolute position data”), the inside of the tourist facility of the visitor wearing the IC tag 20 specified by the tag identification data received by the tag receiver 30 Identify the location.

  When the photographic image providing server 10 calculates the tag absolute position data, the photographic image providing server 10 selects the CCD camera 40 that includes the calculated tag absolute position data in the shooting range, and transmits a shooting instruction to the selected CCD camera 40.

  When the CCD camera 40 receives a shooting instruction from the photographic image providing server 10, the CCD camera 40 operates the shutter of the CCD camera 40 to shoot a shooting range, and the photographic image (camera image) obtained by shooting the shooting range is taken as the photographic image providing server 10. Send to.

  When the photographic image providing server 10 acquires the photographic image from the CCD camera 40, the absolute position data of the tag is obtained from the tag absolute position data of the IC tag 20 and the parameters of the CCD camera 40 that captured the camera image. A visitor image which is a photograph image obtained by specifying a position in a camera image of a visitor who has the IC tag 20 specified by the tag identification data by trimming a range where the visitor is photographed Is generated from the camera image, and the visitor image is stored for each visitor. At a later date, the visitor can access the photograph image providing server 10 using a PC installed at home or the like, and can acquire his / her visitor image from the photograph image providing server 10 after performing authentication.

  As described above, according to the photographic image providing system 1 according to the present embodiment, it is possible to automatically take a photograph of a visitor himself as a subject at a tourist facility without asking a stranger. Furthermore, by converting the tag absolute position data of the IC tag 20 into the coordinate system of the CCD camera 40, the position in the camera image of the visitor who has the IC tag 20 specified by the tag identification data can be specified. It is possible to extract only the places where visitors are shown. In addition, the visitor can obtain a visitor image, which is the subject himself / herself, from the photographic image providing server 10 via the Internet 61.

  From here, the apparatus which comprises the photographic image provision system 1 illustrated in FIG. 1 is demonstrated in detail. FIG. 2 is a block diagram of the photographic image providing system 1 shown in FIG.

  As described above, the IC tag 20 worn by the visitors is an active tag that can communicate over a long distance (for example, several tens of meters) by incorporating a battery. It is not a passive tag that has a built-in battery.

  Each IC tag 20 stores unique tag identification data for each IC tag 20. The IC tag 20 autonomously transmits a radio wave that encodes the tag identification data, and the IC tag 20 transmits the tag identification data. The transmission period is several seconds (for example, every 2 or 3 seconds).

  A tag receiver 30 installed in a tourist facility to receive radio waves transmitted from the IC tag 20 is a device that receives from the tag receiver 30 and has a communication function using a network. The tag receiver 30 is a tag receiver 30. Reader identification data (for example, a network address), which is unique data, is stored.

  When the tag receiver 30 receives a radio wave from the IC tag 20, the tag receiver 30 decodes the radio wave received from the IC tag 20 to acquire tag identification data transmitted from the IC tag 20, and the strength of the radio wave received from the IC tag 20. Radio wave intensity data which is data obtained by digitizing (electric field intensity) is generated, and tag detection data including tag identification data, radio wave intensity data, and reader identification data of the tag receiver 30 is transmitted to the photographic image providing server 10. .

  When a plurality of IC tags 20 are present in the detection range of the tag receiver 30, the tag receiver 30 receives tag identification data from the plurality of IC tags 20, and generates tag detection data for each IC tag 20. And transmitted to the photographic image providing server 10.

  The CCD camera 40 installed in the tourist facility has a communication function using a network, and stores camera identification data (for example, a network address) that is unique to each CCD camera 40. The CCD camera 40 is not provided with a movable mechanism, and the photographing range in the tourist facility where the CCD camera 40 photographs is fixed. When receiving a shooting instruction from the photographic image providing server 10, the CCD camera 40 shoots a predetermined shooting range and transmits the shot camera image to the photographic image providing server 10.

  The photograph image providing server 10 is realized by one or a plurality of servers on which a CPU is mounted. In order to realize the present invention, an IC tag possessed by a visitor using data received from the tag receiver 30 is used. 20 position calculating means 100 for calculating the tag absolute position data, camera control means 110 for operating the CCD camera 40 to photograph the vicinity of the tag absolute position data, and processing the camera image taken by the camera control means 110. A photographic image processing means 120 for generating a visitor image and a photographic image providing means 130 for providing the visitor image to the visitor, and a visitor for storing the visitor image generated by the photographic image processing means 130 Visitors such as image database 140 (DB: Data Base) and camera image processing conditions set by visitors who wish to use the photographic image providing system 1 A visitor DB 150 that stores data related to the above, a map DB 170 that stores map data in the tourist facility, and a CCD camera DB 160 that stores data related to the CCD camera 40 are provided.

  FIG. 3 is a diagram illustrating the structure of the map DB 170 provided in the photographic image providing server 10. The map DB 170 is provided with at least a tag receiver table 171 that stores reader position data in the tourist facility.

  In the tag receiver table 171, a reader indicating the position where the tag receiver 30 specified by the reader identification data is installed in the absolute coordinate system in the tourist facility in association with the reader identification data stored in the tag receiver 30. Position data is stored.

  FIG. 4 is a diagram for explaining the structure of the CCD camera DB 160 provided in the photographic image providing server 10. The CCD camera DB 160 is provided with at least a CCD camera table 161. The CCD camera table 161 is associated with the camera identification data stored in the CCD camera 40 and is captured by the CCD camera 40 specified by the camera identification data. Condition data is stored.

  The shooting condition data stored in the CCD camera table 161 includes shooting range data indicating the shooting range of the CCD camera 40 in the absolute coordinate system in the sightseeing area, the direction of the center line of the field of view of the CCD camera 40, the CCD camera 40 Camera parameters necessary for converting a position in the absolute coordinate system within the sightseeing area, such as a viewing angle, into the camera coordinate system of the CCD camera 40 are included.

  FIG. 5 is a diagram for explaining the structure of the visitor DB 150 provided in the photographic image providing server 10. In the visitor DB 150, a visitor table 151 is provided for each visitor to whom the IC tag 20 has been delivered. In this visitor table 151, the tag identification data of the IC tag 20 passed to the visitors and the visitors are associated with the visitor identification data that is allocated for each visitor and identifies each visitor. The camera image processing condition data set when the IC tag 20 is delivered, name data that is the name of the visitor, a password set by the visitor, and the like are stored.

  The processing condition data of the camera image stored in the visitor table 151 of the visitor DB 150 and set by the visitor includes data indicating trimming contents (for example, the upper body center or the whole body) according to the visitor's preference, When there is a companion, the tag identification data of the IC tag 20 possessed by the companion is included, and the photograph image providing server 10 processes the camera image according to the processing condition data set by the visitor. A person image is generated.

  FIG. 6 is a diagram for explaining the structure of the visitor image DB 140 provided in the photo image providing server 10. In the visitor image DB 140, a visitor image table 141 is provided for each visitor to whom the IC tag 20 has been delivered. In this visitor image table 141, a visitor image of the visitor identified by the visitor identification data is stored in association with the visitor identification data that is allocated for each visitor and identifies each visitor. The

  The position calculation means 100 of the photographic image providing server 10 illustrated in FIG. 2 uses the tag detection data received from the tag receiver 30 as the position data of the IC tag 20 worn by the visitor. It is means for calculating tag absolute position data.

  When the position calculation means 100 receives the tag detection data from the plurality of tag receivers 30 at the same time, the position calculation means 100 refers to the tag identification data included in the received plurality of tag detection data and checks whether there are three or more of the same tag identification data, For the IC tag 20 specified by three or more tag identification data, the tag absolute position data is calculated using the three-point positioning method.

  FIG. 7 is a flowchart showing a procedure for the position detection unit 100 to calculate the absolute tag position data. FIG. 8 is a diagram for explaining the principle of the position detection unit 100 calculating the tag absolute position data. Three tag receivers 30 </ b> _A to C are illustrated as a plurality of tag receivers 30 that have received radio waves transmitted from one IC tag 20.

  When the position calculating unit 100 detects the absolute tag position data, first, the position calculating unit 100 refers to the tag receiver table 171 of the map DB 170 and reads the reader identification data of the tag receiver 30 that has received the radio wave transmitted by the IC tag 20. The reader position data associated with is acquired (S20).

  In FIG. 8, since the plurality of tag receivers 30 that have received the radio waves transmitted by one IC tag 20 are the three tag receivers 30_A to C, the position calculating means is the reader position of each of the three tag receivers 30_A to C. Data is acquired from the tag receiver table 171 of the map DB 170.

  When the position calculation means 100 acquires the reader position data, it next calculates the distance between the tag receiver 30 and the IC tag 20 (S21). In calculating the distance between the tag receiver 30 and the IC tag 20, the radio wave intensity data received from the tag receiver 30 is used, and the IC tag 20 is present from the radio wave intensity data centering on the position where the tag receiver 30 is installed. The length of the radius to be calculated is calculated.

  In FIG. 8, since the plurality of tag receivers 30 that have received radio waves transmitted by one IC tag 20 are tag receivers 30_A to C, the position calculating unit 100 includes a distance Ra between the tag receiver 30_A and the IC tag 20, The distance Rb between the tag receiver 30_B and the IC tag 20 and the distance Rc between the tag receiver 30_C and the IC tag 20 are calculated.

  When calculating the distance between the tag receiver 30 and the IC tag 20, the position calculating means 100 calculates tag absolute position data using the three-side positioning method (S22). In FIG. 8, centered on the reader position data of the tag receiver 30_A, centered on the arc having the radius Ra and the reader position data of the tag receiver 30_B, centered on the arc having the radius Rb and the reader position data of the tag receiver 30_C. The position detecting means 100 calculates the point where the radius Rc intersects the circular arc as the tag absolute position data.

  When the position calculating means 100 detects the absolute tag position data, it passes the tag identification data of the IC tag 20 whose position has been detected and all of the absolute tag position data to the camera control means 110, and the camera control means 110 captures the image of the visitor. Ask.

  FIG. 9 is a flowchart showing a procedure in which the camera control unit 110 of the photograph image providing server 10 acquires a camera image. When the tag absolute position data is delivered from the position calculation means 100, the camera control means 110 of the photographic image providing server 10 refers to the CCD camera table 161 of the CCD camera DB 160, and for each tag absolute position data delivered, Search the camera identification data whose absolute position data is included in the shooting range data of the shooting condition data, and calculate the tag absolute position data and tag absolute position data used for searching the camera identification data in association with the searched camera identification data The photographing target data storing the tag identification data of the IC tag 20 is generated (S30).

  When the camera control unit of the photographic image providing server 10 generates the shooting target data, the camera identification data is used as a key to sort these shooting target data (S31), and for each camera identification data included in the shooting target data, The CCD camera 40 specified by the camera identification data is instructed to shoot a visitor, and a camera image is acquired from the CCD camera 40 (S32).

  FIG. 10 is a supplementary diagram for explaining a procedure by which the camera control unit 110 of the photographic image providing server 10 acquires a camera image. FIG. 10 illustrates photographing target data generated from search results of 10 tag absolute position data and sorted using camera identification data as a key.

  As can be seen from FIG. 10, since the same camera identification data is included in the shooting target data, the CCD camera 40 instructed to be shot by the camera control unit 110 of the photographic image providing server 10 has the camera identification data. There are six CCD cameras 40 from “C0001” to “C0006”, and the camera control means 110 acquires camera images from each of the six CCD cameras 40.

  When the camera control unit 110 of the photographic image providing server 10 acquires the camera image, the camera image is transferred to the photographic image processing unit in association with the shooting target data and the camera identification data of the CCD camera 40.

  The photographic image processing means 120 of the photographic image providing server 10 refers to the visitor DB 150 when the photographic target data and the camera image associated with the camera identification data of the CCD camera 40 are delivered, and are included in the photographic target data. Processing condition data is acquired from the visitor table 151 in which tag identification data is described.

  When the photographic image processing unit 120 of the photographic image providing server 10 obtains the processing condition data, each of the tag identification data included in the photographing target data delivered from the camera control unit 110 is specified by the camera identification data corresponding to the tag identification data. The camera image taken by the CCD camera 40 is processed based on the processing condition data corresponding to the tag identification data, so that the visitor image of the visitor wearing the IC tag 20 specified by the tag identification data is displayed. Is generated.

  FIG. 11 is a flowchart showing a procedure in which the photographic image processing unit 120 of the photographic image providing server 10 processes the camera image. FIG. 12 shows the photographic image processing unit 120 of the photographic image providing server 10 processes the camera image. It is a supplementary figure explaining a procedure.

  The photographic image processing unit 120 of the photographic image providing server 10 executes the procedure illustrated in FIG. 11 for each tag identification data included in the shooting target data delivered from the camera control unit 110.

  When the photographic image processing means 110 of the photographic image providing server 10 processes the camera image, the tag absolute position data associated with the tag identification information included in the shooting target data is converted into the coordinate system of the CCD camera 40, whereby the camera Data indicating the position of the IC tag 20 in the image (hereinafter referred to as “tag image position data”) is calculated (S40). By converting the tag absolute position data into the coordinate system of the CCD camera 40, the photographic image processing means 120 can specify the position on the photographic image of the visitor specified by the tag identification data.

  In order to convert the tag absolute position data into the coordinate system of the CCD camera 40, the photographic image processing means 120 refers to the CCD camera DB 160 and capture condition data associated with the camera identification data of the CCD camera 40 that captured the camera image. The tag absolute position data is converted into the coordinate system of the CCD camera 40 by projection conversion using the center line direction and the viewing angle included in the camera parameters of the acquired photographing condition data, and the tag image position data is calculated. .

  When the tag image position data is calculated, the photographic image processing means 120 refers to the visitor DB 150 and acquires the processing condition data from the visitor table 151 including the tag identification data for which the tag image position data has been calculated (S41).

  When the photographic image processing unit 120 acquires the processing condition data, the photographic image processing unit 120 refers to the shooting target data, specifies the camera identification data corresponding to the tag identification data for which the tag image position data is calculated, and the CCD camera specified by the camera identification data 40 selects a camera image taken, processes an image around the tag position image data in the selected camera image, and recognizes a person shape around the tag position image data.

  Then, it is judged whether processing (for example, the upper body or the whole body) based on the processing condition data set by the visitor can be applied, a region to be used as a visitor image is determined, and the determined region is trimmed. An image is generated (S42).

  If the tag identification data of the accompanying person is set in the processing condition data set by the visitor, the photograph image processing means 120 of the photograph image providing server 10 adds the accompanying person's tag to the shooting target data. Check whether there is identification data, and if there is tag identification data, obtain tag absolute position data corresponding to the tag identification data of the accompanying person from the photographing target data, and the tag image position data related to the accompanying person with the content described above. calculate. Then, if the tag image position data of the visitor and the tag image position data of the accompanying person are within the set distance, an area to be the visitor image is determined so as to include the accompanying person.

  The contents described above will be described with reference to FIG. 12A is a camera image. In FIG. 12A, X and Y indicate positions specified by the tag image position data, and X is a position specified by the tag image position data of the visitor. Y is a position specified by tag image position data of the accompanying person of the visitor.

  In FIG. 12B, if X and Y are within a predetermined distance, the photographic image processing means 120 of the photographic image processing server recognizes a person shape by processing an image in the vicinity of X and Y. As shown in FIG. 12B, the trimming range is determined so that the recognized human shapes can be accommodated. By trimming the determined range, the visitor image illustrated in FIG. 12C is generated.

  When the photographic image providing unit 130 of the photographic image providing server 10 receives a visitor image provision request from the PC 50, it prompts the operator of the PC 50 to enter visitor identification data and a password, and is stored in the visitor DB 150. The operator of the PC 50 is authenticated by comparing the visitor identification data with the password.

  When the operator of the PC 50 is successfully authenticated, the visitor image stored in the visitor image DB 140 in association with the visitor identification data is provided to the operator of the PC 50 via the Internet 61.

  From here, a series of operations of the photographic image providing system 1 shown in FIG. 1 will be described. FIG. 13 is a flowchart showing a series of operations of the photographic image providing system 1.

  Visitors wear IC tags 20 that transmit radio waves independently at regular time intervals, and tag receivers 30 installed at commemorative photo spots in tourist facilities constantly visit the visitors. In this state, the IC tag 20 worn by the person is waiting to receive radio waves. When a visitor visits the vicinity of the tag receiver 30, the tag receiver 30 receives a radio wave transmitted by the IC tag 20 worn by the visitor (S1).

  When the tag receiver 30 receives a radio wave from the IC tag 20 worn by the visitor, the tag receiver 30 obtains tag identification data by decoding the radio wave, and further generates radio wave intensity data from the strength of the received radio wave, Tag detection data including tag identification data, radio wave intensity data, and reader identification data of the own device is generated, and the tag detection data is transmitted to the photo image providing server 10 (S2).

  The above-described operations of S1 and S2 are performed by all the tag receivers 30 installed in the tourist facility, and the photographic image providing server 10 has been described above from all the tag receivers 30 that have received the radio waves transmitted by the IC tag 20. Receive data.

  The photographic image providing server 10 refers to tag identification data included in all tag detection data received simultaneously from the tag receiver 30 and receives tag detection data including the same tag identification data from three or more different tag receivers 30. If tag detection data including the same tag identification data is received from three or more different tag receivers 30 (S3), the absolute tag is detected for all IC tags 20 specified by the tag identification data. When the operation for calculating the position data is performed (S4) and the same tag identification data has not been received from three or more different tag receivers 30, this procedure ends.

  After calculating the tag absolute position data, the photographic image providing server 10 refers to the CCD camera DB 160 and selects the CCD camera 40 that can photograph the detected tag absolute position data as the CCD camera 40 that photographs the visitor. A photographing instruction is transmitted to the CCD camera 40 (S5).

  When the CCD camera 40 installed in the tourist facility receives a photographing instruction from the photographic image providing server 10, the shutter of the CCD camera 40 is operated to photograph a camera image, and the photographed camera image is photographed. (S6), and the photographic image providing server 10 acquires a camera image from the CCD camera 40 (S7).

  Then, when the photographic image providing server 10 acquires the camera image from the CCD camera 40, the photographic image providing server 10 acquires shooting condition data associated with the camera identification data of the CCD camera 40 that transmitted the camera image from the CCD camera DB 160, and acquires the acquired shooting condition. The tag absolute position data indicating the position of the absolute coordinate system in the tourist facility is converted into tag image position data indicating the position of the coordinate system of the CCD camera 40 by projection conversion using the camera parameters included in the data, and the visitor can A visitor image is generated by processing the camera image according to the set processing conditions (S8).

The figure for demonstrating the structure of a photograph image provision system. 1 is a block diagram of a photographic image providing system. The figure explaining the structure of map DB. The figure explaining the structure of CCD camera DB. The figure explaining the structure of visitor DB. The figure explaining the structure of visitor image DB. The flowchart which showed the procedure which calculates tag absolute position data. The figure explaining the principle which calculates tag absolute position data. The flowchart which showed the procedure which acquires a camera image. FIG. 6 is a supplementary diagram illustrating a procedure for acquiring a camera image. The flowchart which showed the procedure which processes a camera image. FIG. 6 is a supplementary diagram illustrating a procedure for processing a camera image. The flowchart which showed a series of operation | movement of the photograph image provision system.

Explanation of symbols

1 Photo Image Providing System 10 Photo Image Providing Server 100 Position Detection Unit 110 Camera Control Unit 120 Photo Image Processing Unit 130 Photo Image Providing Unit 140 Visitor Image DB
150 Visitor DB
160 CCD camera DB
170 Map DB
20 IC tag 30 Tag receiver 40 CCD camera 50 PC
60 LAN, 61 Internet

Claims (18)

A photographic image providing server for providing a photographic image of a user photographed in a management area to the user,
Identification data (device identification data) of the radio identification device, radio wave intensity data indicating the radio wave of the received radio wave, and identification of the receiver from a receiver that receives radio waves transmitted by the radio identification device worn by the user When device detection data including at least data (receiver identification data) is received from a plurality of the receivers, the position of the receiver that transmitted the device detection data and the radio wave included in the received device detection data Position calculation means for calculating a position on the absolute coordinates (device absolute position) in the management area of the wireless identification device specified by the device identification data included in the received device detection data from intensity data;
The photographing camera including the position of the wireless identification device calculated by the position calculation unit in the photographing range is selected from a plurality of photographing cameras provided in the management area, and photographing is performed on the selected photographing camera. Photographing camera control means for obtaining a photographic image (camera image) photographed by the photographing camera instructed to photograph,
By converting each of the device absolute positions on the absolute coordinates calculated by the position calculating means into a coordinate system of the photographing camera that includes the device absolute position in the photographing range, the camera image is included in the camera image for each camera image. By identifying the position of the wireless identification device (device photo position) in the image, recognizing the human shape by image processing the peripheral image of the device photo position, and trimming the range including the recognized human shape, Photo processing means for generating a photo image (user image) of the user possessing the wireless identification device corresponding to the device photo position, and storing the generated user image in a storage device for each user, A photo providing server comprising:   The photographic image providing server according to claim 1, wherein the photographic image providing server is set by a user having the wireless identification device specified by the device identification data in association with the device identification data. Trimming conditions are stored, and the photographic image processing means retrieves the trimming conditions from the device identification data included in the device detection data received by the position calculating means, and the photographing camera takes a picture according to the retrieved trimming conditions. A photographic image providing server, wherein the camera image is trimmed.   3. The photographic image providing server according to claim 2, wherein the trimming condition includes data indicating a range of a person shape to be included in the user image, and the photographic image processing means is indicated by the trimming condition. A photographic image providing server, wherein the camera image is trimmed based on a range of a person shape.   4. The photographic image providing server according to claim 3, wherein the trimming condition includes the device identification data of the wireless identification device possessed by the user's companion, and the photographic image processing unit includes: If the device photo position of the device identification data of the accompanying person is in the vicinity of the device photo position to be trimmed, a person shape recognized based on the device photo position of the device identification data of the accompanying person is included. A photographic image providing server that performs trimming processing as described above.   The photographic image providing server according to any one of claims 1 to 4, wherein the position calculating unit includes each of the receivers that transmit the same device identification data when there are three or more receivers. A photographic image providing server characterized in that the device absolute position is calculated using a three-point positioning method using the device detection data acquired from a receiver.   The photographic image providing server according to any one of claims 1 to 5, wherein the photographic image providing server provides the user image stored in the storage device via a network. A photographic image providing server comprising image providing means. A photographic image providing method for providing a photographic image of a user photographed in a management area to the user,
A server that provides a photographic image (user image) of the user receives identification data (device identification data) of the wireless identification device from a receiver that receives radio waves transmitted by the wireless identification device worn by the user. Receiving device detection data including at least radio wave intensity data indicating received radio waves and identification data (receiver identification data) of the receiver from a plurality of the receivers, and transmitting the device detection data Absolute coordinates in the management area of the wireless identification device identified by the device identification data included in the received device detection data from the position of the receiver and the radio wave intensity data included in the received device detection data Position calculator that performs the step of calculating the upper position (device absolute position) And,
The server selects, from among a plurality of shooting cameras provided in the management area, the shooting camera that includes the device absolute position calculated by the position calculation means in a shooting range, for the selected shooting camera A shooting camera control step in which shooting is instructed, and a step of acquiring a photographic image (camera image) taken by the shooting camera that has instructed shooting is performed;
For each camera image, the server converts each of the device absolute positions on the absolute coordinates calculated by the position calculating unit into a coordinate system of the photographing camera including the device absolute position in a photographing range. Identifying the position of the wireless identification device (device photo position) in the camera image, recognizing a person shape by performing image processing on a peripheral image of the device photo position, and trimming a range including the recognized person shape By performing the processing, a step of generating the user image possessing the wireless identification device corresponding to the device photo position and a step of storing the generated user image in a storage device for each user are executed. A photographic image providing method comprising: a photographic image processing step.   The photographic image providing method according to claim 7, wherein the server associates the trimming condition set by the user having the wireless identification device specified by the device identification data with the device identification data. In the photographic image processing step, the server searches the trimming condition from the device identification data included in the device detection data received by the server in the position calculating step, and follows the searched trimming condition. A photographic image providing method comprising trimming the camera image taken by the photographing camera.   9. The photographic image providing method according to claim 8, wherein the trimming condition includes data indicating a range of a human shape to be included in the user image, and in the photographic image processing step, the server A photographic image providing method, wherein the camera image is trimmed based on a person shape range indicated by a trimming condition.   The photographic image providing server according to claim 9, wherein the trimming condition includes the device identification data of the wireless identification device possessed by the user's companion, and in the photographic image processing step, When the device photo position of the device identification data of the companion is in the vicinity of the device photo position to be trimmed, the server is recognized based on the device photo position of the device identification data of the companion. A photographic image providing method, wherein trimming processing is performed so as to include a person shape.   The photographic image providing method according to any one of claims 7 to 10, wherein, in the position calculation step, the server has three or more receivers that transmitted the same device identification data. A method for providing a photographic image, wherein the device absolute position is calculated using a three-point positioning method using the device detection data acquired from each of the receivers.   12. The photographic image providing method according to claim 7, wherein the server stores the user image stored in the storage device via a network. A photographic image providing method comprising a photographic image providing step of providing A photographic image providing system for providing a photographic image of a user photographed in a management area to the user,
The photographic image providing system includes a wireless identification device worn by the user, a receiver that receives radio waves transmitted by the wireless identification device, and a photographic image (user image) obtained by photographing the user. And a photographic image providing server to provide
The wireless identification device stores device identification data unique to each wireless identification device, and includes means for periodically transmitting radio waves encoded with the device identification data,
The receiver, when receiving a radio wave transmitted by the wireless identification device, means for decoding the received radio wave to obtain device identification data; means for generating radio wave intensity data indicating the radio wave of the received radio wave; Means for transmitting device detection data including at least the device identification data, the radio wave intensity data, and the receiver identification data (receiver identification data) to the photographic image providing server;
The photographic image providing server, when receiving the device detection data from a plurality of the receivers, the position of the receiver that transmitted the device detection data, and the radio wave intensity data included in the received device detection data, From the position calculation means for calculating the position (device absolute position) on the absolute coordinate in the management area of the wireless identification device specified by the device identification data included in the received device detection data,
From the plurality of shooting cameras provided in the management area, select the shooting camera that includes the device absolute position calculated by the position calculation means in the shooting range, and instruct the selected shooting camera to perform shooting Then, a photographing camera control means for obtaining a photographic image (camera image) photographed by the photographing camera instructed to photograph,
By converting each of the device absolute positions on the absolute coordinates calculated by the position calculating means into a coordinate system of the photographing camera that includes the device absolute position in the photographing range, the camera image is included in the camera image for each camera image. By identifying the position of the wireless identification device (device photo position) in the image, recognizing the human shape by image processing the peripheral image of the device photo position, and trimming the range including the recognized human shape, Photo processing means for generating a photo image (user image) of the user possessing the wireless identification device corresponding to the device photo position, and storing the generated user image in a storage device for each user, A photographic image providing system comprising:   14. The photographic image providing system according to claim 13, wherein the photographic image providing server is set by a user having the wireless identification device specified by the device identification data in association with the device identification data. Trimming conditions are stored, and the photographic image processing means retrieves the trimming conditions from the device identification data included in the device detection data received by the position calculating means, and the photographing camera takes a picture according to the retrieved trimming conditions. A photographic image providing system, wherein the camera image is trimmed.   15. The photographic image providing system according to claim 14, wherein the trimming condition stored by the photographic image providing server includes data indicating a range of a person shape included in the user image, and the photographic image providing The photographic image providing system according to claim 1, wherein the photographic image processing means of the server trims the camera image based on a range of a person shape indicated by the trimming condition.   The photographic image providing system according to claim 15, wherein the trimming condition stored in the photographic image providing server includes the device identification data of the wireless identification device possessed by the accompanying user. When the device photo position of the device identification data of the companion is in the vicinity of the device photo position to be trimmed, the photographic image processing means of the photographic image providing server includes the device identification data of the companion. A photographic image providing system, wherein trimming processing is performed so as to include a person shape recognized based on the device photo position.   The photographic image providing system according to any one of claims 13 to 16, wherein the position calculating unit of the photographic image providing server includes three or more receivers that have transmitted the same device identification data. In this case, the device absolute position is calculated using a three-point positioning method using the device detection data acquired from each of the receivers. The photographic image providing system according to any one of claims 13 to 17, wherein the photographic image providing server provides the user image stored in the storage device via a network. A photographic image providing system comprising image providing means.

Images