JP2009071738A - Photographing control apparatus, wireless communication terminal, photographing system, and photographing control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a photographing control apparatus, a wireless communication terminal, a photographing system, and a photographing control method, wherein photographed images are easily transferred in units of objects. <P>SOLUTION: When the wireless communication terminal receives an instruction signal for instructing the sending of a photographing request including the identification information of the terminal itself from the photographing control apparatus for controlling camera photography (S2020:YES), the terminal sends a photographing request including the identification information of the terminal itself by wireless communication (S2060) and receives images sent correspondingly to the identification information of the terminal itself out of images sent from the photographing control apparatus by using a millimeter wave UWB (S2100). <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a shooting control device that controls shooting operation of a camera and transmission of a shot image, a wireless communication terminal that acquires a shot image from the shooting control device by wireless communication, a shooting system using these devices, and shooting of a camera. The present invention relates to a shooting control method for controlling operation and transmission of a shot image.

  In recent years, as part of services at theme parks, attention has been focused on services that take photos of visitors on the vehicle, etc., using the facility's imaging equipment, and sell the images taken to the visitors. Yes. This kind of service that allows customers to acquire their own images taken by the facility (hereinafter referred to as “self-picture ring”) is a good memorial for visiting and visiting, so it is used by many people. ing.

  As a specific method for passing a captured image to the subject side, a print image is conventionally transferred at a service center. However, this conventional method involves development of a captured image and handing work, so that labor costs are added to the actual cost, which is uneconomical.

Therefore, for example, Patent Document 1 discloses a technique for transferring a captured image to the subject side by wireless communication. In the technique described in Patent Document 1, a wireless reception device is prepared on the subject side, and a captured image is transmitted to the wireless reception device by wireless communication. By applying this technique to self-picture ringing, it is possible to reduce the burden and cost associated with the delivery of captured images.
JP 2003-143595 A

  However, the technique described in Patent Document 1 has a problem that it is not suitable for shooting many subjects in a short time. For example, when a passenger on a roller coaster is photographed one after another with a camera installed on the course, a large number of image data is generated in a short time, and it is difficult to associate the image data with a subject. For this reason, the customer has to find and select an image in which he / she is reflected from a large number of printed images or monitor display images, while the seller holds the image selected by the customer. Work to transfer to the wireless receiver must be done. Therefore, when many subjects are photographed in a short time, the burden associated with image transfer becomes a problem.

  The present invention has been made in view of the above points, and even when a large number of subjects are photographed in a short time, a photographing control device, a wireless communication terminal, and a photographing device that can perform image transfer in units of subjects. It is an object to provide a system and a photographing control method.

  The imaging control device of the present invention is configured to transmit the wireless communication terminal transmitted from the wireless communication terminal when a wireless communication terminal carried by a user is located in a detection range corresponding to a shooting range of a camera installed at a predetermined location. A request receiving unit that receives a shooting request including identification information of a communication terminal, and a shooting determination unit that determines whether a user of the wireless communication terminal is located in the shooting range based on whether or not the shooting request is received Shooting control means for causing the camera to perform shooting when the user is located in the shooting range; and image sending means for sending an image shot by the camera in association with identification information of the wireless communication terminal The structure which has these.

  The wireless communication terminal according to the present invention includes a request sending unit that sends a shooting request including identification information of the terminal by wireless communication, and an image sent by a shooting control device that controls shooting of a camera installed at a predetermined location. The image receiving means for receiving the image sent in association with the identification information of the terminal itself and the image storage means for storing the image received by the image receiving means are adopted.

  An imaging system of the present invention includes a camera installed at a predetermined location, a wireless communication terminal carried by a user, and an imaging control device that causes the camera to take an image of the user of the wireless communication terminal as a subject. The wireless communication terminal includes: a request sending unit that sends a shooting request including identification information of its own terminal by wireless communication; and an image sent from the shooting control device using a millimeter wave UWB. An image receiving unit that receives an image transmitted in association with identification information of the terminal, and an image storage unit that stores an image received by the image receiving unit. Request receiving means for receiving the shooting request sent from the wireless communication terminal when the terminal is located in a detection range corresponding to the shooting range of the camera; Shooting determination means for determining whether or not the user of the wireless communication terminal is located in the shooting range based on the presence or absence of shooting, and shooting that causes the camera to perform shooting when the user is located in the shooting range The control unit and an image transmission unit that transmits an image captured by the camera in association with identification information of the wireless communication terminal using a millimeter wave UWB are employed.

  The radiography control method according to the present invention provides the radio communication terminal transmitted from the radio communication terminal when a radio communication terminal carried by a user is located in a detection range corresponding to an imaging range of a camera installed at a predetermined location. A request receiving step for receiving a shooting request including identification information of a communication terminal, a shooting control step for causing the camera to perform shooting when the shooting request is received in the request receiving step, and a shooting control step by the camera. An image sending step for sending the photographed image in association with the identification information of the wireless communication terminal.

  According to the present invention, since the captured image is transferred in association with the identification information of the wireless communication terminal, it is possible to perform image transfer in units of subjects even when shooting many subjects in a short time. .

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(Embodiment 1)
FIG. 1 is a system configuration diagram showing the configuration of an imaging system according to Embodiment 1 of the present invention. This embodiment is an example in which the present invention is applied to self-picture ring where a roller coaster passenger in an amusement park is photographed with a camera installed on the course and the photographed image is transmitted to a wireless communication terminal carried by the customer. is there.

  In FIG. 1, a photographing system 100 includes a wireless communication device with a camera function (hereinafter referred to as “photographing device”) 200 including a photographing control device according to the present invention, and a wireless communication device with a memory function (hereinafter referred to as a wireless communication terminal) according to the present invention. 300 (referred to as “terminal device”). The photographing apparatus 200 is fixedly installed at a predetermined location near a course (hereinafter simply referred to as “course”) 400 of a roller coaster (not shown). The terminal device 300 is, for example, a mobile phone carried by a roller coaster passenger. The terminal device 300 moves on the course 400 together with the roller coaster. In the following, in the course 400, the one that corresponds to the front in time is referred to as “front”, and the one that corresponds to the time later in time is referred to as “after”.

  The photographing apparatus 200 has a photographing range 410 for photographing passengers and a communication range 420 for detecting arrival of passengers in the photographing range 410 and transmitting images on the route 400.

  The imaging range 410 includes an area (hereinafter referred to as “subject area”) 411 in which a passenger who is a subject on the captured image is to be placed. The communication range 420 includes a shooting area 421 disposed in the subject area 411, a detection area 422 disposed immediately before the shooting area 421, and a transmission area 423 disposed immediately after the shooting area 421. The detection area 422 corresponds to a time that allows for a predetermined time lag in the time required for authentication of the terminal device 300 described later. The shooting area 421 corresponds to a time when shooting is actually performed. The transmission area 423 corresponds to the time required for compression and transfer of image data of a captured image. As is apparent from FIG. 1, the terminal device 300 passes through the detection area 422, the imaging area 421, and the transmission area 423 in this order.

  The imaging apparatus 200 periodically sends out a command signal instructing the terminal apparatus 300 to send an imaging request to the detection area 422, and monitors whether there is a response from the terminal apparatus 300. When a roller coaster enters the detection area 422 and receives a photographing request sent from the terminal device 300 in the detection area 422, the photographing device 200 captures the photographing range 410 immediately after assuming that the passenger has entered the photographing area 421. Do. Then, assuming that the photographing apparatus 200 and the terminal apparatus 300 enter the transmission area 423 immediately after that, the photographed image is transmitted toward the transmission area 423. The photographing request includes identification information of the terminal device 300 that is the transmission source. The imaging device 200 transmits a captured image in association with the received identification information.

  The terminal device 300 monitors whether or not a command signal sent from the photographing device 200 has been received. Upon receiving the command signal, the terminal device 300 sends a photographing request including identification information of the own terminal, assuming that the terminal has entered the detection area 422. To do. Then, among the images transmitted from the photographing apparatus 200 toward the transmission area 423, an image transmitted in association with the identification information of the own terminal is received, and the received image is stored.

  In such a photographing system 100, since a photographed image can be transferred in association with the identification information of the terminal device 300, the photographed image can be automatically transferred for each passenger.

  On the other hand, since the running speed of the roller coaster is relatively fast, it is necessary to use a wireless communication system with a high communication speed when trying to transmit image data with higher image quality. In addition, since the antenna of the photographing apparatus 200 must be installed at a distance of several meters from the course 400 from the viewpoint of safety, it is necessary to use a wireless communication method capable of communication even at a distance of several meters or more. .

  Therefore, the photographing apparatus 200 has a piconet controller function for UWB wireless communication using directional radio waves, and realizes high-speed image transfer at a distance of several meters or more by using a millimeter wave UWB having particularly high directivity. Specifically, the photographing apparatus 200 uses a wireless communication method IEEE 802.15.3c having a bandwidth exceeding 1 Gbps. However, since the directivity is high, the transmission area 423 is naturally narrow, and more accurate synchronization between the position of the terminal device 300 and the transmission timing is required. For this reason, the transmission area 423 is arranged as close as possible to the detection area 422, that is, immediately after the imaging area 421.

  IEEE802.15.3c is a method close to the MAC layer protocol, with a view to touch-and-move aiming at instantaneous file transfer and WirelessHD, an organization aiming at uncompressed wireless transmission of HDMI (high-definition multimedia interface). Is expected to be adopted. Specifically, the IEEE standard “Part 15.3 Wireless Medium Access Control (MAC) and Physical Layer (PHY) Specifications for High Rate Wireless Personal Area Networks (WPANs)” is expected to be adopted.

  On the other hand, since the position and direction of the imaging device 200 are indefinite when viewed from the terminal device 300, the terminal device 300 uses an omnidirectional antenna with a reduced rate in order to increase the communication distance.

  Next, the configuration of each device will be described.

  FIG. 2 is a block diagram illustrating a configuration of the image capturing apparatus 200.

  In FIG. 2, a photographing apparatus 200 includes a lens unit 210, a camera function unit 220, an image compression unit 230, a photographic memory unit 240, an antenna unit 250, a UWB-PHY (physical layer) unit 260, and a UWB-MAC (media access control). Unit 270, UWB management unit 280, and photo service server unit 290.

  The lens unit 210 forms an image of the imaging range 410 illustrated in FIG. 1 on the imaging surface of the camera function unit 220.

  The camera function unit 220 includes a CCD (charge coupled device) sensor or the like (not shown), captures an image formed on the imaging surface at a timing instructed by the photo service server unit 290, and converts the image into image data. And output.

  In response to a request from the camera function unit 220, the image compression unit 230 performs a predetermined compression process on the image data, and stores the compressed image data in the photo memory unit 240.

  The photographic memory unit 240 temporarily holds the image data stored by the image compression unit 230.

  The antenna unit 250 has an antenna with high directivity with respect to the communication range 420 shown in FIG. 1, and transmits and receives radio waves.

  The UWB-PHY unit 260 controls communication of the physical layer of the millimeter wave UWB via the antenna unit 250.

  The UWB-MAC unit 270 controls communication of the MAC layer of the millimeter wave UWB via the UWB-PHY unit 260.

  The UWB management unit 280 has an IEEE 802.15.3 piconet controller function, and establishes an association with the terminal device 300 using the UWB-MAC unit 270 and the UWB-PHY unit 260.

  When the association with the terminal device 300 is established and the photograph service server unit 290 receives a message requesting photographing from the terminal device 300, the photograph service server unit 290 causes the camera function unit 300 to photograph an image in the photographing range 410. Then, the photo service server unit 290 reads the obtained image data from the photo memory unit 240, and transmits the read image data to the terminal device 300 via the UWB-MAC unit 270 and the UWB-PHY unit 260.

  Although not shown, the photographing apparatus 200 includes a central processing unit (CPU), a storage medium such as a ROM (read only memory) storing a control program, a working memory such as a random access memory (RAM), a communication circuit, and the like. Have That is, the function of each unit of the photographing apparatus 200 described above is realized by the CPU executing the control program.

  FIG. 3 is a block diagram illustrating a configuration of the terminal device 300.

  As shown in FIG. 3, the terminal device 300 includes an antenna unit 310, a UWB-PHY unit 320, a UWB-MAC unit 330, a UWB management unit 340, a photo service client unit 350, a photo memory unit 360, an operation unit 370, and an image decompression. Part 380 and photo display part 390.

  The antenna unit 310 includes an omnidirectional antenna and transmits and receives radio waves. That is, since there is no data to be transmitted / received at a high rate from the user side, the antenna unit 310 is configured to reduce the rate and increase the communication distance.

  The UWB-PHY unit 320 controls communication of the physical layer of the millimeter wave UWB via the antenna unit 310.

  The UWB-MAC unit 330 controls communication of the MAC layer of the millimeter wave UWB via the UWB-PHY unit 320.

  The UWB management unit 340 has a function as an IEEE 802.15.3 slave, and establishes an association with the photographing apparatus 200 using the UWB-MAC unit 330 and the UWB-PHY unit 320.

  When the association with the photographing apparatus 200 is established, the photograph service client unit 350 transmits a message requesting photographing to the photographing apparatus 200. The photo service client unit 350 receives the image data transmitted from the photographing apparatus 200 and stores it in the photo memory unit 360. At this time, the photo service client unit 350 receives only image data sent to the terminal itself. Further, the photo service client unit 350 controls various processes for image data in accordance with a user operation of an operation unit 370 described later.

  The photo memory unit 360 holds the image data stored by the photo service client unit 350.

  The operation unit 370 includes a key switch (not shown) and receives various operations including display of image data from the user. In order to improve the usability of the key switch, it is desirable that a lamp is disposed therein so that the lamp is lit while receiving a beacon or continuing an association.

  The image decompression unit 380 reads the compressed image data from the photo memory unit 360 in response to a request from the photo display unit 390 described later, and performs a predetermined decompression process on the image data.

  The photograph display unit 390 includes a liquid crystal display 391. When the display of image data is instructed by the user, the photo display unit 390 reads and decompresses the corresponding image data using the image decompression unit 380, and displays the decompressed image data on the liquid crystal display 391.

  Although not shown, the terminal device 300 includes a CPU, a storage medium such as a ROM storing a control program, a working memory such as a RAM, a communication circuit, and the like. That is, the function of each unit of the terminal device 300 described above is realized by the CPU executing the control program.

  Next, the operation of each device will be described.

  FIG. 4 is a flowchart showing the operation of the photographing apparatus 200.

  First, in step S1010, the photo service server unit 290 internally initializes and then causes the UWB management unit 280 to start a piconet controller function. Thereby, UWB management section 280 starts transmission of a normal beacon for each super subframe and transmission of a sub-beacon having a shorter transmission cycle than this beacon, using the initial value for control. These beacons and sub-beacons are for notifying the terminal device 300 that has entered the communication range 420 that is the piconet area of the photographing device 200, and for synchronizing the superframe. In addition, the beacon and the sub-beacon according to the present embodiment serve as part of a command signal that commands transmission of a message requesting photographing. The significance of using the sub-beacon will be described later.

  In step S1020, UWB management unit 280 determines whether an association request has been received from terminal device 300 as a response to the transmitted beacon or sub-beacon. As a result of this determination, while the association request is not received (S1020: NO), the process proceeds to step S1030. When the association request is received (S1020: YES), the process proceeds to step S1040.

  In step S1040, the UWB-MAC unit 270 performs an association operation assuming that the terminal device 300 has entered the communication range 420. Specifically, the UWB-MAC unit 270 transmits an ACK (acknowledgement) response, performs a predetermined registration operation, and then transmits an association response to perform a predetermined authentication process. In this association operation, the UWB-MAC unit 270 and the counterpart device (here, the UWB-MAC unit 330 of the terminal device) notify each other of identification information (DEVID: device identification), and associate using the identification information. Differentiate and manage each communication. That is, the UWB-MAC unit 270 acquires the identification information of the terminal device 300 in the association operation. For example, the MAC address of the device is used as the identification information.

  In step S1050, the UWB-MAC unit 270 determines whether an association has been established with the terminal device 300. Specifically, the UWB-MAC unit 270 determines whether or not the association is established based on whether or not the association request is received twice from the terminal device 300 within a predetermined time. If the association is established as a result of this determination (S1050: YES), the UWB-MAC unit 270 notifies the photo service server unit 290 of the identification information and registration, and then the process proceeds to step S1060. If not established (S1050: NO), the process proceeds to step S1070.

  In step S1060, the photo service server unit 290 transmits the photo service advertisement message to the other party (here, the terminal device 300) indicated by the identification information notified from the UWB-MAC unit 270. The photo service advertisement message is a message for notifying that the self-picture ring service is started and shooting and transmission of the shot image are performed, and serves as a part of a command signal for instructing transmission of a message requesting shooting. To fulfill. When transmitting the photo service advertisement message, the photo service server unit 290 may transmit data for improving the security of information transmission, such as an encryption key.

  In step S1080, the photo service server unit 290 determines whether a photo service request message, which is a message for requesting shooting, has been received from the terminal device 300 as a response to the photo service advertisement message. As a result of this determination, if a photo service request message is received (S1080: YES), the process proceeds to step S1090, and if a predetermined time elapses without receiving a photo service request message, a time-out occurs ( (S1080: NO), the process proceeds to step S1070.

  In step S1070, UWB-MAC section 270 deletes the association information of the current association. Then, the process proceeds to step S1030.

  On the other hand, in step S1090, the photo service server unit 290 responds with an ACK and instructs the camera function unit 220 to take a photo, assuming that the terminal device 300 desires to transfer the photo. Then, the camera function unit 220 takes a photograph of the photographing range 410 shown in FIG. 1, compresses the obtained image data using the image compressing unit 230 and transfers the compressed image data to the photo memory unit 240, and then the photo service server. The imaging completion report is sent to the unit 290.

  In step S1100, the photo service server unit 290 reads the image data from the photo memory unit 240 and associates the image data with the identification information notified from the UWB-MAC unit 270, that is, with the terminal device 300 as the destination in FIG. It is sent to the communication range 420 shown.

  In step S <b> 1110, the photo service server unit 290 determines whether there is a request for retransmission of image data from the terminal device 300. As a result of this determination, if there is no retransmission request (S1110: NO), the process proceeds to step S1120. If there is a retransmission request (S1110: YES), the process returns to step S1100 to retransmit the image data. .

  In step S1120, the UWB management unit 280 determines whether a disassociation request has been received from the terminal device 300, or whether a predetermined time has elapsed without receiving a disassociation request and a timeout has occurred. As a result of this determination, if the disassociation request has not been received and the timeout has not occurred (S1120: NO), the process returns to step S1110. On the other hand, if a disassociation request is received or a timeout occurs (S1120: YES), the process proceeds to step S1130.

  In step S1130, the photo service server unit 290 deletes the image data remaining in the photo memory unit 240 and the association information in the current association held internally, and then proceeds to step S1030.

  In step S1030, the photo service server unit 290 determines whether to continue the self-picture ring. As a result of this determination, when self-picture ring is continued (S1030: YES), the process returns to step S1020, and when self-picture ring is not continued due to receiving a predetermined end instruction (S1030: NO), The process proceeds to step S1140.

  In step S1140, the photo service server unit 290 causes the UWB management unit 280 to terminate the piconet controller function. As a result, a series of processing ends.

  In this way, the imaging device 200 performs imaging in the imaging range 410 in response to a request from the terminal device 300 that has entered the communication range 420, and directs the image data of the captured image toward the communication range 420 of the terminal device 300. It is sent in association with the identification information.

  FIG. 5 is a flowchart showing the operation of the terminal device 300.

  First, in step S2010, the photo service client unit 350 internally initializes and then causes the UWB management unit 340 to start monitoring beacons and sub-beacons.

  In step S2020, the UWB management unit 340 determines whether a beacon or a sub-beacon transmitted from the imaging apparatus 200 has been received. If no beacon or sub-beacon is received as a result of this determination (S2020: NO), the process proceeds to step S2030. If a beacon or sub-beacon is received (S2020, YES), the process proceeds to step S2040.

  In step S2040, the UWB management unit 340 transmits an association request to the transmission source of the received beacon or sub-beacon (here, the imaging device 200). In this association operation, the UWB management unit 340 notifies the imaging apparatus 200 of identification information of the own apparatus as described above.

  In step S2050, the UWB-MAC unit 330 determines whether an association response has been received from the imaging apparatus 200 as a response to the association request. As a result of this determination, if an association response is received (S2050: YES), the process proceeds to step S2060, and if a predetermined time elapses without receiving an association response (S2050: NO). The process proceeds to step S2070.

  In step S2060, the UWB-MAC unit 330 transmits an association request to the imaging apparatus 200 again. As a result, as described in step S1050 of FIG. 4, an association is established between the terminal device 300 and the imaging device 200, and communication that is distinguished from other communication terminals becomes possible.

  In step S2080, the photo service client unit 350 determines whether a photo service advertisement message has been received from the photographing apparatus 200. As a result of this determination, if a photo service advertisement message is received (S2080: YES), the process proceeds to step S2090, and if a predetermined time elapses without receiving a photo service advertisement message, a timeout occurs ( (S2080: NO), the process proceeds to step S2070.

  In step S2090, the photo service client unit 350 transmits a photo service request message to the photographing apparatus 200.

  Then, in step S2100, the photo service client unit 350 transmits, after the ACK response, whether or not the image data sent from the photographing apparatus 200 in association with the identification information of the own terminal has been received, that is, the own apparatus is sent as the destination. It is determined whether the received image data has been received. As a result of this determination, if image data sent in association with the identification information of the own terminal is received (S2100: YES), the process proceeds to step S2110, and the image sent in association with the identification information of the own terminal. If a predetermined time elapses without receiving data and a timeout occurs (S2100: NO), the process proceeds to step S2120.

  In step S2110, the photo service client unit 350 stores the received image data in the photo memory unit 360. Then, the process proceeds to step S2070.

  On the other hand, in step S2120, the photo service client unit 350 determines whether or not a predetermined time has elapsed since the photo service request message was transmitted and a time-out has occurred. As a result of this determination, if the timeout has not yet been reached (S2120: NO), the process returns to step S2100. If the timeout has occurred (S2120: YES), the process proceeds to step S2070.

  In step S2070, the UWB-MAC unit 330 transmits a disassociation request to the imaging apparatus 200, and deletes association information of the current association. Then, the process proceeds to step S2030.

  In step S2030, the photo service client unit 350 determines whether to continue the self-picture ring. As a result of this determination, when the self-picture ring is continued (S2030: YES), the process returns to step S2020, and when the self-picture ring is not continued by receiving a predetermined end instruction (S2030: NO), The process proceeds to step S2130.

  In step S2130, the photo service client unit 350 causes the UWB management unit 340 to finish monitoring beacons and sub-beacons. As a result, a series of processing ends.

  As described above, the terminal device 300 receives the beacon or sub-beacon and the photo service advertisement message from the photographing device 200 and requests photographing in a form associated with the identification information of the own device. Then, the terminal device 300 receives the image data transmitted in association with the identification information of the own device, and stores it in the photo memory unit 360.

  The image data stored in the photographic memory unit 360 is displayed on the liquid crystal display 391 in accordance with a user operation. If the user of the terminal device 300 wants to manually set the photo shooting timing, the photo service client unit 350 may transmit a photo service request message when a predetermined key switch is pressed.

  In the operation described above, in order to perform shooting reliably, the processes in steps S1040 to S1080 in FIG. 4 and steps S2040 to S2090 in FIG. 5 are performed while the terminal device 300 passes through the detection area 422. There is a need. And the process of step S1090 of FIG. 4 needs to be performed while the terminal device 300 passes the imaging | photography area 421. FIG. Further, in order to reliably transfer the image data, the processes in steps S1100 to S1120 in FIG. 4 and steps S2100 and S2120 in FIG. 5 need to be executed while the terminal device 300 passes through the transmission area 423. There is. Therefore, the shooting range 410, the area 411, and the communication range 420 are set in advance so that the above conditions are satisfied in relation to the moving speed of the terminal device 300 (traveling speed of the roller coaster) and the time required for each process. .

  Next, the significance of using the sub-beacon will be described.

  A sub-beacon is a frame in which only information necessary for normal beacon frame association is collected and made known to the neighborhood.

  FIG. 6 is a diagram for explaining the significance of using a sub-beacon. In FIG. 6, the vertical axis represents time, the horizontal axis represents the distance on the course 400 with respect to the terminal device 300, and time passes from top to bottom on the page. In addition, here, for simplification of explanation, the delay time in transmission / reception of individual signals and the time required for internal processing of each device are ignored.

  The normal beacon transmission period in the IEEE802.15.3 piconet controller function is on the order of several tens of milliseconds (ms), and here, the case of 64 milliseconds is assumed. Here, a beacon having a transmission period of 1 millisecond is inserted as a sub-beacon between normal beacons, and the reach range of the beacon and the sub-beacon is indicated by an arrow 510.

  As shown in FIG. 6, the beacon and sub-beacon reach 510 (that is, the communication range 420 shown in FIG. 1) approaches the terminal device 300 relatively with the movement of the terminal device 300 over time. When the terminal device 300 enters the communication range 420, the terminal device 300 receives the beacon or sub-beacon transmitted first after the entry. As a result of receiving this beacon or sub-beacon, the terminal device 300 transmits an association request to the photographing device 200, assuming that the terminal has entered the communication range 420, and thereafter, photographing and transfer of the photographed image are performed.

  However, when only the beacon is used, the delay time from when the terminal device 300 enters the communication range 420 until the first beacon is received by the terminal device 300 is 64 milliseconds at maximum. This corresponds to the time lag time to be expected in the detection area 422 in FIG.

  Therefore, for example, when the running speed of the roller coaster is 100 km / h, the distance corresponding to this delay time is about 1.78 meters, and the position on the user's shooting screen (the shooting area 421 in FIG. 1) is also The maximum deviation is about 1.78 meters. Then, the subject area 411 shown in FIG. 1 has to be secured about 1.78 meters on the course 400, the size of the subject on the screen becomes smaller, the position of the subject on the screen deviates from the center, etc. As a result, the commercial value of the image is reduced. Therefore, it is conceivable to shorten the superframe cycle and shorten the beacon transmission cycle, but the ratio of the overhead portion of the superframe occupying the band increases, and the transfer rate of the image data decreases.

  For this reason, in the imaging apparatus 200 of the present embodiment, as already described, a frame that transmits only information necessary for beacon authentication is periodically transmitted as a sub-beacon between beacons. . In this case, as shown in FIG. 6, the delay time from when the terminal device 300 enters the communication range 420 until the first beacon or sub-beacon is received by the terminal device 300 is 1 millisecond at maximum. . Therefore, for example, when the running speed of the roller coaster is 100 km / h, the distance corresponding to this delay time is only about 3 cm, and the position on the shooting screen of the user is shifted only about 3 cm at the maximum. Absent.

  Thus, by using the sub-beacon, the subject area 411 can be set narrow, and an image with a high commercial value can be obtained.

  Here, it is assumed that the time from when the photographing apparatus 200 receives the association request until the photographing and the compression of the image data are completed is 1 millisecond or less. In this case, since the transmission interval of the sub-beacon is 1 millisecond, until the terminal device 300 enters the communication range 420 and can start transmission of image data by adding the maximum delay time of 1 millisecond as described above. The maximum time is 2 milliseconds. Further, when a circular communication range 420 of about 30 centimeters is set, it takes about 10 milliseconds for communication to pass through the terminal device 300, and an image transfer time of about 8 milliseconds is secured. . This corresponds to a data transfer time of about 1 megabyte (MB) in UWB having a transfer capability of 1 Gbps.

  Therefore, even when the moving speed of the terminal device 300 is 100 km / h and the communication range 420 of about 30 centimeters is set, it is possible to transfer image data of 1 megabyte by using UWB.

  Note that 30 centimeters is merely an example, and the communication range 420 can be set larger as necessary. For example, in the case of a vehicle such as a train in a row, or when the distance between passengers is sufficiently large, if the communication range 420 is set to the size of one person, communication between passengers interferes. It is possible to transfer a single photograph without any problem.

  In addition, the photographing apparatus 200 may not transmit the sub-beacon from the time when the predetermined number of authentications are completed or when the predetermined time has elapsed from the first authentication to the end of the transfer of the captured image. As a result, more bands can be used for image data transfer, and the transfer speed of image data can be improved. The higher the transfer rate of the image data, the more high-quality images can be transferred and the communication range 420 can be set narrower.

  Further, the positions and sizes of the shooting range 410 and the communication range 420 vary depending on the moving speed and moving direction of the terminal device 300, the processing speed of each device, the data size of image data, and the communication speed between the devices. Can be considered.

  FIG. 7 is a diagram illustrating an arrangement example of the imaging range 410 and the communication range 420.

  For example, consider a case where the moving direction of the user carrying the terminal device 300 is not fixed in one direction. In this case, as shown in FIG. 7A, the shooting range 410 and the communication range 420 are substantially matched, and the communication is set to a size that can complete the transfer of the image data in any direction. A range 420 may be set. As a result, even if the user enters the communication range 420 from any direction, as long as it passes through the vicinity of the center of the communication range 420, it is possible to reliably perform shooting and image data transfer. On the other hand, since the communication range 420 must be set large, it can be said that it is suitable when the moving speed of the user is relatively low. Therefore, the arrangement example as shown in FIG. 7A is suitable when the user moves on foot, such as a haunted house.

  Further, for example, consider a case where the moving direction of the user carrying the terminal device 300 is fixed in one direction. In this case, as shown in FIG. 7B, the communication range 420 may be set so as to extend to the rear of the shooting range 410. Since the communication range 420 can be set small, it can be said that the communication range 420 is suitable when the moving speed of the user is relatively high. Therefore, the arrangement example as shown in FIG. 7B is suitable when the user gets on a vehicle that moves at a high speed on a predetermined course such as a roller coaster.

  As described above, according to the present embodiment, when the terminal device 300 is located in the communication range 420, the photographing device 200 performs photographing according to the photographing request sent from the terminal device 300, and the photographed image Is transmitted in association with the identification information of the terminal device 300. In addition, the terminal device 300 transmits a photographing request including identification information of the own device, and receives image data transmitted from the photographing device 200 in association with the identification information of the own device. Thereby, even when a large number of subjects are photographed in a short time, it is possible to transfer a photographed image for each subject from the photographing device 200 to the terminal device 300. Further, since shooting is performed in response to a request from the terminal device 300 located in the communication range 420, the user of the terminal device 300 can be reliably shot regardless of the timing when the user passes the shooting range 410. In other words, the boarding commemorative photo delivery service such as a roller coaster can be unmanned, and the user of the terminal device 300 can collect the self-portrait photos without being aware of them.

  Further, since the millimeter wave UWB is used, large-capacity image data can be transmitted from the imaging device 200 to the terminal device 300 in a short time.

  Further, since the sub-beacon is inserted between the normal beacons, the maximum delay time from when the terminal device 300 enters the communication range 420 of the photographing device 200 until photographing is performed can be shortened. The range 410 can be reduced. Also, by reducing the shooting range 410, the time from when the terminal device 300 enters the communication range 420 until transmission of image data is started can be shortened. Especially when the moving speed of the terminal device 300 is constant. Even when there is no image data, the image data can be reliably transmitted.

  In the above-described embodiment, the case where the transmission area 423 is set immediately after the imaging area 421 has been described. However, when the route and speed of the terminal device 300 are constant, or when the terminal device 300 detects the entry again. When performing, the sending area 423 may be set at a position away from the imaging area 421. Further, for example, the transmission area 423 may be provided in the service center, and a manual operation by the user may be received, the identification information of the own apparatus may be specified, a photo service request message may be transmitted, and image data may be received. In this case, the user of the terminal device 300 can arbitrarily select whether or not image data can be received for each location.

(Embodiment 2)
In the present embodiment, a case will be described in which an agent device that performs a photographing request and image data reception on behalf of a plurality of terminal devices 300 is arranged.

  In the first embodiment, the description has been given on the assumption that there is one terminal device 300 that is simultaneously present in the piconet area of the imaging device 200. However, in actual vehicles such as theme parks, passengers often sit side by side at close distances. In this case, authentication with the photographing apparatus 200 may collide among the plurality of terminal apparatuses 300, and it is difficult to determine the photographing start time and the photo transfer start time.

  Therefore, it is conceivable to provide a plurality of photographing devices 200 corresponding to the positions of the respective passengers. However, since the antenna of the terminal device 300 is omnidirectional, there is still a possibility that a communication collision will occur between the plurality of terminal devices 300. Therefore, in the present embodiment, an agent device that performs authentication and image transfer as a proxy is provided to avoid such a collision between authentication and communication.

  The imaging system according to the present embodiment is implemented except that a plurality of terminal devices 300 can be simultaneously located in the transmission area 423 of the imaging device 200 and that the device further includes an agent device as a wireless relay device according to the present invention. The configuration is almost the same as that of the photographing system 100 of the first embodiment. A description of the configuration and operation of the imaging device 200 and the terminal device 300 will be omitted.

  The agent device is fixedly installed for each roller coaster vehicle, receives the image data sent from the photographing device 200 on behalf of the plurality of terminal devices, and individually receives the received image data for the plurality of terminal devices 300. Forward to.

  FIG. 8 is a block diagram showing the configuration of the agent device. Hereinafter, the subscript “E” is an abbreviation for “External”, and indicates a functional unit used for communication with the imaging apparatus 200. The subscript “I” is an abbreviation for “Internal”, and indicates a functional unit used for communication with the terminal device 300.

As shown in FIG. 8, the agent device 600 realizes both a photo service server function and a photo service client function. The agent device 600 includes an antenna unit 611 _I , a UWB-PHY unit 612 _I , a UWB-MAC unit 613 _I , and a UWB management unit 614 _I as a communication system that communicates with the terminal device 300. Further, the agent device 600 includes an antenna unit 621 _E , a UWB-PHY unit 622 _E , a UWB-MAC unit 623 _E , and a UWB management unit 624 _E as communication systems for communicating with the imaging device 200. The agent unit 600 includes a photo service agent unit 630 that functions as a photo service server and a photo service client using these communication systems, and a memory unit 640 for storing image data, association information, and the like.

The antenna unit 611 _I , UWB-PHY unit 612 _I , UWB-MAC unit 613 _I , and UWB management unit 614 _I are the antenna unit 250, UWB-PHY unit 260, and UWB-MAC unit 270 of the imaging apparatus 200 shown in FIG. , And UWB management unit 280 have the same functional configuration. However, the antenna unit 611 can wirelessly communicate with the terminal device 300 held by a passenger of the vehicle. Hereinafter, the communication range on the vehicle of the antenna unit 611 is referred to as “proxy communication range”.

The antenna unit 621 _E , the UWB-PHY unit 622 _E , the UWB-MAC unit 623 _E , and the UWB management unit 624 _E are the antenna unit 310, the UWB-PHY unit 320, and the UWB-MAC unit 330 of the terminal device 300 shown in FIG. , And UWB management unit 340 have the same functional configuration.

  The photo service agent unit 630 establishes an association for each of the plurality of terminal devices 300 located in the proxy communication range before the own device enters the communication range 420 of the photographing apparatus 200. For example, the photo service agent unit 630 may start the association operation immediately after the roller coaster departs. Thereafter, while the vehicle is located in the communication range 420, the photo service agent unit 630 temporarily stops the image data reception process of each terminal device 300 and requests the image capturing device 200 to perform image capturing on behalf of the photo service agent unit 630. Then, the photo service agent unit 630 receives the image data from the photographing device 200, temporarily stores it in the memory unit 640, and after releasing the suspension of the wireless communication of each terminal device 300, sends the image data to the proxy communication range. To do.

  Hereinafter, the operation of the agent device 600 will be described using an example of the operation flow of the imaging system.

  FIG. 9 is a sequence diagram showing the operation of the imaging system using the agent device 600. Here, it is assumed that the first and second terminal devices 300-1 and 300-2 exist in the proxy communication range of the agent device 600.

As shown in FIG. 9, the photo service agent unit 630 of the agent device 600 internally initializes, and then the UWB management unit 614 _I sends a beacon and a sub-beacon toward the proxy communication range ( S3010). The first and second terminal apparatuses 300-1 and 300-2 that have received the beacon or the sub-beacon establish an association with the agent apparatus 600, respectively (S3020-1 and S3020-2). In addition, since there is time in establishing the association between the agent device 600 and the terminal device 300, the sub-beacon may not be used.

  When the association is established, the photo service agent unit 630 transmits a photo service advertisement proxy message to the first and second terminal devices 300-1 and 300-2. The photo service advertisement proxy message is the same as the photo service advertisement message described in the first embodiment except that the photo service advertisement proxy message includes information indicating that the own device is performing the photo service advertisement message as a proxy.

  The first and second terminal devices 300-1 and 300-2 that have received the photo service advertisement proxy message transmit a photo service request message to the agent device 600 to request transfer of photos (S3030-1). , S3030-2).

  Note that a communication collision may occur between the first and second terminal apparatuses 300-1 and 300-2 before the processes of steps S3020 and 3030 are completed. Even in such a case, it is sufficient that the processes of steps S3020 and 3030 are completed before the vehicle reaches the communication range 420 of the photographing apparatus 200, and the first and second terminal apparatuses 300-1 and 300-2 are The retry may be repeated as appropriate.

A beacon and a sub-beacon are transmitted from the imaging device 200 to the communication range 420 in a short cycle (S3040). When the agent device 600 enters the communication range 420, the agent device 600 receives the beacon (S3050). UWB manager 624 _E of the agent device 600 which has received the beacon or sub beacon notifies this fact to the photo service agent unit 630. Photo service agent unit 630 having received the notification, using the UWB manager 614 _I, it broadcasts a Wait instruction to the proxy communication range (S3060). The first and second terminal apparatuses 300-1 and 300-2 that have received this Wait command temporarily stop the image data reception process and shift to an image data transfer waiting state (S3070-1, S3070-2). ).

  Since the photo service agent unit 630 of the agent device 600 receives the photo service request message from the first and second terminal devices 300-1 and 300-2, the photo service agent unit 630 associates with the photographing device 200. Establish (S3080). Then, the photo service agent unit 630 generates a photo service request message having its own device as a transmission source, sends it to the photographing device 200, and requests transfer of the photo (S3090). The image capturing apparatus 200 that has received the photo service request message performs image capturing (S3100), and transmits image data of the captured image toward the communication range 420 (S3110).

  At this time, for example, the photographing apparatus 200 has a plurality of subjects existing at predetermined positions with reference to the agent apparatus 600, and the agent apparatus 600 can communicate with each terminal apparatus 300 in association with the position. As a premise, each subject may be photographed for one photo service request message. In addition, the photographing apparatus 200 may cut out one image obtained by photographing the whole for each subject on the above assumption. In such a case, the imaging device 200 transmits the plurality of image data to the agent device 600 in a state in which the image data is associated with the position of the subject. Further, the photographing apparatus 200 may perform a plurality of photographings with respect to each subject at a plurality of different angles and zooming.

  The image data sent to the communication range 420 is not received by the first and second terminal devices 300-1 and 300-2 that are waiting to transfer image data, but only by the agent device 600. In addition, since the destination of the image data is only the agent device 600, the terminal device 300 does not need to newly associate with the photographing device 200, and there is no fear of request collision between the terminals and a delay due to this.

Photo service agent unit 630 of the agent device 600 has completed the reception and storage of the image data, using the UWB manager 614 _I, broadcasts the Wait released proxy communication range (S3120). The first and second terminal devices 300-1 and 300-2 that have received the Wait cancellation resume the image data reception process. Then, the photo service agent unit 630 transfers the image data individually or simultaneously to the first and second terminal apparatuses 300-1 and 300-2 using the respective identification information (S3130). Note that when a plurality of pieces of image data are transmitted from the image capturing apparatus 200 in association with the positions of the subjects, the photo service agent unit 630 sends each image data to the terminal device 300 corresponding to the position. You may make it transmit separately.

  As described above, according to the present embodiment, the agent device 600 that performs the imaging request and the image data reception on behalf of the plurality of terminal devices 300 is arranged. As a result, even when the time for passing through the communication range 420 is short and a plurality of terminal devices 300 can be simultaneously located in the communication range 420, it is possible to perform shooting and image data transfer more reliably, thereby improving the reliability of the system. Can be improved.

  In each of the embodiments described above, application to a case where a subject is on a moving vehicle has been described, but it goes without saying that the present invention can also be applied to a case where the subject does not move much. In such a case, as described above, it is desirable that the shutter timing for photographing can be designated by a user operation.

  In addition, a communication device that operates as a normal UWB piconet controller may be used as the communication system of the imaging device.

  Further, the case where the terminal device is applied to a mobile phone has been described, but the present invention is not limited to this, and has a wireless communication function, particularly a millimeter wave UWB communication function, such as a portable music player and a personal digital assistant (PDA) Of course, it can be applied to various wireless communication terminals.

  An imaging control apparatus, a wireless communication terminal, an imaging system, and an imaging control method according to the present invention can perform image transfer in units of subjects even when many subjects are photographed in a short time. It is useful as a wireless communication terminal, a photographing system, and a photographing control method.

1 is a system configuration diagram showing the configuration of an imaging system according to Embodiment 1 of the present invention. 1 is a block diagram illustrating a configuration of a photographing apparatus according to Embodiment 1. FIG. FIG. 3 is a block diagram showing a configuration of a terminal apparatus according to Embodiment 1. Flowchart showing the operation of the photographing apparatus according to the first embodiment. The flowchart which shows operation | movement of the terminal device which concerns on Embodiment 1. The figure explaining the significance of using the sub beacon in Embodiment 1 FIG. 5 is a diagram illustrating an example of arrangement of shooting ranges and communication ranges in the first embodiment The block diagram which shows the structure of the agent apparatus which concerns on Embodiment 2 of this invention. FIG. 9 is a sequence diagram showing the operation of the imaging system in the second embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Image | photographing system 200 Image pick-up device 210 Lens part 220 Camera function part 230 Image compression part 240, 360 Photo memory part 250, 310, 611 _I , 621 _E antenna part 260, 320, 612 _I , 622 _E UWB-PHY part 270, 330 , 613 _I , 623 _E UWB-MAC unit 280, 340, 614 _I , 624 _E UWB management unit 290 Photo service server unit 300 Terminal device 350 Photo service client unit 370 Operation unit 380 Image expansion unit 390 Photo display unit 391 Liquid crystal display 600 Agent device 630 Photo service agent unit 640 Memory unit

Claims (12)

Photographing including identification information of the wireless communication terminal transmitted from the wireless communication terminal when a wireless communication terminal carried by the user is located in a detection range corresponding to a photographing range of a camera installed at a predetermined location A request receiving means for receiving the request;
Shooting determination means for determining whether a user of the wireless communication terminal is located in the shooting range based on whether or not the shooting request is received;
Photographing control means for causing the camera to perform photographing when the user is located in the photographing range;
Image sending means for sending an image taken by the camera in association with identification information of the wireless communication terminal;
An imaging control apparatus having The image sending means includes
When the user is located in a transmission range corresponding to the shooting range, the image is transmitted to the transmission range by wireless communication.
The imaging control apparatus according to claim 1. The imaging range, the detection range, and the sending range are the same range.
The imaging control apparatus according to claim 2. Command sending means for sending a command signal for commanding the radio communication terminal to send the photographing request toward the detection range;
The imaging control device according to claim 1, further comprising: The image sending means includes
Storing the image in a storage medium in association with the identification information;
Image output means for reading out and outputting an image corresponding to the specified identification information from the storage medium when receiving an image output command specifying the identification information;
The imaging control device according to claim 1, further comprising: The image sending means includes
Send out the image using millimeter wave UWB,
The imaging control apparatus according to claim 2. Request sending means for sending a radiography request including identification information of the own terminal by wireless communication;
Image receiving means for receiving an image sent by the hand associated with the identification information of the own terminal among images sent by a shooting control device that controls shooting of a camera installed at a predetermined place;
Image storage means for storing the image received by the image receiving means;
A wireless communication terminal. Command receiving means for receiving a command signal for commanding transmission of the shooting request from the shooting control device;
The request sending means includes
Sending the shooting request when the command signal is received;
The wireless communication terminal according to claim 7. The image receiving means
Receiving the image using millimeter wave UWB,
The wireless communication terminal according to claim 7. An imaging system comprising: a camera installed at a predetermined location; a wireless communication terminal carried by a user; and an imaging control device that causes the camera to take an image of the user of the wireless communication terminal as a subject;
The wireless communication terminal is
Request sending means for sending a radiography request including identification information of the own terminal by wireless communication;
Image receiving means for receiving an image transmitted in association with the identification information of the terminal among the images transmitted using the millimeter wave UWB from the imaging control device;
Image storage means for storing the image received by the image receiving means,
The photographing control device includes:
Request receiving means for receiving the shooting request sent from the wireless communication terminal when the wireless communication terminal is located in a detection range corresponding to the shooting range of the camera;
Shooting determination means for determining whether a user of the wireless communication terminal is located in the shooting range based on whether or not the shooting request is received;
Photographing control means for causing the camera to perform photographing when the user is located in the photographing range;
Image sending means for sending an image taken by the camera in association with identification information of the wireless communication terminal and sending out using millimeter wave UWB;
Shooting system. Proxy reception means for receiving an image transmitted from the imaging control device on behalf of a plurality of the wireless communication terminals;
An image transfer means for individually transferring an image received by the proxy reception means to the plurality of wireless communication terminals;
The imaging system according to claim 10, further comprising: Photographing including identification information of the wireless communication terminal transmitted from the wireless communication terminal when a wireless communication terminal carried by the user is located in a detection range corresponding to a photographing range of a camera installed at a predetermined place A request receiving step for receiving the request;
A shooting control step for causing the camera to perform shooting when receiving the shooting request in the request receiving step;
An image sending step for sending an image shot by the camera in the shooting control step in association with identification information of the wireless communication terminal;
A shooting control method.

Images