JP2009164817A - Camera system and synthesizing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera system for synthesizing additional images by evaluating an imaging object without any complicated processes. <P>SOLUTION: The camera system includes a distribution terminal 200 for distributing position data and bearing data, a camera 100 for receiving distribution terminal data during the imaging process and recording this data as the data corresponding to image data together with imaging position and imaging direction, and a synthesizing apparatus 300 for storing a plurality of kinds of additional images, selecting the additional images based on the imaging data and distribution terminal data corresponding to the image data obtained by reading process and generating printing data attained by synthesizing the selected additional data to the image data. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a camera system and a synthesizing apparatus that prints image data taken by a photographer with a special effect.

In a facility such as an amusement park or a theme park, a service is known in which an image taken by a visitor is combined with an additional image such as a frame and printed. In order to enhance the added value of such a service, Patent Document 1 discloses that a camera transmits position information to a server each time shooting is performed, and the server randomly selects an additional image based on the sent position information. It is described that providing an amusement property with a high degree of surprise to visitors.
JP 2004-2448037 A

  However, it is generally considered that what is important in the photographed image is not the photographing position but what is being photographed. For this reason, it is desirable to synthesize the additional image based on the photographed object. However, it is difficult to discriminate the photographed object from the photographed image, and the processing becomes complicated, and accuracy cannot be expected.

  The present invention has been made in view of such a situation, and an object of the present invention is to provide a camera system and a composition apparatus suitable for evaluating an object to be photographed and composing an additional image without performing complicated processing. And

  In order to solve the above problems, a camera system according to the present invention includes position information acquisition means for acquiring position information of the own apparatus, direction information acquisition means for acquiring direction information toward the own apparatus, and acquired position information. And a distribution terminal device that distributes the azimuth information as distribution terminal information, a position information acquisition unit that acquires the position information of the shooting position, a direction information acquisition unit that acquires the direction information of the shooting direction, An imaging unit that generates image data, a receiving unit that receives distribution terminal information distributed by the distribution terminal device at the time of imaging by the imaging unit, and the received position information and orientation information as imaging information. A camera having a recording means for recording in association with the image data together with the distributed terminal information, a storage means for recording a plurality of types of additional images, and the recorded image data. The distribution terminal device is arranged from the reading means for reading the image, the distance between the shooting position calculated from the shooting information associated with the read image data and the distribution terminal information, and the distribution terminal device, and the relative direction. A selection unit that determines whether or not the front side of the object is reflected in the image data based on a predetermined criterion, and selects the additional image according to the determination result; and the print that combines the selected additional image with the image data And a synthesizing device including print data generation means for generating data.

  In order to solve the above problems, the synthesizing apparatus according to the present invention provides the distribution terminal information from the distribution terminal apparatus that distributes the position information of the own apparatus and the azimuth information to which the own apparatus is directed as the distribution terminal information at the time of shooting. Reading means for reading image data recorded by a camera that records the position information of the shooting position and the direction information of the shooting direction as shooting information in association with the received distribution terminal information and the image data relating to shooting. , From a storage unit that records a plurality of types of additional images, a shooting position calculated from the shooting information associated with the read image data and the distribution terminal information, and a distance and a relative direction between the distribution terminal device, It is determined whether or not the front of the object on which the distribution terminal device is arranged is reflected in the image data based on a predetermined criterion, and an additional image is selected according to the determination result. Comprising a selection unit, a print data generating unit that generates print data obtained by synthesizing the selected additional image to said image data.

  According to the present invention, the additional image to be combined is selected based on the position information and the direction information from the distribution terminal device and the position information and the direction information at the time of shooting by the camera. Therefore, it is possible to realize a camera system and a synthesizing apparatus suitable for evaluating an object to be photographed and synthesizing an additional image without performing complicated processing.

  Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the drawings. However, the relative arrangement of components and display drawings described in the present embodiment do not limit the scope of the present invention to those unless otherwise specified.

  FIG. 1 is a diagram showing an overview of a camera system according to the present embodiment. As shown in the figure, the camera system can be effectively applied in the facility 700. The facility 700 is typically an amusement facility where a plurality of objects to be photographed, such as an amusement park and a theme park, but is not limited thereto.

  In the facility 700, there are a building A600a, an attraction B600b, and a character C600c as examples of objects to be photographed. Note that examples of these shooting objects may be referred to as shooting objects 600. The direction and position of each object to be photographed are determined. Here, the direction is the front direction of the subject. However, depending on the object to be photographed, the direction may not be a problem. The building A600a is a photographing object whose position and direction are both fixed. The attraction B600b is an object to be photographed that has both a position and direction that change depending on the type, a position that is fixed and the direction changes, and a position that changes and the direction is fixed. The character C600c is a subject to be photographed whose position and direction change freely.

  A distribution terminal device 200 is disposed on each photographing object 600. That is, the distribution terminal device 200a is arranged in the building A600a, the distribution terminal device 200b is arranged in the attraction B600, and the distribution terminal device 200c is arranged in the character C600c. Each distribution terminal device 200 has a front direction set, and is fixedly arranged so as to coincide with the front direction of the corresponding photographing object 600. In addition, the arrow attached | subjected to the imaging | photography target object 600 in the figure has shown the front direction of the imaging | photography target object 600 and the delivery terminal device 200. FIG. The distribution terminal device 200 has a position detection function for detecting a position and an azimuth detection function for detecting a direction in which the own device is facing, and the distribution terminal information including the identification information, the azimuth information, and the position information of the own device in advance. It is distributed by radio signals of a prescribed method.

  A user who is a visitor of the facility 700 uses the camera 100 to photograph the inside of the facility 700. In addition to the normal shooting function, the camera 100 receives a shooting position and shooting direction, and distribution terminal information distributed by the distribution terminal device 200, and receives image data together with shooting information of the shooting position and shooting direction. And a function of recording in the portable storage device 500. The arrow attached to the camera 100 in the figure indicates the shooting direction.

  A service center 620 is provided in the facility 700. The service center 620 includes a composition device 300 and a printer 320. The synthesizing device 300 stores a plurality of types of frames, reads image data from the storage device 500, selects a frame corresponding to distribution terminal information and shooting information associated with the image data, and selects the selected frame. Is generated and output to the printer 320.

  FIG. 2 is a block diagram illustrating the configuration of the camera 100. As shown in the figure, the camera 100 includes a processing device, a memory, and the like, a control unit 11 that controls various processes in the camera 100, a photographing mechanism unit 12 that includes a lens, a CCD, and the like to perform photographing, A display device 13 such as a screen; an image information recording unit 14 that writes image data or the like in a portable storage device 500; a wireless reception unit 15 that receives distribution terminal information from the distribution terminal device 200; and a radio wave from a satellite. It includes a GPS 16 that receives and detects the position of the own device, and an orientation sensor 17 that detects the direction (photographing direction) of the own device.

  The control unit 11 includes an image processing unit 11a that performs processing on an image captured by the imaging mechanism unit 12. Note that the camera 100 may have a communication function with the synthesizing device 300 so that information can be directly exchanged without using the storage device 500. The communication may be wired or wireless.

  FIG. 3 is a block diagram illustrating a configuration of the distribution terminal device 200. As shown in the figure, the distribution terminal device 200 receives a radio wave from a satellite, a control unit 21 that controls processing in the distribution terminal device 200, a wireless distribution unit 22 that distributes distribution terminal information by a radio signal, A GPS 23 that detects the position of the device and an azimuth sensor 24 that detects the orientation of the device itself are provided. However, the distribution terminal device 200 arranged on the photographing object 600 whose position does not change does not need to include the GPS 23, and the set location information of the device itself may be stored. Further, the distribution terminal device 200 arranged on the photographing object 600 whose direction does not change does not need to include the direction sensor 24, and the set direction of the device itself may be stored.

  An identifier is assigned to the distribution terminal device 200 and is recorded in the control unit 21. With this identifier, it is possible to specify which photographing object 600 the distribution terminal device 200 is placed on. The range in which the distribution terminal device 200 distributes the distribution terminal information is desirably set to a distance that is about the shootable range of the shooting target object 600 in which the distribution terminal device 200 is arranged. For example, if the object 600 is large and can be photographed from a distance, the distribution range is set wide. If the object 600 is small and cannot be photographed, the distribution range is set narrow. Of course, all of the distribution terminal devices 200 may be set uniformly or may be variable. The wireless method used for distribution by the distribution terminal device 200 is also adopted by the wireless reception unit 15 of the camera 100, and the camera 100 within the distribution range of the distribution terminal device 200 is distributed by the distribution terminal device 200. It is possible to receive information.

  FIG. 4 is a block diagram illustrating a configuration of the synthesis apparatus 300. As shown in the figure, the synthesizing device 300 includes a processing device, a memory, etc., and a control unit 31 that controls various processes in the synthesizing device 300, and image information reading that reads image data and the like from the portable storage device 500. A unit 32, a frame information storage unit 33 that stores a frame image to be combined with the image data, and a print data output unit 34 that outputs the generated print data to the printer 320. Note that the compositing device 300 may have a communication function with the camera 100 so that information can be directly exchanged without using the storage device 500. The communication may be wired or wireless.

  The control unit 31 includes a frame processing unit 31a that selects a frame according to distribution terminal information and shooting information associated with the image data, and a print data generation unit 31b that generates print data obtained by combining the selected frame and the image data. Is included.

  In the present embodiment, the frames stored in the frame information storage unit 33 are roughly classified into three types: general-purpose frames, frames for photographing objects, and special frames. The general-purpose frame is a frame used when it is determined that the object to be photographed is not captured in the image data, or when it is determined that the subject is far away or not facing the front. Original frame. A plurality of general-purpose frames may be prepared.

  The frame corresponding to the shooting target is a frame used when it is determined that the front of the shooting target is reflected in the image data, and can be a frame related to the shooting target, and is prepared for each shooting target. It is desirable to keep it. Further, a plurality of the same object to be photographed may be prepared.

  The special frame is a premium frame that is used when a special condition is satisfied even when a frame corresponding to the photographing object is used. The special condition can be, for example, limited to a specific shooting time, limited to a specific shooting location, limited to a specific shooting target, or when a predetermined probability is satisfied. In addition, you may make it define the upper limit of the frequency | count of a daily use. By using such a special frame that cannot be easily obtained, entertainment can be further enhanced. Further, the special frame may be common to the photographing object or may be prepared for each photographing object. Of course, the types of frames stored in the frame information storage unit 33 are not limited to three. For example, a special frame and a frame corresponding to a photographing object may be used without using a special frame.

  The synthesizing device 300 stores a correspondence table between the identifier of the distribution terminal device 200 and the shooting target object 600 on which the distribution terminal device 200 is arranged, and the shooting target object 600 is determined from the identifier of the distribution terminal device 200. It can be specified.

  Next, the processing flow of each device in the present embodiment will be described. First, the processing of the distribution terminal device 200 will be described with reference to the flowchart of FIG. As shown in FIG. 5A, the distribution terminal device 200 acquires position information at regular or irregular intervals or by a predetermined trigger (S101). The position information can be acquired using the GPS 23. Also, direction information is acquired (S102). The direction information can be acquired using the direction sensor 24. Then, distribution terminal information including the acquired position information, direction information, and the identifier of the own device is distributed through the wireless distribution unit 22 (S103).

  If the distribution terminal device 200 is placed on the photographing object 600 whose position and direction do not change, the position information (S101a) and the direction information (S102a) are only once at the beginning as shown in FIG. You may make it acquire and distribute delivery terminal information (S103a) repeatedly. In this case, the position information and the azimuth information, which are fixed values, can be obtained by reading out values recorded in advance without using the GPS 23 and the azimuth sensor 24.

  Further, if the distribution terminal device 200 is arranged on the photographing object 600 whose direction is changed but the position is not changed, the position information is acquired only once as shown in FIG. 5C (S101b). You may make it repeat acquisition of azimuth | direction information (S102b), and delivery (S103b) of delivery terminal information. In this case, the position information that is a fixed value can be obtained by reading a value recorded in advance without using the azimuth sensor 24.

  Next, processing of the camera 100 will be described. FIG. 6 is a flowchart for explaining processing of the camera 100. As shown in the figure, the camera 100 waits to accept a shooting instruction from the user (S201). Specifically, the shooting instruction can be a press of a shutter button (not shown). When a shooting instruction is received from the user (S201: Yes), the camera 100 executes shooting and records image data in the storage device 500 (S202).

  At the time of shooting, position information of the shooting location is acquired using the GPS 16 (S203). Further, the orientation sensor 17 is used to acquire the direction of the device itself, that is, the shooting direction (S204).

  Further, it is determined whether or not the distribution terminal information can be received (S205). As a result, when the distribution terminal information cannot be received (S205: No), that is, when the camera 100 is not within the distribution range of any of the distribution terminal devices 200, the reception of the imaging instruction is again waited (S201).

  On the other hand, when the distribution terminal information is receivable (S205: Yes), that is, when the camera 100 is within the distribution range of any of the distribution terminal devices 200, the received distribution terminal information, that is, the distribution terminal device 200 The position information, the direction information, the identifier, and the shooting information acquired by the own apparatus, that is, the position information of the shooting location and the shooting direction are recorded in the storage device 500 in association with the image data (S206). The association between the distribution terminal information and the photographing information and the image data can be performed, for example, by recording each piece of information of the distribution terminal information and each piece of information of the photographing information in a predetermined item of Exif information of the image data. When distribution terminal information is received from a plurality of distribution terminal devices 200, each distribution terminal information is associated with image data. However, any one of the distribution terminal devices 200 may be selected according to reception intensity, reception timing, and the like, and the distribution terminal information may be associated with the image data.

  Next, processing of the synthesis apparatus 300 will be described. FIG. 7 is a flowchart for explaining an outline of processing of the synthesis apparatus 300. When the synthesizing apparatus 300 reads the storage device 500, the synthesizing apparatus 300 identifies image data to be processed and reads the image data (S301). Note that the image data to be processed can be specified by displaying thumbnail images and accepting selection from the user, or by sequentially handling the recorded image data.

  When the image data is read, a frame image is set based on the distribution terminal information and shooting information associated with the read image data (S302). Then, print data of an image obtained by combining the frames set in the image data is generated (S303), and the print data is output to the printer 320 (S304). When the printer 320 executes printing based on the print data, it is possible to obtain a photograph in which frames are combined.

  Here, the setting of the frame image in the process (S302) will be described. FIG. 8 is a flowchart for explaining frame image setting processing. In the frame image setting process, it is determined whether distribution terminal information is associated with the image data to be processed (S401). As a result, if they are not associated with each other (S401: No), it is determined that the object 600 is not captured, and a general-purpose frame is selected (S408).

  On the other hand, when the delivery terminal information is associated (S401: Yes), the delivery terminal information is extracted, and further, the shooting information is also extracted (S402). Then, the positional relationship between the distribution terminal device 200 and the camera 100, specifically, the distance and the facing relationship are calculated from the extracted information. Here, the distance can be calculated from the position information of the distribution terminal device 200 included in the distribution terminal information and the position information at the time of shooting included in the shooting information.

  The face-to-face relationship is used to determine whether or not the object to be imaged 600 appears in the image data. The orientation information of the distribution terminal device 200 included in the distribution terminal information and the direction information at the time of imaging included in the imaging information Calculate from Since it is a face-to-face relationship, it can be obtained by inverting one direction by 180 degrees and calculating the difference from the other direction. That is, if this difference is 0 degree, the object 600 and the camera 100 are facing each other, and the image is taken from the front direction of the object 600, and the image is taken from an oblique direction as the difference increases. Become.

  When the positional relationship is calculated, it is determined whether the calculated distance is a predetermined distance (S404). This is because when the distance from the distribution terminal device 200 is more than a predetermined distance, it is determined that the photographing object 600 on which the distribution terminal device 200 is arranged is not captured. For this reason, when it is not within the predetermined distance (S404: No), a general-purpose frame is selected (S408). However, the calculation and determination of the distance may be omitted assuming that the distribution terminal information is within the range that can be photographed when it has been received.

  If it is within the predetermined distance (S404: Yes), it is further determined whether or not the photographing object 600 on which the distribution terminal device 200 is arranged and the camera 100 at the time of photographing face each other (S405). This determination can be made based on whether or not the difference between the 180 ° reversal of one azimuth indicating the facing relationship calculated in the process (S403) and the other azimuth is within a predetermined value.

  As a result, when it is determined that the shooting target object 600 and the camera 100 at the time of shooting are not facing each other (S405: No), it is determined that the shooting target object 600 on which the distribution terminal device 200 is arranged is not shown. Then, a general-purpose frame is selected (S408).

  On the other hand, if it is determined that the shooting object 600 and the camera 100 at the time of shooting face each other (S405: Yes), it is determined that the front of any shooting object 600 is reflected in the image data. Then, the photographed object 600 is identified (S406). The photographed object 600 can be identified from the identifier of the distribution terminal device 200 included in the distribution terminal information.

  Then, in order to determine whether or not to use a special frame, it is determined whether or not a predetermined special condition is satisfied (S407). As described above, the special condition is, for example, limited to a specific shooting time, limited to a specific shooting location, limited to a specific shooting target, or when a predetermined probability is satisfied. Can do.

  When the special condition is not satisfied (S407: No), a frame corresponding to the shooting target corresponding to the specified shooting target 600 is selected (S410). On the other hand, when the special condition is satisfied (S407: Yes), a special frame having a premium meaning is selected (S410).

  FIG. 9 is a flowchart showing processing when the special condition of the processing (S407) is that shooting is performed within a specific time. The specific time for selecting the special frame is determined in advance. Entertainment can be improved if the specified time is not notified to the user.

  When it is used as a condition that the shooting is performed within a specific time as a special condition, the shooting time of the processing target image data is acquired (S501). The shooting time may be extracted from the Exif information of the image data, but there is no guarantee that the built-in clock of the camera 100 is accurate, and in order to prevent time data tampering by a user who wants a special frame, It is desirable to include time information in the distribution terminal information and acquire the shooting time from the time information of the acquired distribution terminal information.

  Then, it is determined whether or not the acquired shooting time is included in the specific time (S502). As a result, when it is included within the specific time (S502: Yes), it is determined that the special condition is satisfied (S503), and when it is not included within the specific time (S502: No), it is determined that the special condition is not satisfied (S502: No). S504).

  FIG. 10 is a diagram for explaining the composition of frames to be photographed. Here, for simplicity, the special frame is not considered. An image 350 shows an example of a frame corresponding to a character 600x that is a shooting target on which the distribution terminal device 200 is arranged. Here, for the image in which the front of the character 600x is shown as shown in the image 352, an image in which the frame image 350 corresponding to the character 600x is combined as shown in the image 354 is generated.

  FIG. 11 is a diagram for explaining the synthesis of the general-purpose frame. The image 360 shows an example of a general-purpose frame that is used when the front of the object to be photographed is not shown. Here, as shown in the image 362, for the image in which the building 600y is shown but is not in front, an image in which the general-purpose frame image 360 is combined as shown in the image 364 is generated.

  In addition, when the place where the camera 100 has shot is within the distribution range of the plurality of distribution terminal devices 200, for example, as illustrated in FIG. 12, the camera 100 includes the distribution range 220x of the distribution terminal device 200x and the distribution terminal device. When shooting is performed in an area where the 200y distribution range 220y overlaps, both pieces of distribution information are received and recorded.

  In such a case, the synthesizing apparatus 300 selects any distribution terminal apparatus 200 and sets a frame according to a predetermined standard. Predetermined criteria are, for example, those that face each other than (1), those that are closer than (2), (3) those that have a higher evaluation value by evaluating the distance and direction with a predetermined evaluation formula, etc. be able to. However, a frame may be set for all of the distribution terminal devices 200 that have received the distribution information, and the frames may be overlapped.

  In addition, the camera 100 may be provided with an inclination angle sensor, and it may be determined whether or not the photographing object 600 is reflected in the image data in consideration of the inclination angle. Further, it may be determined whether or not the photographing object 600 is reflected in the image data in consideration of the focal length when photographing with the camera 100. As a result, it is possible to improve the accuracy of determining whether or not the photographing object 600 is reflected in the image data.

It is a figure which shows the outline | summary of the camera system which concerns on this embodiment. It is a block diagram which shows the structure of a camera. It is a block diagram which shows the structure of a delivery terminal device. It is a block diagram which shows the structure of a synthesizing | combining apparatus. It is a flowchart for demonstrating the process of a delivery terminal device. It is a flowchart for demonstrating the process of a camera. It is a flowchart for demonstrating the outline | summary of a process of a synthesizing | combining apparatus. It is a flowchart for demonstrating the setting process of a frame image. It is a flowchart which shows the process at the time of making it the conditions that it is imaging | photography within specific time as special conditions. It is a figure for demonstrating the synthesis | combination of an imaging | photography target object corresponding | compatible frame. It is a figure for demonstrating the synthesis | combination of a general purpose frame. It is a figure which shows the case where the place which the camera image | photographed is in the delivery range of a some delivery terminal device.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 ... Control part, 11a ... Image processing part, 12 ... Imaging | photography mechanism part, 13 ... Display apparatus, 14 ... Image information recording part, 15 ... Wireless reception part, 16 ... GPS, 17 ... Direction sensor, 21 ... Control part, 22 ... Wireless distribution unit, 23 ... GPS, 24 ... Direction sensor, 31 ... Control unit, 31a ... Frame processing unit, 31b ... Print data generation unit, 32 ... Image information reading unit, 33 ... Frame information storage unit, 34 ... Print data Output unit 100 ... Camera 200 ... Distribution terminal device 300 ... Composition device 320 ... Printer 500 ... Storage device 600 ... Photographing object 620 ... Service center 700 ... Facility

Claims (2)

Position information acquisition means for acquiring position information of the own apparatus, direction information acquisition means for acquiring direction information that the own apparatus is facing, and distribution means for distributing the acquired position information and direction information as distribution terminal information A distribution terminal device provided;
Position information acquisition means for acquiring position information of the shooting position, direction information acquisition means for acquiring direction information of the shooting direction, shooting means for generating image data, and the distribution terminal device at the time of shooting by the shooting means A camera comprising: receiving means for receiving distribution terminal information to be distributed; and recording means for recording the acquired position information and orientation information as shooting information in association with the received distribution terminal information in association with the image data;
Storage means for recording a plurality of types of additional images, reading means for reading the recorded image data, photographing position and distribution calculated from the photographing information associated with the read image data and the distribution terminal information Based on the distance from the terminal device and the relative direction, it is determined whether or not the front side of the object on which the distribution terminal device is arranged is reflected in the image data, and an additional image is selected according to the determination result. A combining device comprising: selecting means; and print data generating means for generating print data obtained by combining the selected additional image with the image data;
A camera system comprising: At the time of shooting, the distribution terminal information is received from the distribution terminal device that distributes the position information of the own device and the direction information to which the own device is directed as the distribution terminal information, and the position information of the shooting position and the direction information of the shooting direction Reading means for reading image data recorded by a camera that records the image information in association with the received distribution terminal information and image data related to shooting,
Storage means for recording multiple types of additional images;
From the distance and relative direction between the shooting position calculated from the shooting information associated with the read image data and the distribution terminal information and the distribution terminal device, the front of the object on which the distribution terminal device is arranged is Selecting means for determining whether or not the image data is reflected by a predetermined criterion, and selecting an additional image according to the determination result;
A synthesizing apparatus comprising: print data generating means for generating print data by synthesizing the selected additional image with the image data.