JP4750158B2 - Shooting support device - Google Patents

Description

The present invention relates to a photographing support device, and more particularly to a photographing support device that is mounted on a camera owned by a photographer and supports photographing of a target subject.

Regarding photographing support for a subject, Japanese Patent Laid-Open No. 2004-228561 discloses that the quality of a photographing state is evaluated from image data obtained by imaging a subject from a spatial frequency component of the image data, and the result of the quality evaluation is displayed in a viewfinder. There has been disclosed a technique for guiding a shooting state to a better one by displaying on a monitor screen and feeding back to a user who is shooting with good timing.

JP 2000-209468 A

However, the photographing support described in Patent Document 1 is based on the premise that the subject is within the photographed image frame corresponding to the photographing range, and cannot be applied when the subject deviates from the photographed image frame. In particular, for example, in the case where shooting is performed using a subject of an arbitrary competition held in a stadium (for example, baseball, soccer, athletics, etc.), it is difficult for the photographer to shoot close to the subject, In general, shooting is performed at a high magnification. However, since the subject is moving, the subject easily deviates from the captured image frame, and there is a problem that skill is required to properly capture the subject.

The present invention has been made in consideration of the above facts, and an object of the present invention is to obtain a photographing support apparatus that can support photographing by a photographer so that a target subject is within a photographed image frame .

In order to achieve the above object, a photographing support apparatus according to a first aspect of the present invention is a photographing support apparatus mounted on a camera possessed by a photographer, and is a portable transmitter possessed by a target subject . When a communication or IC tag in which the target object is in possession of the provided base station at regular intervals and communicate with the IC tag sensor provided at regular intervals, and the camera that is possessed to the photographer the communication or the photographer with the base station with the IC tag carried by the communication with the IC tag sensor, is detected by the management apparatus by, from the management device periodically notified, the position and the camera of the target object Based on the receiving means for receiving the position, the detecting means for detecting the shooting direction of the camera, and the position of the target subject and the position of the camera received by the receiving means, the photographer A shooting direction calculating means for calculating a target shooting direction for shooting the target subject by the camera, and comparing a shooting direction detected by the detecting means with a target shooting direction calculated by the shooting direction calculating means; A determination unit that determines whether or not the target subject is within a captured image frame that represents a shooting range of the camera, and the determination unit determines that the target subject is not within the captured image frame; A change direction calculation means for calculating a change direction of the shooting direction for placing the target subject in the shot image frame, and a change direction of the shooting direction calculated by the change direction calculation means are displayed on the display unit of the camera. Change direction notifying means.

The photographing support apparatus according to the first aspect of the present invention is mounted on a camera possessed by the photographer. Further, according to the invention of claim 1, wherein a constant spacing communication or the IC tag target subject is in possession of the base station provided in the transmitter and a certain distance of the portable target subject is in possession And the communication between the camera and the base station possessed by the photographer, or the communication between the IC tag and the IC tag sensor possessed by the photographer, The position of the camera is detected by the management apparatus , the receiving means receives the position of the target subject and the position of the camera that are periodically notified from the management apparatus, and the detection means detects the shooting direction of the camera. The photographing direction calculating means calculates a target photographing direction for the photographer to photograph the target subject with the camera based on the position of the target subject and the position of the camera received by the receiving means, and the determining means detects The shooting direction detected by the means is compared with the target shooting direction calculated by the shooting direction calculation means, and it is determined whether or not the target subject is within the shot image frame representing the shooting range of the camera. The change direction calculation means calculates a change direction of the shooting direction for placing the target subject in the shot image frame when the determination means determines that the target subject does not fit in the shot image frame. The direction notification unit displays the change direction of the photographing direction calculated by the change direction calculation unit on the display unit of the camera.

With the above configuration, in the first aspect of the present invention, when it is determined that the target subject does not fit within the captured image frame, the change direction of the photographing direction for placing the target subject within the captured image frame is the display unit of the camera. By referring to the change direction of the shooting direction displayed on the display unit, the photographer immediately recognizes the change direction of the shooting direction for placing the target subject in the shot image frame, It is possible to quickly change the posture of the camera (shooting direction) so that the target subject is within the shot image frame. Therefore, according to the first aspect of the present invention, it is possible to support photographing by the photographer so that the target subject is within the photographed image frame.

Further, in the first aspect of the present invention, as described in the second aspect, when the determination unit determines that the target subject is within the captured image frame, the reception unit receives the target subject. Based on the position of the target subject and the position of the camera, the distance between the camera and the target subject is calculated, and the size of the target subject in the captured image frame is set to a predetermined size based on the calculated distance. Preferably, there is further provided a photographing magnification calculating means for calculating the photographing magnification of the camera and a photographing magnification changing means for changing the photographing magnification of the camera in accordance with the photographing magnification calculated by the photographing magnification calculating means.

According to the second aspect of the present invention, when the determination unit determines that the target subject is within the captured image frame, the imaging magnification calculation is performed based on the target subject position and the camera position received by the reception unit. The distance between the camera and the target subject is calculated by the means, and the shooting magnification of the camera for setting the size of the target subject within the captured image frame to a predetermined size is calculated based on the calculated distance. The photographing magnification changing means changes the photographing magnification of the camera in accordance with the photographing magnification calculated by the photographing magnification calculating means, so that the target subject within the photographed image frame is further increased to a predetermined size within the photographed image frame. Thus, the photographing by the photographer can be supported.

Further, in the invention described in claim 1 or 2, the change direction notifying means is calculated by the change direction calculating means on the display unit of the camera possessed by the photographer, as described in claim 3, for example. Further, an arrow indicating the change direction can be displayed as the change direction of the shooting direction. This makes it possible for the photographer to intuitively understand the change direction of the shooting direction calculated by the change direction calculation means.

As described above, the present invention receives the position of the target subject and the position of the camera that are detected by the management device and periodically notified, detects the shooting direction of the camera, and the photographer uses the camera to detect the target subject. The target shooting direction for shooting is calculated, the shooting direction of the camera is compared with the target shooting direction, it is determined whether the target subject is within the shooting image frame representing the shooting range by the camera, and the target subject is shot. When it is determined that it does not fit within the image frame, it calculates the change direction of the shooting direction to fit the target subject within the shot image frame, and displays the calculated change direction of the shooting direction on the display unit of the camera. It has an excellent effect that it is possible to assist the photographer in shooting so that the target subject is within the shot image frame.

Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings. Hereinafter, prior to the description of the embodiment of the present invention, a comparative example of the present invention will be described first.

[ First Comparative Example ]
FIG. 1 shows an image ordering system 10 according to the first comparative example . In the first comparative example , for example , in an arbitrary shooting location such as a sightseeing spot, a theme park, an event venue, or a park, the photographer 12 takes an image of an arbitrary person present on the spot as a subject. In the image ordering system 10 according to the first comparative example , a person (customer 16) photographed as a subject in the above photographing orders a photographed image (specifically, the creation of a photographic print is ordered, or image data of the photographed image) It is a system that makes it possible to order delivery of

  That is, the image ordering system 10 includes an order processing device 24 according to the present invention. The order processing device 24 also has a function as an image identification device according to the present invention. The order processing device 24 is composed of a computer such as a workstation, and a CPU 24A, ROM 24B, RAM 24C, and input / output port 24D are connected to each other via a bus 24E, and a communication control device (for example, a modem or a router) 26 is connected to the input / output port 24D. A driver 28 and a hard disk device (HDD) 30 are connected to each other.

  The HDD 30 of the order processing device 24 is preinstalled with an image ordering program for executing image ordering processing (details will be described later) according to the present invention by the CPU 24A of the order processing device 24, and the CPU 24A executes the image ordering program. Thus, the computer constituting the order processing device 24 functions as the order processing device according to the present invention.

  A cameraman 12 who captures an image that can be ordered via the image ordering system 10 uses a digital still camera 14 (with a GPS function for detecting the current position and a timekeeping function for detecting the current date and time using the GPS system). Hereinafter, DSC 14 is possessed, and photographing is performed using this DSC 14. Each time the photographer 12 takes a photograph, the photographed image data and other information are recorded by the DSC 14 on the recording medium 20 (for example, SmartMedia®, CompactFlash®, Memory Stick®, etc.), and the media driver 28 Reads out information such as photographed image data from the recording medium 20 brought in by the cameraman 12.

  The communication control device 26 of the order processing device 24 is connected to the communication network 32. The communication network 32 includes a mobile phone network and a public telephone network, and is configured to include a high-speed and large-capacity dedicated communication network or a computer network such as the Internet, and a part of the mobile phone network. A number of base stations 34 to be configured are connected. The communication network 32 includes a computer (PC) 38 owned by a large number of print finishers 36 nationwide, a plurality of order receiving terminals 42, and a computer (PC) owned by the customer 16 of the image ordering system 10. 48 and the location information service center 50 of the mobile phone company are connected to each other.

  The print finisher 36 is a digital print system 40 comprising a device such as a film scanner for reading an image recorded on photographic film, a digital printer for performing a print finishing process for recording an image represented by image data on a recording material such as photographic paper. Possess. The digital print system 40 is connected to the PC 38 and can perform print finishing processing using image data received by the PC 38 via the communication network 32.

  The order receiving terminal 42 is a terminal for receiving orders from customers, and may be an arbitrary place (near the place where the photographer 12 is taking a picture, or a place unrelated to the taking place (for example, a convenience store or DPE). It may be installed in a store). The order receiving terminal 42 includes a display 44 made of a CRT, LCD or the like and capable of displaying images and the like, and an input unit 46 including a keyboard and the like for a customer to input arbitrary information. It also has a function of communicating with the order processing device 24 via

In the first comparative example , the customers of the image ordering system 10 (customers to be photographed by the cameraman 12) each have a mobile phone 18 and subscribe to a location information service provided by the mobile phone company. . In this location information service, the location information service center 50 determines the location of the mobile phone 18 by communication between the mobile phone 18 carried by the customer (for example, a PHS (Personal Handy-phone System) mobile phone) and the base station 34. A service that periodically recognizes the current position of the customer by searching (determining the nearest base station 34 of the mobile phone 18) and notifying a third party of the recognized current position for each individual customer. In the first comparative example , the current position of each customer is regularly notified from the position information service center 50 to the order processing device 24.

Next, the operation of the first comparative example will be described. In the first comparative example , the cameraman 12 is held at a certain position in the above-described arbitrary shooting location or waiting for the arrival of a person as a subject while hesitating the vicinity, and possesses the person when the person arrives. It repeats photographing the person who arrives using DSC14. The DSC 14 possessed by the cameraman 12 detects the current position by the GPS function every time shooting is performed, and also detects the current date and time by the timekeeping function, and the detected current position and current date and time are obtained as shooting location information and shooting. The position information is recorded on the recording medium 20 in association with the photographed image data obtained by photographing.

  The cameraman 12 sends the recording medium 20 to the management center in which the order processing apparatus 24 is installed at the timing when a certain number of images are taken or the day of shooting is finished. Is set in the media driver 28 of the order processing device 24.

  In the order processing device 24, when the recording medium 20 is set in the media driver 28 or when some information is received from the outside (location information service center 50, order receiving terminal 42, etc.), the image ordering process shown in FIG. . In this image ordering process, in step 100, the type of input information is determined. If the recording medium 20 is activated when the media driver 28 is set, the input information is determined to be photographed image data, and the process proceeds to step 102.

In step 102, single photographic image data is read from the recording medium 20, and in the next step 104, shooting date / time information and shooting location information stored in association with the photographic image data read in step 102 are read . At step 106 with its, in the image DB provided in the HDD 30, the captured image data read in step 102, Ru is stored in association with the photographing date and time information and the photographing location information read out in step 104.

  In the next step 108, it is determined whether or not all photographed image data recorded on the recording medium 20 has been stored in the image DB. If the determination is negative, the process returns to step 102, and steps 102 to 108 are repeated until the determination of step 108 is affirmed. If the determination at step 108 is affirmed, the image ordering process is terminated. By performing the above process every time the recording medium 20 is received from the photographer 12, as shown in the following Table 1, the image DB stores photographed image data and photographing date / time information for all images photographed by the photographer 12. In addition, the shooting location information is recorded.

  Note that the captured image data, the shooting date / time information, and the shooting location information are not limited to being acquired via the recording medium 20 as described above. For example, communication such as a mobile phone possessed by the cameraman 12 is possible. For example, every time shooting is performed, a predetermined number of shootings are performed, or at the end of one day of shooting, the photographed image data, shooting date information, and shooting location information are transmitted to the order processing device 24 by the device. Needless to say, you can.

  Next, collection of movement histories of individual customers will be described. As described above, each customer of the image ordering system 10 has the mobile phone 18 and subscribes to the location information service provided by the mobile phone company, and the customer is sent from the location information service center 50 to the order processing device 24. The current position of is regularly notified. When notifying the customer's current location, in addition to the location information indicating the customer's current location, information for specifying the customer (for example, a customer number uniquely assigned to each customer by the mobile phone company) Will be notified at the same time.

  In the order processing device 24, the image ordering process is activated also when information notifying the current position of the customer is received from the position information service center 50. In this case, the process proceeds from step 100 to step 110. In step 110, the current date and time updated / held by the time measuring function of the order processing device 24 is read.

  In step 112, based on the information received from the location information service center 50 for identifying the customer, the customer ID of the customer to be notified (ID uniquely assigned to each customer by the image ordering system) Judging. The customer ID is determined by, for example, storing in the HDD 30 a table in which information for identifying a customer transmitted from the location information service center 50 is registered in association with the customer ID for each individual customer. This table can be searched by using this information as a key. Then, in the customer movement information DB provided in the HDD 30, the position information received from the position information service center 50 and the date / time information indicating the current date / time read in step 110 are used as movement history information corresponding to the previously determined customer ID. The image ordering process is terminated.

  By performing the above processing every time the current position of each customer is notified from the location information service center 50, as shown in the following Table 2, the customer movement information DB has a movement history in units of individual customers. A plurality of pieces of information (a set of date information and position information indicating the position of the customer at a certain date and time) are stored, and by referring to the movement history information group stored in the customer movement information DB, each customer's It is possible to determine the movement history.

Next, a case where the customer 16 orders an image obtained by photographing by the cameraman 12 will be described. In the first comparative example , an order receiving terminal 42 is installed as a terminal for receiving an order from the customer 16. When ordering an image using the order reception terminal 42, the customer 16 inputs a customer ID via the input unit 46 to request the order processing device 24 to order an image in which the customer 16 is reflected as a subject. To do.

  In addition, a customer card or the like in which the customer ID of each customer is recorded is distributed to each customer in advance, and a card reader or the like for reading the customer ID from the customer card is provided in the order reception terminal 42 to place an order. Sometimes, the customer ID may be automatically input to the order receiving terminal 42 by inserting a customer card possessed by the customer into the card reader. For example, an IC tag that records information such as a customer ID of each customer is added to a customer card possessed by the customer, and an IC tag sensor that reads information from the IC tag is provided in the order reception terminal 42. In addition, when the customer arrives at the place where the order reception terminal 42 is installed, by configuring the IC tag sensor to read information such as the customer ID from the IC tag attached to the customer card etc. possessed by the incoming customer, An incoming customer may be automatically recognized without causing the customer to input a customer ID or inserting a customer card into a card reader.

In the first comparative example , the image order by the customer 16 can be performed using the mobile phone 18 or the PC 48 possessed by the customer 16 in addition to using the order receiving terminal 42. For ordering using the mobile phone 18 or the PC 48, for example, a predetermined web page prepared in advance for image ordering and held in a predetermined web server is accessed, and a predetermined part is displayed on the display unit of the mobile phone 18 or the display of the PC 48. This can be done by inputting a customer ID in a customer ID input field provided on a predetermined web page in a state where the web page is displayed.

  When the customer 16 performs an operation for ordering an image as described above, information requesting the order of the image is transmitted from the order reception terminal 42, the mobile phone 18 or the PC 48 to the order processing device 24 together with the customer ID. In the processing device 24, the image ordering process is activated. In this case, the process proceeds from step 100 to step 114. In step 114, the customer movement information DB is searched using the received customer ID as a key, and all of the customer movement history information corresponding to the received customer ID is extracted from the customer movement information DB.

In step 116, single movement history information (a set of position information and date / time information) is extracted from the movement history information group extracted in step 114. In the next step 118, the movement history information extracted in step 116 is extracted. It is stored in the image DB to collate with the shooting date / time information and shooting location information stored in the image DB in association with the shot image data to determine whether the date / time and the location are substantially the same. By performing the processing for all the photographed image data, it is determined whether or not photographed image data in which the photographing date and time and the photographing place substantially coincide with the position and date and time represented by the movement history information extracted in step 116 is stored in the image DB. Search for. When the captured image data that matches the search condition is present in the image DB is you temporarily stored in RAM24C like reads the captured image data from the image DB.

  In the next step 120, it is determined whether or not the above processing has been performed on all the movement history information extracted in step 114. If the determination is negative, the process returns to step 116, and steps 116 to 120 are repeated until the determination of step 120 is affirmed. As a result, all the captured image data of the image that is likely to be the subject of the customer requesting the image order is extracted.

If the determination in step 120 is affirmative, the process proceeds to step 122, and the image represented by each captured image data is displayed in an index display (reduced and arranged in a matrix) using the captured image data extracted by the search in step 118. ) To generate index image data representing the image, and by transferring the generated index image data to the order requesting device (order receiving terminal 42 or mobile phone 18 or PC 48), the display unit ( display 44 of the order receiving terminal 42, or the display unit of the mobile phone 18, or PC48 display) to Ru display the index image.

  The order processing device 24 also displays a message for requesting the customer 16 to select an image to be ordered together with the index image on the display unit of the order request source device. It is determined whether or not an image has been selected by the customer 16 and waits until the determination is affirmed. The customer 16 refers to the index image displayed on the display unit of the order requesting apparatus. Each of the individual images displayed as the index images is an image with a high possibility that the customer 16 is a subject, so that the customer 16 can easily find the image he / she wants to order. Then, the customer 16 operates the input unit (the input unit 46 of the order receiving terminal 42, the operation key of the mobile phone 18, or the keyboard of the PC 48) of the order request source device to select an image to be ordered, The order type for the selected image (whether it is photo print creation or image data transfer of the photographed image) is also instructed at the same time.

  When the order type is “photo print creation”, the “number of prints” and “print receiving method” (for example, whether the customer 16 wants to deliver to the home or receives at the nearest convenience store) It is specified. When the order type is “image data delivery”, information for specifying the destination of the image data to be ordered (for example, the mail address of the customer 16) is also designated.

  If the image to be ordered is selected by the customer 16, the determination at step 124 is affirmed and the routine proceeds to step 126, where the order content by the customer 16 is determined. If the order by the customer 16 is “photo print creation”, the process proceeds to step 128. In step 128, the most suitable print order for the current print order from among a large number of print finishers 36, based on the "print receiving method" received from the order requesting device, the customer address specified from the customer ID, and the like. The selected print finisher 36, the photographed image data of the image selected as the order object by the customer 16, the information indicating the order contents designated by the customer 16, and the customer ID of the customer 16 are selected by the selected print finisher 36. By transmitting to the PC 38, a print order from the customer is placed.

  The print finishing contractor 36 having received the above information by the PC 38 via the communication network 32 uses the received photographed image data to obtain a photograph of the size specified by “print size” in the information indicating the received order contents. Only the number of prints specified by the “number of prints” is created, and the created photo prints are delivered to a predetermined destination so that the photo prints can be received by the customer 16 by the receiving method specified by the “print receiving method”. . As a result, the customer 16 can receive a photo print of an image selected as an order target (an image in which the customer 16 is captured as a subject) under conditions (size, number of sheets, and receiving method) that match the specified order contents. it can.

If the order by the customer 16 is “delivery of image data”, the process proceeds from step 126 to step 130, and the captured image data of the image selected as the order object by the customer 16 is sent to the transmission destination designated by the customer 16. Send to. As a result, the customer 16 can receive photographed image data of an image selected as an order target (an image in which the customer 16 is captured as a subject) via the PC 48 and the mobile phone 18. Incidentally, when delivering the captured image data to the customer 16, predetermined image processing but it may also be performed (e.g. scaling, cropping, image processing for improving image quality).

In the first comparative example described above, when a customer ID is specified, a case where an image having the customer 16 corresponding to the customer ID as a subject is searched is described. However, the present invention is not limited to this. When the processing device 24 is in a standby state where no information is received from the outside, the order processing device 24 sets the shooting date and time and the shooting location stored in the image DB in association with individual shot image data. Each person may be identified as a subject in the image represented by each captured image data (the subject is one of many customers 16) by collating with the movement history information.

In the first comparative example described above, the case where the movement history of each customer is acquired using the location information service provided by the mobile phone company is not limited to this. in, is carrying the portable equipment which GPS function is mounted, which detects the current position using at least GPS system, GPS function of the mobile device is generated by detecting the current position at predetermined time intervals each You may make it acquire the movement history of a customer. In this aspect, as a movement history acquisition method, for example, a method of acquiring movement history by periodically transmitting movement history information from a portable device possessed by each customer to the order processing device 24 is adopted. Alternatively, for example, when a customer places an order via the order reception terminal 42, etc., a method is adopted in which the movement history information stored and stored in the portable device is read by the order reception terminal 42, etc. It is also possible to do.

In addition, when the range in which the photographer 12 performs shooting is limited to a certain area such as a theme park or a park, for example, in the same area as in the second comparative example described below, for example. In addition, each customer existing in the site possesses a transmitter that transmits a signal including a predetermined ID (this transmitter can also be embedded in an entrance ticket to a certain area) and is transmitted from the transmitter. A large number of base stations that receive signals are provided in the fixed area at substantially regular intervals, and the current position of each customer is determined by determining which base station is receiving the signal transmitted from each customer. The movement history of each customer may be acquired by repeating the detection every predetermined time.

Further, in the first comparative example , the case where the shooting location and the shooting date / time are detected by the GPS function and the time counting function mounted on the DSC 14 possessed by the cameraman 12 has been described. In a case where the number of base stations is limited to within, as in a second comparative example described below, a large number of base stations are provided in the constant area at substantially constant intervals, and image IDs for identifying individual captured images at the time of shooting Is transmitted from the DSC 14 to the base station, and on the order processing device 24 side, the base station receives the signal as well as detecting the shooting location by determining which base station has received the signal. The shooting date and time may be determined by determining the date and time, and may be stored in the image DB or the like in association with the received image ID.

Further, in the first comparative example , the example in which the order processing device 24 collects the movement history of each customer and accumulates and stores it in the customer movement information DB has been described, but the present invention is not limited to this. The information indicating the customer's own movement history input based on the customer's memory without collecting the customer's movement history (for example, “going to △ month × day”): (Corresponding to the “person movement history”) is compared with the shooting date and the shooting location of the individual shot image data, thereby searching for an image that is likely to be the subject of the customer. Good.

Further, in the first comparative example , an image having a high possibility that the customer is a subject is extracted based only on date / location and location matching. However, the corresponding image is extracted using other information. It may be. For example, let the customer input the color of the clothes of the day, and extract an area (face area) that is estimated to correspond to the customer's face by a known face area extraction process for the image extracted by collating the date and time, Based on the position and size of the extracted face area, an area (torso area) that is estimated to correspond to the customer's torso part is determined, and the color of the torso area matches or resembles the color of clothes input by the customer It is also possible to narrow down images that are likely to be the subject of the customer by performing the process of determining whether or not the image is present.

Furthermore, in the first comparative example , when there is an order request from a customer, the photographed image data of an image that is likely to be the subject of the customer requesting the image order is extracted, and the order request source However, the present invention is not limited to this, and a certain person (customer himself or a person registered in advance by the customer) can be a subject without waiting for an order request from the customer. and the image is extracted to the customer but it may also be automatically performed to be distributed via a communication network such as the Internet to to have a mobile phone 18 and the PC48 possession. Also, at this time it is desirable that the customer is also attached program for ordering the image.

  According to the above aspect, for example, when a customer goes to a specific facility such as a tourist spot, a theme park, an event venue, a park, etc., when the photographer 12 takes a photograph of the customer as a subject, the photographer then obtains the photograph. The received image and the program are attached to an e-mail or the like and transmitted (distributed) to the mobile phone 18 or PC 48 possessed by the customer, and when the customer who recognizes the incoming e-mail opens the attached file, the image is taken. The image obtained by the above is displayed on the display unit, and then the program is executed, whereby a message prompting the customer to place an order is displayed, and the customer can order the distributed image. In the above aspect, since the images are distributed to the customer's mobile phone 18 and the PC 48, it is possible to increase the chance of ordering images by the customer.

  In the above aspect, the image to be distributed is not limited to the index image arranged in a matrix by reducing the still image described above, and may be distributed after being edited into a screen configuration like an album. , Synthesize data such as images, characters, audio, text, etc. (for example, explanation messages about shooting date and time, shooting location, decoration of images such as border decorations, adding advertisements, etc.), special processing (for example, blurring, watercolor / For example, an oil-painted image, monochrome image, etc., moving image data may be added, or a plurality of still images may be sequentially reproduced and displayed on the display unit at predetermined time intervals like a slide show. Good. In addition, an image (character, voice, text, etc. to be combined with the image to be distributed, a moving image to be added to the image to be distributed, etc., was taken at the shooting date and time or at the shooting location (this event is It may be selected according to the shooting date and time (which can be determined from the shooting location) (for example, if the shooting location is in a specific theme park, a video that synthesizes an image character of a specific theme park or advertises a specific theme park) Add an image). Further, the image to be distributed may be a moving image. When a moving image is distributed, the image may be distributed after being edited in a screen configuration like a commemorative movie. It is preferable that the data to be distributed is also a moving image). In addition, the customer may be able to select in advance whether or not the image is subjected to data synthesis and special processing, and whether or not the image is illustrated. By processing the distribution image as described above, it is possible to improve the entertainment of the image distribution and increase the willingness to order the image by the customer.

[ Second Comparative Example ]
Next, a second comparative example of the present invention will be described. In addition, the same code | symbol is attached | subjected to the part same as a 1st comparative example, and description is abbreviate | omitted. FIG. 3 shows an image ordering system 11 according to the second comparative example . In the second comparative example , in the stadium 52 where an arbitrary game (for example, baseball, soccer, track and field, etc.) is held, the photographer 12 takes a picture of the player 17 as a subject. The image ordering system 11 according to the second comparative example is a system that enables the customer 16 to order an image obtained by the above photographing.

Each player 17 as a subject in the second comparative example has a transmitter 19 that constantly transmits a predetermined signal including a player ID for identifying each player 17. The transmitter 19 is embedded in, for example, a uniform, a bib, or shoes so as not to hinder the competition of the player 17. A large number of position sensors 35 that receive signals transmitted from the transmitter 19 are embedded in the basement of the stadium 52 at regular intervals (for example, intervals of about several meters). A number of position sensors 35 are connected to the external I / F unit 29 of the order processing device 24.

In the second comparative example , the cameraman 12 possesses a digital still camera (DSC) 15 having a built-in transmitter that constantly transmits a predetermined signal including the camera ID, like the transmitter 19 described above. Yes. The aforementioned position sensor 35 also receives a signal transmitted from the DSC 15. The DSC 15 also has a function of wirelessly communicating with the external I / F unit 29 of the order processing device 24, and a function of detecting a shooting direction and a shooting magnification.

Furthermore, the image ordering system 11 according to the second comparative example includes an electronic signboard 43 installed in a place such as the vicinity of the entrance / exit of the stadium 52 instead of the order receiving terminal 42 described in the first comparative example . . The electronic signboard 43 also includes a large-screen display 44 capable of displaying images and the like, and an input unit 46 including a keyboard for a customer to input arbitrary information, and the order processing device 24 via the communication network 32. It also has a communication function.

Next, the operation of the second comparative example will be described. When the competition by the athlete 17 is started in the stadium 52, the photographer 12 takes a picture of the athlete 17 while moving in the stadium 52. During this time, the transmitter 19 possessed by the athlete 17 and the DSC 15 possessed by the cameraman 12 always transmit a predetermined signal, and the transmitted signal is present at a position closest to the current position of the athlete 17 or the cameraman 12. Received by the position sensor 35.

The HDD 30 of the order processing device 24 is provided with a subject movement information DB in place of the customer movement information DB described in the first comparative example , and the order processing device 24 transmits from the transmitter 19 of each competitor 17. The current position of each player 17 is detected by constantly determining which of the position sensors 35 provided with a large number of received signals, and the detected current position is associated with date / time information indicating the current date / time. In addition, storing in the subject movement information DB as subject position information is repeatedly performed in a predetermined cycle.

Na us, for the positions of the individual photographer 12 (and DSC15), may be accumulated as always detected information as above.

Next, image order processing executed by the order processing apparatus 24 according to the second comparative example will be described with reference to the flowchart of FIG. In step 150, it is determined whether or not the competition at the stadium 52 has ended. When determination is denied, it transfers to step 152 and it is determined whether imaging information was received from DSC15 of the photographer 12. FIG. If the determination is negative, the process returns to step 150, and steps 150 and 152 are repeated until either determination is affirmed.

The DSC 15 according to the second comparative example detects a shooting direction and a shooting magnification when shooting is performed by the cameraman 12 (shooting the athlete 17 as a subject), and a shooting magnification is detected. The information and the photographing magnification information indicating the detected photographing magnification are transmitted to the order processing device 24 together with the photographed image data obtained by photographing. When the above information (referred to as imaging information) is received via the external I / F unit 29, the determination at step 152 is affirmed and the routine proceeds to step 154. Note that the shooting direction can be detected by using, for example, a gyro (any of various types such as a mechanical type, an optical type, a fluid type, and a vibration type) or by detecting geomagnetism.

In step 154, based on which position sensor 35 out of a number of position sensors 35 has received a predetermined signal transmitted from the DSC 15 that has transmitted the shooting information, the current position (shooting position of the cameraman 12 and DSC 15). ) And the current date and time are detected as the shooting date and time . In the next step 156, the shooting position information and shooting date / time information indicating the shooting position and shooting date / time detected in step 154 are temporarily stored in the RAM 24C and the like together with the shooting image data, shooting direction information and shooting magnification information received from the DSC 15.

In the next step 158, based on the shooting position information, shooting direction information, and shooting magnification information among the information temporarily stored in step 156, the range shot by the current shooting in the stadium 52 is determined. In step 160, information indicating the position of each athlete 17 at the shooting date / time is extracted as subject position information from the information stored in the subject movement information DB, and the subject position information determined in step 158 is extracted. By comparing with the information representing the range and determining whether or not the competitor 17 was present within the shooting range at the time of shooting, each of the competitors 17 can determine the current shooting (the shot image represented by the received shot image data). ) identify the competitor 17 as a subject in.

  Note that, in group competitions and the like, a plurality of athletes 17 are often photographed as main subjects. However, when other athletes who are not the main subjects enter the photographing range, the other athletes can capture the background of the photographed image. It may be reflected as. In the identification of a competitor as a subject for such a photographed image, when it is desired to avoid recognizing another competitor reflected in the background as a subject, for example, it is determined that the subject was within the photographing range at the time of photographing. Among the plurality of competitors 17, the athletes whose distance between the shooting position and the shooting location is greatly different from other competitors are excluded, or the distance between the shooting position and the shooting location is A player who sometimes differs greatly from the distance to the subject measured by the AF mechanism may be excluded.

  In the next step 162, the received captured image data is stored in the image DB in association with the ID of the player 17 determined to be the subject in step 160, and the process returns to step 150. As a result, while the competition is being performed in the stadium 52, each time the cameraman 12 takes a picture, Steps 154 to 162 are repeated, and the athlete 17 as the subject is identified, and the ID of the athlete 17 is determined. The captured image data is repeatedly stored and stored in association with each other.

  When the competition in the stadium 52 is completed (photographing by the photographer 12 is completed), the determination in step 150 is affirmed and the process proceeds to step 164, and all the competitors 17 who have competed in the stadium 52 have entered. A list of names, face photos, etc. is displayed on the display 44 of the electronic signboard 43. In the next step 166, it is determined whether or not any player has been selected by the customer 16 who has arrived at the installation position of the electronic signboard 43 (for example, a person who has watched the competition in the stadium 52). Wait until affirmed.

When the customer 16 who has arrived at the installation position of the electronic signboard 43 selects a specific player 17 from among all the listed players 17 in order to order an image of the specific player, the determination in step 166 Is transferred to step 168, the image DB is searched using the ID of the specific player 17 selected by the customer 16 as a key, and the captured image data stored in association with the ID of the specific player is stored. Are all extracted. In the next step 170, images displayed by the photographed image data extracted by the search are displayed as a list on the display 44. Thus, it means that only the image of a specific competitor 17 and the object is a list displayed on the display 44, Ru can be found easily the image to be ordered by the customer 16.

Since the next Steps 172 to 178 are substantially the same as Steps 124 to 130 described in the first comparative example , in brief description, it is determined whether or not the image to be ordered has been selected by the customer 16 (Step 172). ) When the image to be ordered is selected by the customer 16, the order content by the customer 16 is determined (step 174). If the order by the customer 16 is "Create photo print", in step 176, the print finisher 36 is selected. Is sent to the PC 38 of the selected print finisher 36 by sending the photographed image data of the image to be ordered, the information indicating the order contents designated by the customer 16, and the customer ID of the customer 16 to the selected print finisher 36. Place an order. In addition, if the order by the customer 16 is "delivery of image data" is, in step 178, the captured image data of the order subject of the image, that sends to the destination specified by the customer 16.

  In the next step 180, it is determined whether or not to end the process. In this step 180, for example, a predetermined time after the end of the competition is unconditionally denied, and the process returns to step 164. Thereby, the customer 16 who came to the stadium 52 and watched the competition can obtain images of the desired athletes 17 as subjects.

In the second comparative example , only the electronic signboard 43 has been described as an apparatus for ordering images for the sake of simplicity. However, as in the first comparative example , a web page for a customer to order images. It goes without saying that an image can be ordered by accessing.

In the second comparative example , the athlete 17 has the transmitter 19 and the position sensor 35 detects the position of the athlete 17. However, the present invention is not limited to this. A large number of transmitters are installed, and signals including position information indicating the position of each transmitter are transmitted from each transmitter. At the same time, signals from the transmitter are received, and the position information contained in the received signal is displayed as the current date and time. Each athlete 17 possesses a receiver having a function of repeating recording in association with each other at a predetermined cycle, and the receiver is collected after the competition in the stadium 52 is finished, and recorded information (individual It is also possible to obtain the movement history of each competitor by reading out the information indicating the movement history of the competitor 17). Further, instead of reading out information from the receiver after the competition is over, the recorded information may be periodically transmitted from the receiver.

  In addition, the method of detecting the shooting location is not limited to the method described in each of the above embodiments, and a signal including location information indicating the installation location of each base station is sent to a number of base stations at a number of different locations. May be transmitted, and the DSC side may receive this signal to detect the shooting location.

  Further, in the above description, the DSC 14 has been described as an example of the photographing means possessed by the cameraman 12. However, the present invention is not limited to this. The photographing means may be an ordinary camera that records an image on a photographic film or a digital video camera. Needless to say, they may be used as

  In particular, when a digital video camera is used as a photographing unit, information for identifying a subject by applying the present invention to each individual image of moving images obtained by photographing and identifying the determined subject ( (Subject ID) is stored in association with individual images, so that it is possible to easily search for a scene in which a specific subject is captured or to edit a moving image for each subject.

  In addition, when a digital video camera is used as a photographing means, a moving image is ordered from a customer. However, a moving image can be distributed by recording the moving image on a video tape and sending it to the customer. Alternatively, it may be entrusted to a cable television (CATV) company or a moving image may be distributed using the Internet. Specifically, for example, when a moving image of a specific athlete is ordered from a customer via the electronic signboard 43, a recording means (for example, a video recorder or a PC) in which the customer has the ordered moving image. In addition to notifying the recording means of information for making a recording reservation (broadcast channel, broadcast date, etc.), for example, a key for releasing scrambled moving images to be scrambled is also notified at the same time. In this case, the recording means receives the broadcast of the notified broadcast channel at the notified broadcast date and time, and records after releasing the scramble using the notified key. Thereby, the customer can obtain the moving image ordered by the customer.

  Further, the case where the photographer 12 performs shooting has been described above. However, the present invention is not limited to this. The camera unit 12 includes a sensor that detects a person as a subject and detects when the person is detected by the sensor. Needless to say, a camera that automatically shoots a photographed person (this camera may be a DSC, a normal camera that exposes and records an image on a photographic film, or a digital video camera). .

Further, in the second comparative example , a slight time lag occurs after the photographer 12 performs shooting until the order processing device 24 recognizes that shooting has been performed by receiving shooting information from the DSC 15. In the second comparative example , the position of the detected subject (competitor 17) is moved to the subject because the subject identification accuracy may be reduced due to the above-mentioned time lag particularly in a competition with intense movement. Although the case where the information is sequentially stored in the information DB has been described, the subject position detection method described in the second comparative example itself can detect the position of each subject (in the second comparative example , the individual player 17) in real time. Since this is possible, if this is used, the position of a specific subject is detected in real time so that the specific subject always exists in an appropriate size within the imaging range ( To automatically track the constant subject), based on the position of the specific subject detected in real time, photographing azimuth, the focusing position of the photographing means, it is also possible to control the imaging magnification in real time.

Embodiment
Next, an embodiment of the present invention will be described. As described above , the position of a specific subject is detected in real time, and the shooting direction, focus position, and shooting magnification of the shooting means are set in real time so that the specific subject always exists in an appropriate size within the imaging range. The control can be applied, for example, when automatic photographing is performed by a photographing means, but the photographer (for example, the cameraman 12 or the customer 16 who visited the stadium 52) has detected the result of detecting the position of the subject in real time. It can also be used to assist in shooting when shooting a specific subject.

Specifically, for example , as in the second comparative example , when shooting is performed with the athlete 17 as the subject in the stadium 52, the information is centrally managed as in the order processing device 24 described in the second comparative example. The device (hereinafter referred to as the management device) is replaced with the transmitter 19 and the position sensor 35 described in the second comparative example (in place of the transmitter 19, the IC tag possessed by each player 17 and the position sensor 35). IC tag sensor embedded in the stadium 52 may be used to detect the position of each individual player 17 as a subject in real time, and by a predetermined signal transmitted from the DSC 15 possessed by each individual photographer. The position of each photographer (and DSC 15) is also detected in real time. Instead of a predetermined signal transmitted from the DSC 15, the position of each photographer (and DSC 15) is detected by an IC tag possessed by each photographer and an IC tag sensor embedded in the stadium 52. Also good.

  Further, the management device adds identification information for identifying the individual player 17 to the position information indicating the position of the individual player 17 detected in real time, and each of the DSCs 15 possessed by the individual photographer is assigned to the DSC 15. The information is transmitted periodically (for example, every several milliseconds to several seconds), and position information indicating the position of the DSC 15 itself as the notification destination (the position of the photographer who owns the DSC 15) is also transmitted. Note that the position information of the athlete 17 is not limited to transmitting the position information of all the athletes 17 to the individual DSCs 15, but specific athletes notified from the individual photographers as subjects of photographing. Only 17 pieces of position information may be transmitted to the DSC 15 of each photographer.

Further, in the DSC 15, every time the position information of the athlete 17 and the position information of the DSC 15 itself are received from the management device, the photographing support process shown in FIG. 5 is executed. Hereinafter, this photographing support process will be described. The reception of the information corresponds to the receiving means according to the present invention. In step 200, the position information of the shooting target player 17 (target subject) registered in the DSC 15 in advance is extracted from the position information of the player 17 received from the management device (as described above, the shooting target player 17 If only the position information is transmitted from the management device, this position information is not required to be extracted), and based on the position information of the athlete 17 to be photographed and the position information of the DSC 15 itself, the photographing that possesses the DSC 15 The direction of the player 17 to be photographed when viewed from the person (the photographing direction for photographing the target subject) is calculated. The step 200 corresponds to the photographing direction calculation means according to the present invention.

  The shooting direction may be the shooting direction (shooting azimuth angle) in the horizontal plane, but preferably includes the shooting direction (shooting elevation angle) in the vertical plane in addition to the azimuth angle. The shooting elevation angle can be calculated if the altitudes of the player 17 (target subject) and the photographer (DSC 15) to be shot can be detected. The altitude of the target subject and the photographer can be detected simultaneously by detecting the positions of the target subject and the photographer using, for example, a GPS system. If the altitude at each position of the stadium 52 is known, the altitude of the target subject and the photographer can be detected from the position of the target subject and the photographer (position in the horizontal plane).

The DSC 15 has a built-in gyro sensor for detecting the shooting direction (this gyro sensor corresponds to the detecting means according to the present invention) , and in step 202, the current shooting direction of the DSC 15 is fetched from the gyro sensor. By comparing the current shooting direction with the shooting direction for shooting the target subject calculated in step 200, the target subject is within the shooting image frame representing the predetermined shooting range in the current shooting direction of the DSC 15. It is determined whether or not it is accommodated. This step 202 corresponds to the determination means according to the present invention.

As an example, as shown in FIG. 6B, when the target subject deviates from the captured image frame in the current shooting direction, the determination in step 202 is denied and the process proceeds to step 204, where the target subject is selected. A change direction (for example, a horizontal direction and a vertical direction) of the shooting direction to fit in the shot image frame is calculated. This step 204 corresponds to the change direction calculation means according to the present invention. Then, in the next step 206, a direction indication arrow indicating the change direction of the photographing direction calculated in step 204 is displayed on the display unit of the DSC 15 including an LCD or the like, and the process returns to step 202. Step 206 corresponds to the change direction notifying unit according to the present invention (more specifically, the change direction notifying unit described in claim 3). Therefore, steps 204 and 206 are repeated until it is determined in step 202 that the target subject is within the captured image frame.

  FIG. 6B shows an example of a screen image displayed on the display unit of the DSC 15 by the process of step 206 described above. In the example of FIG. 6B, an image corresponding to the current shooting range is displayed in the shot image frame W and corresponds to the change direction of the shooting direction calculated in step 204 out of the shot image frame W. At the position, a direction indicating arrow D indicating the change direction is displayed. As a result, the photographer can change (move) the shooting direction of the DSC 15 so that the DSC 15 faces in the direction indicated by the direction instruction arrow D, so that the target subject can be placed in the shot image frame W, and the target subject can be moved. It is possible to shoot easily and reliably. Note that the display size or the like of the direction indication arrow D may be changed according to the deviation between the current shooting direction of the DSC 15 and the shooting direction for shooting the target subject.

  If it is determined in step 202 that the target subject is within the captured image frame (for example, as shown in FIG. 6A), the process proceeds to step 208. At this time, information related to the target subject (for example, information such as the profile of the specific player 17 as the target subject) is acquired from the management device or the like, and as shown in FIG. May be displayed on the display unit of the DSC 15. Thereby, the convenience for the photographer can be improved.

In step 208, the distance from the DSC 15 to the target subject is calculated based on the position information of the target subject and the position information of the DSC 15 itself, and in the next step 210, based on the distance to the target subject obtained by the calculation, Shooting to make the target subject fit within the captured image frame W and to set the size of the target subject within the captured image frame W to an appropriate size (for example, about 1/4 of the area ratio with respect to the captured image frame W). Calculate the magnification. The steps 208 and 210 correspond to the photographing magnification calculation means described in claim 2. Then, in the next step 212, according to the photographing magnification obtained by the calculation, at least one of the change of the optical magnification of the zoom lens of the DSC 15 and the change of the electronic magnification of the electronic zoom of the DSC 15 is performed. The magnification is changed and the photographing support process is terminated. Step 212 corresponds to the photographing magnification changing means described in claim 2.

  Each time the position information of the player 17 and the position information of the DSC 15 itself is received from the management device, the above-described shooting support process is executed in the DSC 15, so that the photographer can also use the direction indication arrow even when the target subject is lost. By simply performing the operation of directing the DSC 15 in the direction indicated by, the target subject can be accommodated in the captured image frame W, and the target subject can be reliably imaged.

It is a schematic block diagram of the image order system which concerns on a 1st comparative example . It is a flowchart which shows the content of the image order process which concerns on a 1st comparative example . It is a schematic block diagram of the image order system which concerns on a 2nd comparative example . It is a flowchart which shows the content of the image order process which concerns on a 2nd comparative example . In this embodiment, it is a flowchart which shows the content of the imaging | photography assistance process performed with a camera based on the result of having detected the position of the to-be-photographed object in real time. It is an image figure which shows an example of the image displayed on the display part of a camera by the imaging | photography assistance process of FIG.

Explanation of symbols

11 Image Ordering System 15 Digital Still Camera 19 Transmitter 24 Order Processing Device 32 Communication Network 35 Position Sensor

Claims (3)

A shooting support device mounted on a camera owned by a photographer,
Communication with the IC tag communication or to the target object with the portable transmitter and a base station that is provided at regular intervals in possession of the target object is possessed with IC tag sensor provided at regular intervals When the communication with the IC tag and the IC tag sensor communication or that the photographer and the camera and the base station is possessed, which is possessed to the photographer, is detected by the management apparatus by, periodically notified from the management device Receiving means for receiving the position of the target subject and the position of the camera;
Detecting means for detecting a shooting direction of the camera;
Based on the position of the target subject and the position of the camera received by the receiving means, the photographing direction calculating means for calculating a target photographing direction for the photographer to photograph the target subject with the camera;
Determination of whether or not the target subject is within a photographic image frame representing a photographic range by the camera by comparing the photographic direction detected by the detecting unit with the target photographic direction calculated by the photographic direction calculating unit. Means,
A change direction calculation unit that calculates a change direction of a shooting direction for placing the target subject in the captured image frame when the determination unit determines that the target subject does not fit in the captured image frame; ,
Change direction notifying means for displaying on the display unit of the camera the change direction of the shooting direction calculated by the change direction calculating means;
An imaging support apparatus comprising: When the determination unit determines that the target subject is within the captured image frame, the camera and the target are based on the position of the target subject and the position of the camera received by the reception unit. A photographing magnification calculating means for calculating a distance to the subject and calculating a photographing magnification of the camera for setting the size of the target subject within the photographed image frame to a predetermined size based on the calculated distance;
A photographing magnification changing means for changing a photographing magnification of the camera according to a photographing magnification calculated by the photographing magnification calculating means;
The photographing support apparatus according to claim 1, further comprising: The change direction notifying unit displays an arrow indicating the change direction on the display unit of the camera possessed by the photographer as the change direction of the shooting direction calculated by the change direction calculating unit. The imaging support apparatus according to claim 2.

Images