JP5082005B2 - Imaging data processing device - Google Patents

Description

  The present invention relates to an information processing apparatus capable of capturing a still image or a moving image, and more particularly to an imaging data processing apparatus capable of capturing a still image or a moving image including a self-position acquisition unit such as GPS.

  Some information processing apparatuses (for example, a camera, a video camera, and a mobile phone) that can capture a still image or a moving image include a self-position acquisition unit such as a GPS. As a result, it has begun to be considered to provide new usage methods and services using location information, rather than simply taking pictures and videos.

  The prior art regarding such a thing is disclosed by patent document 1 etc. The prior art disclosed in Patent Document 1 can leave a message in an image serving as a mark and obtain a message corresponding to the mark when the mark is photographed. When a person who wants to leave a message takes a picture of a bee image, the latitude and longitude information of the position is acquired by GPS, and the position information corresponds to the input message (image). And send it to the server. Next, when a person who wants to read the message takes a picture of the bee image, the latitude and longitude information of the position is acquired by GPS, and the position information and the image (the bee image) are transmitted to the server. A person who wants to read the message can acquire the message by searching for a message corresponding to the image (Hachiko) and returning the message. That is, “photograph (image)” is used to specify the location in more detail (in addition to the latitude and longitude information by GPS, the location where the message is left is specified by “photograph (image)” The image photographing means also functions as a means for specifying the position).

JP 2002-41526 A

  The present invention provides an imaging data processing apparatus or the like that can provide a new usage method in an information processing apparatus capable of capturing a still image or a moving image including self-position acquisition means such as GPS, or a new service It aims to provide a method.

An imaging data processing apparatus according to the present invention is an imaging data processing apparatus that can capture a still image or a moving image by including an image capturing unit, and includes a display unit, a control unit, a storage unit, and a self-position acquisition unit. And the positional information and the processed data are stored in association with each other in the storage unit or in a storage medium that is detachable from the imaging data processing device. The imaging data is subjected to processing using the processing data corresponding to the self-position information acquired by the self-position acquisition unit, and the processing data is stored in the past at the corresponding position. The photograph is stored as processed data, and the acquisition conditions for the processed data are set in the acquisition condition table. Acquisition conditions (hereinafter referred to as "regional conditions") regarding regional managing as constant to acquire the processed data are those that are set by the image pickup data processing apparatus, set by the regional conditions when calculating the position of the subject is to be the predetermined area, and executes a display process of the past pictures as the processing data corresponding to the object position information.

According to the above configuration, positional information and processing data are managed in association with each other, processing data corresponding to “self-position” acquired by the imaging data processing apparatus is acquired based on the positional information and processing data, and further, self-position information and When processing data acquisition conditions are set based on the region-limited conditions and the position of the subject is calculated within the predetermined region set by the region-limited conditions, imaging is performed using the processing data corresponding to the position information. Processing for the data is executed. A processing process is performed on the image data captured by the image data processing apparatus using the processed data . Na you, "processed data" is information for performing some processing for "imaging data", for example, and audio data for adding voice data or image, the "imaging data" to be superimposed like a photograph, This is information for driving a drive portion provided in an apparatus that executes the reproduction when “imaging data” is reproduced (screen display or the like).

The imaging data processing apparatus according to the present invention is characterized in that the predetermined area as the area limiting condition for acquiring the processed data is a figure having map coordinates .

According to the above configuration, the area limiting condition is configured by a line segment, a plane figure, or a three-dimensional figure composed of one map coordinate or a plurality of map coordinates .

Imaging data processing apparatus according to the present invention, the past pictures of the previous SL Work piece data acquired by regional condition is acquired condition data, to actually image generated on the display unit side by side with the captured photo Features.

According to the above configuration, when it is determined that the position of the subject is within a predetermined area based on the area limitation condition, the processed data acquired based on the area limitation condition is generated along with the imaging data .

Imaging data processing apparatus according to the present invention is characterized in that it is a pre-Symbol processed data Gath text data.

According to the above configuration, the display unit of an imaging data processing apparatus, so that the image after the processing overlapped with the character string in the imaging data is displayed.

According to the imaging data processing apparatus according to the present invention, for example, in a digital camera or a mobile phone (imaging data processing apparatus) provided with a self-position acquisition means using GPS or the like, it corresponds to the current position (self-position information). It can be used such as acquiring past photographs (processed data) and displaying the photographed photographs (imaging data) and past photographs side by side . Therefore, it is possible to provide a new usage method in an information processing apparatus that can capture a still image or a moving image including self-position acquisition means such as GPS.

According to the imaging data processing apparatus according to the present invention, in addition to the acquisition of the processed data based on the correspondence between the position information and the processed data, and the processing data identification information is set with a "regional conditions", which The processing data is acquired based on the association between the processing data and the processing data, and processing processing is performed on the imaging data captured by the imaging data processing apparatus using the acquired processing data .

Block diagram showing outline of configuration of imaging data processing system A flowchart showing an outline of processing operations related to initial settings when an application is first activated in a terminal device Flow chart showing an outline of processing operation in the service providing server that has received the initial setting request Flow chart showing an outline of the processing operation of “frame image acquisition processing” Flow chart showing the outline of the processing operation of "acquisition condition setting process" A flowchart showing an outline of processing operations related to the present invention in a terminal device Flow chart showing the outline of the processing operation of “mounting (frame selection screen) display processing” Flowchart showing the outline of the processing operation of “frame shooting processing” Flow chart showing the outline of the processing operation of "parameter acquisition processing" Flow chart showing the outline of the processing operation of “frame acquisition processing” in the service providing server Flow chart showing the outline of the processing operation of "Acquisition condition (region) suitability determination processing" Flow chart showing an outline of the processing operation of "acquisition condition (time) suitability determination processing" A flowchart showing an outline of processing operations in the service providing server that has received the mount change request The figure which shows the outline of the table structure with which an imaging data processing system is provided: (a) Frame mount table, (b) Menu icon table The figure which shows the outline of the table structure with which an imaging data processing system is provided: (a) Frame image attribute table, (b) Terminal corresponding | compatible frame image table The figure which shows the outline of the table structure with which an imaging data processing system is provided: (a) Acquisition condition (area limitation) table, (b) Acquisition condition (time limitation) table The figure which shows the outline of the table structure with which an imaging data processing system is provided: (a) Acquisition condition (cancellation code) table, (b) Acquisition condition (order limitation) table The figure which shows the outline of the table structure with which an imaging data processing system is provided: (a) Acquisition condition (quantity code) table, (b) User data management table The figure which shows the outline of the table structure with which an imaging data processing system is provided: (a) Current frame mount table, (b) Current menu icon table The figure which shows the outline of a holding | maintenance frame image attribute table structure with which an imaging data processing system is provided. The figure which shows an example of the display screen in a terminal device The figure which shows an example of another display screen in a terminal device The figure which shows an example of another display screen in a terminal device The figure which shows an example of another display screen in a terminal device The figure which shows an example of another display screen in a terminal device The figure which shows an example of another display screen in a terminal device

  Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. The following embodiment is one form when the present invention is embodied, and is not intended to limit the present invention within the scope thereof.

  FIG. 1 is a block diagram showing an outline of the configuration of the imaging data processing system of this embodiment. The imaging data processing system according to the present invention is capable of taking a photograph (may be a moving image) and is capable of detecting its own position by GPS or the like at the time of taking the photograph. This is to provide a photo processing service (such as adding a frame to the photo) according to the self-location. For example, when a photograph is taken at the beach, a frame named after the sea is superimposed on the photograph, and when a photograph is taken at the mountain, a frame named after the mountain is superimposed on the photograph.

  As shown in FIG. 1, the imaging data processing system of the present embodiment includes a terminal device 1 (for example, a mobile phone) capable of camera photography and GPS positioning, a service providing server 3, and a content providing server 4. 2 are connected. Note that there may be a plurality of constituent elements instead of one.

  The terminal device 1 includes a control unit 110 that controls the entire device, data input / output, various arithmetic processes, temporary storage of data, a camera unit 120 that can capture still images or moving images, and various data. , A storage unit 130 that stores programs and the like, a communication unit 140 that transmits and receives information to and from the network 2, a GPS reception unit 150 that receives signals from a GPS (GLOBAL Positioning System) satellite, and an input that is an input interface A display unit 170, a display unit 170 as a monitor, and the like.

  The service providing server 3 includes a control unit 310 that controls the entire apparatus, input / output of data, various arithmetic processes, temporary storage of data, a storage unit 320 that stores various data and programs, and an input An input unit 330 that is an interface, an output unit 340 such as a monitor, a communication unit 350 that transmits and receives information to and from the network 2, and the like.

  The storage unit 320 of the service providing server 3 includes a frame DB 322 that stores frame data that is processed data for processing a photograph, and application software related to the service (hereinafter may be abbreviated as “app”) as a terminal. Corresponding to the screen component DB 323 storing data related to icons and text that are components constituting the screen when executed on the apparatus 1, frame acquisition conditions (for example, correspondence between each frame and position information), etc. A table 321 and the like are stored.

  14 to 18 are diagrams illustrating an example of the structure of the table 321 stored in the storage unit 320 of the service providing server 3. The frame mount table in FIG. 14A and the menu icon table in FIG. 14B are tables that define information for configuring a screen when an application is executed mainly on the terminal device 1. The frame image attribute table in FIG. 15A and the terminal-compatible frame image table in FIG. 15B are tables that mainly define frame attributes and the like. The various acquisition condition tables from FIG. 16A to FIG. 18A are tables for defining the frame acquisition conditions. The user data management table in FIG. 18B is a table for managing data (user data) related to users (users of the terminal device 1).

  19 and 20 are diagrams illustrating an example of a configuration of a table stored in the storage unit 130 of the terminal device 1. As will be described below, each table is formed by acquiring necessary information from the table 321 (FIGS. 14 to 18) of the service providing server 3 at the time of initial setting of the application.

  The content providing server 4 is a server that provides frame data that is processed data for processing a photograph. That is, the frame data itself is not limited to what the service providing server 3 has (the service providing server 3 may not have the frame data), but is acquired from the content providing server 4 and distributed to the terminal device 1. In some cases (the data download itself may be performed directly from the content providing server 4 to the terminal device 1).

  Next, an outline of the processing operation of the imaging data processing system having the above configuration will be described with reference to the flowcharts of FIGS. Each of these processes basically operates when a program stored in the storage unit is executed in the control unit. The control unit uses the data in the storage unit or the communication unit to connect the network 2 as necessary. In response to an instruction (user request) from the input unit 13 or a request from the terminal device, using data transmitted / received via the interface, information received by the GPS receiving unit 16 or user input information obtained from the input unit 13 The processing of various data is performed, and the result is displayed on the display unit or transmitted as a response to the terminal device while storing the calculation result in the storage unit as necessary (any of the terminal device and the server). Is basically the same concept). FIGS. 21 to 26 are screen examples (showing transitions of display screens) displayed on the display unit 170 of the terminal device 1. The screen example will also be described with reference to the description of each process.

  FIG. 2 is a flowchart regarding the initial setting when the application (program) according to the present embodiment is first activated in the terminal device 1.

  When the application related to the present invention is activated and this is the first activation (step 201), the “frame mount ID” included in the application and the terminal identification information of the terminal device 1 (the storage unit of the terminal device 1) Is recorded on the service providing server 3 (step 202). The “frame mount ID” is to determine the type and range of the service to be provided (photo processing service related to the present invention). For example, there are services such as series, The “frame mount ID” is assigned to this series (corresponding to “service type information” in claim 38). That is, for example, a “frame mount ID” is assigned to each of a series of frame data of a character A and a series of frame data of a character B. In this embodiment, there is an application corresponding to each series (for example, an application for A character frame), and the application is assumed to be downloaded by the user. Although it is described that the “frame mount ID” is automatically transmitted, a plurality of “frame mount IDs” are included in the application and the user selects this to transmit to the server. It may be such that the “frame mount ID” known by means (for example, introduction in a magazine or the like) is directly input and transmitted.

  FIG. 3 is a flowchart showing an outline of the processing operation in the service providing server 3 that has received the information transmitted in step 202 of FIG. This process is a process for collecting and transmitting to the terminal device 1 information necessary for performing initial settings required for the operation of the application of the terminal device 1 (information held by the service providing server 3).

  When the “frame mount ID” and the “terminal identification information” transmitted from the terminal device 1 are received (step 301), the data corresponding to the “frame mount ID” is stored in the frame mount table (FIG. 14A). And the menu icon table (FIG. 14B) (step 302). As described above, these tables mainly define information for configuring a screen when an application is executed on the terminal device 1, and a place (path) where an image or text for configuring the screen is present. Or the image and the text itself are stored. When a path is stored in the table, processing for obtaining necessary information (image and text) from the screen component DB 323 based on the path is performed. The acquired information is temporarily stored for later transmission to the terminal device 1 (the same applies to information acquisition in the subsequent processes). Note that the acquired information may be transmitted each time. When the information acquired in step 302 is transmitted to the terminal device 1, the current frame mount table (FIG. 19 a) in FIG. 19, which is a table stored in the storage unit 130 of the terminal device 1, and the current menu icon table ( Information necessary for FIG. B) is obtained.

  The loop processing subsequent to step 302 is to execute the processing from step 303 to step 309 for all frames corresponding to the “frame mount ID” received from the terminal device 1. As described above, the “frame mount ID”, for example, allows a frame providing service related to the A character to be performed, and a plurality of frames can exist as frames using the A character. That is, there are a plurality of frames corresponding to a certain “frame mount ID”, and each of these frames is identified by the frame ID. The loop processing following step 302 is executed for each frame ID having the same frame mount ID. As can be understood from these descriptions, the table of FIG. 14 exists for each “frame mount ID” (for example, a table for A character, a table for B character,...), And FIGS. Each table exists for each frame ID (frame mount ID and frame ID) (for example, a first frame table for A character, a second frame table,...).

  In step 303, the attribute information corresponding to the frame mount ID and the frame image attribute table (FIG. 15A) corresponding to the frame ID is acquired. The “description character string”, “holdable flag”, “initial hold flag”, and “acquisition” necessary for the hold frame image attribute table of FIG. 20 which is a table stored in the storage unit 130 of the terminal device 1 by the acquisition process. Information on “method character string” is obtained.

  In the subsequent step 304, it is determined whether or not the thumbnail image path is set with reference to the frame image attribute table (FIG. 15A) (in other words, whether or not there is a thumbnail image of the frame). If there is no thumbnail image path, the process proceeds to step 306, where the terminal corresponding frame image table (FIG. 15 (b)) is based on the frame mount ID, the frame ID, and the terminal identification information (information received from the terminal device 1). )), The frame image is acquired (the image is acquired based on the path. The acquisition process is the same as the process of FIG. 4 described later), and the thumbnail image is acquired based on the acquired frame image. Process to generate. On the other hand, if there is a thumbnail image path, the process proceeds to step 305 to execute processing for acquiring the corresponding image. Through the processing of step 304 to step 306, the frame mount ID and the thumbnail image of the frame corresponding to the frame ID are acquired (the information is “thumbnail image” in the holding frame image attribute table (FIG. 20) of the terminal device 1). ). As can be seen from the processing, the thumbnail image itself is acquired corresponding to all the frames, but for the frames that are subject to acquisition restrictions and retention restrictions, thumbnail images are generated based on the frame images themselves. Instead of making a reduced version of the frame design itself, a thumbnail that does not know the design of the frame itself may be generated, such as generating a thumbnail that only shows the silhouette.

  In the subsequent step 307, the authenticity of the initial holding flag is determined with reference to the frame image attribute table (FIG. 15A). The initial holding flag is a flag that defines whether or not a frame is allowed to be used from the initial state in the application of the terminal device 1. If the initial holding flag is true (usable), the process proceeds to step 308 to execute frame image acquisition processing. On the other hand, if it is false (unusable), step 308 is skipped.

  FIG. 4 is a flowchart showing an outline of the “frame image acquisition process” in step 308 of FIG.

  In this “frame image acquisition process”, a frame mount ID, a frame ID, and terminal identification information are given as arguments (step 401). This “frame image acquisition process” is also called from another process (step 1014 in FIG. 10) described later. In this case, the “acquisition condition parameter” is also passed as an argument. When the processing is executed from step 308 of No. 3, “acquisition condition parameter” is not relevant. The terminal identification information is used to identify the type of terminal. The display area and resolution of the display unit may differ depending on the terminal device, and therefore it is necessary to prepare frame images corresponding to these differences. Therefore, even if the same frame (frame ID) is used as a symbol, each terminal A terminal-compatible frame image table (FIG. 15B) exists in accordance with the identification information.

  Steps 402 to 404 subsequent to step 401 are processes executed when “acquisition condition parameter” is given as an argument, and thus are not relevant when executed from step 308 of FIG. 3.

  In step 405, a process of acquiring a frame image file from the location by using a frame image path obtained by referring to the terminal-compatible frame image table (FIG. 15B) based on the frame mount ID, the frame ID, and the terminal identification information. Is executed. When the path is URL information indicating an external server (content providing server 4), if the frame image is acquired from the server and held by the service providing server 3, processing in the service providing server 3 It becomes.

  Returning to FIG. 3, the description will be continued.

  A frame image (a frame permitted to be used in the initial state) is acquired by the “frame image acquisition process” in step 308. (It becomes information of “frame image” in the holding frame image attribute table (FIG. 20) of the terminal device 1)

  In the subsequent step 309, “acquisition condition setting process” is executed. FIG. 5 is a flowchart showing an outline of the processing operation of the “acquisition condition setting process”.

  In step 501, the acquisition condition (area limitation) table (FIG. 16A) is referred to based on the frame mount ID and the frame ID to determine whether or not there is an acquisition condition setting related to the area limitation. When there is an acquisition condition (step 502), information for setting “position information transmission” to the terminal device 1 (“position information transmission” in the holding frame image attribute table (FIG. 20) corresponding to the frame ID) "Flag set to the item") is acquired (step 503). On the other hand, if there is no acquisition condition, step 503 is skipped.

  In the subsequent step 504, it is determined whether or not an acquisition condition relating to the release code has been established with reference to the acquisition condition (release code) table (FIG. 17A) based on the frame mount ID and the frame ID. If there is an acquisition condition (step 505), information corresponding to the code type (a flag set in the “transmission code transmission” item of the holding frame image attribute table (FIG. 20) corresponding to the frame ID) is acquired. (Step 506). On the other hand, if there is no acquisition condition, step 506 is skipped. The release code is permitted to acquire the corresponding frame by having the code, and is information acquired by reading from a barcode or an IC tag, for example. “Function according to code type” so that the terminal device 1 can determine the function to be activated because the function to be activated differs depending on the medium such as the barcode or the IC tag. Is sent to the terminal device 1.

  In the subsequent step 507, it is determined whether or not there is an acquisition condition setting related to the order limitation with reference to the acquisition condition (order limitation) table (FIG. 17B) based on the frame mount ID and the frame ID. If there is an acquisition condition (step 508), acquisition order information (information set in the item “acquisition order” in the holding frame image attribute table (FIG. 20) corresponding to the frame ID) is acquired (step 509). ). On the other hand, if there is no acquisition condition, step 509 is skipped. It should be noted that the processing related to the acquisition of “position information transmission” (steps 501 to 503), the processing related to the acquisition of “transmission code transmission” (steps 504 to 506), and the processing related to the acquisition of “acquisition order” (steps 507 to 507). Step 509) may be performed first.

  Returning to FIG. 3, the description will be continued.

  Information set in each item of “position information transmission”, “transmission code transmission”, and “acquisition order” in the holding frame image attribute table (FIG. 20) of the terminal device 1 by the “acquisition condition setting process” in step 309. To be acquired.

  By performing the processing of Step 303 to Step 309 described above once, various types of information (information necessary for the holding frame image attribute table (FIG. 20) corresponding to the corresponding frame ID) is acquired, By repeating this by the loop processing, necessary information is acquired for all frames having the same frame mount ID. The process for acquiring thumbnail images (steps 304 to 306), the process of acquiring initial frames (steps 307 to 308), and the acquisition condition setting process (step 309) are performed first. It does not matter. Any of the processing in step 302 and the loop processing may be performed first.

  In step 310, a process of transmitting each acquired information to the terminal device 1 is performed. That is, each information is transmitted to the terminal device 1 as a response to the “frame mount ID” and “terminal identification information” transmitted in step 202 of FIG.

  In the terminal device 1 that has received the information, a current frame mount table (FIG. 19A), a current menu icon table (FIG. 19B), and a holding frame image attribute table (FIG. 20) are received according to the received information. After the initial setting is made, the top menu screen (FIG. 21) is displayed on the display unit 170 (FIG. 2: step 203).

  As can be seen from the above description, in this embodiment, thumbnail images are acquired corresponding to all frames, but only frame images that are permitted to be used in the initial state are acquired. It becomes.

  Through the above processing, the initial setting of the application relating to the present invention is completed, and it becomes possible to receive a service (photo processing service). Note that user registration is also executed simultaneously with the initial setting process. That is, a user is specified by a user ID or the like, and the user ID is managed by the service providing server 3. As will be described later, the user data management table (FIG. 18B) corresponding to the user ID is also formed in the service providing server 3, but it is not always necessary to generate the user data management table at the initial setting stage. Absent.

  Next, processing related to the present invention (imaging data processing) of the application will be described. FIG. 6 is a flowchart showing an outline of the processing operation in the terminal device 1.

  When the application is activated, the display screen of the display unit 170 of the terminal device 1 is as shown in FIG. When “frame shooting” is selected on the menu screen (step 601 in FIG. 6), the processing from step 602 to step 603 is executed, “setting change” is selected on the menu screen, and a request to change the mount is made. If there is (step 604), the processing of step 605 to step 607 is executed. If “end” is selected, the application is ended (step 608). The processing in FIG. 6 is omitted except for what is particularly necessary for explaining the concept of the present invention. However, when “view photo” is selected on the menu screen, the processing described later is obtained. When various kinds of photos are displayed on the screen and “exchange with friends” is selected, processing for sending photos to other terminal devices or the like (other users) is executed.

  Processing when “frame shooting” is selected will be described.

  When “frame shooting” is selected (step 601), the process proceeds to step 602, and “mounting (frame selection screen) display processing” is executed. FIG. 7 is a flowchart showing an outline of the processing operation of the “mounting (frame selection screen) display processing”. The mount (frame selection screen) is a screen for displaying thumbnail images of frames side by side and selecting them, and is a screen as shown at the left end of FIGS.

  When the mount (frame selection screen) display process of FIG. 7 is executed, first, information necessary for the screen configuration is obtained from the current frame mount table (FIG. 19A) and the current menu icon table (FIG. 19B). To obtain and display a background screen (a screen in which no frame thumbnail is displayed on the screen as shown at the left end of FIGS. 22 to 26) (step 701).

  The loop processing following step 701 is to perform the processing from step 702 to step 707 for all frame IDs. “All frame IDs” are based on all retained frame image attribute tables (FIG. 20) stored in the terminal device 1. Since the table shown in FIG. 3 extracts “frames with matching frame mount IDs” and is generated based on this, the loop processing of FIG. 7 changes to “all frames with matching frame mount IDs”. Will be done.

  The processing from step 702 to step 707 is processing for displaying the thumbnail image of each frame on the screen, and is processing for changing the display of the thumbnail image according to the acquisition condition or the like. In step 702, it is determined whether the initial holding flag is true or false by referring to the holding frame image attribute table (FIG. 20). As described above, a frame whose initial holding flag is “true” is a frame that is permitted to be used by the application from the beginning, and a frame image is also downloaded to the terminal device 1 in the initial setting. Accordingly, when the initial holding flag is “true”, the process proceeds to step 707 without any other conditions being judged, and the process of displaying the thumbnail image at the corresponding position as it is is performed. “Display at corresponding position” means that specific coordinates are set in the holding frame image attribute table (FIG. 20) (originally set in the service providing server 3) and displayed based on this. Alternatively, the display position of thumbnails is determined as a mount (in the current frame mount table), and the thumbnails are displayed in order at the positions (the same applies to “display at corresponding position” in the following processing).

  If the initial holding flag is false, it is determined whether the acquisition flag is true (step 703). The acquisition flag is a flag indicating whether or not the frame has already been acquired by the terminal device 1 as will be apparent from the processing described later (for example, the condition is satisfied for a frame for which an acquisition condition is imposed). In the past, frames actually downloaded from the server). If the acquisition flag is false, since the frame has not been acquired yet, “unacquired thumbnail image” is displayed at the corresponding position (step 704). The “unacquired thumbnail image” is, for example, “?” On the leftmost screen in FIGS. As described in step 304 to step 306 in FIG. 3, in this embodiment, the thumbnail image itself is temporarily downloaded to the terminal device 1 for all frames. Therefore, in the process of displaying the thumbnail image of FIG. 7, it is possible to display thumbnails of all frames, but the contents of the frames for which acquisition conditions are imposed are unconditionally (the original frame Rather than clarifying the same thumbnails as the symbols), the symbols and the like can be understood only when they are acquired. As in this example, a flag indicating whether or not to set an “unacquired thumbnail image” for a frame that has not been acquired is set in the holding frame image attribute table (original source). May be set in the service providing server 3), and only a special frame may be hidden such as “?”. As mentioned in the description of step 304 to step 306 in FIG. 3, for the frames with acquisition restrictions, the server generates thumbnails that do not know the design of the frames themselves (or for frames with holding restrictions). In the case of generating a semi-transparent thumbnail), the thumbnail image that is received and set from the server as it is may be displayed without performing the processing of step 702 to step 706.

  If the initial holding flag is false and the acquisition flag is true (step 702 → step 703), it is determined whether the holding flag is true (step 705). The “holdable flag” is a flag that defines whether or not the terminal device 1 is permitted to hold a frame image (not a thumbnail image). If the terminal device 1 is not allowed to hold the frame, it is necessary to download a frame image from the server every time it is used for frame shooting, and even a frame once acquired (used) can be used freely thereafter. (This setting is based on the intention of the content provider, etc.). When the holdable flag is false (and the acquisition flag is true), the thumbnail image is used to indicate that the frame has been acquired (used) in the past but needs to be downloaded. A semi-transparency process is performed on the screen (the point is to distinguish it from that which can be used as it is, so other visual effects may be applied) and displayed at the corresponding position (step 706).

  If the initial holding flag is false, the acquisition flag is true, and the holdable flag is true (step 702 → step 703 → step 705), the process proceeds to step 707 and the thumbnail image is directly displayed at the corresponding position. Process to be displayed on.

  Through the above processing, as shown at the left end of FIGS. 22 to 26, a screen for displaying the thumbnail images of the frames side by side and selecting them is displayed. In the loop processing of FIG. 7, the description is “processing for all frames”. However, when the display area of the display unit 170 is limited and all thumbnail images cannot be displayed (page feed or the like). In such a case, it is possible to perform only the processing necessary for one-screen display (execution of processing necessary for each page feed or the like).

  Returning to FIG. 6, the description will be continued.

  Frame shooting processing is performed by selecting a frame on the “frame selection screen” displayed by the above processing (step 603). FIG. 8 is a flowchart showing an outline of the processing operation of the “frame photographing process”.

  When a frame is selected on the frame selection screen (step 801), information on the selected frame is acquired with reference to the holding frame image attribute table (FIG. 20) (step 802).

  In subsequent step 803, it is determined whether the acquisition flag (information acquired in step 802) is true or false (that is, whether or not a frame image has been acquired by the terminal device 1 in the past).

  If the acquisition flag is false, it is determined whether or not the conditions regarding the acquisition order are satisfied by the processing in steps 805 to 807. When the acquisition flag is false, it indicates that there is no frame image in the terminal device 1, so it is necessary to acquire a frame image from the server for frame shooting. If the condition is not satisfied, the acquisition of the frame is not permitted in the first place. Therefore, it is determined whether or not the condition regarding the acquisition order is satisfied before inquiring the server to acquire the frame image. The “acquisition order” in this embodiment is simply set with order information (numerical information). For example, when “acquisition order” is 6, another five frames are acquired before that. It will be necessary to have been. Note that the “acquisition order” does not have to be set for all frames (the same is true for other acquisition conditions described later in that the restriction need not be provided for all frames). ). For example, when there are n frames, by setting “n−1” as the “acquisition order” for only one of them, there is no restriction on the acquisition order for the other n−1 frames. It is possible to apply a restriction such as “a frame that can be acquired for the first time when all other frames are acquired” only for the set frame. In this embodiment, the order information is taken as an example as described above. For example, by setting the frame ID (one or more) of other frames as the “acquisition order”, “the set frame is acquired. If it is not, acquisition of the frame cannot be performed ”.

  In step 805, it is determined whether or not “acquisition order” is set. If it is set, in step 806, the acquisition flag is true with reference to each holding frame image attribute table (FIG. 20). The number of data (that is, the number of acquired frames) is totaled. If the value obtained by subtracting 1 from the acquisition order information is not less than or equal to the number of acquired frames (step 807), the condition regarding the “acquisition order” is not satisfied, and the process proceeds to step 808. A display indicating that the acquisition of the frame is not permitted (acquisition failure) is performed, and the frame photographing process is terminated. On the other hand, when the “acquisition order” is not set (step 805) or when the conditions regarding the “acquisition order” are satisfied (steps 805 to 807), the process proceeds to “parameter acquisition process” in step 809.

  FIG. 9 is a flowchart showing an outline of the repair operation of the “parameter acquisition process”. In the parameter acquisition process, there is a frame acquisition condition that determines whether or not acquisition is possible based on information (or information to be acquired) that the terminal device 1 has, and the “information that the terminal device 1 has” "Is necessary to send to the service providing server 3, which is a preparation process.

  In step 901, it is determined whether or not “transmission code transmission” (information acquired in step 802 in FIG. 8) is designated. As described above, the release code is information acquired by reading from a barcode, an IC tag, or the like. When “transmission code transmission” is designated, the barcode or IC is used for frame acquisition. It is necessary to read information (release code) from a tag or the like. Therefore, if specified, the code type is discriminated (step 901 → step 902). If the information to be acquired is a passcode, the process proceeds to step 904, and an input dialog is displayed to the user. Prompt for code. If the information to be acquired is a two-dimensional bar code, the process proceeds to step 903, where a code reader (camera function and two-dimensional bar code decoding function) is activated to obtain a release code (here, manually input by the user) 2D bar code reading is used as an example, but information may be acquired by wireless communication or the like). In the next step 905, the acquired release code and its type are set in the “acquisition condition parameter”. The “acquisition condition parameter” is a parameter transmitted to the service providing server 3. If there is no designation of "transmission code transmission" (step 901), steps 902 to 905 are skipped.

  In the subsequent step 906, it is determined whether or not “position information transmission” (information acquired in step 802 in FIG. 8) is designated. Since “position information transmission” requires that the current position of the terminal device 1 is within a set range as a condition for acquiring a frame, the current position information of the terminal device 1 is used as the service providing server 3. To indicate that it needs to be sent. When “position information transmission” is designated, the GPS receiver 150 is activated to perform GPS positioning, and the position information obtained by this and the positioning accuracy (positioning level information) are acquired. "Condition parameter" is set (step 906 → step 907). On the other hand, if “position information transmission” is not designated, step 907 is skipped and the “parameter acquisition process” is terminated. The parameter acquisition process (steps 906 to 907) related to “position information transmission” may be performed prior to the parameter acquisition process (steps 901 to 905) related to “transmission code transmission”.

  As a result of the above processing, information to be transmitted to the service providing server 3 (information regarding the frame acquisition condition) is set in the “acquisition condition parameter”.

  Returning to FIG.

  In step 810 following step 809 (the process of FIG. 9), the frame mount ID, the frame ID (frame ID selected by the user), the acquisition condition parameter, and the terminal identification information are transmitted to the service providing server 3. . In the service providing server 3 that has received the information, the process of FIG. 10 to be described later is performed. As a result, the terminal device 1 is either “acquired frame image” or “acquired failure (and reason)”. Receive information.

  If the acquisition of the frame image is successful, the acquisition flag of the holding frame image attribute table (FIG. 20) is set to “true”, the camera unit 120 is activated to perform the shooting process, and the photograph obtained thereby A process of superimposing a frame image on (combining process) is performed (step 811 → step 812 → step 813 → step 814). On the other hand, if the acquisition is unsuccessful, the fact of the acquisition failure and the reason are displayed on the screen, and the “frame shooting process” is terminated (step 811 → step 808). If the holdable flag of the frame is true (determined with reference to the hold frame image attribute table), the frame image is held in the terminal device 1 after shooting (photo compositing process) (stored in the storage unit 130). However, if the holdable flag is false, a process for deleting the frame image is performed (the frame image is not held in the terminal device 1).

  When frame shooting processing (photo combination) is performed, a thumbnail image is generated based on the combined photo, and the generated thumbnail image is stored in the “thumbnail image” in the holding frame image attribute table (FIG. 20). You may make it set as. By performing such processing every time, the previously taken photo (photo after frame synthesis) is displayed as a thumbnail for selecting a frame on the frame selection screen displayed by the processing of FIG. Alternatively, when frame shooting processing is performed, the path (storage location) of the image data (photo after frame synthesis) is set as “thumbnail image” in the holding frame image attribute table (FIG. 20). 7, if a path is set as a “thumbnail image”, the image data of the path (photo after frame composition) may be reduced and displayed on the frame selection screen. (An effect similar to the above is obtained). The information of the “thumbnail image” in the holding frame image attribute table (FIG. 20) updated by these is transmitted to the server side in the processing of step 606 in FIG. 6 described later, and managed as user information in the server. It may be allowed. Along with this, by returning the information from the server to the terminal device by the processing of FIG. 13 described later, and setting the application based on the information in the terminal device that has received this (step 607 in FIG. 6), Even if there is a change in the mount, a picture taken before (a picture after frame synthesis) may be displayed as a thumbnail for selecting a frame.

  If the acquisition flag is “true” as a result of the determination in step 803, the process proceeds to step 804 to determine whether the holdable flag is true or false. If the holdable flag is true as a result of the determination in step 804 (that is, the acquisition flag and the holdable flag are both true), the frame is already acquired and can be held in the terminal. Therefore, a frame image exists in the terminal device 1. Therefore, the process proceeds to step 813 and the camera photographing and the photo composition process are executed immediately. On the other hand, as a result of the determination in step 804, if the holdable flag is false (that is, the acquisition flag is true and the holdable flag is false), it has been acquired (used) in the past (that is, the conditions regarding the acquisition order). Is a frame that has been cleared), but is a frame that cannot be retained in the terminal, and therefore there is no frame image in the terminal device 1, and acquisition from the server is required. Therefore, step 805 to step 807 are skipped, and the processing after step 809 is executed. Note that the photographing process in step 813 may be performed first. In other words, the frame selection or acquisition process may be performed after shooting to perform the synthesis process.

  For the above processing, the screen transition diagram of the terminal device 1 is referred to. FIG. 22 is a screen transition diagram when an initial frame or the like has been acquired and the terminal holds a frame image. An explanatory text about the frame (thumbnail) highlighted on the leftmost screen is displayed (based on the information in the holding frame image attribute table (FIG. 20)). When this is selected, the camera shooting and composition processing are immediately performed. It is executed (the flow from step 803 to step 804 to step 813).

  FIG. 23 is a screen transition diagram in a case where “position information transmission” is designated. An explanatory text about the frame (thumbnail) highlighted on the leftmost screen is displayed. When this is selected, a hint of the location is displayed ("Acquisition method character in the holding frame image attribute table (FIG. 20)"). Column "). Next, the positioning of the position information is executed, and if the frame is acquired as a result of sending it to the server, the screen on the right end is displayed (step 803 → step 809 (step 906 → step 907 in FIG. 9) → step. Step 810 → Step 811 → Step 812) If the frame is not acquired, the lower right screen is displayed (Step 803 → Step 809 (Step 906 → Step 907 in FIG. 9) → Step 810 → Step 811). (The flow of step 808).

  FIG. 24 is a screen transition diagram when “acquisition order” is designated. An explanatory text about the frame (thumbnail) highlighted in the leftmost screen is displayed. When this is selected, it is determined whether the acquisition order condition is satisfied. The frame image is acquired in the upper part of the figure (step 803 → step 805 → step 806 → step 807 → step 809˜). On the other hand, when the acquisition order condition is not satisfied, the lower screen is shown (step 803 → step 805 → step 806 → step 807 → step 808).

  Next, processing in the service providing server 3 that has received the information transmitted from the terminal device 1 in step 810 of FIG. 8 will be described. FIG. 10 is a flowchart showing an outline of the processing operation of the processing (frame acquisition processing) in the server.

  Steps 1001 to 1003 are determination processing related to area limitation, which is a frame acquisition condition. Similarly, step 1004 to step 1006 are determination processing related to code limitation, step 1007 to step 1009 are determination processing related to time limitation, and step 1010. Step 1013 is a determination process related to quantity limitation. Any of these determination processes may be performed first.

  In step 1001, it is determined whether or not the acquisition condition parameter received from the terminal device 1 has position information. If there is this, “acquisition condition (region) suitability determination processing” is executed (step 1002). . FIG. 11 is a flowchart showing an outline of the processing operation of the “acquisition condition (region) suitability determination process”.

  In step 1101, the acquisition condition is acquired with reference to the acquisition condition (region limited) table (FIG. 16A) based on the frame mount ID, the frame ID, and the positioning level (both are information received from the terminal device 1). To do.

  In the subsequent step 1102, a circle centered on the position information (information received from the terminal device 1) and having a radius corresponding to the positioning level is generated. Since the positioning level assumes information indicating that “error is less than 50 m” in this embodiment, the radius is also set to 50 m or 100 m as it is. For example, when the positioning level is information on the number of satellites supplemented, the number information and the distance (radius) information corresponding to the information are defined in the acquisition condition (region limited) table. In this case, a circle may be generated based on this.

  In the subsequent loop processing, the processing in steps 1103 to 1104 is performed by the number of figures (= regions) set in the acquisition condition (region limitation) table (FIG. 16A). “Graphic” here refers to a graphic with map coordinates. Since there are cases where a plurality of locations are set, processing is executed for all the graphics (= regions) by loop processing. .

  In step 1103, a process of generating a graphic from the graphic data based on the graphic type in the acquisition condition (region limited) table (FIG. 16A) is executed. The graphic type is a type such as a line or a polygon, and the graphic data is a point (map coordinate) or the like. For example, when there are three map coordinates as graphic data, a triangular figure is generated when the graphic type is polygon, and a line connecting three points is generated when the graphic type is line. Is. In this figure generation process, positioning level information is also used, and a graphic type or graphic data is selected according to the positioning level, and graphic generation processing is performed (correspondence between positioning level and graphic type or graphic data). (Attachment is made to the acquisition condition (region-only) table). More specifically, the lower the positioning level, the smaller the figure (= region) range. When the positioning level is low, the specific error of the self-position is large, and the circle generated in step 1102 (indicating the range where the terminal device 1 will exist) becomes large. In a later process, it is determined whether or not there is the terminal device 1 in the set area by determining whether or not the circle and the figure (= area) in step 1103 are in contact with each other. If the figure (= region) in a certain step 1103 is constant, the result is that the condition becomes loose when the circle is large (positioning level is low). Therefore, even when the positioning level is low, the range of the figure (= area) is changed according to the positioning level so that the condition for contact with the set area (graphic) does not become too loose. It should be noted that it is possible to prevent the “contact condition from becoming loose” by keeping the radius of the circle generated in step 1102 constant regardless of the level of the positioning level. Indicates the range within which the terminal device will be present, and therefore the processing of this embodiment is superior to making the circle constant while ignoring the positioning level.

  In the subsequent step 1104, it is determined whether or not the circle generated in step 1102 and the graphic generated in step 1103 are in contact with each other. If not, the loop process proceeds (processing of the next graphic (region)). If there is contact, the process exits the loop and proceeds to step 1105 to return information indicating “acquisition of acquisition conditions”. When the loop is finished (that is, when no figure (= region) is touched), information indicating that “acquisition condition is not met” is returned, and “acquisition condition (region) suitability determination process” This process is terminated (step 1106).

  Returning to FIG.

  In step 1003 subsequent to step 1002 in FIG. 11, it is determined whether or not the return value obtained by the “acquisition condition (region) suitability determination process” is the acquisition condition conformity. If the acquisition condition is met, the process proceeds to step 1004. If the acquisition condition is not met, the process proceeds to step 1015 to indicate that the frame acquisition has failed and the reason (the area is not in the area where the frame can be acquired). The positional relationship between the circle and the graphic described above is discriminated, and hint information such as “slightly more east” may be returned) as a return value (information to be returned to the terminal device 1).

  In step 1004, it is determined whether or not the acquisition condition parameter received from the terminal device 1 has a release code. If there is, the frame mount ID, frame ID, code type, (information received from the terminal device 1). ) Based on the acquisition condition (cancellation code) table (FIG. 17A), the acquisition condition is acquired.

  In the subsequent step 1006, it is determined whether or not the code information as the acquisition condition acquired from the acquisition condition (release code) table and the release code received from the terminal device 1 are compatible. Then, the fact that the frame acquisition has failed and the reason (information indicating that it is not a cancellation code that can acquire the frame) is set as a return value (information to be returned to the terminal device 1). On the other hand, if it matches (or if the acquisition condition parameter has no release code as a result of the determination in step 1004), the process proceeds to step 1007.

  In step 1007, it is determined whether there is an acquisition condition by referring to the acquisition condition (time limited) table (FIG. 16B) corresponding to the frame mount ID and frame ID (information received from the terminal device 1). To do. If the acquisition condition is set, the process proceeds to step 1008 to execute “acquisition condition (time) suitability determination process”. FIG. 12 is a flowchart showing an outline of the processing operation of the “acquisition condition (time) suitability determination process”.

  In step 1201, an acquisition condition (time zone information) is acquired from an acquisition condition (time limited) table corresponding to the frame mount ID and frame ID.

  In the subsequent loop processing, the processing in step 1203 is performed for the number of time zones set in the acquisition condition (time limited) table. Since a plurality of time zones may be set, the processing is executed for all the time zones by loop processing.

  In Step 1203, it is determined whether or not the current time is between the start date and time and the end date and time set in the acquisition condition (time limited) table. If not, the loop process is performed (in the next time zone). If applicable, exit the loop and go to step 1204 to return information indicating “acquisition of acquisition conditions”. When the loop is completed (that is, when it does not conform to any time zone), information indicating that “acquisition condition non-conformity” is returned and “acquisition condition (time) conformity determination processing” is performed. The process ends (step 1205).

  Returning to FIG.

  In step 1009 following step 1008, which is the process of FIG. 12, it is determined whether or not the return value obtained by the “acquisition condition (time) suitability determination process” is the acquisition condition conformity. If the acquisition condition is met (or if the result of determination in step 1007 is that there is no acquisition condition related to time), the process proceeds to step 1010. If the acquisition condition is not met, the process proceeds to step 1015. The acquisition failure and the reason (information indicating that it is not the time zone in which the frame can be acquired) are set as return values (information to be returned to the terminal device 1).

  In step 1010, referring to the acquisition condition (quantity limited) table (FIG. 18 (a)) corresponding to the frame mount ID and frame ID (information received from the terminal device 1), the acquisition enable flag is true or false. Is determined. If the acquisition permission flag is false, the process proceeds to step 1015, and the return value (terminal device) indicates that the frame acquisition has failed and the reason (information indicating that the distribution limited quantity of the corresponding frame has ended). Information to return to 1).

  If the acquisition enable flag is true, the frame mount ID and the “counter” in the acquisition condition (quantity limited) table corresponding to the frame ID are incremented (step 1011), and the incremented counter becomes the “upper limit counter”. It is determined whether or not it is less than (step 1012). If it is less, the process proceeds to “frame image acquisition processing” in step 1014. If the counter reaches the upper limit counter, the acquisition enable flag is set. If it is false, the process proceeds to “frame image acquisition process” in step 1014.

  The “frame image acquisition process” in step 1014 is the process shown in FIG. When calling the processing of FIG. 4 from step 1014, the frame mount ID, the frame ID, the terminal identification information, and the acquisition condition parameter (both are information received from the terminal device 1) are given as arguments (step 401).

  In step 402, the parameter permission flag of the terminal corresponding frame image table (FIG. 15B) is referred to based on the frame mount ID, the frame ID, and the terminal identification information. The parameter permission flag is a flag indicating that a parameter is added to the frame image path (URL), and the parameter (location information, release code, etc.) is passed to the external server (content providing server 4), thereby providing the content providing server. 4 can also change the content (frame image) to be provided according to the parameters.

  In step 403, it is determined whether the parameter permission flag is true. If it is true, the process proceeds to step 404 to add an acquisition condition parameter to the frame image path (URL). On the other hand, if the permission flag is false, step 404 is skipped.

  In the subsequent step 405, processing for acquiring a frame image file from the location is executed based on the frame image path. Note that the processing in FIG. 4 is mainly processing assuming that a frame image is acquired from an external server (content providing server 4), but the same applies when the service providing server 3 possesses a frame image. (The difference is that the frame image path only points to a location in the service providing server 3).

  When a frame image is acquired by the above processing (step 1014 in FIG. 10), the frame image is transmitted to the terminal device 1. When acquisition fails (step 1015), a return value (acquisition failure and its reason is displayed). (Information shown) is transmitted to the terminal device 1 (the terminal device 1 performs the determination processing in step 811 of FIG. 8 by receiving the information).

  An example of the screen transition of the terminal device 1 based on the said process is FIG. An explanatory text about the frame (thumbnail) highlighted on the leftmost screen is displayed. When this is selected, if the frame is acquired as a result of determining the acquisition condition in the server, the screen on the upper right is displayed. (Step 810 → (Step 1010 in FIG. 10 of server side processing → Step 1011 → ˜ → Step 1014) → Step 811 → Step 812-12), and if the frame is not acquired, the lower right screen is displayed ( Step 810 → (Step 1010 → Step 1015 in FIG. 10) → Step 811 → Step 808)

  Returning to FIG. 6, the description will be continued.

  In the above description, the frame photographing process performed in steps 601 to 603, the server-side process necessary for the frame photographing process, and the like have been described.

  When “change setting” is selected on the menu screen (FIG. 21) and there is a request to change the mount (step 604), the process proceeds to step 605 to select the frame mount ID. This processing is performed by displaying a list of a plurality of frame mount IDs possessed by the application or downloaded from the server (the display may be displayed as it is, but the category name such as “C character frame”). Selected by the user, a user directly inputting a frame mount ID, a frame mount ID obtained by reading two-dimensional barcode information, and the like.

  In the subsequent step 606, a process of transmitting the frame mount ID before the change, the acquisition flag of each frame, and the frame mount ID after the change to the service providing server 3 together with the terminal identification information and the user ID is performed. This is for managing user information (acquisition status of frames belonging to the frame mount ID before change) on the server side.

  If there is a response from the service providing server 3 to the information transmission in step 606 (the server side processing will be described below), the application about the frame mount ID after the change is based on the information included in the response And the display process of the screen (menu screen (FIG. 21)) is performed (step 607).

  FIG. 13 is a flowchart showing an outline of the processing operation in the service providing server 3 when the information from the terminal device 1 in step 606 is received.

  In step 1301, the user data management table (FIG. 18B) is updated (generated if there is no corresponding table) based on the received frame mount ID before change, the acquisition flag of each frame, and the user ID.

  In the subsequent step 1302, the “frame mount information acquisition process” (the process of FIG. 3) is executed based on the received frame mount ID after change and the terminal identification information, and based on the changed frame mount ID and user ID. The user data management table (FIG. 18B) is searched, and if there is a corresponding table, an “acquisition flag” is acquired to determine whether it is true or false (step 1303).

  For the frame ID (and frame mount ID) for which the acquisition flag is true, the authenticity of the holdable flag is determined with reference to the frame image attribute table (FIG. 15A), and processing is performed if it can be held. A frame image is added to the result (information to be transmitted to the terminal device 1). Note that the “acquisition flag” acquired in step 1303 is also added to the processing result (information transmitted to the terminal device 1) (step 1304).

  In step 1305, the processing result (initial setting information in step 1302 and setting information based on user information in step 1304) is transmitted to the terminal device. In the terminal device 1, when user information is managed on the server side by setting an application with the received information (step 607 in FIG. 6), a frame image is already acquired for the already acquired frame. Downloaded and ready to use.

  In this embodiment, the user first selects a desired frame (thumbnail) and whether or not to allow the acquisition of the frame has been described as an example. The user selects only “I want to do”, sends the acquisition condition parameter to the server, and determines whether there is a frame that can be acquired based on the received parameter and the condition (for example, time) that can be determined by the server. When this occurs, the frame image may be transmitted to the terminal device, and the terminal device that has received the frame image may be able to acquire or shoot the frame. Since frames cannot be acquired unless the conditions are met, frame shooting is not performed, and if there is a condition, frame shooting is performed (you do not know what kind of frame it will be) can do. In this case, when the acquisition condition parameter is transmitted from the terminal device, the one that requires the user's operation for acquisition of the acquisition condition parameter becomes complicated, so that it can be automatically acquired by the device (for example, a position using GPS) Information) may be used alone, or the acquisition condition parameter may not be transmitted from the terminal device, and processing may be performed based only on a condition that can be discriminated on the server side.

  In addition, even when a frame is selected by the user, it is determined whether or not the specific condition is met and the frame selected by the user is changed when the frame is met. There may also be a change in the frame using the acquisition condition parameter mentioned in the description of the processing in FIG. FIG. 26 shows an example of screen transition of the terminal device 1 in such processing. An explanatory text about the frame (thumbnail) highlighted on the leftmost screen is displayed. When this is selected, the acquisition condition in the server is determined. In the case of this example, on the server side, based on the position information acquired from the terminal device 1, processing for acquiring weather information at the position, and (if the weather information is owned by itself, the server acquires based on it) Or may be acquired by inquiring to an external weather information providing server), and a determination process is performed to determine whether there is a frame corresponding to the weather (the acquisition condition table regarding weather is Required). As a result, when the frame can be acquired, the frame image (for example, a rain version frame arranged in the frame selected by the user) is transmitted to the terminal device 1.

  As described above, according to the imaging data processing system of this embodiment, frame information (processing data) corresponding to the current position (self-position information) in a digital camera or a mobile phone having a self-position acquisition means using GPS. ) Can be used such that a frame is added to a photograph (imaging data). Therefore, it is possible to provide a new usage method in an information processing apparatus that can capture a still image or a moving image including self-position acquisition means such as GPS. In the present embodiment, a device that uses GPS is used as an example of the self-location acquisition unit. However, for example, a wireless tag or bar installed (attached) at a specific location using a wireless tag, a barcode, or the like. The current position information may be acquired by reading the information from the code (that is, the terminal device is provided with an IC reader, a barcode reader, etc., which functions as a self-position acquisition unit) In the case of a mobile phone, the current position information is acquired from the base station information, or the current position information of the slave unit (terminal device) is acquired from the access point information in a wireless network such as a wireless LAN. It may be a thing.

  In addition to the acquisition of the frame corresponding to the current position information, other acquisition conditions (processing data specifying information) are also associated with the frame image that is the processing data, and various services (new data) are provided to the user. Use method). In this embodiment, the time information, code information, order information, and quantity information have been described as examples of “processing data specifying information”. However, various other conditions (information) are used as “processing data specifying information”. You can do it. For example, although mentioned a little in the description, the weather information may be used as “processing data specifying information”. As described above, the weather information may be acquired from the weather information providing server. However, the terminal device is provided with a weather observation unit (such as a temperature observation unit or a humidity observation unit), and is obtained from the weather observation unit. Information may be transmitted to the server and used for frame acquisition and change determination.

  The subject information may be used as “processing data specifying information”. The terminal device is provided with an image recognition unit, and the information obtained from the image recognition unit is transmitted to the server (or the server side is provided with the image recognition unit, and the imaging data is transmitted from the terminal device to the server. It may be used for image discrimination), frame acquisition and change discrimination, and photo processing. For example, when it can be determined that the subject is a human (face), an image of a character or the like is added around the face.

  The event information may be used as “processing data specifying information”. The event information is based on the operation history of the user terminal device. For example, information such as the number of times this application has been started and the number of times frame shooting has been performed with this application is managed as a history on the terminal device or server side, and frames that can be acquired when a certain number is exceeded are set. Or a frame that is acquired or changed based on user information set by the user (for example, a birthday can be managed and a special frame can be acquired for the birthday) For example, you can manage your hometown or home so that you can get a special frame if you are in that area). It can be said that the acquisition of the code information described in the embodiment also corresponds to this event information.

  Audio information may be used as “processed data specifying information”. The terminal device may be provided with an audio information acquisition unit (microphone), and information obtained from the audio information acquisition unit may be transmitted to a server and used for frame acquisition or change determination. For example, it may be used to determine the frequency or the like of a sound and use it to acquire or change a frame, or simply determine the volume of a sound and use it to determine the acquisition or change of a frame. It may be a thing.

  Numerical information may be used as “processing data specifying information”. The order information and quantity information in this embodiment can also be said to correspond to this numerical information, but in addition, for example, when a random number is generated and the random number falls within a defined numerical range, a frame is acquired or changed. It may be a thing.

  The point information may be used as “processing data specifying information”. The information obtained at that point is used to acquire or change the frame. The information obtained at the point is, for example, information obtained from an IC tag or barcode installed in the site, or the point obtained by performing a map search (inquiring to the map information providing server) from the position information. Facility information. Thereby, for example, when entering a facility such as an amusement park, it is possible to obtain an entrance number using an IC tag or the like (requires handling at the local facility) and embed the entrance number in the frame.

  The azimuth information may be used as “processing data specifying information”. The terminal device may be provided with an orientation information acquisition unit, and information obtained from the orientation information acquisition unit may be transmitted to a server and used for frame acquisition or change determination. For example, a representative constellation of that direction is drawn on the frame (it is possible to obtain a constellation frame only at night, along with time information, or a frame of the constellation of that direction at that time (time)) May be a good process). The orientation information acquisition unit is, for example, a geomagnetic sensor. The traveling direction may be determined by performing position acquisition a plurality of times (in this case, an “azimuth information acquisition unit” may be provided on the server side).

  In addition to the azimuth information acquisition unit, a focus information acquisition unit is also provided so that the subject's position can be determined based on the self-position information, the azimuth information, and the focus information (that is, based on the reference position, direction, and distance). The position may be calculated and used for frame acquisition or change determination based on the subject position information.

  In order to determine whether to acquire or change a frame based on each of the “processed data specifying information (acquisition conditions)” exemplified above, it is a matter of course that a “condition table” that defines each condition is set. Although it is a premise, the basic idea is the same as the acquisition condition table described in the embodiment (As long as each processing data specifying information (acquisition condition) and processing data (frame) are associated with each other). . The point that each “processing data specifying information (acquisition condition)” can be processed in combination is also as described in the embodiment.

  As described above, the processing data is acquired or changed based on the correspondence between the processing data specifying information and the processing data, and the imaging data captured by the imaging data processing device (terminal device) using the acquired processing data. Is processed. Various pieces of processing data specifying information are conceivable, and combinations thereof can be freely performed. Therefore, various services can be provided to the user. In particular, environmental information (location information, weather information, voice information, etc.) near the location where the terminal device is located is information based on the location where the user is located. Can be provided.

  The association between the machining data specifying information and the machining data may be dynamically changed. For example, by dynamically changing the position information associated with the processing data (frame), even if a specific frame is used for a photograph taken at point A at one time, point A at another time Since a different frame is used for the photos taken in (no additional processing of or frames is performed), taking a photo at the same location does not always give the same result, time and time Depending on the case, different results will be obtained. Therefore, various services can be provided to the user. The method of dynamically changing the position information is, for example, a method in which a random number is generated every fixed period and “graphic data” or “graphic type” is changed based on the random number, or based on a numerical value obtained from time information. The “graphic data” and the “graphic type” are changed (for example, arithmetic processing is performed based on a specific mathematical expression using numerical values such as random numbers as coordinate information).

  The frame selection screen in this embodiment also functions as a “mounting book” of frames. That is, for the frames that have been acquired (used), the symbols are displayed as they are (thumbnail), and those that have not been acquired are displayed as thumbnails whose symbols are not known. Therefore, for the processed data (frame) used, the corresponding column of the “Mount Book” is filled in sequentially, and the column of the processed data that is not used is displayed with only the data name or silhouette display. It can be done. Therefore, it is possible to provide a service that enhances the user's desire to collect.

  If a frame can be acquired (or there is a frame) during the frame photographing process, the display unit 170 may display the frame superimposed on the image obtained by the camera unit 120. That is, apart from performing processing (compositing) processing for superimposing a frame on an image after shooting, “video with a frame superimposed on a subject” is displayed on the display unit. Thereby, the user can recognize what the image obtained after shooting is like before shooting.

  The imaging data processing system according to the present invention can also be used for orienteering and the like. According to the imaging data processing system according to the present invention, by combining the area limitation and the order limitation, each frame cannot be acquired unless “frame shooting” is performed in the order determined by the determined points. Therefore, only when “frame shooting” is performed in the correct order at the correct point, processing such as “nth point passing OK” can be superimposed on the photograph. Therefore, the participant can recognize whether or not he / she has reached the correct order by performing “frame shooting” at each point, and also serves as a trail indicating that the photograph at each point has correctly passed the point.

  In addition, by using the imaging data processing system according to the present invention, it is possible to provide a service that provides a past landscape of a place where a photograph was taken. In place of the “frame” described in the embodiment, past photographs at the position are associated as “processing data”, and the actually photographed photograph and the past photograph are arranged (embedded as an or sub-screen). It is possible to generate an image. Further, the user may be allowed to acquire a past photo or the like corresponding to each age by inputting the age. By doing this, for example, “frame shooting” is performed at the castle ruins where there is no castle tower, so that the left half generates photo data composed of the current shoot and the right half of the castle tower. be able to.

  In this embodiment, the frame image is used as an example of “processed data”. However, “processed data” is not limited to this, and some processing for “imaging data (moving image or still image)” is performed. It may be information to do. For example, in addition to image data to be superimposed on a photograph or the like used in the embodiment, text data to add text to “imaging data”, audio data to add voice to “imaging data”, or “imaging data” "Is information for driving a drive portion (for example, a vibration device) provided in a device that performs the reproduction when" "is reproduced (screen display or the like).

  Also, a plurality of “processing data” and processing processes may be combined. Different types of processing data and processing may be combined, or the same type of processing data and processing may be combined. “Combination of processing data of the same type” is, for example, processing by combining a plurality of image data. As an example according to the present embodiment, a photograph is processed by using a frame image based on region limitation, a clear mark icon image based on weather information, and a sweaty character image based on temperature information. It ’s like that.

  In the present embodiment, various tables are described with specific configuration examples, but the present invention is not limited to this. It is sufficient that necessary information is stored in association with each other based on the above-described gist of the present invention, and how much normalization is performed as a DB in actual implementation is appropriately determined. That's fine.

  In this embodiment, a mobile phone is described as a specific example of the terminal device. However, in other portable information processing devices such as a PDA, a portable game machine, a digital camera / digital video camera, and a notebook PC. Of course, it can be applied. Further, although the usage scene is limited, the scope of application of the present invention is not limited to a portable terminal device, and for example, it may be operated on an ordinary stationary PC (various types). It can be applied to the information processing apparatus of the above).

  In this embodiment, the terminal device 1 acquires necessary information from another device (the service providing site 3 or the content providing server 4), but the terminal device 1 itself has all necessary information, The processing performed on the server side described above may be performed by the terminal device (that is, the terminal device operates alone). The “necessary information” may be provided in the storage unit 12 incorporated in the apparatus, or obtained via a removable storage medium (semiconductor memory, optical disk medium, magnetic disk medium, etc.). There may be.

  Conversely, part of information held by the terminal device 1 and part of processing executed by the terminal device in the present embodiment may be possessed and executed on the server side via the network. (For example, determination processing related to the acquisition order). Even if the main processing is executed on the server in response to a request from the terminal device and the processing result is returned to the terminal device as a response, the same function as described above can be realized. Good. In this embodiment, in response to a command (request) obtained from the input unit, the control unit executes each process while using each piece of information in the storage unit. In response, each process is performed while using each information (or information obtained from the terminal or information obtained from another server) in the server, and the processing result is transmitted to the terminal device as a response. The received terminal device may output the result to the display unit. It is possible to appropriately select which device has each information and which device performs each process.

  However, for user data management on the server side and processing related to limited quantity (providing services with limited quantity on a first-come-first-served basis assuming the existence of multiple users), naturally the "terminal device operates alone" Is not suitable. In reality, in view of the throughput of each terminal device, network, and server, information that should be managed on the server side or processing that should be executed on the server side (or managed on the terminal side is better) Information and processing that should be executed on the terminal side) exist. Normally, the throughput of the terminal device and the network is often low, so that there is a tendency to reduce the amount of information transmitted and received between the terminal device and the server and to perform heavy processing on the server side.

  A first imaging data processing apparatus according to the present invention is an imaging data processing apparatus that can capture a still image or a moving image by including an image capturing unit, and includes a control unit, a storage unit, a self-position acquisition unit, Image data obtained by photographing by the image photographing means by storing the positional information and the processed data in association with each other in the storage unit or in a storage medium removable from the imaging data processing device. The processing using the processing data corresponding to the self-position information acquired by the self-position acquisition unit is executed on the data.

  According to the above configuration, positional information and processing data are managed in association with each other, processing data corresponding to “self-position” acquired by the imaging data processing device is acquired based on the positional information, and the processing data is used. Then, the processing for the image data captured by the image data processing apparatus is performed. For example, a photograph taken using frame information (processed data) corresponding to the current position (self-position information) in a digital camera or mobile phone (imaging data processing apparatus) provided with self-position acquisition means using GPS or the like It can be used such that a frame is added to (imaging data). The “processed data” is information for performing some processing on the “imaging data”. For example, image data to be superimposed on a photograph or the like, audio data to which sound is added to the “imaging data”, “ This is information for driving a drive portion provided in a device that executes the reproduction when the “imaging data” is reproduced (screen display or the like).

  A second imaging data processing apparatus according to the present invention is an imaging data processing apparatus that can capture a still image or a moving image by including an image capturing unit, and includes a control unit, a storage unit, a self-position acquisition unit, A processing unit that associates self-position information acquired by the self-position acquisition unit with imaging data obtained by photographing by the image photographing unit and associates position information with processing data. The processing data corresponding to the self-position information is acquired from the server or the processing data holding server determined by the association via the communication unit, and the processing processing is performed on the imaging data obtained by the imaging using the acquired processing data It is characterized by performing.

  According to the above configuration, the position information and the processing data are managed in association with each other in the server on the network, and the imaging data processing device acquires the processing data from the server via the network and executes the processing.

  A third imaging data processing device according to the present invention is the first or second imaging data processing device for specifying the processing data in the processing data stored in the storage unit or the storage medium. By storing the processing data specifying information in association with each other or by storing the processing data specifying information in association with the processing data in the processing data association server or the processing data holding server, the imaging The processing data corresponding to the processing data specifying information acquired by either a data processing device or each of the servers is determined, and the processing using the processing data is executed.

  According to the above configuration, in addition to the acquisition of the processing data based on the association between the position information and the processing data, the processing data is acquired based on the association between the processing data specifying information and the processing data, and the acquired processing Processing is performed on the image data captured by the image data processing apparatus using the data.

  A fourth imaging data processing device according to the present invention is the third imaging data processing device, wherein the processing data specifying information is time information or time information, and either the imaging data processing device or each of the servers is used. By providing the time measuring unit, the processing using the processing data corresponding to the time or time information acquired by the time measuring unit is executed, or the processing data specifying information is weather information, and weather information The processing data corresponding to the acquired weather information is used by acquiring weather information from a providing server or by acquiring the weather information from the imaging data processing apparatus provided with the weather observation unit. The processing data specifying information is subject information, and the imaging data processing device or the previous Any one of the servers includes an image recognition unit, so that the processing using the processing data corresponding to the subject information recognized by the image recognition unit is executed, or the processing data specifying information is event information. Yes, executing the processing using the processing data corresponding to the event information accumulated by either the imaging data processing device or each of the servers, or the processing data specifying information is audio information, When the imaging data processing apparatus includes a voice information acquisition unit, the processing using the processing data corresponding to the voice information acquired by the voice information acquisition unit is executed, or the processing data specifying information is a numerical value. Information, and either the imaging data processing device or each of the servers includes a numerical information generating unit, The processing using the processing data corresponding to the numerical information generated by the report generator is executed, or the processing data specifying information is direction information, and either the imaging data processing device or each of the servers By providing the azimuth information acquisition unit, the processing using the processing data corresponding to the azimuth information acquired by the azimuth information acquisition unit is executed, or the processing data specifying information is point information, and the imaging Either the data processing device or each of the servers includes a point information acquisition unit, so that the processing using the processing data corresponding to the point information acquired by the point information acquisition unit or the processing using the point information is performed. The process is executed.

  According to the above configuration, the processing data specifying information includes “time information or time information”, “weather information”, “subject information”, “event information”, “voice information”, “numerical information”, “azimuth information”, Any one or more of the “point information” is associated with “process data”, the process data is acquired based on the association between the process data specifying information and the process data, and the process for the imaging data is executed. . For example, in a digital camera or mobile phone equipped with self-position acquisition means using GPS or the like, a frame is added to “photographed” using frame information corresponding to the current position, and further weather information is acquired (self For example, the weather data at the corresponding position is acquired from the weather server based on the position information), and a weather icon (processed data) corresponding to the weather information is added to the photograph.

  A fifth imaging data processing device according to the present invention is any one of the first to fourth imaging data processing devices, wherein the imaging data processing device includes an orientation acquisition unit and a focus information acquisition unit. Based on the self-position information, the azimuth information acquired by the azimuth acquisition unit, and the focus information acquired by the focus information acquisition unit, either the imaging data processing device or each server A position is calculated, the processing data corresponding to the subject position information is determined, and the processing using the processing data is executed.

  According to the above configuration, the position of the subject is calculated based on the self-position information, the azimuth information, and the focus information, and the processing process for the imaging data is executed using the processing data corresponding to the position information.

  A sixth imaging data processing apparatus according to the present invention is any one of the first to fifth imaging data processing apparatuses, and dynamically changes the position information associated with the processing data. And

  According to the above configuration, the position information associated with the machining data changes dynamically. Thus, for example, even if a certain frame is used for a photograph taken at a point A at a certain time, another frame is used for a photograph taken at a point A at another time.

  A seventh imaging data processing device according to the present invention is any one of the first to sixth imaging data processing devices, comprising a display unit, wherein the processing data is superimposed on the imaging data. By displaying the image, moving image data, or text data, the image captured at the time of shooting is displayed on the display unit, and the still image, moving image, or text based on the processed data is superimposed on the image and displayed on the display unit It is characterized by making it.

  According to the above configuration, at the time of shooting, the processed image using the processed data is displayed on the display unit of the imaging data processing apparatus.

  An eighth imaging data processing device according to the present invention is any one of the first to seventh imaging data processing devices, and includes a display unit, whereby the processing unit includes the processing data in the processing data. In addition to displaying a list of items used for processing, information about machining data that has not been used yet is also displayed in a list.

  According to the above configuration, a list of processing data used as processing for the imaging data and a list of information related to processing data that has processing data associated with position information but is not yet used for processing Will be displayed. For example, a display format such as “mounting book” that stores all (not necessarily “all”) processing data is used, and the processing data (for example, a frame to be superimposed on a photograph) is sequentially used as a “mounting book”. The corresponding column of "" is filled in, and the column of processed data that is not used can be displayed with only the data name or silhouette display (display of information regarding the processed data).

  The first imaging data processing system according to the present invention is an imaging data processing system configured by connecting an information processing apparatus capable of capturing a still image or a moving image and a server via a network by including an image capturing unit. The information processing apparatus includes a self-position acquisition unit, and the server is a processing data correspondence server that associates position information with processing data. Imaging data obtained by imaging by acquiring the processed data corresponding to the self-position information acquired by the self-position acquiring unit from a server or a processed data holding server determined by the association It is characterized by executing the processing for

  A second imaging data processing system according to the present invention is an imaging data processing system configured by connecting an information processing apparatus capable of capturing a still image or a moving image and a server via a network by including an image capturing unit. The information processing apparatus includes a self-position acquisition unit, and the server is a processing data association server that associates position information with processing data, so that imaging data obtained by photographing by the image photographing unit is obtained. The self-position information acquired by the self-position acquisition unit is associated with the image data and the self-position information for which the association is performed is transmitted to the processing data association server, and the image data and the self-position information are transmitted. In the processing data association server that has received the data, the imaging data is processed using the processing data corresponding to the self-position information. And executes the processing for.

  A third imaging data processing system according to the present invention is the first or second imaging data processing system, wherein processing data specifying information for specifying the processing data is associated with the processing data. The processing data specifying information acquired by the information processing apparatus is transmitted to the processing data correspondence server and obtained by the photographing using the processing data corresponding to the processing data specifying information obtained as a response thereto. The processing data is processed, or the processing data specifying information acquired by the information processing apparatus, the self-location information, and the imaging data are associated with each other and transmitted to the processing data association server. Before the processing data correspondence server corresponds to the self-location information and the processing data specifying information. The processing data is processed using the processing data, or the processing data corresponding to the processing data specifying information acquired by any of the servers is determined and the processing data is used. A process is executed.

  A fourth imaging data processing system according to the present invention is the third imaging data processing system, wherein the processing data specifying information is time information or time information, and is either the information processing apparatus or each of the servers. Is provided with a time measuring unit, thereby executing processing using the processing data corresponding to time or time information acquired by the time measuring unit, or the processing data specifying information is weather information, and providing weather information Processing by using the processing data corresponding to the acquired weather information by acquiring weather information from a server or by acquiring the weather information by the information processing apparatus having a weather observation unit. Execute processing, or the processing data specifying information is subject information, and the information processing apparatus or each server Any one of which includes an image recognizing unit to execute processing using the processed data corresponding to the subject information recognized by the image recognizing unit, or the processed data specifying information is event information, Either the information processing device or each of the servers executes processing using the processing data corresponding to the event information accumulated, or the processing data specifying information is audio information, and the information processing device Is provided with a voice information acquisition unit, to perform processing using the processing data corresponding to the voice information acquired by the voice information acquisition unit, or the processing data identification information is numerical information, One of the information processing device and each of the servers includes a numerical information generation unit, and is generated by the numerical information generation unit. By executing the processing using the processing data corresponding to the value information, or the processing data specifying information is azimuth information, and either the information processing device or each of the servers includes a azimuth information acquisition unit , Execute processing using the processing data corresponding to the orientation information acquired by the orientation information acquisition unit, or the processing data specifying information is point information, and either the information processing device or each of the servers By providing a spot information acquisition unit, the processing using the processing data corresponding to the point information acquired by the point information acquisition unit or the processing using the point information is executed. To do.

  A fifth imaging data processing system according to the present invention is the imaging data processing system according to any one of the first to fourth aspects, wherein the information processing apparatus includes an orientation acquisition unit and a focus information acquisition unit. Thus, based on the self-position information, the azimuth information acquired by the azimuth acquisition unit, and the focus information acquired by the focus information acquisition unit, either the information processing apparatus or each server Is calculated, the processing data corresponding to the subject position information is determined, and the processing using the processing data is executed.

  A sixth imaging data processing system according to the present invention is the imaging data processing system according to any one of the first to fifth aspects, wherein the position associated with the processing data in any of the servers. It is characterized by changing information dynamically.

  A seventh imaging data processing system according to the present invention is the imaging data processing system according to any one of first to sixth, wherein the information processing apparatus includes a display unit, and the processing unit is provided with the processing unit. A list of data used for the processing is displayed, and information on processing data that has not been used is displayed in a list.

  The first imaging data processing server according to the present invention includes an image capturing unit and a self-position acquisition unit, and thereby an information processing apparatus capable of acquiring imaging data that is a still image or a moving image and self-position information; A server connected via a network, wherein when the self-position information is received from the information processing apparatus by associating the position information with the processing data, the self-position information corresponding to the self-position information Processing data is transmitted to the information processing apparatus.

  The second imaging data processing server according to the present invention includes an image capturing unit and a self-position acquisition unit, and associates the self-position information acquired by the self-position acquisition unit with imaging data that is a still image or a moving image. Information processing apparatus capable of performing image processing and a server connected via a network, and by associating position information with processed data, imaging data and self-position information associated with each other from the information processing apparatus Is received, the processing data corresponding to the self-position information is used to perform processing on the imaging data.

  A third imaging data processing server according to the present invention is the first or second imaging data processing server, wherein processing data specifying information for specifying the processing data is associated with the processing data. Thus, when the processing data specifying information is received from the information processing apparatus, the processing data corresponding to the processing data specifying information is transmitted, or the processing data corresponding to the processing data specifying information is used. The processing for the imaging data is executed, or the processing data corresponding to the processing data specifying information acquired by the server is determined and the processing using the processing data is executed. .

  A fourth imaging data processing server according to the present invention is the third imaging data processing server, wherein the processing data specifying information is time information or time information, and the information processing apparatus or the imaging data processing server By providing a time measuring unit, a process for determining the processed data corresponding to time or time information acquired by the time measuring unit is executed, or the processed data specifying information is weather information, and a weather information providing server A process for determining the processed data corresponding to the acquired weather information by acquiring weather information or by acquiring the weather information by the information processing apparatus provided with a weather observation unit. Or the processing data specifying information is subject information, and the information processing device or the imaging data is added. When the server includes an image recognition unit, a process of determining the processed data corresponding to the subject information recognized by the image recognition unit is executed, or the processed data specifying information is event information, and the information processing A process for determining the processed data corresponding to the event information stored in the apparatus or the imaging data processing server is executed, or the processed data specifying information is audio information, and the information processing apparatus acquires audio information A processing unit for executing processing for determining the processing data corresponding to the voice information acquired by the voice information acquisition unit, or the processing data specifying information is numerical information, and the information processing device or the When the imaging data processing server includes a numerical information generation unit, the numerical data generation unit generates the numerical data generation unit. The processing for determining the processing data corresponding to the numerical information is executed, or the processing data specifying information is azimuth information, and the information processing apparatus or the imaging data processing server includes a azimuth information acquisition unit. A process for determining the processed data corresponding to the azimuth information acquired by the azimuth information acquiring unit is executed, or the processed data specifying information is point information, and the information processing apparatus or the imaging data processing server performs the point information. By providing an acquisition unit, a process of determining the processing data corresponding to the spot information acquired by the spot information acquisition unit or a processing process using the spot information is executed.

  A fifth imaging data processing server according to the present invention is any one of the first to fourth imaging data processing servers, wherein the information processing apparatus includes an orientation acquisition unit and a focus information acquisition unit. The processing data corresponding to the subject position information is calculated by calculating the position of the subject based on the self-position information, the orientation information acquired by the orientation acquisition unit, and the focus information acquired by the focus information acquisition unit. It is characterized in that processing for discriminating is executed.

  A sixth imaging data processing server according to the present invention is any one of the first to fifth imaging data processing servers, and dynamically changes the position information associated with the processing data. And

  A seventh imaging data processing server according to the present invention is any one of the first to sixth imaging data processing servers, wherein the information processing apparatus includes a display unit, and the display unit stores the processing data. Among them, the one used for the processing is displayed as a list, and information for displaying a list of information regarding the processing data that has not been used yet is transmitted to the information processing apparatus.

  A first imaging data processing program according to the present invention is an information processing apparatus that can capture a still image or a moving image by including an image capturing unit, and includes a control unit, a storage unit, and a self-position acquisition unit. A self-position acquired by the self-position acquisition unit in the information processing apparatus in which the position information and the processing data are stored in association with each other in the storage unit or in a storage medium removable from the information processing apparatus A step of determining the presence or absence of processed data corresponding to the information, and a step of performing processing on imaging data obtained by photographing by the image photographing unit using the processed data when there is processed data as a result of the determination; Is executed.

  A second imaging data processing program according to the present invention is an information processing apparatus capable of capturing a still image or a moving image by including an image capturing unit, and includes a control unit, a storage unit, a self-position acquisition unit, and a communication The processing unit corresponding to the self-position information acquired by the self-position acquisition unit from a processing data association server that associates the position information with the processing data. And the step of performing processing on the image data obtained by photographing by the image photographing means by the obtained processing data.

  A third imaging data processing program according to the present invention is the first or second imaging data processing program for specifying the processing data in the processing data stored in the storage unit or the storage medium. By storing the processing data specifying information in association with each other or by storing the processing data specifying information in association with the processing data in the processing data association server or the processing data holding server determined by the association Determining the processing data corresponding to the processing data specifying information acquired by the information processing apparatus or by each of the servers, and using the processing data obtained by the determination Is executed.

  A fourth imaging data processing program according to the present invention is the third imaging data processing program, wherein the processing data specifying information is time information or time information, and is either the information processing apparatus or each of the servers. Is provided with a time measuring unit, thereby executing processing using the processing data corresponding to time or time information acquired by the time measuring unit, or the processing data specifying information is weather information, and providing weather information Processing by using the processing data corresponding to the acquired weather information by acquiring weather information from a server or by acquiring the weather information by the information processing apparatus having a weather observation unit. Or the processing data specifying information is subject information, and the information processing device or each of the devices One of the bars includes an image recognition unit, so that the processing using the processing data corresponding to the subject information recognized by the image recognition unit is executed, or the processing data specifying information is event information. , Execute processing using the processing data corresponding to the event information stored in either the information processing apparatus or each of the servers, or the processing data specifying information is audio information, and the information When the processing apparatus includes a voice information acquisition unit, a processing process using the processing data corresponding to the voice information acquired by the voice information acquisition unit is executed, or the processing data specifying information is numerical information. Any one of the information processing apparatus and each of the servers includes a numerical information generating unit, so that it is generated by the numerical information generating unit. Or the processing data specifying information is orientation information, and either the information processing device or each of the servers includes an orientation information acquisition unit. The processing using the processing data corresponding to the orientation information acquired by the orientation information acquisition unit is executed, or the processing data specifying information is point information, and the information processing device or each server Any one of them includes a point information acquisition unit, and performs processing using the processing data corresponding to the point information acquired by the point information acquisition unit or processing using the point information. And

  A fifth imaging data processing program according to the present invention is any one of the first to fourth imaging data processing programs, and the information processing apparatus includes an orientation acquisition unit and a focus information acquisition unit. Calculating the position of the subject by either the information processing apparatus or each of the servers based on the self-position information, the direction information acquired by the direction acquisition unit, and the focus information acquired by the focus information acquisition unit And determining the processing data corresponding to the subject position information, and executing the processing using the processing data when there is processing data as a result of the determination.

  A sixth imaging data processing program according to the present invention is any one of the first to fifth imaging data processing programs, and executes the step of dynamically changing the position information associated with the processing data. It is characterized by making it.

  A seventh imaging data processing program according to the present invention is any one of the first to sixth imaging data processing programs, wherein the information processing apparatus includes a display unit, and the processing data is included in the imaging data. A still image or moving image data or text data to be superimposed on the image, and a step of displaying an image captured at the time of shooting on the display unit; and a still image or moving image or text based on the processed data is superimposed on the image. And displaying on the display unit.

  An eighth imaging data processing program according to the present invention is any one of the first to seventh imaging data processing programs, wherein the information processing apparatus includes a display unit, and the display unit stores the processing data. Among them, a step of displaying a list of items used for the processing and displaying information on processing data not yet used is executed.

  An information processing apparatus capable of acquiring imaging data that is a still image or a moving image and self-position information by including an image photographing unit and a self-position acquisition unit, and a first imaging data processing server program according to the present invention The processing corresponding to the self-position information when the self-position information is received from the information processing apparatus to a server connected via a network, which associates the position information with the processing data. The step of transmitting data to the information processing apparatus is executed.

  The second imaging data processing server program according to the present invention includes image capturing means and a self-position acquisition unit, thereby associating self-position information acquired by the self-position acquisition unit with imaging data that is a still image or a moving image. An information processing apparatus capable of being connected to a server that is connected via a network and that associates position information and processed data with the imaging data that has been associated with the information processing apparatus from the information processing apparatus. A step of determining whether or not there is the processed data corresponding to the self-position information when the position information is received; and when there is processed data as a result of the determination, the processed data is used to Performing the processing step.

  A third imaging data processing server program according to the present invention is the first or second imaging data processing server program, wherein processing data specifying information for specifying the processing data is associated with the processing data. When the processing data specifying information is received from the information processing apparatus, the processing data corresponding to the processing data specifying information is transmitted or the processing data corresponding to the processing data specifying information is used. A step of performing processing on the imaging data is executed, or a step of determining the processing data corresponding to the processing data specifying information acquired by the server and performing the processing using the processing data is executed. It is characterized by making it.

  A fourth imaging data processing server program according to the present invention is the third imaging data processing server program, wherein the processing data specifying information is time information or time information, and the information processing apparatus or the imaging data processing When the server includes a time measuring unit, a process for determining the processed data corresponding to time or time information acquired by the time measuring unit is executed, or the processed data specifying information is weather information, and weather information is provided. A process of determining the processed data corresponding to the acquired weather information by acquiring weather information from a server or by acquiring the weather information by the information processing apparatus having a weather observation unit. Or the processing data specifying information is subject information, and the information processing apparatus The imaging data processing server includes an image recognition unit, thereby executing processing for determining the processing data corresponding to the subject information recognized by the image recognition unit, or the processing data specifying information is event information. Yes, the information processing device or the imaging data processing server executes a process for determining the processing data corresponding to the event information, or the processing data specifying information is voice information, and the information processing When the apparatus includes a voice information acquisition unit, the process for determining the processing data corresponding to the voice information acquired by the voice information acquisition unit is executed, or the processing data specifying information is numerical information, When the information processing apparatus or the imaging data processing server includes a numerical information generation unit, the numerical information generation The processing for determining the processing data corresponding to the numerical information generated by the unit is executed, or the processing data specifying information is direction information, and the information processing apparatus or the imaging data processing server has the direction information acquisition unit By providing, the process which determines the said process data corresponding to the azimuth | direction information acquired by the said azimuth | direction information acquisition part is performed, or the said process data specific information is point information, and the said information processing apparatus or the said imaging data The processing server includes a point information acquisition unit, and executes processing for determining the processing data corresponding to the point information acquired by the point information acquisition unit or processing using the point information. To do.

  A fifth imaging data processing server program according to the present invention is any one of the first to fourth imaging data processing server programs, wherein the information processing apparatus includes an orientation acquisition unit and a focus information acquisition unit, Calculating the position of the subject based on the self-position information, the orientation information acquired by the orientation acquisition unit, and the focus information acquired by the focus information acquisition unit; and the processing data corresponding to the subject position information And a step of discriminating.

  A sixth imaging data processing server program according to the present invention is any one of the first to fifth imaging data processing server programs, and dynamically changes the position information associated with the processing data. Is executed.

  A seventh imaging data processing server program according to the present invention is any one of the first to sixth imaging data processing server programs, wherein the information processing apparatus includes a display unit, and the display unit includes A step of displaying a list of the processing data used for the processing and sending information to the information processing apparatus for displaying information on the processing data that has not been used yet is executed. Features.

  A first image data processing service method according to the present invention is a service method for providing additional information to a still image or a moving image that has been shot when shooting is performed at a specific location. The self-position information is associated with the position information and the processing data from the information processing apparatus that can acquire the imaging data and the self-position information that are still images or moving images by providing the means and the self-position acquisition unit. Transmitting the processing data to the server with processing data, and determining the processing data corresponding to the self-location information in the processing data correspondence server or the processing data holding server defined by the correspondence, The step of transmitting to the information processing apparatus and the imaging using the processed data in the information processing apparatus that has received the step Wherein the step of providing additional information to the photographed still image or moving image by performing processing for over data, in that it consists of.

  A second imaging data processing service method according to the present invention is a service method for providing additional information to a captured still image or moving image when imaging is performed at a specific location, The information processing apparatus capable of associating the self-position information acquired by the self-position acquisition unit with the imaging data that is a still image or a moving image by including the means and the self-position acquisition unit; The self-location information is transmitted to the processing data correspondence server that associates the position information with the processing data, and the processing data correspondence server that has received the information or the processing data holding server defined by the correspondence The processing data corresponding to the self-position information is determined, and the received imaging data is used using the processing data. Wherein the step of providing additional information to the photographed still image or moving image by performing processing for, in that it consists of.

  A third imaging data processing service method according to the present invention is the first or second imaging data processing service method, wherein processing data specifying information is associated with the processing data in any of the servers. Thus, when transmitting information from the information processing apparatus, the processing data specifying information is also transmitted, and the processing data matching the processing data specifying information is determined in any of the servers that have received the information, or The processing data corresponding to the processing data specifying information acquired by any of the servers is discriminated.

  A fourth imaging data processing service method according to the present invention is the third imaging data processing service method, wherein the processing data specifying information is time information or time information, and the information processing device or each server Any one of them includes a time measuring unit, so that the processing step using the processing data corresponding to time or time information acquired by the time measuring unit is executed, or the processing data specifying information is weather information. The processing data corresponding to the acquired weather information by acquiring weather information from a weather information providing server, or when the information processing apparatus includes a weather observation unit and acquiring the weather information by the weather observation unit Or the processing data specifying information is subject information, and The information processing apparatus or each of the servers includes an image recognition unit, thereby executing the processing step using the processing data corresponding to the subject information recognized by the image recognition unit, or the processing The data specifying information is event information, and the processing step using the processing data corresponding to the event information stored in either the information processing apparatus or each of the servers is executed, or the processing data The specific information is audio information, and the information processing apparatus includes an audio information acquisition unit, thereby executing the processing step using the processing data corresponding to the audio information acquired by the audio information acquisition unit. Alternatively, the processing data specifying information is numerical information, and either the information processing device or each of the servers is a number. By providing the information generating unit, the processing step using the processing data corresponding to the numerical information generated by the numerical information generating unit is executed, or the processing data specifying information is azimuth information, Either the information processing device or each of the servers includes a direction information acquisition unit, thereby executing the processing step using the processing data corresponding to the direction information acquired by the direction information acquisition unit, or The processed data specifying information is point information, and the information processing device or each of the servers includes a point information acquisition unit, whereby the processing data corresponding to the point information acquired by the point information acquisition unit is The processing step used or the processing step using the point information is executed. To do.

  A fifth imaging data processing service method according to the present invention is any one of the first to fourth imaging data processing service methods, wherein the information processing apparatus includes an orientation acquisition unit and a focus information acquisition unit. Thus, based on the self-position information, the azimuth information acquired by the azimuth acquisition unit, and the focus information acquired by the focus information acquisition unit, either the information processing device or each server A step of calculating a position, and determining the processing data corresponding to the subject position information, and executing the processing step using the processing data.

  A sixth imaging data processing service method according to the present invention is any one of the first to fifth imaging data processing service methods, wherein the position information associated with the processing data is dynamically changed. It is characterized by.

  A seventh imaging data processing service method according to the present invention is any one of the first to sixth imaging data processing service methods, wherein the information processing apparatus includes a display unit, and the display unit includes the processing unit. The method includes a step of displaying a list of data used for the processing among the data, and displaying a list of information on the processing data that has not been used yet.

  An eighth imaging data processing service method according to the present invention is any one of the first to seventh imaging data processing service methods, wherein service identification for determining a service type in any of the servers is performed. For each information, the positional information and the processing data are managed in association with each other, and the service identification information of the service that is permitted to be used by the information processing apparatus is held, thereby transmitting information from the information processing apparatus. At this time, the service identification information is also transmitted, and the processing data matching the service identification information is discriminated at any of the servers that have received the service identification information.

  According to the first imaging data processing apparatus of the present invention, for example, in a digital camera or a mobile phone (imaging data processing apparatus) provided with a self-position acquisition unit using GPS or the like (imaging data processing apparatus), the current position (self-position information) It can be used such that a frame is added to a photograph (imaging data) taken using frame information (processed data) corresponding to. Therefore, it is possible to provide a new usage method in an information processing apparatus that can capture a still image or a moving image including self-position acquisition means such as GPS.

  According to the third imaging data processing apparatus of the present invention, in addition to the acquisition of the processing data based on the correspondence between the position information and the processing data, the processing data of the processing data based on the correspondence between the processing data specifying information and the processing data Acquisition is performed, and processing is performed on imaging data captured by the imaging data processing apparatus using the acquired processing data. For example, when meteorological information is used as the processing data specifying information, the “photographed photograph” is obtained using the frame information corresponding to the current position in a digital camera or mobile phone equipped with a self-position acquisition means using GPS or the like. A frame is added to ", and weather information is acquired (such as acquiring weather data at the corresponding location from the weather server based on the self-location information), and a weather icon (processed data) corresponding to the weather information is added to the photo You can use it like Therefore, various services (new usage methods) can be provided to the user.

  According to the sixth imaging data processing apparatus of the present invention, for example, even if a certain frame is used for a photograph taken at a point A at a certain time, a photograph taken at a point A at another time is used. On the other hand, because different frames are used (or frame is not added), taking a picture at the same place does not always give the same result, and different results can be obtained according to time and time. It becomes. Therefore, various services (new usage methods) can be provided to the user.

  According to the eighth imaging data processing apparatus of the present invention, for example, the processing data (for example, a frame) is displayed in a display format such as “mounting book” in which all the processing data is stored. The corresponding column of “” is filled, and the column of processed data that is not used can display only the data name or silhouette. Therefore, it is possible to provide a service that enhances the user's desire to collect.

1 Terminal device (information processing device, imaging data processing device)
2 Network 3 Service providing server (server with processing data support)
4 Content provision server (processing data holding server)
110 control unit 120 camera unit (image photographing means)
130 storage unit 140 communication unit 150 GPS reception unit (self-position acquisition unit)
170 Display

Claims (4)

An imaging data processing apparatus capable of capturing a still image or a moving image by including an image capturing unit, comprising: a display unit, a control unit, a storage unit, and a self-position acquisition unit, and the storage unit or The self-position acquisition is performed with respect to imaging data obtained by imaging by the image imaging unit by storing positional information and processing data in association with each other in a storage medium that is detachable from the imaging data processing apparatus. The processing using the processing data corresponding to the self-location information acquired by the unit is executed,
The processed data is stored as processed data of past photographs at the associated positions,
The acquisition condition of the processing data is set in the acquisition condition table, and the acquisition condition includes an acquisition condition (hereinafter referred to as “region limitation condition”) for managing the region so as to acquire the processing data by limiting a predetermined region. ”)) Is set,
In the case where the position of the subject is calculated within the predetermined area set by the area limitation condition by the imaging data processing device , display processing of past photographs as the processing data corresponding to the subject position information The imaging data processing apparatus characterized by performing. The imaging data processing apparatus according to claim 1, wherein the predetermined area as the area limiting condition for acquiring the processed data is a figure having map coordinates . The past image as the processing data acquired according to the region limitation condition that is the processing data acquisition condition is generated side by side with the actually taken photo to generate an image on the display unit. 2. The imaging data processing device according to 2. Before Symbol Processing data Gath text imaging data processing apparatus according to any one of claims 1 to 3, characterized in that it is a data.

Images