JP7446107B2 - Information processing system, information processing system control method, and computer program - Google Patents

Description

The present invention relates to information processing technology.

Patent Document 1 describes subjects such as taking landscape photos, taking photos of subjects such as autumn leaves, or taking photos from a pet's perspective, and the location and time of taking photos, such as taking photos of places not listed in Hokkaido tour guides. , a technique for presenting a task, mission, etc. (mission) with a specified theme, etc. to a user of an imaging device is disclosed.

Japanese Patent Application Publication No. 2016-173864

The technology disclosed in Patent Document 1 is for presenting themes and missions, but is not for determining whether or not a series of presented themes and missions have been achieved, and distributing content according to the result of that determination. do not have.

The present invention provides a technique for determining whether or not imaging has been performed in a series of imaging areas based on files of captured images, and distributing content in accordance with the result of the determination.

In order to solve the above problems, the information processing system of the present invention includes:
determination means for determining whether a mission given to the user has been accomplished based on an image taken by the user;
Notifying means for notifying the user based on mission accomplishment when the determining means determines that the mission has been accomplished;
Point granting means for granting points to the user when the determination means determines that the mission has been accomplished;

a mission granting means for granting a new mission to the user based on the points;
It is characterized by having the following.

According to the configuration of the present invention, it is possible to determine whether or not imaging has been performed in a series of imaging areas based on files of captured images, and to distribute content according to the result of the determination.

FIG. 1 is a diagram showing an example of a system configuration. (a) is a diagram showing an example of the configuration of a mode selection screen, and (b) is a diagram showing an example of the configuration of a mission selection screen. (a) is a diagram showing an example of the configuration of a selection screen, and (b) is a diagram showing an example of message display. The figure which shows the example of a structure of mission data. Flowchart showing the operation of the system. (a) is a flowchart of a process for displaying a mission achievement record, and (b) is a diagram showing a display example of a mission achievement record screen. The figure which shows the example of a display of the display part 197 in mission purchase mode. A flowchart showing the operation of the system for purchasing new missions.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the claimed invention, and not all combinations of features described in the embodiments are essential to the invention. Two or more features among the plurality of features described in the embodiments may be arbitrarily combined. In addition, the same or similar configurations are given the same reference numerals, and duplicate explanations will be omitted.

[First embodiment]
First, a configuration example of a system according to this embodiment will be described using FIG. 1. As shown in FIG. 1, the system according to this embodiment includes a server 100, an imaging device 190, and a terminal device 180. The server 100 is connected to the network 150 by wire, and the imaging device 190 and the terminal device 180 are connected to the network 150 wirelessly. The network 150 is a network such as a LAN or the Internet. Note that the connection form to the network 150 is not limited to a specific connection form.

First, the server 100 as an information processing device will be explained.

The CPU 101 executes various processes using computer programs and data stored in the RAM 102 and ROM 103. Thereby, the CPU 101 controls the overall operation of the server 100, and also executes or controls each process that will be described later as being performed by the server 100.

The RAM 102 has an area for storing computer programs and data loaded from the ROM 103 and external storage device 106, and data received from the outside (imaging device 190 and terminal device 180) via I/F (interface) 107. have Further, the RAM 102 has a work area used by the CPU 101 when executing various processes. In this way, the RAM 102 can provide various areas as appropriate.

The ROM 103 stores configuration data, startup programs, etc. of the server 100.

The operation unit 104 is a user interface such as a keyboard, mouse, touch panel, etc., and can be operated by a user to input various instructions to the CPU 101.

The display unit 105 is a display device having a liquid crystal screen or a touch panel screen, and can display processing results by the CPU 101 in the form of images, characters, and the like. Note that the display unit 105 may be a projection device such as a projector that projects images and characters.

The external storage device 106 is a large capacity information storage device such as a hard disk drive device. The external storage device 106 stores an OS (operating system) and computer programs and data for causing the CPU 101 to execute or control various processes that will be described later as being performed by the server 100. Computer programs and data stored in the external storage device 106 are loaded into the RAM 102 as appropriate under the control of the CPU 101, and are subject to processing by the CPU 101.

The I/F 107 is a network interface for connecting the server 100 to the network 150, and the server 100 performs data communication with the imaging device 190 and terminal device 180 connected to the network 150 via the I/F 107. conduct.

The CPU 101, RAM 102, ROM 103, operation section 104, display section 105, external storage device 106, and I/F 107 are all connected to a bus 108.

Next, the imaging device 190 will be explained.

The imaging unit 191 is composed of an optical system, an image sensor, an image processing circuit, etc. Light that enters from the outside world through the optical system is converted into an image signal by the image sensor, and the image processing circuit converts the image signal into an image signal. A captured image is generated by performing various image processing on the image.

The CPU 192 executes various processes using computer programs and data stored in the RAM 193 and ROM 194. As a result, the CPU 192 controls the overall operation of the imaging device 190, and also executes or controls each process that will be described later as being performed by the imaging device 190.

The RAM 193 stores computer programs and data loaded from the ROM 194 and nonvolatile memory 195, captured images output from the imaging unit 191, and data received by the communication unit 198 from the outside (server 100 and terminal device 180). It has an area of Furthermore, the RAM 193 has a work area used when the CPU 192 executes various processes. In this way, the RAM 193 can provide various areas as appropriate.

The ROM 194 stores setting data and a startup program for the imaging device 190, as well as computer programs and data for causing the CPU 101 to execute or control the overall operation of the imaging device 190.

The nonvolatile memory 195 stores an image file including a captured image captured by the imaging unit 191 and metadata of the captured image. The metadata of the captured image includes imaging parameters such as the angle of view, focal length, and shutter speed at the time of capturing the captured image, the imaging position (latitude, longitude) of the captured image, and the date and time when the captured image was captured. Contains various information regarding the captured image.

The button group 196 includes buttons for inputting imaging instructions, buttons for inputting selection operations and decision operations on the menu screen, buttons for turning on/off the power of the imaging apparatus 190, etc. It includes buttons for performing various user operations.

The display unit 197 is a liquid crystal screen or a touch panel screen, and can display, for example, an image captured by the imaging unit 191, various screens, data received from the server 100 or the terminal device 180, and the like. When the display section 197 is a touch panel screen, the user can input various instructions to the CPU 192 by touching the screen of the display section 197.

The communication unit 198 controls data communication with the server 100 connected to the network 150. Further, the communication unit 198 performs communication such as close proximity wireless communication with the terminal device 180.

The imaging section 191 , CPU 192 , RAM 193 , ROM 194 , nonvolatile memory 195 , button group 196 , display section 197 , and communication section 198 are all connected to the bus 199 .

Next, the terminal device 180 will be explained. The terminal device 180 is a portable computer device such as a smartphone, a tablet terminal device, or a notebook computer, and can perform data communication with the server 100 via the network 150. Further, the terminal device 180 can also perform communication such as close proximity wireless communication with the imaging device 190.

Next, the user of the imaging device 190 searches for and images objects to be imaged provided at various positions, and when all the objects are imaged, the imaging device 190 is provided with information (content) that is a benefit. The operation of the above system for providing the information will be explained.

The user of the imaging device 190 shifts the imaging device 190 to mission mode. For example, the user operates the button group 196 or touches the display screen of the display unit 197 to display a mode selection screen as shown in FIG. 2(a) on the display screen of the display unit 197. In the following description, it is assumed that the CPU 192 performs all display control on the display section 197 and processing performed in response to user operations on the display section 197.

The button 200 is a button for shifting the imaging device 190 to mission mode. When the user touches the display area of the button 200 or operates the button group 196 to instruct the button 200, the imaging device 190 goes into the mission mode. Transition. Mission mode will be described later.

The button 201 is a button for shifting the imaging device 190 to normal shooting mode. When the user touches the display area of the button 201 or operates the button group 196 to instruct the button 201, the imaging device 190 switches to the normal shooting mode. mode. In the normal shooting mode, the imaging device 190 performs a so-called normal imaging operation in which a still image or a moving image is captured in response to a user inputting an imaging instruction.

The button 202 is a button for shifting the imaging device 190 to mission purchase mode. When the user touches the display area of the button 202 or operates the button group 196 to instruct the button 202, the imaging device 190 enters the mission purchase mode. mode. The mission purchase mode will be described later.

When the imaging device 190 shifts to the mission mode, a mission selection screen as shown in FIG. 2(b) is displayed on the display screen of the display unit 197.

The button 203 is a button for selecting a mission (person mission) that is achieved (cleared) when all specific people are photographed, and the user touches the display area of the button 203 or operates the button group 196. When the button 203 is designated, processing of the character mission is started.

The button 204 is a button for selecting a mission (animal mission) that is achieved when all specific animals are photographed, and the user touches the display area of the button 204 or operates the button group 196 to press the button 204. Once specified, processing of the animal mission will begin.

The button 205 is a button for selecting a mission (fieldwork mission) that is achieved by searching for and imaging objects to be imaged provided at various positions and capturing images of all the objects to be imaged. When the user touches the display area of the button 205 or operates the button group 196 to specify the button 205, field work mission processing is started.

When the user specifies the button 205 by touching the display area of the button 205 or operating the button group 196, the display screen of the display unit 197 displays fieldwork missions A to C, as shown in FIG. 3(a). A selection screen for selecting one of them is displayed.

The subsequent operation of this system will be explained according to the flowchart in FIG. In FIG. 5, steps S501 to S511 are processes executed or controlled by the CPU 192 of the imaging device 190, and steps S551 to S560 are processes executed or controlled by the CPU 101 of the server 100.

In step S501, the CPU 192 controls the communication unit 198 to identify the ID corresponding to the fieldwork mission selected by the user by touching the display unit 197 or operating the button group 196 on the selection screen of FIG. 3(a). is sent to the server 100.

In step S551, the CPU 101 receives the field work mission ID transmitted from the imaging device 190 via the I/F 107.

In step S552, the CPU 101 identifies mission data associated with the ID received in step S551 from among the plurality of mission data stored in the external storage device 106.

An example of the structure of mission data is shown in FIG. The mission data is composed of a plurality of pieces of submission data, and in FIG. 4, each row of data corresponds to the submission data.

The submission data includes the submission ID, which is an ID unique to the submission data, the imaging area (imaging position (latitude, longitude), and from the imaging position) which is the area that can be imaged by the submission corresponding to the submission data. permissible distance), a message notifying the user of the content of the submission corresponding to the submission data, image features of the object to be imaged in the submission corresponding to the submission data (SIFT, etc.), the submission It has an achievement flag (initialized to 0 by default) that indicates whether or not the submission corresponding to the data has been achieved.

In step S552, the CPU 101 further selects unselected submission data from among the submission data included in the mission data as selected submission data. The order in which submission data is selected from mission data is not limited to a specific order, and may be selected in descending order of submission ID, or may be selected at random, for example.

In step S553, the CPU 101 transmits the submission ID and message included in the selected submission data to the imaging device 190 via the I/F 107.

In step S502, the CPU 192 controls the communication unit 198 to receive the submission ID and message sent from the server 100.

In step S503, the CPU 192 displays the message received in step S502 on the display screen of the display unit 197. An example of a message displayed on the display screen of the display unit 197 is shown in FIG. 3(b). In FIG. 3B, since imaging of object A is given as a submission, the user of the imaging device 190 carries the imaging device 190 and searches for object A. When the user finds the object A, the user uses the imaging device 190 to take an image of the object A.

When the user inputs an imaging instruction by operating the button group 196 while placing the object A within the field of view of the imaging device 190, the imaging unit 191 outputs a captured image including the object A. The CPU 192 generates metadata of the captured image, and generates an image file including the captured image and the metadata.

In step S504, the CPU 192 determines whether the user operates the button group 196 to input an instruction to send the image file. As a result of this determination, if a transmission instruction has been input, the process proceeds to step S505, and if a transmission instruction has not been input, the process returns to step S503.

In step S505, the CPU 192 controls the communication unit 198 to transmit the generated image file and the submission ID received from the server 100 in step S502 to the server 100.

In step S554, the CPU 101 receives the image file and submission ID transmitted from the imaging device 190.

In step S555, the CPU 101 acquires the captured image in the image file received in step S554, and extracts the image feature amount of the object included in the captured image. Then, the CPU 101 determines the degree of similarity between the extracted image feature amount and the image feature amount included in the submission data corresponding to the submission ID received in step S554.

If the similarity is less than the threshold, the CPU 101 selects the object included in the captured image in the received image file and the object to be imaged in the submission corresponding to the submission ID received in step S554. It is determined that and are the same. That is, the CPU 101 determines that the user has imaged the object to be imaged with the submission corresponding to the submission ID received in step S554.

On the other hand, if the similarity is greater than or equal to the threshold, the CPU 101 selects the object included in the captured image in the received image file and the submission corresponding to the submission ID received in step S554 as the imaging target. It is determined that object and are not the same. In other words, the CPU 101 determines that the user has not imaged the object to be imaged in the submission corresponding to the submission ID received in step S554.

Note that there are various methods for determining whether the object included in the captured image in the image file is an object to be imaged in the submission corresponding to the submission ID received in step S554. However, it is not limited to a specific method.

For example, instead of comparing image feature quantities, the captured image in the image file and the image of the object to be imaged in the submission corresponding to the submission ID received in step S554 (registered in advance in the external storage device 106) The above judgment may be made by matching the

For example, when a captured image is input to a neural network (previously registered in the external storage device 106) that has learned images of each object designated as an imaging target in a fieldwork mission, the output from the neural network (each object The above judgment may be made based on the likelihood for

Whichever determination method is used, the object included in the captured image in the received image file is the same as the object to be imaged in the submission corresponding to the submission ID received in step S554. If it is determined that there is, the process advances to step S556. On the other hand, if it is determined that the object included in the captured image in the received image file is not the same as the object to be imaged in the submission corresponding to the submission ID received in step S554, , the process proceeds to step S557.

In step S556, the CPU 101 determines whether the imaging position included in the metadata in the image file received in step S554 is within the imaging area included in the submission data corresponding to the submission ID received in step S554. Determine whether or not the position is the same. For example, when the submission ID received in step S554 is 2, in the example of FIG. 5, the imaging position included in the metadata in the image file received in step S554 is (latitude, longitude) = ( _B , _YB ), it is determined whether the distance is within the range (imaging area) of the allowable distance _dB .

If the imaging position included in the metadata in the image file received in step S554 is a position within the imaging area included in the submission data corresponding to the submission ID received in step S554, Processing proceeds to step S558.

On the other hand, if the imaging position included in the metadata in the image file received in step S554 is not a position within the imaging area included in the submission data corresponding to the submission ID received in step S554, If so, the process advances to step S557.

In step S557, the CPU 101 determines that the user has not captured an image of the object corresponding to the submission or that the user has not captured an image within the imaging area corresponding to the submission, and sends an error message to that effect to the I/O. It is transmitted to the imaging device 190 via F107.

In step S506, the CPU 192 controls the communication unit 198 to receive the error message sent from the server 100. Step S506 is a processing step that is executed only when an error message is sent from the server 100.

In step S507, the CPU 192 determines whether an error message has been received. As a result of this determination, if no error message has been received, the process advances to step S509. On the other hand, if an error message is received, the process advances to step S508.

In step S508, the CPU 192 displays the error message received in step S506 on the display screen of the display unit 197. The process then proceeds to step S503.

In step S558, the CPU 101 sets "1" to the achievement flag included in the submission data corresponding to the submission ID received in step S554.

In step S559, the CPU 101 determines whether the achievement flags in all the submission data included in the mission data are "1".

As a result of such judgment, if the achievement flag in all the submission data included in the mission data is "1", that is, the submission corresponding to all the submission data included in the mission data If this is achieved, the process proceeds to step S560.

On the other hand, among the submission data included in the mission data, if there is submission data whose achievement flag is "0", that is, the submission corresponding to all the submission data included in the mission data If there are any unfulfilled submissions remaining, the process proceeds to step S552, and unselected submission data is selected.

In step S560, the CPU 101 transmits the content to the I/F 107 in order to provide the content to the user, since the user has captured an image of the object to be captured within the imaging area defined in each submission. The information is transmitted to the imaging device 190 via the image capturing device 190.

In step S509, the CPU 192 controls the communication unit 198 to receive the content transmitted from the server 100. Step S509 is a processing step that is executed only when content is transmitted from the server 100.

In step S510, CPU 192 determines whether content has been received from server 100. As a result of this determination, if the content has been received from the server 100, the process proceeds to step S511, and if the content has not been received from the server 100, the process proceeds to step S502.

In step S511, the CPU 192 displays the content received in step S509 on the display screen of the display unit 197.

Here, various types of content can be considered as the content. In this embodiment, it is assumed that the content is a code (a bonus code) necessary for purchasing a new mission.

Note that in the flowchart of FIG. 5, when the process proceeds to step S558, the server 100 does not notify the imaging device 190 of the submission ID that corresponds to the submission ID received in step S554. The imaging device 190 may be notified that this has been achieved.

Here, the user of the imaging device 190 wants to know the mission accomplishment record, such as how many submissions are included in the fieldwork mission, which submissions have been cleared and which submissions have not been cleared yet. , can request the server 100 to display the achievement record.

Processing performed by the server 100 and the imaging device 190 to display a mission achievement record on the display unit 197 of the imaging device 190 in response to a request from a user will be described with reference to the flowchart in FIG. 6(a).

In step S601, the CPU 192 controls the communication unit 198 to transmit to the server 100 an instruction to display a mission achievement record, which the user inputs by operating the button group 196.

In step S611, the CPU 101 receives an instruction to display a mission achievement record transmitted from the imaging device 190 via the I/F 107.

In step S612, the CPU 101 generates a screen (mission achievement record screen) in which markers corresponding to each submission ID in the mission data are arranged. At this time, the CPU 101 selects a marker for the submission ID whose achievement flag is "0" (a marker corresponding to a submission that has not been achieved), and a marker for the submission ID whose achievement flag is "1" (a marker corresponding to an unachieved submission). (markers corresponding to the submitted submissions) are displayed in a visually distinguishable manner. For example, as shown in FIG. 6(b), the marker for the submission ID whose achievement flag corresponds to "0" is displayed as a white circle, and the marker for the submission ID whose achievement flag corresponds to "1" is displayed as "completed". Displayed with a white circle.

In step S613, the CPU 101 transmits the mission achievement record screen generated in step S612 to the imaging device 190 via the I/F 107.

In step S602, the CPU 192 controls the communication unit 198 to receive the mission achievement record screen transmitted from the server 100.

In step S603, the CPU 192 displays the mission achievement record screen received in step S602 on the display screen of the display unit 197. This allows the user to easily check the achievement status of a mission made up of a plurality of submissions.

<About purchasing missions>
The user of the imaging device 190 can purchase a new mission in order to experience a new mission. Here, "purchasing a new mission" means "making available one or more of the mission data that cannot be used by the imaging device 190 in the mission data group held by the server 100 (mission data usage rights)""toobtain" means "to obtain".

When purchasing a new mission, the imaging device 190 is moved to mission purchase mode using the mode selection screen shown in FIG. 2(a). A screen 700 shown in FIG. 7 is displayed on the display screen of the display unit 197 of the imaging device 190 that has entered the mission purchase mode. Screen 700 has buttons 701, 702, and 703.

When the user touches the display screen of the display unit 197 or operates the button group 196 to instruct the button 701, a screen 710 for purchasing a new mission using a benefit code is displayed on the display screen of the display unit 197. is displayed. When the user operates the button group 196 to input the benefit code received from the server 100 into the area 711 and then inputs a transmission instruction using the button group 196, the CPU 192 of the imaging device 190 inputs the privilege code into the area 711. The received benefit code is sent to the server 100. The server 100 transmits to the imaging device 190 the ID of the mission data associated with or represented by the benefit code received from the imaging device 190 and a button icon for selecting the mission data. do. The imaging device 190 associates the icon and ID sent from the server 100 and stores them in the nonvolatile memory 195.

When the user touches the display screen of the display unit 197 or operates the button group 196 to instruct the button 702, the display screen of the display unit 197 displays a new mission using the points the user has earned so far. A screen 720 for purchasing is displayed.

Here, "points" will be explained. When the server 100 transmits content to the imaging device 190, it gives points to the user associated with the destination of the content (if points have already been given to the user, points are accumulated). ). The higher the level of the fieldwork mission (e.g., the number of submissions, the distance the user has to travel to complete all submissions, the difficulty of finding objects to image, etc.), the higher the points. Alternatively, the shorter the time required to accomplish the fieldwork mission, the higher the points. These points can be used to purchase new missions. The screen 720 is provided with a button 721 corresponding to a mission that can be purchased for 100 points (points), a button 722 that corresponds to a mission that can be purchased for 200 points, and a button 723 that corresponds to a mission that can be purchased for 300 points. When the user touches the display screen of the display unit 197 or operates the button group 196 to instruct the button 721, the server 100 is notified of this, and the server 100 subtracts 100 from the points managed for the user. At the same time, the ID of the mission data corresponding to the button 721 and the button icon for selecting the mission data are transmitted to the imaging device 190. When the user touches the display screen of the display unit 197 or operates the button group 196 to instruct the button 722, the server 100 is notified of this, and the server 100 subtracts 200 from the points managed for the user. At the same time, the ID of the mission data corresponding to the button 722 and the button icon for selecting the mission data are transmitted to the imaging device 190. When the user touches the display screen of the display unit 197 or operates the button group 196 to instruct the button 723, the server 100 is notified of this, and the server 100 subtracts 300 from the points managed for the user. At the same time, the ID of the mission data corresponding to the button 723 and the button icon for selecting the mission data are transmitted to the imaging device 190. The imaging device 190 associates the icon and ID sent from the server 100 and stores them in the nonvolatile memory 195.

When the user touches the display screen of the display unit 197 or operates the button group 196 to instruct the button 703, a screen 730 for purchasing a new mission by charging is displayed on the display screen of the display unit 197. Ru. When the user operates the button group 196 to input the ID (terminal ID) of the terminal device 180 in the area 731 and then inputs a transmission instruction using the button group 196, the CPU 192 of the imaging device 190 inputs the ID (terminal ID) of the terminal device 180 into the area 731. The terminal ID inputted in is sent to the server 100. It is assumed that at this point the user has accessed the server 100 using the terminal device 180, specified the mission to purchase, and completed the payment. The server 100 transfers the ID of the mission data for which payment has been completed on the terminal device 180 and the button icon for selecting the mission data to the terminal device specified by the terminal ID input in the area 731. 180 (download). The user transfers the ID and icon downloaded to the terminal device 180 to the imaging device 190 through close proximity wireless communication with the imaging device 190, and the imaging device 190 associates the transferred icon and ID with each other and makes them non-volatile. The data is stored in the data memory 195.

Next time, when the CPU 192 of the imaging device 190 displays the mission selection screen, it displays a button with the icon saved in the non-volatile memory 195 in addition to the existing buttons, and when the user instructs the button, , transmits the ID associated with the button to the server 100.

The processing performed by the imaging device 190, the server 100, and the terminal device 180 to purchase a new mission will be described according to the flowchart of FIG. 8.

In step S801, the CPU 192 determines which of the buttons 701, 702, and 703 has been designated. As a result of this determination, if the button 701 is designated, the process advances to step S802, if the button 702 is designated, the process advances to step S805, and if the button 703 is designated, the process advances to step S802. The process advances to step S808.

In step S802, the CPU 192 displays the screen 710 on the display screen of the display unit 197. In step S803, CPU 192 transmits the benefit code input in area 711 to server 100.

On the other hand, in step S805, the CPU 192 displays the screen 720 on the display screen of the display unit 197. In step S806, the CPU 192 transmits information indicating the button designated by the user among the buttons 721, 722, and 723 to the server 100.

On the other hand, in step S808, the CPU 192 displays the screen 730 on the display screen of the display unit 197. In step S809, CPU 192 transmits the terminal ID input in area 731 to server 100.

In step S851, the CPU 101 receives the information indicating the benefit code or the instructed button transmitted in step S803 or step S806, and in step S852, the CPU 101 receives the information indicating the received privilege code or the instructed button. The icon and ID of the corresponding mission data are transmitted to the imaging device 190. In step S804, the CPU 192 receives the mission data icon and ID corresponding to the benefit code from the server 100. In step S807, the CPU 192 receives the mission data icon and ID corresponding to the designated button from the server 100.

In step S853, the CPU 101 receives the terminal ID transmitted in step S809, and in step S854, the CPU 101 receives the icon and ID of the mission data for which payment has been completed on the terminal device 180 in step S853. It is transmitted (downloaded) to the terminal device 180 specified by the terminal ID.

In step S891, the terminal device 180 receives the mission data icon and ID transmitted from the server 100, and in step S892, the terminal device 180 transmits the mission data icon and ID received in step S891 to close proximity wireless communication. and transmits it to the imaging device 190.

In step S810, the CPU 192 receives the mission data icon and ID transmitted from the terminal device 180 through close proximity wireless communication with the terminal device 180. Note that in the present embodiment, the CPU 192 of the imaging device 190 transmits the terminal ID to the server 100, but the information of the terminal device 180 that can communicate with the imaging device 190 is stored in advance in the imaging device 190, and the CPU 192 of the imaging device 190 and The terminal device 180 may also communicate. Furthermore, when the imaging device 190 and the terminal device 180 are able to communicate, the CPU 192 determines whether or not information regarding the mission for which payment has been completed is stored in the terminal device 180, and the information regarding the mission is stored. In this case, information regarding the mission may be received from the terminal device 180.

In step S811, the CPU 192 associates the icon and ID received from the server 100 or the terminal device 180 and stores them in the nonvolatile memory 195. As described above, by giving instructions to the display unit 197 of the imaging device 190, the user can add mission data to the imaging device 190 in a desired manner.

<About content>
As mentioned above, various types of content can be considered. For example, in addition to the above-mentioned benefit code, the content may also include ``discounts when users who go on fieldwork missions such as photographing various objects scattered around the city shop at stores in the city.'' Such information may be, for example, a URL to a site that provides a discount service screen that allows you to receive a discount service by showing it to a store. In this case, the user accesses the URL from the terminal device 180 to display the discount service screen on the display screen of the terminal device 180, and shows the displayed discount service screen to the store clerk to receive discounts at the store. can receive services.

Further, the content may be a code representing such a URL. For example, the server 100 transmits a two-dimensional barcode indicating such a URL to the imaging device 190, and the imaging device 190 receives the two-dimensional barcode and displays it on the display screen of the display unit 197. Then, the URL is identified by reading the displayed two-dimensional barcode with the camera of the terminal device 180, and the URL is accessed to display the discount service screen on the display screen of the terminal device 180, and the displayed discount service screen is displayed on the display screen of the terminal device 180. By showing the service screen to a store clerk, the user can receive a discount service at the store.

Note that the content is not limited to information for receiving such discount services, but also includes, for example, services useful for attracting customers to the town where the fieldwork mission will be conducted, services useful for economic revitalization of the town, etc. , may be content related to various services.

Further, in step S560, a plurality of contents may be presented to the terminal device 180, and the user may select the content that the user actually wants to acquire.

Further, two or more of the above-mentioned contents may be provided to the user.

[Second embodiment]
Differences from the first embodiment will be explained below, and unless otherwise mentioned below, it is assumed that the second embodiment is the same as the first embodiment.

In the first embodiment, steps S555 and S556 are required, but step S555 may be omitted and step S556 may be executed immediately after step S554.

Further, the determination in step S556 may be made based on the recognition result of the object in the captured image. For example, in step S556, if the object recognized from the captured image is an object corresponding to the selected submission data, the imaging position of the captured image is determined to belong to the imaging area in the selected submission data. You may decide.

Furthermore, there are various methods of transferring the submission ID and message in the submission data to the imaging device 190. For example, when the imaging device 190 approaches a server installed at a venue where a fieldwork mission will be conducted (the technology for determining whether the devices have approached each other is a well-known technology, a description thereof will be omitted. ), the server may transfer the submission ID and message from the submission data in the mission data of the fieldwork mission to the imaging device 190.

Note that all of the configurations described above are not essential configurations, and new functional units/processing may be added to the configuration described above as appropriate, or one or more functional units/processing may be omitted from the configuration described above. It's okay to stay.

Further, the subject of each process explained above is not limited to the above explanation, and may be another subject. Furthermore, the above description of the configuration of the various types of information and the device that holds it is merely an example, and is not intended to be limiting.

Further, the specific numerical values used in the above explanation are used for concretely carrying out the explanation, and are not intended to be limited to the specific numerical values used in the above explanation.

Further, the configuration of the screen and the method of operating the screen described above are given as an example for concrete explanation, and are not intended to be limited to this example.

Furthermore, some or all of the embodiments described above may be combined, or some or all of the embodiments described above may be selectively used. Further, the invention is not limited to the above-described embodiments, and various modifications and changes can be made within the scope of the gist of the invention.

100: Server 101: CPU 102: RAM 103: ROM 104: Operation unit 105: Display unit 106: External storage device 107: I/F 108: Bus 150: Network 180: Terminal device 190: Imaging device 191: Imaging unit 192: CPU 193: RAM 194: ROM 195: Nonvolatile memory 196: Button group 197: Display section 198: Communication section 199: Bus

Claims (17)

determination means for determining whether a mission given to the user has been accomplished based on an image taken by the user;
Notifying means for notifying the user based on mission accomplishment when the determining means determines that the mission has been accomplished;
Point granting means for granting points to the user when the determination means determines that the mission has been accomplished;
a mission granting means for granting a new mission to the user based on the points;
An information processing system comprising: The mission is a mission achieved by photographing a predetermined object,
The information processing system according to claim 1, wherein the determining means determines whether the mission has been accomplished based on whether an object related to the mission has been photographed by the user. The mission is a mission achieved by photographing a plurality of predetermined objects,
The information processing system according to claim 1, wherein the determining means determines whether the mission has been accomplished based on whether all of the plurality of objects related to the mission have been photographed by the user. The determining means determines whether the object related to the mission has been photographed based on the degree of similarity between the feature amount related to the predetermined object and the feature amount related to the image captured by the user. The information processing system according to item 2 or 3. The mission is a mission achieved by photographing a predetermined object within a predetermined range,
2. The determining means determines whether the mission has been accomplished based on whether the photographing position of the image is within the predetermined range and whether an object related to the mission has been photographed. 4. The information processing system according to any one of 4. 5. The notification means notifies the user of a predetermined message when the image taken by the user is not an image of the predetermined object. information processing system. 6. The information processing system according to claim 5, wherein the notification unit notifies the user of a predetermined message if the image taken by the user is not an image taken from within the predetermined range. Further comprising a distribution means for distributing content to the user,
According to any one of claims 1 to 7, the notification by the notification means when the determination means determines that the mission has been accomplished is a notification regarding content distributed by the distribution means. The information processing system described. 9. The information processing system according to claim 8, wherein the distribution means distributes the content when the determination means determines that the mission has been accomplished. The content is information for acquiring a new mission,
10. The information processing system according to claim 8 , wherein the mission assigning means assigns a mission associated with the content . The information processing system according to claim 8 or 9, wherein the content is information for receiving a discount service. 12. The information processing system according to claim 1, wherein the points awarded by the point assigning means are determined according to the level of the mission. 13. The level of the mission is determined according to at least one of the number of predetermined objects, the travel distance required to accomplish the mission, and the ease with which the predetermined object is found. information processing system. 14. The information processing system according to claim 1, wherein the points awarded by the point awarding means are determined according to the time required to accomplish the mission. The information processing system according to any one of claims 1 to 14 , further comprising display control means for displaying the degree of mission accomplishment. A method for controlling an information processing system, the method comprising:
a determining step in which the determining means of the information processing system determines whether a mission given to the user has been achieved based on an image taken by the user;
a notification step in which the notification means of the information processing system notifies the user based on mission accomplishment when it is determined in the determination step that the mission has been accomplished;
a point granting step in which the point granting means of the information processing system grants points to the user when it is determined in the determination step that the mission has been accomplished;
a mission granting step in which the mission granting means of the information processing system grants a new mission to the user based on the points;
A method for controlling an information processing system, comprising: A computer program for causing at least one computer to function as each means of the information processing system according to any one of claims 1 to 15 .

Images