JP6485121B2 - Information processing system, information processing apparatus, information processing method, and program - Google Patents

Description

  The present invention relates to an information processing system, an information processing apparatus, an information processing method, and a program.

  Conventionally, various techniques for constructing a network in which a plurality of devices such as a multifunction peripheral, a PC, and a projector are connected are known.

  For example, Patent Literature 1 discloses a technique for constructing a corresponding network using a captured image obtained by imaging with a mobile terminal.

  However, conventionally, there has been no mechanism for automatically leaving the mobile terminal from the network or joining another network as the user carrying the mobile terminal moves.

  In order to solve the above-described problems and achieve the object, the present invention is an information processing system including a mobile terminal including an imaging device and an information processing apparatus, wherein the mobile terminal is at predetermined intervals. Imaging control means for controlling the imaging device to perform imaging, and transmission means for transmitting a captured image obtained by the imaging to the information processing device each time imaging by the imaging device is performed, The information processing apparatus includes: a captured image receiving unit configured to receive the captured image; and correspondence information in which one or more images are associated with each of a plurality of networks to which a plurality of devices are connected. If there is an image that matches the captured image, the mobile terminal is allowed to use the network corresponding to the image that matches the captured image, while the captured information is received in the correspondence information. If the image that matches the captured image received by the means does not exist, it has an authentication means for performing control that does not allow use of the network to the mobile terminal.

  According to the present invention, it is possible to automatically leave the network or join another network as the mobile terminal moves.

FIG. 1 is a diagram illustrating an example of a schematic configuration of an information processing system. FIG. 2 is a diagram illustrating an example of a hardware configuration of the mobile terminal. FIG. 3 is a diagram illustrating an example of a hardware configuration of the server. FIG. 4 is a diagram illustrating an example of functions of the mobile terminal according to the first embodiment. FIG. 5 is a diagram illustrating an example of functions of the server of the first embodiment. FIG. 6 is a diagram illustrating an example of correspondence information. FIG. 7 is a diagram illustrating an example of a device usage screen. FIG. 8 is a diagram illustrating an example of a setting screen corresponding to the MFP. FIG. 9 is a diagram illustrating an example of the authentication NG screen. FIG. 10 is a sequence diagram illustrating an example of a flow when the mobile terminal is authenticated. FIG. 11 is a diagram illustrating an example of the home screen. FIG. 12 is a diagram illustrating an example of a screen indicating that authentication is being performed. FIG. 13 is a sequence diagram illustrating an example of a flow when the mobile terminal is not authenticated. FIG. 14 is a flowchart illustrating an operation example of the network cooperation app according to the first embodiment. FIG. 15 is a flowchart illustrating an operation example of the server according to the first embodiment. FIG. 16 is a diagram illustrating an example of functions of the mobile terminal according to the second embodiment. FIG. 17 is a flowchart illustrating an operation example of the network cooperation app according to the second embodiment. FIG. 18 is a diagram illustrating an example of the functions of the mobile terminal according to the third embodiment. FIG. 19 is a flowchart illustrating an operation example of the network cooperation app according to the third embodiment. FIG. 20 is a diagram illustrating an example of the functions of the mobile terminal according to the fourth embodiment. FIG. 21 is a flowchart illustrating an operation example of the network cooperation app according to the fourth embodiment. FIG. 22 is a diagram illustrating an example of the functions of the mobile terminal according to the fifth embodiment. FIG. 23 is a flowchart illustrating an operation example of the network cooperation app according to the fifth embodiment. FIG. 24 is a diagram illustrating an example of functions of the mobile terminal according to the sixth embodiment. FIG. 25 is a flowchart illustrating an operation example of the network cooperation app according to the sixth embodiment. FIG. 26 is a diagram illustrating an example of the functions of the mobile terminal according to the seventh embodiment. FIG. 27 is a flowchart illustrating an operation example of the network cooperation app according to the seventh embodiment. FIG. 28 is a flowchart showing an example of detailed processing in step S42 of FIG.

  Hereinafter, embodiments of an information processing system, an information processing apparatus, an information processing method, and a program according to the present invention will be described in detail with reference to the accompanying drawings.

(First embodiment)
FIG. 1 is a diagram illustrating an example of a schematic configuration of an information processing system 1 according to the present embodiment. The information processing system 1 includes at least a mobile terminal 10 possessed by a user and a server 20 that is an example of an information processing apparatus. The server 20 determines whether or not the mobile terminal 10 can be used for each of a plurality of networks to which a plurality of devices are connected (whether or not to participate). Specific contents of the server 20 will be described later. In the example of FIG. 1, two examples of the network are the network A to which the MFP 30, the projector 31, and the interactive whiteboard 32 belong, and the network B to which the MFP 40, the projector 41, and the interactive whiteboard 42 belong. Not limited to this, the number of networks and the number and types of devices belonging to the network can be arbitrarily changed. Further, the number of portable terminals 10 and servers 20 included in the information processing system 1 can be arbitrarily changed (not limited to one each).

  FIG. 2 is a diagram illustrating an example of a hardware configuration of the mobile terminal 10. As shown in FIG. 2, the mobile terminal 10 includes a CPU 11, a ROM 12, a RAM 13, a flash memory 14, an operation panel 15, a communication I / F 16, a camera 17, and an acceleration sensor 18. Connection is made via the system bus 19.

  The CPU 11 selectively executes a program stored in the ROM 12 or the flash memory 14 using the RAM 13 as a work area, thereby controlling the entire mobile terminal 10 and realizing various functions including communication control with the server 20. Therefore, the CPU 11 is a central processing unit (microprocessor) that performs processing for realizing various functions of the mobile terminal 10 described later in the mobile terminal.

  The ROM 12 is a read-only memory in which each program executed by the CPU 11 and fixed data necessary for the execution are recorded in advance. The RAM 13 functions as a work area when the CPU 11 executes a program and is a readable / writable memory that stores temporary data. The flash memory 14 stores each program executed by the CPU 11 and fixed data necessary for the execution, stores various setting values in a changeable manner, and registers the server 20 and a destination as a data transmission destination. It is a non-volatile memory that is also used. Instead of the flash memory 14 or in addition to the flash memory 14, other nonvolatile storage means such as a nonvolatile RAM or HDD may be provided.

  The operation panel 15 is a device that displays various types of information and accepts various types of operations. For example, the operation panel 15 includes a display unit using a liquid crystal display or the like, and an operation unit using a touch panel provided on the display unit. Also good.

  The communication I / F 16 is an interface for communicating with an external device such as the server 20. In general, the mobile terminal 20 also has a communication function such as telephone, e-mail, and Internet communication as a communication function. However, the description is omitted here because it is not directly related to the feature of the present embodiment.

  The camera 17 is an example of an imaging device that performs imaging, and stores an image (captured image) obtained by imaging a subject within an imaging range by an image sensor in an internal memory. “Imaging” refers to converting an image of a subject (imaging target) imaged by an optical system such as a lens into an electrical signal.

  The acceleration sensor 18 is an example of an angle detection unit that detects an angle (orientation) of the mobile terminal 10 or an acceleration detection unit that detects an acceleration generated when the user who has the mobile terminal 20 moves.

  FIG. 3 is a diagram illustrating an example of a hardware configuration of the server 20. As shown in FIG. 3, the server 20 includes a CPU 21, a ROM 22, a RAM 23, a flash memory 24, a communication I / F 25, and a camera 26. These are connected by a system bus 27 so as to be able to exchange data, addresses, and control signals with each other.

  The CPU 21 controls the entire server 20 by selectively executing a program stored in the ROM 22 or the flash memory 24 using the RAM 23 as a work area, and performs various functions including communication control with each device and the portable terminal 10. Realize. Therefore, the CPU 21 is a central processing unit (microprocessor) that performs processing for realizing various functions of the server 20 described later.

  The ROM 22 is a read-only memory that stores in advance each program executed by the CPU 21 and fixed data necessary for the execution. The RAM 23 functions as a work area when the CPU 21 executes a program and is a readable / writable memory for storing temporary data.

  The flash memory 24 stores each program executed by the CPU 21 and fixed data necessary for the execution, stores various setting values in a changeable manner, and registers each device and a destination as a data transmission destination. It is a non-volatile memory that is also used. Instead of the flash memory 24 or in addition to the flash memory, other nonvolatile storage means such as a nonvolatile RAM or HDD may be provided.

  The communication I / F 25 is an interface for communicating with an external device such as the mobile terminal 10. The camera 17 stores an image (captured image) obtained by imaging a subject within the imaging range by an image sensor in an internal memory. The camera 17 is used when generating (registering) correspondence information described later.

  FIG. 4 is a diagram illustrating an example of functions that the mobile terminal 10 has. As shown in FIG. 4, the mobile terminal 10 includes a wireless communication unit 101, an imaging control unit 102, a transmission unit 103, a setting unit 104, a first storage unit 105, and a display control unit 106.

  Here, the mobile terminal 10 is loaded with an application (hereinafter referred to as “network cooperation application”) for using any device on the network. When the CPU 11 of the mobile terminal 10 executes the network cooperation application, the functions of the wireless communication unit 101, the imaging control unit 102, the transmission unit 103, the setting unit 104, and the display control unit 106 are realized. However, the present invention is not limited to this. For example, at least a part of the functions of the wireless communication unit 101, the imaging control unit 102, the transmission unit 103, the setting unit 104, and the display control unit 106 is a dedicated hardware circuit (semiconductor integrated circuit). Etc.). The first storage unit 105 is realized by, for example, the ROM 12, the RAM 13, the flash memory 14, and the like.

  For convenience of explanation, FIG. 4 illustrates only functions related to the network cooperation app, but the functions of the mobile terminal 10 are not limited to these.

  The wireless communication unit 101 provides a function of performing communication with an external device such as the server 20 by wireless communication.

  The imaging control unit 102 controls the camera 17 so that imaging is performed at predetermined intervals.

  The transmission unit 103 transmits the captured image obtained by the imaging to the server 20 every time imaging by the camera 17 is performed.

  The setting means 104 sets the interval. For example, the setting unit 104 can variably set the interval according to an instruction (input) from the user.

  The first storage unit 105 stores information indicating the interval set by the setting unit 104.

  The display control means 106 performs control to display various screens related to the network cooperation application. A specific screen example will be described later.

  FIG. 5 is a diagram illustrating an example of functions that the server 20 has. As illustrated in FIG. 5, the server 20 includes a wireless communication unit 201, a captured image reception unit 202, a correspondence information storage unit 203, an authentication unit 204, an update unit 205, and a screen transmission unit 206.

  Here, the CPU 21 of the server 20 executes the program stored in the ROM 22 or the like, thereby realizing the functions of the wireless communication unit 201, the captured image reception unit 202, the authentication unit 204, the update unit 205, and the screen transmission unit 206. However, the present invention is not limited to this. For example, at least a part of the functions of the wireless communication unit 201, the captured image reception unit 202, the authentication unit 204, the update unit 205, and the screen transmission unit 206 is a dedicated hardware circuit ( It may be realized by a semiconductor integrated circuit or the like. The correspondence information storage unit 203 is realized by, for example, the ROM 22, the RAM 23, the flash memory 24, and the like.

  For convenience of explanation, FIG. 5 illustrates only the functions according to the present embodiment, but the functions of the server 20 are not limited to these.

  The wireless communication unit 201 provides a function of communicating with an external device such as the mobile terminal 10 by wireless communication.

  The captured image receiving unit 202 receives a captured image. More specifically, the captured image receiving unit 202 receives captured images obtained by capturing with the camera 17 of the mobile terminal 10 from the mobile terminal 10 at predetermined intervals.

  The correspondence information storage unit 203 stores correspondence information in which one or more images are associated for each of a plurality of networks to which a plurality of devices are connected. FIG. 6 is a diagram illustrating an example of correspondence information. In the example of FIG. 6, the correspondence information is information in which, for each of the three networks (networks 1 to 3), one image corresponding to a place where the network is constructed is associated with devices belonging to the network. . For example, when the place where the network 1 is constructed is a conference room in which each of the ceiling, the floor, and the floor is decorated in red, a red image is set as an image associated with the network 1. May be. Note that the type and number of images associated with each network can be arbitrarily changed as long as the image can identify the location where the network is constructed.

  Returning to FIG. If there is an image that matches the captured image received by the captured image reception unit 202 in the correspondence information, the authentication unit 204 uses the network corresponding to the image that matches the received captured image. On the other hand, if there is no image that matches the captured image received by the captured image receiving unit 202 in the correspondence information, control is performed not to permit the mobile terminal 10 to use the network. .

  For example, when the correspondence information includes an image that matches the captured image received by the captured image receiving unit 202, the authentication unit 204 includes a plurality of networks belonging to the network corresponding to the received image that matches the captured image. The screen transmission unit 206 is controlled to transmit a screen for using the device (device use screen) to the mobile terminal 10. FIG. 7 is a diagram illustrating an example of a device usage screen. The display control means 106 of the portable terminal 10 performs control to display the device usage screen received from the server 20 on the operation panel 15. Further, when receiving an operation for selecting any of a plurality of devices via the device usage screen, the display control unit 106 performs control to display a setting screen corresponding to the selected device on the operation panel 15. Do. For example, when the display control unit 106 receives an operation for selecting an MFP via the device usage screen shown in FIG. 7, the display control unit 106 performs control to display a setting screen corresponding to the MFP on the operation panel 15 as shown in FIG. It can be carried out. Then, the user can perform operations for instructing execution of various settings and processes (for example, execution of printing) on the setting screen.

  On the other hand, for example, when there is no image in the correspondence information that matches the captured image received by the captured image receiving unit 202, the authentication unit 204 notifies the mobile terminal 10 that the use of the network is not permitted. The screen transmission unit 206 is controlled so as to transmit the screen (authentication NG screen) to be transmitted to the mobile terminal 10. FIG. 9 is a diagram illustrating an example of the authentication NG screen. The display control means 106 of the portable terminal 10 performs control to display the authentication NG screen received from the server 20 on the operation panel 15. In this case, the mobile terminal 10 is disconnected from any network, and devices on any network cannot be used.

  The description of FIG. 5 is continued. When there is an image that matches the captured image received by the captured image receiving unit 202 in the correspondence information, the update unit 205 sends the mobile terminal to the network corresponding to the image that matches the received captured image. 10 is associated (corresponding as a device belonging to the network) and the correspondence information is updated.

  The screen transmission unit 206 transmits various screens (device use screen and authentication NG screen) to the mobile terminal 10 under the control of the authentication unit 204.

  FIG. 10 is a sequence diagram illustrating an example of a flow when the mobile terminal 10 is authenticated (use of any network is permitted). First, the user presses the icon corresponding to the network cooperation app among the icons displayed on the home screen displayed on the operation panel 15 of the mobile terminal 10 as shown in FIG. The activation is instructed (step S1). The activated network cooperation application controls the camera 17 to take images at a predetermined interval, and the camera 17 takes an image (step S2).

  Next, the network cooperation application (transmission means 103) transmits the captured image obtained by imaging with the camera 17 to the server 20 (step S3). The server 20 (authentication means 204) determines whether or not the network can be used for the mobile terminal 10 by determining whether or not an image that matches the captured image received from the mobile terminal 10 exists in the correspondence information. An authentication process is performed (step S4). Note that the network cooperation application (display control means 106) starts from imaging by the camera 17 until a screen (device use screen or authentication NG screen) corresponding to the result of the authentication processing is received from the server 10. For example, as shown in FIG. 12, it is possible to perform control for displaying on the operation panel 15 a screen indicating that authentication is being performed by imaging.

  Returning to FIG. In this example, since the mobile terminal 10 is authenticated, the server 20 (the authentication unit 204, the screen transmission unit 206) performs the mobile terminal 10 with respect to the network corresponding to the image that matches the captured image received from the mobile terminal 10. To update the correspondence information and transmit a device usage screen for using a plurality of devices belonging to the network (a network permitted to be used for the mobile terminal 10) to the mobile terminal 10 (step S5). The network cooperation application (display control means 106) performs control to display the device usage screen received from the server 20 on the operation panel 15 (step S6). For example, when the user of the mobile terminal 10 selects an MFP from the device usage screen and performs an operation to instruct execution of printing on the setting screen corresponding to the selected MFP (step S7), the network cooperation application Transmits a print job instructing execution of printing to the server 20 (step S8). The server 20 that has received this print job confirms the authentication status of the mobile terminal 10 that is the transmission source of the print job (for example, by referring to the updated correspondence information, the mobile terminal 10 is associated with the network to which the MFP belongs. (Step S9). If the portable terminal 10 has been authenticated, the received print job is transmitted to the MFP (step S10), and the MFP executes printing based on the received print job (step S11).

  Thereafter, each time the camera 17 captures an image (step S12), the network cooperation app (transmission unit 103) transmits the captured image obtained by the imaging to the server 20 (step S13). Then, the server 20 (authentication means 204) determines whether or not the network can be used for the mobile terminal 10 by determining whether or not an image that matches the captured image received from the mobile terminal 10 exists in the correspondence information. An authentication process is performed to determine (step S14). In this example, since the mobile terminal 10 is authenticated, the server 20 transmits to the mobile terminal 10 a device usage screen for using a plurality of devices belonging to a network that allows the mobile terminal 10 to be used (step). S15).

  FIG. 13 is a sequence diagram illustrating an example of a flow when the mobile terminal 10 is not authenticated. The processing contents in steps S21 to S24 in FIG. 13 are the same as the processing contents in steps S1 to S4 in FIG. In this example, as a result of the authentication processing in step S24, the mobile terminal 10 is not authenticated, so the server 20 (authentication means 204, screen transmission means 206) notifies the mobile terminal 10 that the use of the network is not permitted. An authentication NG screen is transmitted to the mobile terminal 10 (step S25). The network cooperation application (display control means 106) performs control to display the authentication NG screen received from the server 20 on the operation panel 15 (step S26).

  FIG. 14 is a flowchart illustrating an operation example of the network cooperation app after activation. As shown in FIG. 14, every time the time measured by the timer reaches the set time (the time set according to the interval) (step S30: Yes), the imaging control unit 102 Imaging is instructed, and the camera 17 receiving this instruction performs imaging (step S31). Next, the transmission means 103 transmits the captured image obtained by the imaging in step S31 to the server 20 (step S32). Next, the set time of the timer is reset (step S33). For example, the set time of the timer is set to be a time point after the above-mentioned interval from the current time point. The setting subject may be the setting means 104 or another function of the network cooperation application.

  FIG. 15 is a flowchart illustrating an operation example of the server 20. As shown in FIG. 15, when the captured image receiving unit 202 receives a captured image from the mobile terminal 10 (step S41), the authentication unit 204 matches the captured image received in step S41 in the correspondence information. It is confirmed whether or not an image exists (step S42).

  If there is an image that matches the captured image received in step S41 in the correspondence information (step S42: Yes), the authentication unit 204 determines that the network corresponding to the image that matches the captured image received in step S41. Then, the correspondence information is updated in association with the portable terminal 10 (step S43). Then, the authentication unit 204 sets the screen transmission unit 206 to transmit to the mobile terminal 10 a device usage screen for using a plurality of devices belonging to the network corresponding to the image that matches the captured image received in step S41. Control (step S44).

  On the other hand, when there is no image in the correspondence information that matches the captured image received in step S41 (step S42: No), the authentication unit 204 notifies the mobile terminal 10 that the use of the network is not permitted. The screen transmission means 206 is controlled to transmit the authentication NG screen to be transmitted to the mobile terminal 10 (step S45).

  As described above, in the present embodiment, the mobile terminal 10 provided with the camera 17 controls the camera 17 so as to capture images at a predetermined interval. The captured image obtained by imaging is transmitted to the server 20. When the server 20 includes an image that matches the captured image received from the mobile terminal in the correspondence information in which one or more images are associated with each other for each of a plurality of networks to which a plurality of devices are connected, Control for permitting the portable terminal 10 to use the network corresponding to the image that matches the received captured image is performed. On the other hand, when the correspondence information does not include an image that matches the captured image received from the mobile terminal 10, control is performed not to permit the mobile terminal 10 to use the network. As a result, it is possible to automatically leave the network or join another network as the mobile terminal 10 moves.

(Second Embodiment)
Next, a second embodiment will be described. Description of parts common to the first embodiment described above will be omitted as appropriate.

  FIG. 16 is a diagram illustrating an example of functions of the mobile terminal 10 according to the present embodiment. As shown in FIG. 16, the mobile terminal 10 is different from the above-described first embodiment in that it further includes a determination unit 111 and a second storage unit 112. In this example, the determination unit 111 is realized by the CPU 11 of the mobile terminal 10 executing the network cooperation application of the present embodiment. However, the determination unit 111 is not limited to this, and is, for example, a dedicated hardware circuit (semiconductor integrated circuit or the like). It may be realized. The second storage unit 112 is realized by, for example, the ROM 12, the RAM 13, the flash memory 14, and the like.

  Each time the image is captured by the camera 17, the determination unit 111 is a pixel whose luminance value is equal to or less than a threshold value (for example, may be 0) among a plurality of pixels included in the captured image obtained by the imaging. It is determined whether or not the number exceeds a predetermined number. That is, the determination unit 111 has a function of determining whether or not a captured image obtained by imaging with the camera 17 is a black image. The predetermined number should just be a value which can determine whether a captured image is a black image, and can be changed arbitrarily.

  The second storage unit 112 stores the captured image. When the determination unit 111 determines that the number of pixels whose luminance value is equal to or lower than the threshold value among the plurality of pixels included in the captured image is determined by the determination unit 111 according to the present embodiment. Stores the captured image to be determined in the second storage unit 112 and transmits it to the server 20. In addition, when the determination unit 111 determines that the number of pixels whose luminance value is equal to or lower than the threshold value among the plurality of pixels included in the captured image is determined by the determination unit 111, Instead of the captured image to be determined, the server 20 uses a captured image (captured image obtained by imaging before (typically immediately before) the determined target captured image) stored in the second storage unit 112. Send to.

  FIG. 17 is a flowchart illustrating an operation example of the network cooperation app of the present embodiment after activation. The processing content of step S51 and step S52 of FIG. 17 is the same as the processing content of step S30 and step S31 of FIG. After step S52, the determination unit 111 determines whether or not the number of pixels whose luminance value is equal to or less than a threshold value among a plurality of pixels included in the captured image obtained by the imaging in step S52 exceeds a predetermined number. Is determined (step S53). When it is determined that the number of pixels whose luminance value is less than or equal to the threshold does not exceed a predetermined number (step S53: No), that is, when it is determined that the captured image is not a black image, the transmission unit 103 memorize | stores the captured image obtained by imaging of step S52 in the 2nd memory | storage means 112 (step S54). For example, the captured image obtained by the imaging in step S52 can be stored in the second storage unit 112 together with time information indicating the imaging time. Next, the transmission means 103 transmits the captured image obtained by the imaging in step S52 to the server 20 (step S55).

  On the other hand, if it is determined in step S53 described above that the number of pixels whose luminance value is equal to or less than the threshold value exceeds a predetermined number (step S53: Yes), that is, the captured image is a black image. If determined to be, the transmission unit 103 transmits the captured image stored in the second storage unit 112 to the server 20 instead of the captured image obtained by the imaging in step S52 (step S56).

  After step S55 or step S56 described above, the timer setting time is reset (step S57).

  According to the present embodiment described above, for example, the user's finger blocks the camera 17 of the mobile terminal 10 and sends a black image to the server 20, whereby the mobile terminal 10 is not authenticated and the user intends. It is possible to prevent the user from leaving the network at an unscheduled timing.

(Third embodiment)
Next, a third embodiment will be described. Description of parts common to the first embodiment described above will be omitted as appropriate. In the present embodiment, the camera 17 is provided at a first camera 17 a provided at the first position of the mobile terminal 10 and at a second position different from the first position of the mobile terminal 10. 2 cameras 17b.

  The first position and the second position are arbitrary. For example, the 1st camera 17a may be provided in the front (front surface) of the housing | casing of the portable terminal 10, and the 2nd camera 17b may be provided in the back surface (rear surface) of the housing | casing of the portable terminal 10, and vice versa. There may be. Further, for example, the first camera 17a may be provided on the upper surface of the casing of the mobile terminal 10, and the second camera 17b may be provided on the lower surface of the casing of the mobile terminal 10, or vice versa. . Further, for example, the first camera 17 a may be provided on the upper surface or the lower surface of the casing of the mobile terminal 10, and the second camera 17 b may be provided on either one of both side surfaces of the casing of the mobile terminal 10. And vice versa. Further, for example, the first camera 17a may be provided on the front surface or the back surface of the casing of the mobile terminal 10, and the second camera 17b may be provided on either one of both side surfaces of the casing of the mobile terminal 10. And vice versa. Further, for example, the first camera 17a may be provided on the upper surface or the lower surface of the casing of the mobile terminal 10, and the second camera 17b may be provided on the front or rear surface of the casing of the mobile terminal 10, or vice versa. There may be.

  FIG. 18 is a diagram illustrating an example of functions of the mobile terminal 10 according to the present embodiment. As shown in FIG. 18, the mobile terminal 10 differs from the first embodiment described above in that it further includes a determination unit 113. In this example, the determination unit 113 is realized by the CPU 11 of the mobile terminal 10 executing the network cooperation application of the present embodiment. However, the determination unit 113 is not limited thereto, and is, for example, a dedicated hardware circuit (semiconductor integrated circuit or the like). It may be realized.

  Each time the image is captured by the first camera 17a, the determination unit 113 determines in advance that the number of pixels whose luminance value is equal to or less than a threshold value from among the plurality of pixels included in the first captured image obtained by the image capturing. It is determined whether or not a predetermined number is exceeded. That is, the determination unit 113 has a function of determining whether or not the first captured image obtained by imaging with the first camera 17a is a black image. The predetermined number may be any value that can determine whether or not the first captured image is a black image, and can be arbitrarily changed.

  In the present embodiment, the imaging control unit 102 controls the first camera 17a so as to perform imaging at a predetermined interval, and among the plurality of pixels included in the first captured image by the determination unit 113, When it is determined that the number of pixels whose luminance value is less than or equal to the threshold value exceeds a predetermined number, control is performed to cause the second camera 17b to perform imaging.

  In the present embodiment, the transmission unit 103 causes the determination unit 113 to exceed the predetermined number of pixels whose luminance value is equal to or less than the threshold among the plurality of pixels included in the first captured image. If it is determined that there is not, the first captured image is transmitted to the server 20. On the other hand, when the determination unit 113 determines that the number of pixels whose luminance value is equal to or lower than the threshold value among the plurality of pixels included in the first captured image exceeds the predetermined number, The second captured image obtained by imaging by the camera 17b is transmitted to the server 20.

  FIG. 19 is a flowchart illustrating an operation example of the network cooperation app of the present embodiment after activation. As shown in FIG. 19, every time the time measured by the timer reaches the set time (the time set according to the interval) (step S61: Yes), the imaging control means 102 uses the first camera 17a. The first camera 17a that has received this instruction performs imaging (step S62). Next, the determination unit 113 determines whether the number of pixels whose luminance value is equal to or less than a threshold value exceeds a predetermined number among a plurality of pixels included in the first captured image obtained by imaging in step S62. It is determined whether or not (step S63). When it is determined that the number of pixels whose luminance value is equal to or less than the threshold does not exceed a predetermined number (step S63: No), that is, when it is determined that the first captured image is not a black image The transmitting unit 103 transmits the first captured image obtained by the imaging in step S62 to the server 20 (step S64).

  On the other hand, when it is determined in step S63 described above that the number of pixels whose luminance value is equal to or lower than the threshold value exceeds a predetermined number (step S63: Yes), that is, the first captured image is black. When it is determined that the image is an image, the imaging control unit 102 instructs the second camera 17a to perform imaging. Receiving this instruction, the second camera 17b performs imaging (step S65). Next, the transmission means 103 transmits the 2nd captured image obtained by imaging of step S65 to the server 20 (step S66).

  After step S64 or step S66 described above, the set time of the timer is reset (step S67).

  For example, in a form in which the first camera 17a is provided on the front of the casing of the mobile terminal 10 and the second camera 17b is provided on the back of the casing, the user places the front side of the casing of the mobile terminal 10 on the desk. When placed on the top surface, the first captured image obtained by imaging with the first camera 17a is a black image, but this black image is not transmitted to the server 20 and is placed on the back side of the mobile terminal 10. A second captured image obtained by imaging with the provided second camera 17b is transmitted to the server 20, and authentication processing is performed. Accordingly, it is possible to prevent the user from leaving the network at an unintended timing.

(Fourth embodiment)
Next, a fourth embodiment will be described. Description of parts common to the first embodiment described above will be omitted as appropriate.

  FIG. 20 is a diagram illustrating an example of functions of the mobile terminal 10 according to the present embodiment. As shown in FIG. 20, the mobile terminal 10 differs from the first embodiment described above in that it further includes a first determination unit 114, a second determination unit 115, and a second storage unit 116. In this example, each function of the first determination unit 114 and the second determination unit 115 is realized by the CPU 11 of the mobile terminal 10 executing the network cooperation app of the present embodiment, but is not limited thereto. For example, at least a part of the functions of the first determination unit 114 and the second determination unit 115 may be realized by a dedicated hardware circuit (semiconductor integrated circuit or the like). The second storage unit 116 is realized by, for example, the ROM 12, the RAM 13, the flash memory 14, and the like.

  The first determination unit 114 determines whether or not the mobile terminal 10 is in a horizontal state based on the angle of the mobile terminal 10. In the present embodiment, the first determination unit 114 acquires the angle of the mobile terminal 10 detected by the acceleration sensor 18 at predetermined intervals, and the mobile terminal 10 is leveled based on the acquired angle. It is determined whether or not it is in a state. For example, in the form in which the angle of the mobile terminal 10 is considered to be 0 degrees when the longitudinal direction of the mobile terminal 10 and the vertical direction (direction in which gravity acts) are parallel, the angle of the mobile terminal 10 is measured by the acceleration sensor 18. Is detected to be 90 degrees, the first determination means 114 can determine that the mobile terminal 10 is in a horizontal state. In addition, not only this but various well-known methods can be used as a method of determining whether the portable terminal 10 is a horizontal state.

  When the first determination unit 114 determines that the mobile terminal 10 is in a horizontal state, the second determination unit 115 generates a captured image (a captured image obtained by imaging of the camera 17 in that case). It is determined whether or not the number of pixels whose luminance value is equal to or lower than a threshold value among a plurality of included pixels exceeds a predetermined number. That is, it is determined whether or not the captured image is a black image. The predetermined number should just be a value which can determine whether a captured image is a black image, and can be changed arbitrarily.

  The second storage unit 116 stores the captured image. In the present embodiment, when the first determination unit 114 determines that the mobile terminal 10 is in a horizontal state, or in the present embodiment, the transmission unit 103 includes a plurality of images included in the captured image. If it is determined that the number of pixels whose luminance value is equal to or less than the threshold value among the pixels does not exceed a predetermined number, the captured image obtained by imaging of the camera 17 in that case is stored in the second storage unit. The information is stored in 116 and transmitted to the server 20. On the other hand, when the first determination unit 114 determines that the mobile terminal 10 is not in a horizontal state, or the second determination unit 115 determines that the transmission unit 103 includes a plurality of pixels included in the captured image. When it is determined that the number of pixels whose luminance value is equal to or less than the threshold value exceeds a predetermined number, the second storage unit 116 is used instead of the captured image obtained by the imaging of the camera 17 in that case. The captured image stored in is transmitted to the server 20.

  FIG. 21 is a flowchart illustrating an operation example of the network cooperation app of the present embodiment after activation. As shown in FIG. 21, every time the time measured by the timer reaches the set time (the time set according to the interval) (step S71: Yes), the first determination unit 114 includes the acceleration sensor 18. Whether or not the mobile terminal 10 is in a horizontal state is determined based on the angle of the mobile terminal 10 detected by (Step S72). Similarly to the first embodiment described above, every time the time measured by the timer reaches the set time, the imaging control unit 102 instructs the camera 17 to perform imaging, and receives the instruction from the camera 17. Performs imaging.

  In step S72 described above, when it is determined that the mobile terminal 10 is in a horizontal state (step S72: Yes), the second determination unit 115 performs imaging by the camera 17 when the set time is reached in step S71. It is determined whether or not the number of pixels whose luminance value is equal to or lower than the threshold value among a plurality of pixels included in the obtained captured image exceeds a predetermined number (step S73). When it is determined that the number of pixels whose luminance value is equal to or lower than the threshold value does not exceed a predetermined number (step S73: No), or in step S72 described above, the mobile terminal 10 is not in a horizontal state. When it is determined (step S72: No), the transmission unit 103 stores the captured image obtained by the imaging of the camera 17 when the set time is reached in step S71 in the second storage unit 116 (step S74). . And the transmission means 103 transmits the captured image obtained by the imaging of the camera 17 when the set time is reached in step S71 to the server 20 (step S75).

  On the other hand, when it is determined in step S73 described above that the number of pixels whose luminance value is equal to or less than the threshold value exceeds a predetermined number (step S73: Yes), the transmission unit 103 sets the set time in step S71. The captured image stored in the second storage means 116 is transmitted to the server 20 instead of the captured image obtained by the imaging of the camera 17 at the time of reaching (step S76).

  After step S75 or step S76 described above, the set time of the timer is reset (step S77).

  According to the present embodiment described above, for example, when the user places the mobile terminal 10 on a horizontal place (desk or the like), the camera 17 is blocked and a black image is sent to the server 20 so that the mobile terminal 10 10 is not authenticated, and it is possible to prevent the user from leaving the network at a timing not intended by the user.

(Fifth embodiment)
Next, a fifth embodiment will be described. Description of parts common to the first embodiment described above will be omitted as appropriate.

  FIG. 22 is a diagram illustrating an example of functions of the mobile terminal 10 according to the present embodiment. As shown in FIG. 22, the mobile terminal 10 is different from the above-described first embodiment in that it further includes a determination unit 117 and a second storage unit 118. In this example, the determination unit 117 is realized by the CPU 11 of the mobile terminal 10 executing the network cooperation application of the present embodiment. However, the determination unit 117 is not limited to this, and is, for example, a dedicated hardware circuit (semiconductor integrated circuit or the like). It may be realized. The second storage unit 118 is realized by, for example, the ROM 12, the RAM 13, the flash memory 14, and the like.

  The determination unit 117 determines whether the acceleration of the mobile terminal 10 is equal to or greater than a threshold value. In the present embodiment, the determination unit 117 acquires the acceleration of the mobile terminal 10 detected by the acceleration sensor 18 at a predetermined interval, and determines whether the acquired acceleration is equal to or greater than a threshold value. As this threshold value, it is desirable to set an acceleration value as an imaging condition such that the blur of the captured image exceeds an allowable value, and various values can be set according to the performance of the camera 17 and the like.

  The second storage unit 118 stores a captured image when the determination unit 117 determines that the acceleration of the mobile terminal 10 is not greater than or equal to the threshold value.

  In the present embodiment, when the determination unit 117 determines that the acceleration of the mobile terminal 10 is not equal to or greater than the threshold value, the transmission unit 103 stores the captured image obtained by imaging of the camera 17 in that case in the second storage. The information is stored in the means 118 and transmitted to the server 20. On the other hand, if the determination unit 117 determines that the acceleration of the mobile terminal 10 is equal to or greater than the threshold value, it is stored in the second storage unit 118 instead of the captured image obtained by the imaging of the camera 17 in that case. The captured image is transmitted to the server 20.

  FIG. 23 is a flowchart illustrating an operation example of the network cooperation app of the present embodiment after activation. As shown in FIG. 23, whenever the time measured by the timer reaches the set time (the time set according to the interval) (step 81: Yes), the determination unit 114 is detected by the acceleration sensor 18. It is determined whether the acceleration of the mobile terminal 10 is equal to or greater than a threshold value (step S82). Similarly to the first embodiment described above, every time the time measured by the timer reaches the set time, the imaging control unit 102 instructs the camera 17 to perform imaging, and receives the instruction from the camera 17. Performs imaging.

  In step S82 described above, when it is determined that the acceleration of the mobile terminal 10 is equal to or greater than the threshold (step S82: Yes), the transmission unit 103 is obtained by imaging of the camera 17 when the set time is reached in step S81. The captured image is stored in the second storage means 118 (step S83). And the transmission means 103 transmits the captured image obtained by the imaging of the camera 17 when the set time is reached in step S81 to the server 20 (step S84).

  On the other hand, when it is determined in step S82 described above that the acceleration of the mobile terminal 10 is less than the threshold value (step S82: No), the transmission unit 103 captures the image of the camera 17 when the set time is reached in step S81. Instead of the obtained captured image, the captured image stored in the second storage unit 118 is transmitted to the server 20 (step S85).

  After step S84 or step S85 described above, the timer setting time is reset (step S86).

  According to the above embodiment, the mobile terminal 10 is not authenticated by sending to the server 20 a captured image with large image degradation such as blur, obtained by imaging when the mobile terminal 10 moves sharply, It is possible to prevent the user from leaving the network at an unintended timing.

(Sixth embodiment)
Next, a sixth embodiment will be described. Description of parts common to the first embodiment described above will be omitted as appropriate.

  FIG. 24 is a diagram illustrating an example of functions of the mobile terminal 10 according to the present embodiment. As shown in FIG. 24, the mobile terminal 10 is different from the first embodiment described above in that it further includes a face detection unit 120 and a second storage unit 121. In this example, the face detection unit 120 is realized by the CPU 11 of the mobile terminal 10 executing the network cooperation application of the present embodiment, but is not limited thereto, for example, a dedicated hardware circuit (semiconductor integrated circuit or the like). It may be realized with. The second storage unit 121 is realized by, for example, the ROM 12, the RAM 13, the flash memory 14, and the like.

  The face detection unit 120 detects whether or not a human face is included in the captured image. In the present embodiment, the face detection unit 120 detects whether or not a human face is included in the captured image obtained by the image capture every time the image is captured by the camera 17. Note that various known techniques can be used as the face detection method.

  The second storage unit 121 stores the captured image. In the present embodiment, the transmission unit 103 stores the captured image detected by the face detection unit 120 as not including a human face in the second storage unit 121 and transmits it to the server 20. On the other hand, the transmission unit 103 transmits the captured image stored in the second storage unit 121 to the server 20 instead of the captured image in which the human face is detected by the face detection unit 120.

  FIG. 25 is a flowchart illustrating an operation example of the network cooperation app of the present embodiment after activation. As shown in FIG. 25, every time the time measured by the timer reaches the set time (the time set according to the interval) (step 91: Yes), the face detection unit 120 has reached the set time. It is detected whether or not a human face is included in the captured image obtained by the imaging of the camera 17 at the time (step S92). As in the first embodiment described above, every time the time measured by the timer reaches the set time, the imaging control unit 102 instructs the camera 17 to perform imaging, and the camera 17 that receives this instruction captures the image. I do.

  In the above-described step S92, when it is detected that the human face is not included in the captured image (step S92: No), the transmission unit 103 determines that the camera 17 at the time when the set time is reached in step S91. The captured image obtained by imaging is stored in the second storage unit 118 (step S93). And the transmission means 103 transmits the captured image obtained by imaging of the camera 17 when the set time is reached in step S91 to the server 20 (step S94).

  On the other hand, when it is detected in step S92 described above that a human face is included in the captured image (step S92: Yes), the transmission unit 103 determines that the camera at the time when the set time is reached in step S91. Instead of the picked-up image obtained by picking up the image 17 (the picked-up image targeted for face detection in step S92), the picked-up image stored in the second storage means 118 is transmitted to the server 20 (step S95).

  After step S94 or step S95 described above, the timer setting time is reset (step S96).

  According to the present embodiment described above, the mobile terminal 10 is not authenticated by sending a captured image in which a subject unrelated to authentication, such as a human face, is reflected to the server 20, and the user intends. It is possible to prevent the user from leaving the network at an unscheduled timing.

(Seventh embodiment)
Next, a seventh embodiment will be described. Description of parts common to the first embodiment described above will be omitted as appropriate.

  FIG. 26 is a diagram illustrating an example of functions of the mobile terminal 10 according to the present embodiment. As shown in FIG. 26, the mobile terminal 10 is different from the first embodiment described above in that it further includes a determination unit 122 and a second storage unit 123. In this example, the determination unit 122 is realized by the CPU 11 of the mobile terminal 10 executing the network cooperation application of the present embodiment. However, the determination unit 122 is not limited to this, and is, for example, a dedicated hardware circuit (semiconductor integrated circuit or the like). It may be realized. The second storage unit 123 is realized by, for example, the ROM 12, the RAM 13, the flash memory 14, and the like.

  The determination unit 122 determines whether or not the angle of the mobile terminal 10 matches the imaging condition. In the present embodiment, the determination unit 122 acquires the angle of the mobile terminal 10 detected by the acceleration sensor 18 at predetermined intervals, and determines whether or not the acquired angle matches the imaging condition. . For example, when an image in which a ceiling, a floor, a wall surface, or the like is used as an authentication image (an image associated with a network), an angle condition in which the camera 17 of the mobile terminal 10 faces the ceiling, the floor, the wall surface, or the like is set. Are set as imaging conditions.

  The second storage unit 123 stores the captured image. In the present embodiment, when the determination unit 122 determines that the angle of the mobile terminal 10 matches the imaging condition, the transmission unit 103 displays the captured image obtained by imaging with the camera 17 in that case. 2 in the storage unit 123 and transmitted to the server 20. On the other hand, when the determination unit 122 determines that the angle of the mobile terminal 10 does not match the imaging condition, the transmission unit 103 replaces the captured image obtained by imaging with the camera 17 in that case. The captured image stored in the second storage unit 123 is transmitted to the server 20.

  FIG. 27 is a flowchart showing an operation example of the network cooperation app of the present embodiment after activation. As shown in FIG. 27, every time the time measured by the timer reaches the set time (the time set according to the interval) (step 101: Yes), the determination unit 122 determines that the angle of the mobile terminal 10 is It is determined whether or not the imaging conditions are met (step S102). As in the first embodiment described above, every time the time measured by the timer reaches the set time, the imaging control unit 102 instructs the camera 17 to perform imaging, and the camera 17 that receives this instruction captures the image. I do.

  When it is determined in step S102 described above that the angle of the mobile terminal 10 matches the imaging condition (step S102: Yes), the transmission unit 103 captures the image of the camera 17 when the set time is reached in step S101. The captured image obtained in the above is stored in the second storage unit 123 (step S103). And the transmission means 103 transmits the captured image obtained by the imaging of the camera 17 when the set time is reached in step S101 to the server 20 (step S104).

  On the other hand, when it is determined in step S102 described above that the angle of the mobile terminal 10 does not match the imaging conditions (step S102: No), the transmission unit 103 causes the camera 17 when the set time is reached in step S101. The captured image stored in the second storage unit 123 is transmitted to the server 20 instead of the captured image obtained by the imaging (step S105).

  After step S104 or step S105 described above, the timer setting time is reset (step S106).

  According to the above-described embodiment, the mobile terminal 10 is not authenticated by sending a captured image in which a subject unrelated to authentication is reflected to the server 20, and leaves the network at a timing not intended by the user. Can be prevented.

(Eighth embodiment)
Next, an eighth embodiment will be described. Description of parts common to the first embodiment described above will be omitted as appropriate.

  The authentication unit 204 included in the server 20 determines whether any of the images included in the correspondence information matches the captured image received by the captured image receiving unit 202 when the ratio of the captured image is greater than or equal to a threshold value. Is determined to match. For example, the authentication unit 204 has a ratio that matches the captured image received by the captured image reception unit 202 in any of the images included in the correspondence information (hereinafter, may be referred to as “image matching ratio”) of 80% or more. In this case, it can be determined that any one of the images matches the captured image. Other configurations are the same as those of the above-described embodiments. This embodiment is applicable to any of the above-described embodiments.

  FIG. 28 is a flowchart showing detailed processing (processing in the present embodiment) in step S42 of FIG. As shown in FIG. 28, the authentication unit 204 matches the captured image received by the captured image receiving unit 202 in any of the images included in the correspondence information (hereinafter sometimes referred to as “target image”). Is calculated (step S111), and it is determined whether or not the calculated image matching ratio is equal to or greater than a threshold value (step S112). When the calculated image matching ratio is equal to or greater than the threshold (step S112: Yes), it is determined that the target image matches the image received by the captured image receiving unit 202 (step S113). On the other hand, when the calculated image matching ratio is less than the threshold value (step S112: No), it is determined that the target image and the image received by the captured image receiving unit 202 do not match (does not match) (step S114).

  Although the embodiments according to the present invention have been described above, the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above-described embodiments. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

  The program executed in the information processing system 1 of the above-described embodiment is a file in an installable format or an executable format, and is a CD-ROM, a flexible disk (FD), a CD-R, a DVD (Digital Versatile Disk). It may be configured to be recorded and provided on a computer-readable recording medium such as USB (Universal Serial Bus), or may be configured to be provided or distributed via a network such as the Internet. Various programs may be provided by being incorporated in advance in a ROM or the like.

DESCRIPTION OF SYMBOLS 1 Information processing system 10 Mobile terminal 20 Server 101 Wireless communication means 102 Imaging control means 103 Transmission means 104 Setting means 105 First storage means 106 Display control means 111 Determination means 112 Second storage means 113 Determination means 114 First determination Means 115 Second determination means 116 Second storage means 117 Determination means 118 Second storage means 120 Face detection means 121 Second storage means 122 Determination means 123 Second storage means 201 Wireless communication means 202 Captured image reception means 203 Corresponding information storage means 204 Authentication means 205 Update means 206 Screen transmission means

JP 2014-56333 A

Claims (15)

An information processing system including a mobile terminal including an imaging device and an information processing device,
The portable terminal is
Imaging control means for controlling the imaging device to perform imaging at a predetermined interval;
Transmission means for transmitting a captured image obtained by the imaging to the information processing device each time imaging by the imaging device is performed,
The information processing apparatus includes:
Captured image receiving means for receiving the captured image;
If there is the image that matches the captured image received by the captured image receiving means in the correspondence information in which one or more images are associated with each other for each of a plurality of networks to which a plurality of devices are connected, the reception thereof While allowing the portable terminal to use the network corresponding to the image that matches the captured image, the image corresponding to the captured image received by the captured image receiving means in the correspondence information If there is no, there is an authentication means for performing control that does not allow the mobile terminal to use the network,
Information processing system. The information processing apparatus includes:
When the image matching the captured image received by the captured image receiving means exists in the correspondence information, the network corresponding to the image corresponding to the received captured image is Update means for associating a mobile terminal with the corresponding information and updating the correspondence information;
The information processing system according to claim 1. The information processing apparatus further includes correspondence information storage means for storing the correspondence information.
The information processing system according to claim 1 or 2. The portable terminal is
Setting means for setting the interval;
First storage means for storing information indicating the interval set by the setting means;
The information processing system according to any one of claims 1 to 3. The portable terminal is
Whether the number of pixels whose luminance value is equal to or lower than a threshold value exceeds a predetermined number among a plurality of pixels included in the captured image obtained by the imaging each time imaging is performed by the imaging device Determination means for determining whether or not
Second storage means for storing the captured image;
The transmission means includes
When it is determined by the determination means that the number of pixels whose luminance value is less than or equal to the threshold value among the plurality of pixels included in the captured image does not exceed the predetermined number, the determination target Storing the captured image in the second storage unit and transmitting it to the information processing apparatus;
When it is determined by the determination means that the number of pixels whose luminance value is less than or equal to the threshold value among the plurality of pixels included in the captured image exceeds the predetermined number, the determination target Instead of the captured image, the captured image stored in the second storage unit is transmitted to the information processing apparatus.
The information processing system according to any one of claims 1 to 4. The imaging device
A first imaging device provided at a first position of the portable terminal;
A second imaging device provided at a second position different from the first position of the portable terminal,
The portable terminal is
Each time imaging is performed by the first imaging device, a predetermined number of pixels whose luminance value is equal to or less than a threshold value among a plurality of pixels included in the first captured image obtained by the imaging. Determination means for determining whether or not
The imaging control unit controls the first imaging device to perform imaging at the interval, and the determination unit determines that a luminance value is equal to or less than a threshold value among a plurality of pixels included in the first captured image. If it is determined that the number of pixels to be shown exceeds a predetermined number, control is performed to cause the second imaging device to perform imaging,
The transmission means includes
When it is determined by the determination means that the number of pixels whose luminance value is equal to or less than a threshold value among a plurality of pixels included in the first captured image does not exceed a predetermined number, the first Is transmitted to the information processing apparatus,
When it is determined by the determination means that the number of pixels having a luminance value equal to or lower than a threshold value among a plurality of pixels included in the first captured image exceeds the predetermined number, the second Transmitting a second captured image obtained by imaging by the imaging apparatus to the information processing apparatus,
The information processing system according to any one of claims 1 to 4. The portable terminal is
First determination means for determining whether or not the mobile terminal is in a horizontal state based on an angle of the mobile terminal;
When the first determination unit determines that the mobile terminal is in a horizontal state, among the plurality of pixels included in the captured image, the number of pixels whose luminance value is equal to or less than a threshold is determined in advance. Second judging means for judging whether or not the number exceeds the number,
Second storage means for storing the captured image,
The transmission means includes
When the first determination unit determines that the mobile terminal is in a horizontal state, or the second determination unit determines that the luminance value is equal to or less than a threshold value among a plurality of pixels included in the captured image. When it is determined that the number of pixels indicating the number does not exceed a predetermined number, the captured image obtained by imaging of the imaging device in that case is stored in the second storage unit and the information Sent to the processing unit,
When the first determination unit determines that the mobile terminal is not in a horizontal state, or the second determination unit determines that the luminance value is equal to or less than a threshold value among a plurality of pixels included in the captured image. If it is determined that the number of pixels exceeds the predetermined number, the second storage means stores the captured image obtained by the imaging of the imaging device in that case. Transmitting the captured image to the information processing apparatus;
The information processing system according to any one of claims 1 to 4. The portable terminal is
Determination means for determining whether or not the acceleration of the mobile terminal is equal to or greater than a threshold;
Second storage means for storing the captured image,
The transmission means includes
When the determination means determines that the acceleration of the portable terminal is not equal to or greater than a threshold value, the captured image obtained by the imaging of the imaging device in that case is stored in the second storage means and the information Sent to the processing unit,
If the determination means determines that the acceleration of the mobile terminal is equal to or greater than a threshold value, the determination is stored in the second storage means instead of the captured image obtained by the imaging device in that case. Transmitting the captured image to the information processing apparatus,
The information processing system according to any one of claims 1 to 4. The portable terminal is
Face detection means for detecting whether or not a human face is included in the captured image;
Second storage means for storing the captured image,
The transmission means includes
Storing the captured image detected by the face detection means not including a human face in the second storage means and transmitting it to the information processing apparatus;
Transmitting the captured image stored in the second storage unit to the information processing device instead of the captured image in which it is detected by the face detection unit that a human face is included;
The information processing system according to any one of claims 1 to 4. The portable terminal is
Determining means for determining whether or not the angle of the mobile terminal matches an imaging condition;
Second storage means for storing the captured image,
The transmission means includes
When the determination unit determines that the angle of the mobile terminal matches the imaging condition, the captured image obtained by imaging of the imaging device in that case is stored in the second storage unit. Together with the information processing device,
If the determination means determines that the angle of the mobile terminal does not match the imaging condition, the second storage means instead of the captured image obtained by imaging of the imaging device in that case Transmitting the captured image stored in the information processing apparatus,
The information processing system according to any one of claims 1 to 4. The authentication unit determines that any of the images and the captured image match if the ratio of the captured image that is included in the correspondence information is equal to or greater than a threshold value.
The information processing system according to any one of claims 1 to 10. An information processing apparatus that communicates with a mobile terminal including an imaging device,
Captured image receiving means for receiving a captured image obtained by imaging by the imaging device from the portable terminal at a predetermined interval;
When each of the correspondence information in which one or more images are associated with each of a plurality of networks to which a plurality of devices are connected, the image that matches the captured image received by the captured image receiving unit exists The mobile terminal is allowed to use the network corresponding to the image that matches the received captured image, while the correspondence information matches the captured image received by the captured image receiving means. An authentication unit that performs control not to permit the mobile terminal to use the network when the image does not exist,
Information processing device. An information processing method by an information processing device that communicates with a mobile terminal including an imaging device,
A captured image receiving step of receiving a captured image obtained by imaging by the imaging device from the mobile terminal at a predetermined interval;
When there is the image that matches the captured image received in the captured image receiving step in the correspondence information in which one or more images are associated with each other for each of a plurality of networks to which a plurality of devices are connected, While permitting the portable terminal to use the network corresponding to the received image that matches the captured image, the correspondence information matches the captured image received in the captured image reception step. When the image does not exist, an authentication step of performing control not to permit the mobile terminal to use the network, and
Information processing method. In an information processing apparatus that communicates with a mobile terminal equipped with an imaging device,
A captured image receiving step of receiving a captured image obtained by imaging by the imaging device from the mobile terminal at a predetermined interval;
When there is the image that matches the captured image received in the captured image receiving step in the correspondence information in which one or more images are associated with each other for each of a plurality of networks to which a plurality of devices are connected, While permitting the portable terminal to use the network corresponding to the received image that matches the captured image, the correspondence information matches the captured image received in the captured image reception step. A program for executing an authentication step of performing control not permitting the mobile terminal to use the network when the image does not exist. In a portable terminal equipped with an imaging device,
An imaging control step of controlling the imaging device to perform imaging at predetermined intervals;
A program for executing a transmission step of transmitting a captured image obtained by the imaging to the information processing device every time imaging by the imaging device is performed;
Including the information processing device,
The information processing apparatus includes:
Captured image receiving means for receiving the captured image;
When each of the correspondence information in which one or more images are associated with each of a plurality of networks to which a plurality of devices are connected, the image that matches the captured image received by the captured image receiving unit exists The mobile terminal is allowed to use the network corresponding to the image that matches the received captured image, while the correspondence information matches the captured image received by the captured image receiving means. Authentication means for performing control that does not allow the mobile terminal to use the network if the image does not exist,
Information processing system.