JP7127901B1 - Information processing terminal, control method, and program - Google Patents

Abstract

An information processing terminal, a control method, and a program capable of appropriately capturing an image using a mounted camera are provided. An information processing terminal 10 according to the present disclosure determines whether or not the operation of the camera 11 is normal based on a camera 11, a control unit 12 that controls the camera 11, and an image captured by the camera 11. and a determination unit 13 for determining the The control unit 12 turns on the power of the camera 11 to start the first imaging, and the determination unit 13 performs the first imaging based on the captured image acquired in the started first imaging. If the determination unit 13 determines that the operation of the camera 11 is not normal, the control unit 12 restarts the camera 11 to perform the second imaging. Start. [Selection drawing] Fig. 1

Description

The present disclosure relates to an information processing terminal, control method, and program.

2. Description of the Related Art Portable information processing terminals for business use are used in stores and the like to take inventories and place orders for products. A portable information processing terminal for business use is often equipped with a camera for the purpose of photographing and communicating in a store, in addition to a liquid crystal display and a touch panel. A technique of using such a camera as a monitoring camera for photographing the situation inside a store is known. Although the portable information processing terminal is battery-driven, it can continue imaging as long as there is capacity in the internal storage device as long as it is set on the charging stand. In addition, the charging stand can be installed anywhere as long as it can be connected to an outlet in the store. Therefore, if there is no surveillance camera in the store, or if there is a surveillance camera but there is a blind spot in the shooting range, equipment costs can be reduced by using a portable information processing terminal for business use as a surveillance camera. be able to.

As a related technology, for example, Patent Document 1 discloses a detection means for detecting that the mobile phone is placed on a charging base, and when the detection means detects placement on the charging base, an imaging operation by an imaging unit is started. An electronic camera is disclosed having an imaging initiation means.

JP 2004-120067 A

Unlike general surveillance cameras that continue to take pictures once the power is turned on, the camera mounted on the portable information processing terminal is turned on only when necessary and turned off at other times in order to save power. Or it may go into sleep mode. Therefore, compared to a general surveillance camera that is always on, the camera mounted on the portable information processing terminal is subject to greater electrical stress when the power state is changed, causing temporary malfunctions. is likely to occur. For example, when turning the camera from an OFF state to an ON state or resuming from a sleep state, the captured image is not output due to insufficient power supply to the camera, and the preview screen of the terminal remains black. Sometimes. In such a case, even if the image capturing is started, the captured image may be black and dark like the preview screen, and the image capturing may not be performed normally. Therefore, when such a problem occurs, it is necessary to change the power state of the camera and reset the state of the camera. For example, by restarting a predetermined camera application for imaging, restarting the camera, and resetting the state of the camera, such a problem can be resolved.

When such a problem occurs, if the operator is operating the portable information processing terminal, the operator can notice the problem because the preview screen of the terminal is pitch black. Therefore, the problem can be resolved by the operator restarting the camera application and restarting the camera. On the other hand, when the image is captured unattended, or when the preview screen is not displayed on the terminal, such a problem cannot be noticed. The same is true when the operator leaves the terminal without waiting for the camera application to start up. In such a case, the camera mounted on the portable information processing terminal cannot function as a monitoring camera until the problem of the camera is resolved.

In view of the problems described above, an object of the present disclosure is to provide an information processing terminal, a control method, and a program capable of appropriately capturing an image using a mounted camera.

The information processing terminal according to the present disclosure is
camera and
a control unit that controls the camera;
a determination unit that determines whether or not the operation of the camera is normal based on the captured image of the camera;
with
The control unit transitions the power of the camera to an ON state to start first imaging,
The determination unit determines whether the operation of the camera in the first imaging is normal based on the captured image acquired in the started first imaging,
The control unit restarts the camera and starts second imaging when the determination unit determines that the operation of the camera is not normal.

The control method according to the present disclosure is
a step of transitioning the power of the camera to an ON state to start a first imaging;
Determining whether the operation of the camera in the first imaging is normal based on the captured image acquired in the started first imaging;
and restarting the camera to start a second imaging when it is determined in the determining step that the operation of the camera is not normal.

The program according to the present disclosure is
a step of transitioning the power of the camera to an ON state to start a first imaging;
Determining whether the operation of the camera in the first imaging is normal based on the captured image acquired in the started first imaging;
causing a computer to execute a control method comprising: restarting the camera to start a second imaging when it is determined in the determining step that the operation of the camera is not normal.

According to the information processing terminal, the control method, and the program according to the present disclosure, it is possible to appropriately perform imaging using the mounted camera.

1 is a block diagram showing the configuration of an information processing terminal according to Embodiment 1; FIG. 4 is a flowchart showing processing of the information processing terminal according to the first embodiment; FIG. 10 is a block diagram showing configurations of an information processing terminal and a charging stand according to a second embodiment; 9 is a flowchart showing processing of the information processing terminal according to the second embodiment; 9 is a flowchart showing processing of the information processing terminal according to the second embodiment; 9 is a flowchart showing processing of the information processing terminal according to the second embodiment; FIG. 7 is a diagram illustrating a hardware configuration example of an information processing terminal according to a second embodiment; FIG.

<Embodiment 1>
Embodiments of the present disclosure will be described below with reference to the drawings. FIG. 1 is a block diagram showing the configuration of an information processing terminal 10 according to this embodiment. The information processing terminal 10 includes a camera 11 , a control section 12 and a determination section 13 .

The control unit 12 controls the camera 11 . The control unit 12 turns on the power of the camera 11 to start the first imaging. The determination unit 13 determines whether or not the operation of the camera 11 is normal based on the captured image of the camera 11 . For example, the determination unit 13 determines whether or not the operation of the camera 11 in the first imaging is normal based on the captured image acquired in the first imaging started by the control unit 12 . When the determination unit 13 determines that the operation of the camera 11 is not normal, the control unit 12 restarts the camera 11 to start the second imaging.

FIG. 2 is a flow chart showing processing performed by the information processing terminal 10 . First, the control unit 12 turns on the power of the camera 11 to start the first imaging (S11). Next, the determination unit 13 determines whether or not the operation of the camera 11 in the first imaging is normal based on the captured image acquired in the first imaging (S13).

The control unit 12 determines whether or not the determination unit 13 has determined that the operation of the camera 11 is normal (S15). When it is determined that the operation of the camera 11 is normal (YES in S15), the control unit 12 continues the first imaging as it is. When the determination unit 13 determines that the operation of the camera 11 is not normal (NO in S15), the control unit 12 restarts the camera 11 and starts the second imaging (S17).

As described above, according to the information processing terminal 10 according to the present embodiment, the camera 11 in the power-on state starts capturing an image, and the obtained captured image is used to determine whether the operation of the camera 11 is normal. It is possible to determine whether or not The information processing terminal 10 continues the first imaging when it is determined that the operation of the camera 11 is normal, and restarts the camera 11 when it is determined that the operation is not normal, and performs the second imaging. can start. By doing so, even when the operation of the camera 11 mounted on the information processing terminal 10 is not normal, it is possible to take an image appropriately.

<Embodiment 2>
Embodiment 2 is a specific example of Embodiment 1 described above. FIG. 3 is a block diagram showing configurations of the information processing terminal 100 and the charging stand 50 according to this embodiment. The information processing terminal 100 includes an information processing section 110 , a camera 120 , a camera power supply control circuit 130 , a power supply circuit 140 , a light 150 , a liquid crystal 155 , a backlight 160 , an illuminance sensor 170 and a charging terminal 180 . The charging stand 50 has a charging terminal 51 for connecting with the charging terminal 180 .

The information processing terminal 100 is an information terminal that can be used for business purposes in a store or the like. Here, business use may include use of the information processing terminal 100 in order to perform processing related to business in an environment in which the information processing terminal 100 is used. The environment in which the information processing terminal 100 is used is, for example, various stores such as grocery stores, supermarkets, department stores, convenience stores, cafeterias, and restaurants. The environment in which the information processing terminal 100 is used may include, but is not limited to, offices, libraries, schools, or other public facilities. Here, as an example, a case where the information processing terminal 100 is used for business in a store such as a grocery store will be described.

The information processing terminal 100 may be used, for example, for product inventory management in a store. Inventory management may include processes such as ordering, registering, and taking inventory of merchandise, for example. The information processing terminal 100 is not limited to these, and may be used for product accounting, customer management, sales analysis, employee attendance management, and the like. A user (for example, an employee of a store) operates the information processing terminal 100 to perform various processes related to the store as described above. The information processing terminal 100 may be wired or wirelessly connected to a server (not shown) inside or outside the store via a network to transmit and receive data necessary for business.

The information processing terminal 100 is, for example, a portable terminal such as a tablet terminal, a mobile phone terminal, or a smart phone. Here, description will be made assuming that the information processing terminal 100 is a tablet terminal. The information processing terminal 100 is driven by a rechargeable internal battery (not shown). The user can use the information processing terminal 100 for business while carrying the information processing terminal 100 in the store as necessary.

Also, the user can charge the built-in battery by connecting the information processing terminal 100 to the charging base 50 . Here, an example will be described in which the user connects the information processing terminal 100 to the charging base 50 for charging after using the information processing terminal 100 for business in a store.

In this embodiment, the information processing terminal 100 connected to the charging stand 50 can function as a monitoring camera by charging the built-in battery and operating the camera 120 . The information processing terminal 100 and the charging stand 50 may be installed, for example, in a sales floor in a store, or may be installed in a backyard or the like. When information processing terminal 100 is unmanned, information processing terminal 100 may be fixed to charging stand 50 using a Kensington lock (registered trademark) or the like.

Each functional unit of the information processing terminal 100 will be described with reference to the block diagram shown in FIG. A camera 120 corresponds to the camera 11 of the first embodiment. The camera 120 is an imaging device that takes an image from a predetermined direction in the space where the information processing terminal 100 is installed. The camera 120 acquires imaging information by imaging. The imaging information includes a captured image. The imaging information may include the date and time of imaging, the positional information of the imaging location, and the like.

The camera 120 may be, for example, a digital camera using an imaging device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The camera 120 records the image captured by the imaging element in the storage unit 115 of the information processing unit 110 as digital data. The captured image may be transmitted to a server inside or outside the store via a network and stored in the server.

A captured image acquired by the camera 120 may be a still image, or may be a moving image captured continuously at a predetermined frame rate. Here, it is assumed that camera 120 captures a moving image in a space where information processing terminal 100 and charging stand 50 are installed (for example, a sales floor in a store).

In this embodiment, the camera 120 pre-installed in the information processing terminal 100 is used to capture an image, but the present invention is not limited to this. Instead of the camera 120 or together with the camera 120, another camera or the like may be connected to the information processing terminal 100 and used.

A camera power supply control circuit 130 is a circuit for controlling the power supply of the camera 120 . The camera power control circuit 130 switches the power of the camera 120 to an ON state, an OFF state, a sleep state, or the like based on control from the control unit 111 .

The power supply circuit 140 receives power supply from the charging stand 50 via the charging terminal 180 . Also, the power supply circuit 140 supplies power to the camera power supply control circuit 130 .

The light 150 functions as an illumination unit that emits illumination light. The light 150 irradiates the surroundings of the information processing terminal 100 with illumination light. Light 150 may be a flashlight that is turned on when camera 120 takes an image. The light 150 emits light under the control of the control unit 111 so that a high-resolution captured image can be obtained even when the surroundings are dark.

The liquid crystal 155 functions as a display that displays various information. Liquid crystal 155 receives display information output from control unit 111 and displays the display information. The liquid crystal 155 displays, for example, an image captured by the camera 120 and predetermined display information used in business use of the information processing terminal 100 .

Like the light 150, the backlight 160 functions as an illumination unit that emits illumination light. The backlight 160 emits illumination light from behind the liquid crystal 155 . The backlight 160 changes the brightness of illumination light based on control from the control unit 111 . For example, when the illuminance around the information processing terminal 100 is high, the backlight 160 increases the brightness of the backlight 160 based on the control from the information processing section 110 . Thereby, the visibility of the display information displayed on the liquid crystal 155 can be improved.

Instead of the combination of the liquid crystal 155 and the backlight 160, for example, a self-luminous display panel such as an organic EL (Organic Electro-Luminescence) panel may be used. By using a self-luminous display panel, illumination light can be emitted without providing the backlight 160 .

The illuminance sensor 170 detects ambient illuminance. Ambient light sensor 170 may serve as an ambient light input for adjusting the brightness of backlight 160 .

The charging terminal 180 is configured to be electrically connectable to the charging terminal 51 on the charging stand 50 side. When charging terminal 180 and charging terminal 51 are connected, the built-in battery of information processing terminal 100 is charged.

The information processing section 110 includes a control section 111 , a determination section 113 and a storage section 115 . The control unit 111 controls each functional unit of the information processing terminal 100 . The control unit 111 can acquire information from each functional unit and control each functional unit based on the acquired information.

The controller 111 corresponds to the controller 12 of the first embodiment. The control unit 111 turns on the power of the camera 120 to start the first imaging. For example, when the charging terminal 180 and the charging terminal 51 of the charging base 50 are electrically connected, the control unit 111 detects the start of charging from the charging base 50 to the information processing terminal 100 . When the control unit 111 detects the start of charging, the control unit 111 switches the power of the camera 120 to the ON state, and automatically starts the first imaging. By doing so, the first imaging can be automatically started when the information processing terminal 100 is placed on the charging base 50 .

Note that the control unit 111 may cause the power of the camera 120 to transition from the OFF state to the ON state, or may transition from the sleep state to the ON state. The power of the camera 120 may be switched to the ON state from another state without being limited to this.

When the determination unit 113 determines that the operation of the camera 120 is not normal, the control unit 111 restarts the camera 120 and starts the second imaging. Specifically, when it is determined that the operation of the camera 120 is not normal, the control unit 111 changes the power of the camera 120 to the OFF state. After that, the control unit 111 changes the power of the camera 120 to the ON state. The control unit 111 may provide a predetermined time between transitioning to the OFF state and transitioning to the ON state. Also, the control unit 111 may end the first imaging before turning off the power. After turning on the power of the camera 120, the control unit 111 starts the second imaging.

In restarting the camera 120, the control unit 111 keeps the information processing terminal 100 powered on. By doing so, the camera 120 can be restored while data such as applications used by the user for business purposes is retained.

The control unit 111 acquires a captured image from the storage unit 115 and performs moving object detection processing for detecting a moving object from the captured image. The control unit 111 may detect the subject appearing in the captured image and detect the movement of the subject using a known image recognition technique or the like. Further, the control unit 111 outputs the captured image acquired from the storage unit 115, the display information used for business use of the information processing terminal 100, and the like to the liquid crystal 155 in response to a user's request or the like.

The determination unit 113 corresponds to the determination unit 13 of the first embodiment. The determination unit 113 acquires the captured image of the camera 120 from the storage unit 115, and determines whether or not the operation of the camera 120 is normal based on the acquired captured image. Here, the normal operation of the camera 120 may be a state in which it is determined that the captured image is properly acquired by the camera 120 . For example, when the captured image acquired from the camera 120 does not correspond to the originally captured image, the determination unit 113 determines that the operation of the camera 120 is not normal.

For example, when the captured image is completely dark, the determination unit 113 determines whether the captured image is an image corresponding to the illuminance detected by the illuminance sensor 170 . If the captured image does not correspond to the detected illuminance, the determination unit 113 determines that the operation of the camera 120 is not normal.

Specifically, first, the determination unit 113 acquires the captured image from the storage unit 115 and determines whether or not the captured image is completely dark. Here, the state in which the captured image is completely dark may include, for example, a state in which all pixels are displayed in black in the captured image. In addition, it is not limited to black, and may include cases where all pixels are displayed in white, red, blue, green, or other colors. Also, a state in which not all pixels but some of them are displayed in these colors may be included. For example, it includes a state in which a predetermined percentage or more of the entire captured image (for example, the lower half) is occupied by black, etc., and a state in which the captured image includes multiple strip-shaped areas such as black. good too.

In order to determine whether the captured image is completely dark, for example, the determination unit 113 obtains the difference between the captured image and an image in which all pixels are displayed in black. The determination unit 113 determines that the captured image is completely dark when the difference is equal to or less than a predetermined value. When it is determined that the captured image is not completely dark, the determination unit 113 may determine that the camera 120 is operating normally.

When it is determined that the captured image is completely dark, the determining unit 113 determines whether or not the surroundings are actually completely dark. The determination unit 113 acquires the detected ambient illuminance from the illuminance sensor 170 . The determining unit 113 determines that the surrounding illuminance is high when the obtained illuminance is equal to or higher than a predetermined value, and determines that the surrounding illuminance is low when the obtained illuminance is less than the predetermined value. When it is determined that the illuminance of the surrounding area is low, the surrounding area is actually dark, and the captured image corresponds to the actual illuminance of the surrounding area. Therefore, the determination unit 113 determines that the camera 120 is operating normally.

When it is determined that the illuminance of the surroundings is high, the captured image is completely dark even though the surroundings are not actually dark, so the captured image does not correspond to the illuminance of the surroundings. Therefore, the determination unit 113 determines that the camera 120 is not operating normally. In this way, the determination unit 113 can determine whether or not the operation of the camera 120 is normal using the ambient illuminance acquired from the illuminance sensor 170 .

Further, the determination unit 113 may use the light 150 or the backlight 160 to determine whether the operation of the camera 120 is normal. The determination unit 113 determines whether or not the captured image is an image corresponding to a state in which the illumination light is illuminated when the periphery or the like is illuminated with the illumination light. The determination unit 113 determines that the operation of the camera 120 is not normal when the captured image does not correspond to the state in which the illumination light is applied.

For example, the determination unit 113 acquires a captured image when the light 150 irradiates the surroundings of the information processing terminal 100 with illumination light. When the captured image is completely dark even though the illumination light is applied, the captured image does not correspond to the state in which the illumination light is applied. Therefore, the determination unit 113 determines that the operation of the camera 120 is not normal. The determination unit 113 may determine whether or not the operation of the camera 120 is normal based on the change in the captured image by changing the illumination state, for example, by blinking the light 150 .

As with the light 150 , the determination unit 113 may use illumination light from the backlight 160 for determination. For example, it may be determined whether or not the operation of the camera 120 is normal based on the change in the captured image when the brightness of the backlight 160 is increased to the maximum. If the captured image is completely dark even though the brightness of the backlight 160 is increased, the captured image does not correspond to the state in which illumination light is applied. Therefore, the determination unit 113 can determine that the operation of the camera 120 is not normal. The brightness of the backlight 160 is not limited to the maximum, and may be increased to a predetermined brightness. Further, similar to the light 150, the backlight 160 may be blinked and determination may be made based on changes in the captured image.

Furthermore, the determination unit 113 may determine whether or not the operation of the camera 120 is normal based on the result of the moving object detection processing in the control unit 111 . For example, the determination unit 113 monitors captured images at predetermined time intervals, and determines that the camera 120 is not operating normally when no moving object is detected in the captured images. The determination unit 113 may set different determination criteria according to the imaging location or the like. For example, the determination unit 113 may set different determination criteria for places where there is a high possibility that people will move, such as entrances and exits of sales floors and checkouts, and places where people are not likely to move. Also, different determination criteria may be provided according to business hours, days of the week, and the like. Note that a known image recognition technique or the like may be used to extract the subject.

The determination unit 113 may determine whether or not the operation of the camera 120 is normal using another method, not limited to the method described above. For example, the determination unit 113 uses a known method to determine whether or not the captured image contains noise, and if noise is contained, determines that the camera 120 is not operating normally. good. Further, the determination unit 113 may determine that the camera 120 is not operating normally even when part or all of the captured image is not stored after the start of imaging. The determination unit 113 may determine that the camera 120 is not operating normally even when the captured image is a black-and-white image even though color imaging is being performed.

After determining whether the operation of the camera 120 is normal, the determination unit 113 outputs the determination result to the control unit 111 .

The determination unit 113 may determine whether or not the operation of the camera 120 is normal at timings other than the timing at which imaging is started. For example, the determination unit 113 may determine whether or not the operation of the camera 120 is normal again not only at the timing when the imaging is started but also at the timing after a predetermined time has passed since the imaging was started. The determination unit 113 may monitor the operation of the camera 120 at predetermined time intervals. The predetermined time interval may not be a constant interval. By monitoring the operation of the camera 120, even if the camera 120 does not operate normally during image capturing, the period during which no image is captured can be shortened.

The storage unit 115 records images captured by the camera 120 . The storage unit 115 may record data files and the like necessary for business use of the information processing terminal 100 .

Next, processing performed by the information processing terminal 100 will be described with reference to FIG. The figure is a flow chart showing the processing performed by the information processing terminal 100 . Here, the description will be made assuming that the information processing terminal 100 is used for business in a store or the like and is connected to the charging stand 50 for charging.

First, the user connects the information processing terminal 100 to the charging base 50 . The control unit 111 detects the supply of power from the charging stand 50, and detects that charging of the information processing terminal 100 has started (S101). The control unit 111 turns on the power of the camera 120 (S103).

The control unit 111 activates a predetermined application for imaging with the camera 120, and starts imaging with the camera 120 (first imaging) (S105). Camera 120 stores the captured image in storage unit 115 . The control unit 111 may cause the display unit (not shown) included in the charging base 50 to display that the image is being captured.

Subsequently, the determination unit 113 determines whether or not the operation of the camera 120 is normal based on the captured image acquired by the started imaging. Here, the determination unit 113 determines whether or not the captured image corresponds to the illuminance detected by the illuminance sensor 170 .

The determination unit 113 acquires the captured image from the storage unit 115 and determines whether or not the captured image is completely dark (S107). For example, the determination unit 113 obtains the difference between the captured image and the image in which all pixels are displayed in black. The determination unit 113 determines that the captured image is completely dark when the difference is equal to or less than a predetermined value. When it is determined that the captured image is not completely dark (NO in S107), the determining unit 113 determines that the camera 120 is operating normally, and continues capturing (S115).

When it is determined that the captured image is completely dark (YES in S107), the determination unit 113 determines whether or not the surrounding illuminance is high (S109). For example, the determination unit 113 acquires the illuminance of the surroundings from the illuminance sensor 170, and determines that the illuminance of the surroundings is high when the acquired illuminance is equal to or greater than a predetermined value. If it is determined that the illuminance of the surroundings is not high (NO in S109), the surroundings are actually dark, so the determination unit 113 determines that the camera 120 is operating normally, and continues imaging. (S115).

If it is determined that the illuminance of the surroundings is high (YES in S109), the captured image is completely dark even though the surroundings are not actually dark, so the captured image is an image corresponding to the illuminance of the surroundings. It is not. Therefore, the determination unit 113 determines that the camera 120 is not operating normally. The control unit 111 ends imaging (S111). The control unit 111 terminates a predetermined application and turns off the power of the camera 120 (S113).

The control unit 111 returns to step S103 and repeats the subsequent processes. The control unit 111 turns the power of the camera 120 from the OFF state to the ON state again (S103), and starts imaging (second imaging) (S105). After the camera 120 is switched to the OFF state in step S113, the control unit 111 may proceed to step S103 after a predetermined period of time has elapsed.

The determination unit 113 may determine whether or not the camera 120 is operating normally using another method, not limited to the method described above. FIG. 5 is a flowchart showing processing performed by information processing terminal 100 when determining whether or not camera 120 is operating normally using light 150 or backlight 160 .

Steps S201 to S207 correspond to steps S101 to S107 in FIG. 4 and have the same contents, so description thereof will be omitted. When the determination unit 113 determines that the captured image is completely dark (YES in S207), the control unit 111 controls the light 150 to irradiate the surroundings with illumination light (S208). The control unit 111 may control the backlight 160 to emit illumination light. For example, the control unit 111 may increase the brightness of the backlight 160 to the maximum, or may increase the brightness to a predetermined brightness.

The determination unit 113 acquires from the storage unit 115 a captured image in a state where illumination light is emitted using the light 150 or the backlight 160 . The determination unit 113 determines whether or not the acquired captured image is an image corresponding to the state of illumination light irradiation (S209).

If the captured image is an image corresponding to the illumination light irradiation state (YES in S209), the determination unit 113 determines that the camera 120 is operating normally, and continues capturing (S215). . If the captured image does not correspond to the state of illumination light irradiation (NO in S209), the determination unit 113 determines that the camera 120 is not operating normally. The control unit 111 ends the imaging (S211). The control unit 111 terminates the predetermined application and turns the power of the camera 120 to the OFF state (S213). The control unit 111 returns to step S203 and repeats the subsequent processes.

Furthermore, the determination unit 113 may determine whether or not the operation of the camera 120 is normal using moving object detection processing on the captured image. FIG. 6 is a flowchart showing processing performed by the information processing terminal 100 when determining whether or not the operation of the camera 120 is normal using moving object detection processing.

Steps S301 to S305 correspond to steps S101 to S105 in FIG. 4 and have the same contents, so description thereof will be omitted. The control unit 111 acquires the captured image from the storage unit 115, and performs moving object detection processing on the acquired captured image (S307). The determination unit 113 acquires the result of the moving object detection process from the control unit 111, and determines whether or not the operation of the camera 120 is normal based on the result. The determination unit 113 determines whether or not a moving object has been detected in the captured image (S309). For example, the determination unit 113 monitors the captured image at predetermined time intervals, and confirms whether or not there is a predetermined change or more in the subject extracted in the captured image with respect to time change. The determination unit 113 may set different criteria for determination according to the imaging location, the imaging time zone, and the like.

If a moving object is detected (YES in S309), the determination unit 113 determines that the camera 120 is operating normally, and continues imaging (S315). If no moving object is detected (NO in S309), the determination unit 113 determines that the camera 120 is not operating normally. The control unit 111 ends the imaging (S311). The control unit 111 terminates a predetermined application and turns the power of the camera 120 to OFF (S313). The control unit 111 returns to step S303 and repeats the subsequent processes.

In determining the operation of the camera 120 described above, the determination unit 113 may determine whether or not the camera 120 is operating normally at any timing, not just immediately after the start of imaging. The determination unit 113 may perform determination at the timing when imaging is started, or may perform determination at timing after a predetermined period of time has elapsed. In addition to the timing at which imaging is started, determination may be made at timing other than the timing. Additionally, the operation of camera 120 may be monitored at predetermined time intervals. Note that the predetermined time interval may not be a constant interval.

In the above description, the control unit 111 detects the start of charging of the information processing terminal 100 to turn on the power of the camera 120 and start imaging, but the present invention is not limited to this. For example, based on a preset timer, the power may be switched to the ON state to start imaging. The timer may be set to the start time of imaging, or may be set to a predetermined timing (for example, two hours after the start of charging). Also, imaging may be started in conjunction with a motion sensor or the like. Furthermore, the timing for ending imaging may be set in conjunction with a timer or a motion sensor. Then, when the information processing terminal 100 is removed from the charging stand 50, the imaging may be stopped.

Also, the control unit 111 may count the number of times the camera 120 is restarted. The control unit 111 may suppress subsequent restarts when the number of restarts reaches or exceeds a predetermined value. By doing so, it is possible to prevent the restart from being excessively repeated. In addition, the control unit 111 may notify the manager of the store or the like according to the number of restarts or the like. By doing so, the administrator or the like can quickly grasp that the imaging is not properly performed.

As described above, according to the information processing terminal 100 according to the present embodiment, the control unit 111 can detect the start of charging of the information processing terminal 100 and automatically start imaging. Further, the determination unit 113 can determine whether the camera 120 is operating normally based on the captured image, and can monitor whether the information processing terminal 100 is properly functioning as a surveillance camera. . When the captured image is completely dark, the determination unit 113 can use the illuminance sensor 170 to determine whether or not the captured image corresponds to the surrounding illuminance.

In addition, the determination unit 113 uses the light 150 or the backlight 160 to irradiate illumination light to the surroundings or the like, and determines whether or not the captured image is an image corresponding to the state in which the illumination light is illuminated. By doing so, it is possible to check the operation of the camera 120 . Furthermore, the determination unit 113 can check the operation of the camera 120 using moving object detection processing.

When the determination unit 113 determines that the camera 120 is not operating normally, the control unit 111 can restart the camera 120 and start new imaging. By doing so, it is possible to stably perform image capturing without the continuation of image capturing problems, so that the information processing terminal 100 can be utilized as a monitoring camera. Therefore, by installing the charging base 50 at a desired location in a store that does not have a surveillance camera or a store that wants to cover the blind spot of the surveillance camera, the number of surveillance cameras can be increased without incurring capital investment. .

Further, according to the information processing terminal 100 according to the present embodiment, the information processing terminal 100 can be activated as a monitoring camera by setting the information processing terminal 100 on the charging base 50 for charging at the end of business at a store or the like. can be made Therefore, since there is no need to add a new operation, there is no burden on the user.

Further, even when it is determined that the operation of the camera 120 is not normal and the camera 120 is restarted, the power of the information processing terminal 100 itself is maintained in the ON state. Therefore, the camera 120 can be restored while data such as applications used by the user is retained.

Since the information processing terminal 100 is equipped with means for connecting to a network inside or outside the store for business use, it is possible to refer to captured images using devices connected to the network. Therefore, the administrator or the like can appropriately check the captured image at any timing.

<Hardware configuration example>
Each functional component of the information processing terminal 100 may be implemented by hardware (eg, hardwired electronic circuit) that implements each functional component, or may be implemented by a combination of hardware and software (eg, combination of an electronic circuit and a program for controlling it, etc.). A case where each functional component of the information processing terminal 100 is realized by a combination of hardware and software will be further described below.

FIG. 7 is a block diagram illustrating the hardware configuration of a computer 900 that implements the information processing terminal 100. As shown in FIG. The computer 900 may be a dedicated computer designed to implement the information processing terminal 100, or may be a general-purpose computer. The computer 900 may be a portable computer such as a smart phone or a tablet terminal.

For example, by installing a predetermined application on the computer 900 , each function of the information processing terminal 100 is realized on the computer 900 . The application is configured by a program for realizing the functional components of the information processing terminal 100 .

Computer 900 has a bus 902 , processor 904 , memory 906 , storage device 908 , input/output interface 910 and network interface 912 . A bus 902 is a data transmission path for the processor 904, memory 906, storage device 908, input/output interface 910, and network interface 912 to transmit and receive data to and from each other. However, the method of connecting the processors 904 and the like to each other is not limited to bus connection.

The processor 904 is various processors such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or an FPGA (Field-Programmable Gate Array). The memory 906 is a main memory implemented using a RAM (Random Access Memory) or the like. The storage device 908 is an auxiliary storage device implemented using a hard disk, SSD (Solid State Drive), memory card, ROM (Read Only Memory), or the like. At least one of the memory 906 and the storage device 908 may be used as the storage unit 115 (see FIG. 3).

The input/output interface 910 is an interface for connecting the computer 900 and input/output devices. For example, the input/output interface 910 is connected to an input device such as a keyboard and an output device such as a display device.

A network interface 912 is an interface for connecting the computer 900 to a network. This network may be a LAN (Local Area Network) or a WAN (Wide Area Network).

The storage device 908 stores a program that implements each functional component of the information processing terminal 100 (a program that implements the application described above). The processor 904 implements each functional component of the information processing terminal 100 by reading this program into the memory 906 and executing it.

Each of the processors executes one or more programs containing instructions for causing the computer to perform the algorithms described with the drawings. This program includes instructions (or software code) that, when read into a computer, cause the computer to perform one or more of the functions described in the embodiments. The program may be stored in a non-transitory computer-readable medium or tangible storage medium. By way of example, and not limitation, computer readable media or tangible storage media may include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drives (SSD) or other memory technology, CDs -ROM, digital versatile disc (DVD), Blu-ray disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disc storage or other magnetic storage device. The program may be transmitted on a transitory computer-readable medium or communication medium. By way of example, and not limitation, transitory computer readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.

It should be noted that the present disclosure is not limited to the above embodiments, and can be modified as appropriate without departing from the spirit of the present disclosure. For example, the information processing terminal 100 may be a desktop terminal equipped with or connected to a camera or the like.

Some or all of the above-described embodiments can also be described in the following supplementary remarks, but are not limited to the following.
(Appendix 1)
camera and
a control unit that controls the camera;
a determination unit that determines whether or not the operation of the camera is normal based on the captured image of the camera;
with
The control unit transitions the power of the camera to an ON state to start first imaging,
The determination unit determines whether the operation of the camera in the first imaging is normal based on the captured image acquired in the started first imaging,
The information processing terminal, wherein the control unit restarts the camera and starts second imaging when the determination unit determines that the operation of the camera is not normal.
(Appendix 2)
The information processing terminal according to appendix 1, wherein, when detecting the start of charging of the information processing terminal, the control unit turns on the power of the camera to start the first imaging.
(Appendix 3)
It further comprises an illuminance sensor that detects the ambient illuminance,
The determination unit determines whether or not the captured image corresponds to the detected illuminance, and if the captured image does not correspond to the detected illuminance, the operation of the camera is The information processing terminal according to appendix 1 or 2, which is determined to be abnormal.
(Appendix 4)
further comprising an illumination unit that emits illumination light,
The determination unit determines whether the captured image is an image corresponding to the state irradiated with the illumination light, and determines whether the captured image is an image corresponding to the state irradiated with the illumination light. 4. The information processing terminal according to any one of Appendices 1 to 3, wherein the operation of the camera is determined to be abnormal if the camera is not.
(Appendix 5)
5. The information processing terminal according to appendix 4, wherein the illumination unit is a light that irradiates the surrounding area with the illumination light.
(Appendix 6)
The information processing terminal according to appendix 4 or 5, wherein the illumination unit is a light that emits the illumination light from a display unit.
(Appendix 7)
The control unit performs moving object detection processing for detecting a moving object from the captured image,
7. The information processing terminal according to any one of supplementary notes 1 to 6, wherein the determination unit determines whether or not the operation of the camera is normal based on the result of the moving body detection process.
(Appendix 8)
8. The determining unit determines whether or not the operation of the camera is normal at a timing other than the timing at which the first imaging is started. information processing terminal.
(Appendix 9)
The information processing terminal according to any one of Appendices 1 to 8, wherein the information processing terminal is portable.
(Appendix 10)
a step of transitioning the power of the camera to an ON state to start a first imaging;
determining whether or not the operation of the camera in the first imaging is normal based on the captured image acquired in the started first imaging;
a step of restarting the camera and starting a second imaging when it is determined in the determining step that the operation of the camera is not normal.
(Appendix 11)
a step of transitioning the power of the camera to an ON state to start a first imaging;
Determining whether the operation of the camera in the first imaging is normal based on the captured image acquired in the started first imaging;
A program for causing a computer to execute a control method comprising: restarting the camera to start a second imaging when it is determined in the determining step that the operation of the camera is not normal.

10 information processing terminal 11 camera 12 control unit 13 determination unit 50 charging base 51 charging terminal 100 information processing terminal 110 information processing unit 111 control unit 113 determination unit 115 storage unit 120 camera 130 camera power control circuit 140 power supply circuit 150 light 155 liquid crystal 160 backlight 170 illuminance sensor 180 charging terminal 900 computer 902 bus 904 processor 906 memory 908 storage device 910 input/output interface 912 network interface

Claims (10)

camera and
a control unit that controls the camera;
a determination unit that determines whether or not the operation of the camera is normal based on the captured image of the camera;
with
When the control unit detects the start of charging of the information processing terminal, the control unit transitions the power of the camera to an ON state to start first imaging,
The determination unit determines whether the operation of the camera in the first imaging is normal based on the captured image acquired in the started first imaging,
The information processing terminal, wherein the control unit restarts the camera and starts second imaging when the determination unit determines that the operation of the camera is not normal. camera and
a control unit that controls the camera;
a determination unit that determines whether or not the operation of the camera is normal based on the captured image of the camera;
with
The control unit transitions the power of the camera to an ON state to start first imaging,
The determination unit determines whether the operation of the camera in the first imaging is normal based on the captured image acquired in the started first imaging,
When the determination unit determines that the operation of the camera is not normal, the control unit restarts the camera to start second imaging ,
It further comprises an illuminance sensor that detects the ambient illuminance,
The determination unit determines whether or not the captured image corresponds to the detected illuminance, and if the captured image does not correspond to the detected illuminance, the operation of the camera is An information processing terminal that determines that it is not normal . camera and
a control unit that controls the camera;
a determination unit that determines whether or not the operation of the camera is normal based on the captured image of the camera;
with
The control unit transitions the power of the camera to an ON state to start first imaging,
The determination unit determines whether the operation of the camera in the first imaging is normal based on the captured image acquired in the started first imaging,
When the determination unit determines that the operation of the camera is not normal, the control unit restarts the camera to start second imaging ,
further comprising an illumination unit that emits illumination light,
The determination unit determines whether the captured image is an image corresponding to the state irradiated with the illumination light, and determines whether the captured image is an image corresponding to the state irradiated with the illumination light. If not, the information processing terminal determines that the operation of the camera is not normal . The information processing terminal according to claim 3 , wherein the lighting unit is a light that irradiates the surrounding area with the illumination light. The information processing terminal according to claim 3 or 4 , wherein the illumination unit is a light that emits the illumination light from a display unit. The control unit performs moving object detection processing for detecting a moving object from the captured image,
The information processing terminal according to any one of claims 1 to 5 , wherein the determination unit determines whether or not the operation of the camera is normal based on the result of the moving body detection process. The information processing terminal according to any one of claims 1 to 6 , wherein the information processing terminal is portable. when the start of charging of the information processing terminal is detected, turning on the power of the camera to start the first imaging;
Determining whether the operation of the camera in the first imaging is normal based on the captured image acquired in the started first imaging;
a step of restarting the camera and starting a second imaging when it is determined in the determining step that the operation of the camera is not normal. a step of transitioning the power of the camera to an ON state to start a first imaging;
Determining whether the operation of the camera in the first imaging is normal based on the captured image acquired in the started first imaging;
a step of restarting the camera and starting a second imaging when it is determined that the operation of the camera is not normal in the determining step ;
Further comprising a step of detecting ambient illuminance,
In the determining step, it is determined whether or not the captured image corresponds to the detected illuminance, and if the captured image does not correspond to the illuminance, the camera operates. is determined to be abnormal . when the start of charging of the information processing terminal is detected, turning on the power of the camera to start the first imaging;
Determining whether the operation of the camera in the first imaging is normal based on the captured image acquired in the started first imaging;
A program for causing a computer to execute a control method comprising: restarting the camera to start a second imaging when it is determined in the determining step that the operation of the camera is not normal.

Images