JP2023005738A - Mobile device and mobile device control method - Google Patents

Abstract

To suppress power consumption of a mobile device.SOLUTION: The mobile device which moves with an imaging apparatus comprises: estimation means which estimates power consumption consumed by the imaging apparatus and the mobile device while the imaging apparatus and the mobile device move from a present position to a target position; and control means which performs control to give predetermined notification based on a residual power of power supply means for supplying power to the imaging apparatus and the mobile device and the power consumption estimated by the estimation means.SELECTED DRAWING: Figure 1

Description

The present invention relates to a mobile device and a control method for the mobile device.

Japanese Patent Laid-Open No. 2002-200002 describes a mobile device equipped with an imaging device.

JP 2019-41185 A

When the imaging device shoots moving images until the imaging device is moved to a destination together with the mobile device, the power used by the mobile device and the imaging device is supplied from the power supply unit of the mobile device. In this case, in order for the mobile device and the imaging device to reach the destination, it is required to suppress the power consumption of the imaging device.

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to reduce the power consumption of a mobile device.

In order to achieve the above object, a mobile device according to the present invention is a mobile device that moves together with an imaging device, wherein the imaging device and the mobile device move from a current position to a target position. estimating means for estimating the amount of power consumed by the device and the mobile device; the remaining power of power supply means for supplying power to the imaging device and the mobile device; and the power consumption estimated by the estimating means. and control means for controlling to give a predetermined notification based on the information.

According to the present invention, power consumption of a mobile device can be suppressed.

2 is a block diagram for explaining a configuration example of the mobile device 100 according to Embodiment 1. FIG. 2 is a block diagram for explaining a configuration example of a control device 200 according to Embodiment 1. FIG. FIG. 10 is a diagram for explaining a movement distance of the mobile device 100 acquired by a movement distance acquisition unit 109; 4 is a flowchart for explaining power consumption monitoring processing 400 according to the first embodiment; 4 is a diagram for explaining an example of display data displayed by a display unit 203 of the control device 200; FIG. 10 is a flowchart for explaining power consumption monitoring processing 600 according to the second embodiment; 11 is a flowchart for explaining power consumption monitoring processing 700 in Embodiment 3. FIG.

Embodiments of the present invention will be described below with reference to the drawings. However, the present invention is not limited to the following embodiments.

<Embodiment 1>
FIG. 1 is a block diagram for explaining a configuration example of a mobile device 100 according to the first embodiment. The mobile device 100 is, for example, an electronic device that moves together with an imaging device. Mobile device 100 can operate, for example, as an unmanned flying device (such as a drone) or as a vehicle. FIG. 1 illustrates a case where the mobile device 100 is an electronic device having an imaging device, but the mobile device 100 may be an electronic device on which an imaging device can be mounted.

As shown in FIG. 1, the mobile device 100 includes a CPU (Central Processing Unit) 101, an imaging unit 102, a moving unit 103, a wireless communication unit 104, a power supply unit 105, a captured image processing unit 106, and a display data generation unit 107. have. Mobile device 100 further includes position information acquisition section 108 , movement distance acquisition section 109 , remaining distance acquisition section 110 , storage section 111 , power consumption estimation section 112 , and system bus 120 . However, the imaging unit 102 , the captured image processing unit 106 and the storage unit 111 are also constituent elements of the imaging device that the mobile device 100 has. Each component of mobile device 100 has an electronic circuit for implementing one or more functions provided by each component. Each component of mobile device 100 shown in FIG. 1 is connected to system bus 120 and can communicate with each other via system bus 120 .

Note that when the mobile device 100 is an electronic device on which an imaging device can be mounted, the imaging unit 102 and the captured image processing unit 106 are not included in the constituent elements of the mobile device 100, and the configuration of the imaging device mounted on the mobile device 100 is contained in the element. If the mobile device 100 is an electronic device on which an imaging device can be mounted, the CPU 101 can communicate with the components of the imaging device (including the imaging unit 102, the captured image processing unit 106, and the storage unit 111) via, for example, a USB interface. configured as When the mobile device 100 is an electronic device on which an imaging device can be mounted, the power supply unit 105 supplies the components of the imaging device (including the imaging unit 102, the captured image processing unit 106, and the storage unit 111) via, for example, a USB interface. configured to power the

CPU 101 can control all components of mobile device 100 . For example, the CPU 101 has a memory that stores programs and a processor (or microcomputer) that controls all components of the mobile device 100 by executing the programs stored in the memory. Furthermore, the CPU 101 can control all or part of the components of the mobile device 100 based on control signals generated by the CPU 201 of the control device 200 (control signals for controlling the mobile device 100).

The imaging unit 102 is composed of a lens unit, an imaging element, an A/D conversion circuit, and the like. The imaging unit 102 performs imaging processing (moving image imaging processing) to generate captured image data (moving image data) from a subject image. It is assumed that the imaging unit 102 starts imaging processing when the mobile device 100 starts moving from the starting position. Note that when the mobile device 100 is an electronic device on which an imaging device can be mounted, the imaging unit 102 is included in the components of the imaging device that can be mounted on the mobile device 100 .

The moving unit 103 has various members (multiple propellers or multiple wheels) used to move the mobile device 100, and can move the mobile device 100 forward, backward, left, or right. If the mobile device 100 is a mobile device that can fly, the mobile unit 103 can also raise, lower, or turn the mobile device 100 . The moving unit 103 controls the driving of a plurality of propellers or a plurality of wheels in accordance with control signals from the CPU 101 to move the moving device 100 forward, backward, left or right, or raise, lower, or move the moving device 100 . You can turn it around.

The wireless communication unit 104 can wirelessly communicate with the wireless communication unit 202 of the control device 200 . The wireless communication unit 104 can receive a control signal generated by the CPU 201 of the control device 200 from the wireless communication unit 202 . A control signal generated by the CPU 201 of the control device 200 is received by the wireless communication unit 104 and supplied from the wireless communication unit 104 to the CPU 101 . Furthermore, the wireless communication unit 104 can transmit the display data generated by the display data generation unit 107 to the wireless communication unit 202 . A control signal for controlling the mobile device 100

The power supply unit 105 supplies power to the mobile device 100 and the imaging device. Power supply 105 is, for example, a single rechargeable battery. A remaining amount of power, which is power remaining in the power supply unit 105 , is calculated by the power supply unit 105 and supplied from the power supply unit 105 to the CPU 101 .

The captured image processing unit 106 performs image processing (including image correction processing, noise reduction processing, white balance processing, etc.) on captured image data (moving image data) generated by the imaging unit 102 . The captured image data processed by the captured image processing unit 106 is supplied to the display data generation unit 107 and the storage unit 111 . Note that when the mobile device 100 is an electronic device on which an imaging device can be mounted, the captured image processing unit 106 is included in the components of the imaging device that can be mounted on the mobile device 100 .

The display data generation unit 107 generates display data to be displayed on the display unit 203 of the control device 200 . The display data includes at least one of captured image data (moving image data) processed by the captured image processing unit 106 and predetermined notification information. Predetermined notification information is supplied from the CPU 101 to the display data generation unit 107 . The predetermined notification information includes, for example, information for proposing a change to the recommended imaging mode to the user, information for proposing to the user to stop the imaging process, and information indicating that the imaging mode of the imaging apparatus has been changed to the recommended imaging mode. and information indicating that the imaging process has been stopped. The predetermined notification information is information for notifying the user that the remaining power of the power supply unit 105 is insufficient to move to the target position, and whether or not to display the captured image data on the display unit 203. It may include at least one piece of information for proposing to the user. The predetermined notification information may include information for notifying the user how much the movable distance or movable time of the mobile device 100 will be extended when the imaging process of the imaging unit 102 is stopped. good. The display data generated by the display data generating section 107 is supplied to the wireless communication section 104 .

The location information acquisition unit 108 acquires location information indicating the current location of the mobile device 100 . The location information acquisition unit 108 can acquire location information indicating the current location of the mobile device 100, for example, by using GPS (Global Position System) technology. For example, the position information acquisition unit 108 acquires position information at the departure position, and acquires position information at predetermined time intervals after departure. The predetermined time can be, for example, anywhere from 10 seconds to 1 minute. The predetermined time may be a time corresponding to a predetermined moving distance.

The movement distance acquisition unit 109 calculates the movement distance of the mobile device 100 . The movement distance of the mobile device 100 corresponds to the distance that the mobile device 100 moves from the starting position to the current position of the mobile device 100 . The moving distance of the mobile device 100 is calculated, for example, based on the position information of the starting position, the position information of the current position, and the position information obtained by the position information obtaining unit 108 at predetermined intervals.

The movement distance of the mobile device 100 acquired by the movement distance acquisition unit 109 will be described with reference to FIG. A starting position P0 indicated by a white circle indicates a position where the mobile device 100 starts moving. A plurality of calculated positions P1 to P5 indicated by black circles indicate positions where the movement distance of the mobile device 100 is calculated by the movement distance acquisition unit 109 . The difference distance d1 is the moving distance calculated by the moving distance obtaining unit 109 based on the position information obtained at the starting position P0 and the calculated position P1. When the current position of the mobile device 100 is the calculated position P1, the movement distance acquisition unit 109 acquires d1 as the movement distance of the mobile device 100. FIG. The difference distance d2 is the movement distance calculated by the movement distance acquisition unit 109 based on the position information acquired at the calculation position P1 and the calculation position P2. When the current position of the mobile device 100 is the calculated position P2, the movement distance acquisition unit 109 acquires d1+d2 as the movement distance of the mobile device 100. FIG. The difference distance d3 is the movement distance calculated by the movement distance acquisition unit 109 based on the position information acquired at the calculation position P2 and the calculation position P3. When the current position of the mobile device 100 is the calculated position P3, the movement distance acquisition unit 109 acquires d1+d2+d3 as the movement distance of the mobile device 100. FIG. The difference distance d4 is the movement distance calculated by the movement distance acquisition unit 109 based on the position information acquired at the calculation position P3 and the calculation position P4. When the current position of the mobile device 100 is the calculated position P4, the movement distance acquisition unit 109 acquires d1+d2+d3+d4 as the movement distance of the mobile device 100. FIG. The difference distance d5 is the movement distance calculated by the movement distance acquisition unit 109 based on the position information acquired at the calculation position P4 and the calculation position P5. When the current position of the mobile device 100 is the calculated position P5, the movement distance acquisition unit 109 acquires d1+d2+d3+d4+d5 as the movement distance of the mobile device 100. FIG. Note that each of the difference distances d1, d2, d3 and d4 corresponds to the distance traveled by the mobile device 100 until the predetermined time has passed.

The remaining distance acquisition unit 110 calculates the remaining distance corresponding to the distance from the current position of the mobile device 100 to the target position. Position information indicating the current position of the mobile device 100 is supplied from the position information acquisition unit 108 to the remaining distance acquisition unit 110 . For example, the user inputs the position information of the target position to the CPU 201 via the operation unit 204 . The CPU 201 supplies the position information of the target position to the wireless communication unit 202 , and the wireless communication unit 202 transmits the position information of the target position to the mobile device 100 . The wireless communication unit 104 receives the position information of the target position from the wireless communication unit 202 , and the remaining distance acquisition unit 110 receives the position information of the target position from the wireless communication unit 104 . The position information of the target position is stored in the memory of remaining distance acquisition section 110 . The target position may be the starting position of the mobile device 100 , one of a plurality of calculated positions, or the current position of the control device 200 . The current position of the control device 200 corresponds to the current position of the user who operates the mobile device 100 using the control device 200 . The position information of the target position may be supplied to the remaining distance acquiring unit 110 before the mobile device 100 departs from the starting position, or may be supplied to the remaining distance acquiring unit 110 after the mobile device 100 departs from the starting position. 110.

The remaining distance acquisition unit 110 calculates the remaining distance, for example, based on the position information indicating the current position of the mobile device 100 and the position information of the target position. The remaining distance may be a linear distance between the current position and the target position of the mobile device 100, or a distance calculated by multiplying the linear distance between the current position and the target position of the mobile device 100 by a predetermined coefficient. may

The storage unit 111 stores captured image data processed by the captured image processing unit 106 in a storage medium (memory card, hard disk device, etc.). The storage medium is, for example, a storage medium removable from the storage unit 111 . Note that when the mobile device 100 is an electronic device on which an imaging device can be mounted, the storage unit 111 is included in the components of the imaging device that can be mounted on the mobile device 100 .

The power consumption estimation unit 112 calculates power consumption per unit distance. The amount of power consumption per unit distance is, for example, the amount of power supplied by the power supply unit 105 to the imaging device and the mobile device 100 while the mobile device 100 moves from the starting position to the current position of the mobile device 100, and the distance traveled by the device 100 . The power consumption estimation unit 112 calculates the amount of power supplied by the power supply unit 105 to the imaging device and the mobile device 100 until the mobile device 100 moves from the starting position to the current position of the mobile device 100 . The moving distance of the mobile device 100 is calculated by the moving distance acquiring unit 109 and supplied from the moving distance acquiring unit 109 to the power consumption estimating unit 112 . The amount of power supplied by the power supply unit 105 to the imaging device and the mobile device 100 until the mobile device 100 moves from the starting position to the current position of the mobile device 100 is determined by the imaging unit 102, the captured image processing unit 106, and the moving unit 100. 103 contains the amount of power consumed.

Power consumption estimator 112 calculates an estimated power consumption based on the power consumption per unit distance and the remaining distance calculated by remaining distance acquisition unit 110 . The estimated power consumption corresponds to the amount of power consumed by the imaging device and the mobile device 100 until the mobile device 100 moves from the current position of the mobile device 100 to the target position. The estimated power consumption calculated by the power consumption estimation unit 112 is supplied from the power consumption estimation unit 112 to the CPU 101 .

The CPU 101 can determine the recommended imaging mode in order to reduce power consumption of the imaging apparatus. When the difference between the estimated power consumption calculated by the power consumption estimating unit 112 and the remaining power of the power supply unit 105 is below a predetermined threshold, the CPU 101 selects a recommended imaging mode different from the current imaging mode of the imaging apparatus. Determine mode. The predetermined threshold corresponds to, for example, the amount of electric power that allows the mobile device 100 to move for a predetermined period of time (for example, 5 minutes) while the imaging unit 102 has stopped the imaging process. The predetermined threshold may be 0. The predetermined threshold may be a user-changeable value. The recommended imaging mode differs from the current imaging mode of the imaging device in at least one of image quality, frame rate, and angle of view. When the image quality is different, the image quality in the recommended imaging mode is one step or more lower than the image quality in the current imaging mode. When the frame rates are different, the frame rate of the recommended imaging mode is a frame rate lower (or slower) than the frame rate of the current imaging mode by one step or more. When the angles of view are different, the angle of view in the recommended imaging mode is one step or more lower (or narrower) than the angle of view in the current imaging mode.

The recommended imaging mode determined by the CPU 101 is an imaging mode in which the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power of the power supply unit 105 is equal to or greater than a predetermined threshold. The CPU 101 has a memory that stores a power consumption table in which power consumption per unit distance is registered in advance for each imaging mode that can be set in the imaging apparatus. The CPU 101 selects one of the imaging modes that can be set for the imaging apparatus as the selected imaging mode. The CPU 101 calculates the difference (second 1 difference). The first difference is calculated based on the power consumption table and the remaining distance calculated by remaining distance obtaining section 110 . The first difference corresponds to the amount of electric power reduced when moving the remaining distance in the selected imaging mode. The CPU 101 calculates a difference (second difference) between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power of the power supply unit 105 . The CPU 101 determines whether or not a value obtained by subtracting the second difference from the first difference is equal to or greater than a predetermined threshold. When the value obtained by subtracting the second difference from the first difference is equal to or greater than a predetermined threshold value, the CPU 101 determines the selected imaging mode as the recommended imaging mode. If the value obtained by subtracting the second difference from the first difference is not equal to or greater than a predetermined threshold value, the CPU 101 selects another imaging mode as a new selected imaging mode. The CPU 101 repeats the above-described processing to determine whether or not the new selected imaging mode can be determined as the recommended imaging mode. When a plurality of imaging modes are determined as recommended imaging modes, the CPU 101 selects the recommended imaging mode according to a predetermined selection criterion. For example, the CPU 101 selects a recommended imaging mode that has the best image quality, highest frame rate, and largest angle of view within a range in which the image quality, frame rate, and angle of view do not exceed the image quality, frame rate, and angle of view of the current imaging mode. do.

Next, referring to FIG. 2, it is a block diagram showing a configuration example of the control device 200 according to the first embodiment. The control device 200 is, for example, a controller for remotely controlling the mobile device 100 . The control device 200 is, for example, an electronic device that can operate as a smartphone or tablet.

As shown in FIG. 2 , the control device 200 has a CPU (Central Processing Unit) 201 , a wireless communication section 202 , a display section 203 and an operation section 204 . Each component of controller 200 has an electronic circuit for implementing one or more functions provided by each component.

The CPU 201 can control all components of the control device 200 . For example, the CPU 201 has a memory that stores programs and a processor (or microcomputer) that controls all components of the control device 200 by executing the programs stored in the memory. Additionally, the CPU 201 can generate control signals for controlling the mobile device 100 . A control signal generated by the CPU 201 is generated by the CPU 201 and supplied to the wireless communication unit 202 .

Wireless communication unit 202 is capable of wireless communication with wireless communication unit 104 of mobile device 100 . The wireless communication section 202 can transmit the control signal generated by the CPU 201 to the wireless communication section 104 . Furthermore, the wireless communication unit 202 can receive the display data generated by the display data generating unit 107 of the mobile device 100 from the wireless communication unit 104 . The display data generated by the display data generation unit 107 of the mobile device 100 is received by the wireless communication unit 202 and supplied to the display unit 203 .

The display unit 203 has a display such as a liquid crystal display. The display unit 203 can display the display data generated by the display data generation unit 107 of the mobile device 100 . By displaying the display data generated by the display data generation unit 107 , the predetermined notification information described above can be presented to the user who remotely controls the mobile device 100 using the control device 200 . Furthermore, the display unit 203 can also display display data or notification information generated by the CPU 201 . Note that the predetermined notification information is not limited to being displayed on the display unit 203, and may be output as sound from the speaker of the control device 200. FIG.

The operation unit 204 is a user interface for receiving instructions from the user for remotely controlling the mobile device 100 . The instruction received by the operation unit 204 is notified to the CPU 201 . The CPU 201 generates control signals for controlling the mobile device 100 based on instructions received by the operation unit 204 .

Next, the power consumption monitoring process 400 according to the first embodiment will be described with reference to the flowchart of FIG. The power consumption monitoring process 400 monitors whether or not the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power of the power supply unit 105 is below a predetermined threshold at predetermined time intervals. is.

The power consumption monitoring process 400 is started when the mobile device 100 starts moving from the starting position. In step S401, the CPU 101 determines whether or not a predetermined time has passed since the start of movement from the starting position or the previous calculated position. The predetermined period of time can be anywhere from 10 seconds to 1 minute, as described above. The predetermined time may be a time corresponding to a predetermined moving distance. If the predetermined time has passed (step S401: YES), the CPU 101 proceeds to step S402. If the predetermined time has not elapsed from the starting position or the previous calculated position (step S401: NO), the CPU 101 returns to step S401 and repeats the processing of step S401.

In step S402, the CPU 101 causes the power consumption estimation unit 112 to calculate the estimated power consumption. Power consumption estimator 112 calculates an estimated power consumption based on the power consumption per unit distance and the remaining distance calculated by remaining distance acquisition unit 110 . The estimated power consumption corresponds to the amount of power consumed by the imaging device and the mobile device 100 until the mobile device 100 moves from the current position of the mobile device 100 to the target position. The estimated power consumption calculated by the power consumption estimation unit 112 is supplied from the power consumption estimation unit 112 to the CPU 101 .

In step S<b>403 , the CPU 101 acquires the remaining amount of power of the power supply unit 105 from the power supply unit 105 . Furthermore, the CPU 101 determines whether the difference between the estimated power consumption calculated in step S402 and the remaining power of the power supply unit 105 is below a predetermined threshold. As described above, the predetermined threshold corresponds to the amount of electric power that allows the mobile device 100 to move for a predetermined period of time (for example, 5 minutes) while the imaging unit 102 has stopped the imaging process. The predetermined threshold may be 0. The predetermined threshold may be a user-changeable value. If the difference between the estimated power consumption calculated in step S402 and the remaining power of the power supply unit 105 is less than the predetermined threshold (step S403: YES), the CPU 101 proceeds to step S404. If the difference between the estimated power consumption calculated in step S402 and the remaining power of the power supply unit 105 is less than a predetermined threshold, the CPU 101 determines that the remaining power of the power supply unit 105 is It determines that there is not enough power to move to the position. On the other hand, if the difference between the estimated power consumption calculated in step S402 and the remaining power of the power supply unit 105 is not below the predetermined threshold (step S403: NO), the CPU 101 returns to step S401. If the difference between the estimated power consumption calculated in step S402 and the remaining power of the power supply unit 105 does not fall below the predetermined threshold, the CPU 101 determines that the remaining power of the power supply unit 105 is It is determined that the amount of power is sufficient to move to the position.

In step S404, the CPU 101 determines a recommended imaging mode in order to reduce power consumption of the imaging apparatus. As described above, the recommended imaging mode is an imaging mode in which the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power level of the power supply unit 105 is equal to or greater than a predetermined threshold. When the CPU 101 can determine the recommended imaging mode, the CPU 101 supplies the display data generation unit 107 with predetermined notification information including information for proposing a change to the recommended imaging mode to the user. When the CPU 101 cannot determine the recommended imaging mode, the CPU 101 supplies predetermined notification information including information for proposing the user to stop the imaging process to the display data generation unit 107 . The predetermined notification information is information for notifying the user that the remaining power of the power supply unit 105 is insufficient to move to the target position, and whether or not to display the captured image data on the display unit 203. It may include at least one piece of information for proposing to the user. The predetermined notification information may include information for notifying the user how much the movable distance or movable time of the mobile device 100 will be extended when the imaging process of the imaging unit 102 is stopped. good. note that. The CPU 101 calculates how much the movable distance or movable time of the mobile device 100 is extended when the imaging process of the imaging unit 102 is stopped.

Furthermore, in step S<b>404 , the display data generation unit 107 generates display data including predetermined notification information supplied from the CPU 101 and supplies the generated display data to the wireless communication unit 104 . Here, the display data may include captured image data (moving image data) processed by the captured image processing unit 106 . The wireless communication unit 104 transmits the display data generated by the display data generation unit 107 to the control device 200 . The wireless communication unit 202 receives the display data generated by the display data generation unit 107 from the wireless communication unit 104 and supplies the display data received by the wireless communication unit 104 to the display unit 203 . A display unit 203 displays the display data generated by the display data generation unit 107 . Thereby, the CPU 101 can present predetermined notification information to the user who remotely controls the mobile device 100 using the control device 200 . By viewing predetermined notification information displayed on the display unit 203 , the user can use the control device 200 to instruct the mobile device 100 to change to the recommended imaging mode or stop imaging processing.

Here, examples of display data generated by the display data generation unit 107 and displayed by the display unit 203 will be described with reference to FIGS. 5A to 5D. The display data shown in FIG. 5(A) does not include captured image data (moving image data), but does include notification information "Battery level is low. Please change to low image quality shooting." Display data containing The notification information "Battery level is running low. Please change to low image quality shooting." It is an example of information. When the user who sees the information for suggesting the user to change to the recommended imaging mode inputs a change to the recommended imaging mode (low image quality imaging mode) to the operation unit 204, the CPU 201 changes the imaging mode of the imaging apparatus to the recommended imaging mode. Generate control signals to change modes. A control signal for changing the imaging mode of the imaging apparatus to the recommended imaging mode (low image quality imaging mode) is supplied to the CPU 101 via the wireless communication units 202 and 104 . The CPU 101 changes the imaging mode of the imaging device to the recommended imaging mode based on the control signal for changing the imaging mode of the imaging device to the recommended imaging mode (low image quality imaging mode).

The display data shown in FIG. 5B is display data including captured image data (moving image data) and a notification saying "Battery level is getting low. Please stop moving image shooting." The notification information "Battery level is running low. Please stop video recording." . When the user who sees the information for proposing the user to stop the imaging process inputs the stop of the imaging process to the operation unit 204 , the CPU 201 generates a control signal for stopping the imaging process of the imaging unit 102 . A control signal for stopping the imaging process of the imaging unit 102 is supplied to the CPU 101 via the wireless communication unit 202 and the wireless communication unit 104 . The CPU 101 stops the imaging processing of the imaging unit 102 based on the control signal for stopping the imaging processing of the imaging unit 102 .

The display data shown in FIG. 5(C) is a display including captured image data (moving image data) and notification information stating, "The remaining battery level is running low. Please switch to shooting with low image quality." Data. The notification information "Battery level is running low. Please change to shooting with low image quality." is the same as the notification information shown in FIG. 5A. In the example of FIG. 5C, predetermined notification information is displayed in strips above and below the display unit 203 so that the captured image data is not obscured. When the user who sees the information for suggesting the user to change to the recommended imaging mode inputs a change to the recommended imaging mode (low image quality imaging mode) to the operation unit 204, the CPU 201 changes the imaging mode of the imaging apparatus to the recommended imaging mode. Generate control signals to change modes. A control signal for changing the imaging mode of the imaging apparatus to the recommended imaging mode (low image quality imaging mode) is supplied to the CPU 101 via the wireless communication units 202 and 104 . The CPU 101 changes the imaging mode of the imaging device to the recommended imaging mode based on the control signal for changing the imaging mode of the imaging device to the recommended imaging mode (low image quality imaging mode).

The display data shown in FIG. 5D includes captured image data (moving image data) and notification information "Battery level is low. Please stop moving image shooting." The notification information "Battery level is running low. Please stop video recording" is the same as the notification information shown in FIG. 5B. A “YES” button and a “NO” button shown in FIG. 5D are a user interface (GUI) controlled by the CPU 201 and displayed on the display unit 203 together with display data generated by the display data generation unit 107 . When the user who sees the information for proposing the user to stop the imaging process selects the “YES” button, the CPU 201 generates a control signal for stopping the imaging process of the imaging unit 102 . A control signal for stopping the imaging process of the imaging unit 102 is supplied to the CPU 101 via the wireless communication unit 202 and the wireless communication unit 104 . The CPU 101 stops the imaging processing of the imaging unit 102 based on the control signal for stopping the imaging processing of the imaging unit 102 .

The display data generated by the display data generation unit 107 and displayed by the display unit 203 is not limited to the examples shown in FIGS. 5A to 5D. The display data shown in FIGS. 5A to 5D include information for notifying the user that the remaining power of the power supply unit 105 is insufficient for moving to the target position. There may be. The display data shown in FIGS. 5A to 5D may include information for proposing to the user whether or not to display the captured image data on the display unit 203. FIG. For example, the display data shown in FIGS. 5A and 5C inform the user how much the movable distance or the movable time of the mobile device 100 is extended when the imaging mode is changed. It may contain information for For example, the display data shown in FIGS. 5B and 5D indicate to the user how much the movable distance or movable time of the mobile device 100 is extended when the imaging process of the imaging unit 102 is stopped. may include information for notifying For example, the display data shown in FIGS. 5(A) and 5(C) may include information for proposing not only lowering the image quality but also lowering the frame rate or narrowing the angle of view. good.

As described above, in the first embodiment, the mobile device 100 determines whether the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power of the power supply unit 105 is below a predetermined threshold. can be monitored at predetermined time intervals. Then, if the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power of the power supply unit 105 is less than a predetermined threshold, change to the recommended imaging mode or stop imaging processing is performed. It can be suggested to the user. When the user uses the control device 200 to instruct the mobile device 100 to change to the recommended imaging mode, the mobile device 100 changes the imaging mode of the imaging device to the recommended imaging mode so that the power consumption of the imaging device is reduced. can do. When the user uses the control device 200 to instruct the mobile device 100 to change to the recommended imaging mode, the power consumption of the imaging device is reduced, so the mobile device 100 can move together with the imaging device to the target position. It becomes possible. On the other hand, when the user uses the control device 200 to instruct the mobile device 100 to stop the imaging process, the mobile device 100 can stop the imaging process of the imaging unit 102 so as to reduce the power consumption of the imaging device. can. When the user instructs the mobile device 100 to stop the imaging process using the control device 200, the power consumption of the imaging device is reduced, so the mobile device 100 can move together with the imaging device to the target position. Become.

Although the power supply unit 105 is one rechargeable battery in the first embodiment, the power supply unit 105 may be a plurality of rechargeable batteries. When the power supply unit 105 is a plurality of rechargeable batteries, some of the plurality of rechargeable batteries supply power to the imaging unit 102 and the captured image processing unit 106, and the rest of the plurality of rechargeable batteries Power may be supplied to the moving unit 103 .

<Embodiment 2>
In the second embodiment, when the difference between the estimated power consumption calculated by the power consumption estimating unit 112 and the remaining power of the power supply unit 105 is below a predetermined threshold, the change to the recommended imaging condition or the imaging process is performed. An example of automatically stopping the

Next, power consumption monitoring processing 600 according to the second embodiment will be described with reference to the flowchart of FIG. The power consumption monitoring process 600 monitors whether or not the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power of the power supply unit 105 is below a predetermined threshold value at predetermined time intervals. is. In the second embodiment, when the difference between the estimated power consumption calculated by the power consumption estimating unit 112 and the remaining power of the power supply unit 105 is less than a predetermined threshold, the shooting mode of the imaging device is changed to the recommended imaging mode. , or the imaging process of the imaging unit 102 can be stopped.

Since the processing from step S401 to step S403 of the power consumption monitoring processing 600 is the same as the processing from step S401 to step S403 of the power consumption monitoring processing 400 in the first embodiment, description thereof will be omitted. However, if the difference between the estimated power consumption calculated in step S402 and the remaining power of the power supply unit 105 is less than the predetermined threshold (step S403: YES), the CPU 101 proceeds to step S604. As described above, the predetermined threshold corresponds to the amount of electric power that allows the mobile device 100 to move for a predetermined period of time (for example, 5 minutes) while the imaging unit 102 has stopped the imaging process. The predetermined threshold may be 0. The predetermined threshold may be a user-changeable value.

In step S604, the CPU 101 determines a recommended imaging mode in order to reduce power consumption of the imaging apparatus. As described above, the recommended imaging mode is an imaging mode in which the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power level of the power supply unit 105 is equal to or greater than a predetermined threshold. When the CPU 101 can determine the recommended imaging mode, the CPU 101 changes the imaging mode of the imaging device to the recommended imaging mode, and sends predetermined notification information including information indicating that the imaging mode of the imaging device has been changed to the recommended imaging mode. It is supplied to the display data generation unit 107 . When the CPU 101 cannot determine the recommended imaging mode, the CPU 101 stops the imaging processing of the imaging unit 102 and supplies predetermined notification information including information indicating that the imaging processing has been stopped to the display data generation unit 107 . The predetermined notification information is information for notifying the user that the remaining power of the power supply unit 105 is insufficient to move to the target position, and whether or not to display the captured image data on the display unit 203. It may include at least one piece of information for proposing to the user. The predetermined notification information may include information for notifying the user how much the movable distance or movable time of the mobile device 100 will be extended when the imaging process of the imaging unit 102 is stopped. good. note that. The CPU 101 calculates how much the movable distance or movable time of the mobile device 100 is extended when the imaging process of the imaging unit 102 is stopped.

Furthermore, in step S<b>604 , the display data generation unit 107 generates display data including predetermined notification information supplied from the CPU 101 and supplies the generated display data to the wireless communication unit 104 . Here, the display data may include captured image data (moving image data) processed by the captured image processing unit 106 . The wireless communication unit 104 transmits the display data generated by the display data generation unit 107 to the control device 200 . The wireless communication unit 202 receives the display data generated by the display data generation unit 107 from the wireless communication unit 104 and supplies the display data received by the wireless communication unit 104 to the display unit 203 . A display unit 203 displays the display data generated by the display data generation unit 107 . Thereby, the CPU 101 can present predetermined notification information to the user who remotely controls the mobile device 100 using the control device 200 . By viewing predetermined notification information displayed on the display unit 203, the user can use the control device 200 to confirm that the imaging mode of the imaging apparatus has been changed to the recommended imaging mode or that the imaging process has been stopped. The device 100 can be instructed.

Further, in the example of FIG. 6, the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power of the power supply unit 105 is compared with one threshold, but is compared with a plurality of thresholds. may For example, when the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power of the power supply unit 105 is less than threshold 1, the CPU 101 changes the imaging mode of the imaging device to the recommended imaging mode. You may make it Furthermore, when the difference between the estimated power consumption calculated by the power consumption estimating unit 112 and the remaining power of the power supply unit 105 is less than the threshold 2, which is smaller than the threshold 1, the CPU 101 stops the imaging process. can be For example, the threshold 1 may be the amount of power that allows the mobile device 100 to move for a predetermined period of time (for example, 5 minutes) while the imaging unit 102 has stopped the imaging process, and the threshold 2 may be half the power amount of the threshold 1 or 0. .

As described above, in the second embodiment, the mobile device 100 determines whether the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power of the power supply unit 105 is below a predetermined threshold. can be monitored at predetermined time intervals. Then, if the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power of the power supply unit 105 is less than a predetermined threshold, the imaging mode of the imaging device is automatically changed to the recommended imaging mode. , or the imaging process of the imaging unit 102 can be automatically stopped. As a result, the power consumption of the imaging device is reduced, so that the mobile device 100 can move together with the imaging device to the target position.

<Embodiment 3>
In the third embodiment, based on the first threshold and the second threshold, the user is suggested to change to the recommended imaging conditions or stop the imaging process, or the change to the recommended imaging conditions or the stop of the imaging process is automatically performed. An example is given.

Next, power consumption monitoring processing 700 according to the third embodiment will be described with reference to the flowchart of FIG. The power consumption monitoring process 700 monitors whether or not the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power of the power supply unit 105 is below a predetermined threshold at predetermined time intervals. is.

Since the processes of steps S401 and S402 of the power consumption monitoring process 700 are the same as the processes of steps S401 and S402 of the power consumption monitoring process 400 in the first embodiment, description thereof will be omitted.

In step S<b>703 , the CPU 101 acquires the remaining amount of power of the power supply unit 105 from the power supply unit 105 . Further, the CPU 101 determines whether the difference between the estimated power consumption calculated in step S402 and the remaining power of the power supply unit 105 is below the first threshold. The first threshold corresponds to the amount of electric power that allows the mobile device 100 to move for a predetermined period of time (for example, 5 minutes) while the imaging unit 102 has stopped the imaging process. The first threshold may be a user-changeable value. If the difference between the estimated power consumption calculated in step S402 and the remaining power of the power supply unit 105 is less than the first threshold (step S703: YES), the CPU 101 proceeds to step S704. If the difference between the estimated power consumption calculated in step S402 and the remaining power amount of the power supply unit 105 is below the first threshold, the CPU 101 determines that the remaining power amount of the power supply unit 105 is Determine that there is not enough power to move to the position. On the other hand, if the difference between the estimated power consumption calculated in step S402 and the remaining power of the power supply unit 105 is not below the first threshold (step S703: NO), the CPU 101 returns to step S701. If the difference between the estimated power consumption calculated in step S402 and the remaining power of the power supply unit 105 does not fall below the first threshold, the CPU 101 determines that the remaining power of the power supply unit 105 is It is determined that the amount of power is sufficient to move to the position.

In step S704, the CPU 101 determines whether the difference between the estimated power consumption calculated in step S402 and the remaining power of the power supply unit 105 is below the second threshold. The second threshold is a value smaller than the first threshold, and corresponds to the amount of electric power that allows the mobile device 100 to move for a predetermined time (for example, two minutes) while the imaging unit 102 has stopped the imaging process. The second threshold may be zero. The second threshold may be a user-changeable value. If the difference between the estimated power consumption calculated in step S402 and the remaining power of the power supply unit 105 is below the second threshold (step S704: YES), the CPU 101 proceeds to step S705. On the other hand, if the difference between the estimated power consumption calculated in step S402 and the remaining power of the power supply unit 105 is not below the first threshold (step S704: NO), the CPU 101 proceeds to step S706.

In step S705, the CPU 101 determines a recommended imaging mode in order to reduce power consumption of the imaging apparatus. As described above, the recommended imaging mode is an imaging mode in which the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power level of the power supply unit 105 is equal to or greater than a predetermined threshold. When the CPU 101 can determine the recommended imaging mode, the CPU 101 changes the imaging mode of the imaging device to the recommended imaging mode, and sends predetermined notification information including information indicating that the imaging mode of the imaging device has been changed to the recommended imaging mode. It is supplied to the display data generation unit 107 . When the CPU 101 cannot determine the recommended imaging mode, the CPU 101 stops the imaging processing of the imaging unit 102 and supplies predetermined notification information including information indicating that the imaging processing has been stopped to the display data generation unit 107 . The predetermined notification information is information for notifying the user that the remaining power of the power supply unit 105 is insufficient to move to the target position, and whether or not to display the captured image data on the display unit 203. It may include at least one piece of information for proposing to the user. The predetermined notification information may include information for notifying the user how much the movable distance or movable time of the mobile device 100 will be extended when the imaging process of the imaging unit 102 is stopped. good. note that. The CPU 101 calculates how much the movable distance or movable time of the mobile device 100 is extended when the imaging process of the imaging unit 102 is stopped.

Furthermore, in step S<b>705 , the display data generation unit 107 generates display data including predetermined notification information supplied from the CPU 101 and supplies the generated display data to the wireless communication unit 104 . Here, the display data may include captured image data (moving image data) processed by the captured image processing unit 106 . The wireless communication unit 104 transmits the display data generated by the display data generation unit 107 to the control device 200 . The wireless communication unit 202 receives the display data generated by the display data generation unit 107 from the wireless communication unit 104 and supplies the display data received by the wireless communication unit 104 to the display unit 203 . A display unit 203 displays the display data generated by the display data generation unit 107 . Thereby, the CPU 101 can present predetermined notification information to the user who remotely controls the mobile device 100 using the control device 200 . By viewing predetermined notification information displayed on the display unit 203, the user can use the control device 200 to confirm that the imaging mode of the imaging apparatus has been changed to the recommended imaging mode or that the imaging process has been stopped. The device 100 can be instructed.

In step S706, the CPU 101 determines a recommended imaging mode in order to reduce power consumption of the imaging apparatus. As described above, the recommended imaging mode is an imaging mode in which the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power level of the power supply unit 105 is equal to or greater than a predetermined threshold. When the CPU 101 can determine the recommended imaging mode, the CPU 101 supplies the display data generation unit 107 with predetermined notification information including information for proposing a change to the recommended imaging mode to the user. When the CPU 101 cannot determine the recommended imaging mode, the CPU 101 supplies predetermined notification information including information for proposing the user to stop the imaging process to the display data generation unit 107 . The predetermined notification information is information for notifying the user that the remaining power of the power supply unit 105 is insufficient to move to the target position, and whether or not to display the captured image data on the display unit 203. It may include at least one piece of information for proposing to the user. The predetermined notification information may include information for notifying the user how much the movable distance or movable time of the mobile device 100 will be extended when the imaging process of the imaging unit 102 is stopped. good.

Furthermore, in step S<b>706 , the display data generation unit 107 generates display data including predetermined notification information supplied from the CPU 101 and supplies the generated display data to the wireless communication unit 104 . Here, the display data may include captured image data (moving image data) processed by the captured image processing unit 106 . The wireless communication unit 104 transmits the display data generated by the display data generation unit 107 to the control device 200 . The wireless communication unit 202 receives the display data generated by the display data generation unit 107 from the wireless communication unit 104 and supplies the display data received by the wireless communication unit 104 to the display unit 203 . A display unit 203 displays the display data generated by the display data generation unit 107 . Thereby, the CPU 101 can present predetermined notification information to the user who remotely controls the mobile device 100 using the control device 200 . By viewing predetermined notification information displayed on the display unit 203 , the user can use the control device 200 to instruct the mobile device 100 to change to the recommended imaging mode or stop imaging processing.

As described above, in the third embodiment, the mobile device 100 determines whether the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power amount of the power supply unit 105 is less than the first threshold or the second threshold. It can be monitored at predetermined time intervals whether or not the If the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power of the power supply unit 105 is less than the first threshold but not less than the second threshold, change to the recommended imaging mode. Alternatively, it is possible to propose to the user to stop the imaging process. On the other hand, if the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power amount of the power supply unit 105 is less than the first threshold and the second threshold, the imaging mode of the imaging apparatus is set to recommended imaging. mode, or the imaging process of the imaging unit 102 can be stopped. Here, changing the imaging mode of the imaging apparatus to the recommended imaging mode and stopping the imaging process of the imaging unit 102 are automatically performed. As a result, the power consumption of the imaging device is reduced, so that the mobile device 100 can move together with the imaging device to the target position.

Note that the number of thresholds used by the CPU 101 is not limited to two, and may be three or more. For example, a case will be described where a third threshold is newly prepared such that first threshold>third threshold>second threshold. When the difference between the estimated power consumption calculated by the power consumption estimating unit 112 and the remaining amount of power of the power supply unit 105 is less than the first threshold, the CPU 101 reduces the power of the power supply unit 105 to move to the target position. Notify the user that the remaining amount is insufficient. Next, when the difference between the estimated power consumption calculated by the power consumption estimation unit 112 and the remaining power amount of the power supply unit 105 is less than the third threshold, the CPU 101 changes to the recommended imaging mode or cancels the imaging process. Suggest a stop to the user. Then, when the difference between the estimated power consumption calculated by the power consumption estimating unit 112 and the remaining power of the power supply unit 105 is less than the second threshold, the CPU 101 automatically changes the imaging mode of the imaging apparatus to the recommended imaging mode. or automatically stop the imaging process of the imaging unit 102 . The first to third thresholds can be, for example, power amounts that allow the mobile device 100 to move for 7 minutes, 5 minutes, and 2 minutes while the imaging process of the imaging unit 102 is stopped. Note that the first to third threshold values are not limited to values prepared in advance, and may be values that can be changed by the user.

<Embodiment 4>
At least one of the various functions, processes and methods described in the above embodiments can also be realized by a personal computer, microcomputer, CPU or microprocessor executing a program. Hereinafter, in Embodiment 4, a personal computer, microcomputer, CPU, or microprocessor will be referred to as "computer X". In the fourth embodiment, a program for controlling the computer X and for implementing at least one of the various functions, processes and methods described in the above embodiments will be referred to as "program Y".

At least one of the various functions, processes and methods described in the above embodiments are implemented by the computer X executing the program Y. In this case, program Y is supplied to computer X via a computer-readable storage medium. A computer-readable storage medium in Embodiment 4 includes at least one of a hard disk device, a magnetic storage device, an optical storage device, a magneto-optical storage device, a memory card, a volatile memory, a non-volatile memory, and the like. A computer-readable storage medium in Embodiment 4 is a non-transitory storage medium.

100: mobile device, 101: CPU, 102: imaging unit, 105: power supply unit, 112: power consumption estimation unit, 200: control device, 201: CPU

Claims (12)

A mobile device that moves with the imaging device,
estimation means for estimating power consumption consumed by the imaging device and the mobile device while the imaging device and the mobile device move from a current position to a target position;
Control means for controlling to give a predetermined notification based on the remaining power of power supply means for supplying power to the imaging device and the moving device and the power consumption estimated by the estimation means. A mobile device characterized by: 2. The mobile device according to claim 1, further comprising display means for displaying said predetermined notification. 3. The movement according to claim 1, wherein the predetermined notification includes either information for proposing a change of imaging mode to the user or information for proposing to the user to stop the imaging process. Device. 4. The mobile device according to claim 3, wherein the information for proposing a change in imaging mode to the user is information for proposing a change in image quality, frame rate, or angle of view to the user. The estimation means estimates the amount of power consumed by the imaging device and the moving device based on the amount of power consumed per unit distance and the distance from the current position to the target position. A mobile device according to any one of claims 1 to 4. 6. The apparatus according to any one of claims 1 to 5, wherein said control means controls at least one of said imaging device and said mobile device based on an instruction from a user in response to said predetermined notification. mobile device. 2. The control means controls to make the predetermined notification when the difference between the power consumption amount and the remaining power amount of the power supply means falls below a first threshold. 7. A mobile device according to any one of claims 6. When the difference between the power consumption and the remaining power of the power supply falls below a second threshold smaller than the first threshold, the control means controls the remaining power of the power supply and the estimated 8. The mobile device according to claim 7, wherein control is performed so as to reduce the amount of power consumed by the imaging device based on the amount of power consumption estimated by the means. The control means is
notifying that the remaining power is insufficient when the difference between the power consumption and the remaining power of the power supply means is less than the first threshold;
Information for proposing a change of the imaging mode to the user and information for proposing the stop of the imaging process to the user when the third threshold is smaller than the first threshold and larger than the second threshold. 9. The mobile device according to claim 8, wherein the mobile device is controlled to notify any one of them. 10. The apparatus according to claim 1, wherein the estimating means estimates the amount of power consumed by the imaging device and the moving device until they move to the target position every time a predetermined time elapses. A mobile device according to any one of the preceding claims. A control method for a mobile device that moves together with an imaging device, comprising:
a step of estimating the amount of power consumed by the imaging device and the mobile device until the imaging device and the mobile device move from a current position to a target position;
and a step of controlling to perform a predetermined notification based on the remaining power of power supply means for supplying power to the imaging device and the mobile device and the estimated power consumption. control method. to a computer on a mobile device that travels with the imaging device;
a step of estimating the amount of power consumed by the imaging device and the mobile device until the imaging device and the mobile device move from a current position to a target position;
A program for executing a step of controlling to perform a predetermined notification based on the remaining power of power supply means for supplying power to the imaging device and the mobile device and the estimated power consumption. .

Images