JP2024054440A - Image output control device, image output control method, program, image output control system, and electronic equipment - Google Patents

Abstract

To provide an image output control device that allows a user to more efficiently obtain the image of a desired situation, an image output control method, a program, an image output control system, and an electronic equipment.SOLUTION: A server device (60) which is an image output control device causes a CPU (61) to execute obtaining desired requested image information (633) regarding a subject to be photographed by a photographing device via a communication unit (65) from an electronic device (30) which is an external device, detecting a scene specified by the requested image information (633) from the acquired captured image, and obtaining the image of the detected scene with the shooting settings specified by the requested image information (633).SELECTED DRAWING: Figure 2

Description

This invention relates to an image output control device, an image output control method, a program, an image output control system, and electronic equipment.

Conventionally, there is technology that transmits images of moving subjects such as pets, elderly people, and small children captured by surveillance cameras or monitoring cameras installed indoors to personal devices. This allows users to remotely check the subject's condition and enjoy watching their behavior and expressions.

Cited Document 1 also discloses a technology that counts the number of times a pet remains in a specific area. It also discloses a technology that uses an infrared sensor to detect the pet's body temperature as a heat source and operates a camera to capture the position of the heat source.

JP 2021-111904 A

However, tracking with an infrared sensor alone is not enough to identify the state of the subject. Because users cannot view the image at all times, there is an issue that they cannot efficiently view the desired situation.

The object of this invention is to provide an image output control device, an image output control method, a program, an image output control system, and electronic devices therefor that can more efficiently obtain an image of a subject in a desired state.

In order to achieve the above object, the present invention provides
an acquisition unit that acquires desired requested image information related to a subject photographed by the photographing device from an external device;
a control unit that detects a scene specified by the requested image information from the acquired photographed image and performs processing to obtain an image of the scene with a photographing setting specified by the requested image information;
The image output control device includes:

The present invention has the advantage of being able to provide the user with an image of the subject in the desired condition more efficiently.

1 is a diagram showing a system configuration of an image delivery system according to an embodiment of the present invention. FIG. 2 is a block diagram showing functional configurations of a server device and an electronic device. 1 is a sequence diagram illustrating the flow of communication and operations between an electronic device, a server device, a support mechanism, and an image capturing device. 10 is a table showing an example of requested image information related to a designated scene that is set and stored in the electronic device. 11A and 11B are diagrams illustrating an example of detection of a specified scene and shooting settings. 11A and 11B are diagrams illustrating an example of detection of a specified scene and shooting settings. 13 is a flowchart of an image output control process executed by the server device. 13 is a flowchart of an image display control process executed by the electronic device.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram showing the system configuration of an image delivery system 100 according to the present embodiment.
This image distribution system 100 (image output control system) includes a photographing device 80, a server device 60 (image output control device, computer), an access point 50, an electronic device 30 (external device), a terminal device 10, and the like.

The photographing device 80 here is a digital camera capable of taking video, but may also be capable of continuously taking still images. The photographing device 80 has a communication unit and a control unit. The control unit transmits the captured images (video or continuous still images; captured video) to the outside, here the server device 60, via the communication unit in approximately real time. The photographing device 80 here is capable of changing the magnification (field of view) (zooming operation). The control unit can perform the zooming operation in accordance with a control signal input from the server device 60. The captured image (mainly the video data) may be accompanied by audio data, or may be only an image. In the following description, the term "view" includes the case where the user can only view the captured image. The photographing device 80 is supported by a support mechanism 70.

The support mechanism 70 includes a movable part, a drive part that operates the movable part, and a control part that controls the operation of the drive part. The support mechanism 70 can change the position and orientation (field of view) of the photographic device 80 by operating the movable part with the drive part based on the control of the control part. That is, the support mechanism 70 may be capable of, for example, moving the photographic device 80 in parallel on a rail or rotating it around a certain axis. The photographic device 80 and the support mechanism 70 (control part) are each connected to the server device 60 via an Internet communication line. There may be multiple photographic devices 80 and multiple support mechanisms 70.

The server device 60 controls the operation of the photographing equipment 80 and the support mechanism 70. The server device 60 acquires photographing data from the photographing equipment 80, and analyzes, edits, and stores the data as necessary. The server device 60 can be connected to the electronic device 30 via an Internet communication line, an access point 50, a wireless LAN, or the like. The server device 60 may also be connected to an external distribution server, etc.

The access point 50 may be a provider's base station or a home router, and controls communication paths related to the Internet and LAN.

The electronic device 30 is a portable device, such as a smartphone, but is not limited to such a device. The electronic device 30 can acquire and display images captured by the image capture device 80 at a remote location from the shooting location via the server device 60. The electronic device 30 can also generate and transmit request information regarding the scene to be viewed (a specified scene) and the settings related to the shooting at that time to the server device 60.

The scenes to be viewed, i.e., the detection conditions, include, for example, scenes in which a pet (a moving subject, but which does not necessarily move as expected) photographed by the photographing device 80 is performing a specific action (playing, eating, playing pranks, etc.). In addition, if there are multiple pets, the scene may be limited to a specific pet. Alternatively, the action of interest may be set individually for each pet. The settings related to the photographing (specified photographing settings) are the setting conditions for the photographing composition. The composition may include a simple close-up, as well as moving the photographing device 80 or changing the photographing angle (position, direction) by selecting an image from multiple photographing devices 80.

The terminal device 10 is, for example, a smart watch or an electronic watch. The terminal device 10 may be capable of acquiring and displaying data of a captured image of a viewing target from the electronic device 30 via a wireless LAN or the like. The terminal device 10 may receive a control signal related to an alarm operation from the electronic device 30 and perform an alarm operation. If only an alarm operation is required, the communication connection may have a communication speed lower than that of a wireless LAN. For example, the terminal device 10 may be capable of communicating with the electronic device 30 via Bluetooth (registered trademark) or the like. Note that if the terminal device 10 is not connected to the electronic device 30, the electronic device 30 may be capable of performing an alarm operation directly.

FIG. 2 is a block diagram showing the functional configuration of the server device 60 and the electronic device 30. As shown in FIG.
The server device 60 shown in FIG. 2A includes a central processing unit (CPU) 61 (control unit), a random access memory (RAM) 62, a storage unit 63, a communication unit 65, a display unit 66, an operation reception unit 67, and the like.

The CPU 61 is a processor that performs calculations and controls the operation of the server device 60. The CPU 61 may have a single processor, or may have multiple processors that operate in parallel or independently depending on the application, etc.

RAM 62 provides working memory space for CPU 61 and stores temporary data. RAM 62 is, for example, a DRAM, but is not limited to this.

The storage unit 63 has a non-volatile memory and stores a program 631, setting data, edited image data 633 obtained from the image capture device 80 and edited, and the like. The non-volatile memory may include a HDD (Hard Disk Drive). The non-volatile memory may also include a flash memory, and the like. The setting data stored in the storage unit 63 includes requested image information 632. Note that the storage unit 63 is not limited to being built-in. It may also include an external device attached as a peripheral device. The storage unit 63 may also be an external storage device such as a network storage or a cloud server.

The communication unit 65 controls transmission and reception of data to and from external devices. The communication unit 65 controls communication according to various communication standards via an Internet line, and can exchange data with the photographing device 80, the support mechanism 70, the electronic device 30, and the like.
The CPU 61 and the communication unit 65 constitute an acquisition unit of this embodiment.

The display unit 66 has a digital display screen such as a liquid crystal display screen, and displays information on the digital display screen under the control of the CPU 61 .
The operation reception unit 67 has a keyboard, a pointing device, etc., receives an input operation from outside, and outputs an operation signal according to the content of the received operation to the CPU 61.
The display unit 66 and the operation acceptance unit 67 may be peripheral devices attached to the server device 60. The server device 60 as a computer does not necessarily have to include the display unit 66 and the operation acceptance unit 67.

The electronic device 30 shown in FIG. 2(b) includes a CPU 31, a RAM 32, a memory unit 33, a communication unit 34, an alarm operation unit 35, a display unit 36, an operation reception unit 37, etc.

The CPU 31 is a processor that performs calculations and controls the overall operation of the electronic device 30. The CPU 31 may have a single processor, or may have multiple processors that operate in parallel or independently depending on the application, etc.

RAM 32 provides working memory space for CPU 31 and stores temporary data. RAM 32 is, for example, a DRAM, but is not limited to this.

The storage unit 33 has a non-volatile memory and stores a program 331, setting data, and the like. The non-volatile memory is, for example, a flash memory, but is not limited to this. The setting data stored in the storage unit 33 includes a request setting 332. The storage unit 33 may also include an external storage device such as a network storage or a cloud server.

The communication unit 34 controls the transmission and reception of data with external devices. For example, the communication unit 34 controls communication according to a communication standard related to wireless LAN, and can exchange data with the server device 60, etc. The communication unit 34 can also transmit and receive data with the terminal device 10 via other short-range wireless communication, such as Bluetooth.

The notification operation unit 35 performs a notification operation based on the control of the CPU 31. Examples of notification operations include the generation of a beep or sound effect, and the generation of vibrations. For these notification operations, the notification operation unit 35 may have, for example, a sound generating unit having a diaphragm and a piezoelectric element, a speaker, and a vibration motor (such as a motor with a weight).

The display unit 36 has a digital display screen such as a liquid crystal display screen, and performs image display operations under the control of the CPU 31. The digital display screen is capable of displaying images captured by the imaging device 80 that are transmitted (e.g., streamed) from the server device 60.

The operation reception unit 37 receives an input operation and outputs an operation signal corresponding to the received operation to the CPU 31. The operation reception unit 37 has, for example, a touch panel located on top of a digital display screen. The operation reception unit 37 may also have a push button switch or the like.
The display unit 36 and the operation reception unit 37 may be peripheral devices attached to the electronic device 30 (including connection via short-range wireless communication, etc.).

Next, the image output control of this embodiment will be described.
The server device 60 of the present embodiment acquires a request (requested image information) related to an image in a shooting setting such as a desired composition (shooting position and field of view range) of a desired scene (designated scene) sent from the electronic device 30. The requested image information may be generated by a user's input operation to the operation reception unit 37 in the electronic device 30. Alternatively, the requested image information may be generated by the terminal device 10 and transmitted to the electronic device 30, and stored and held in the electronic device 30. Furthermore, a plurality of requested image information may be stored and held by the electronic device 30, and one of the requested image information may be selected by an input operation to the operation reception unit 37 or in response to a request received from the terminal device 10. The server device 60 may acquire the selected requested image information. The server device 60 detects the above-mentioned scene from the captured image by the photographing device 80. The detection of the image may be performed by a well-known image recognition technology. The image recognition technology includes one that utilizes a machine learning model. An algorithm of the machine learning model may be a neural network using deep learning, for example, a convolutional neural network (CNN), but is not limited thereto.

If the type of pet and its movements are the only issue, a general trained model can be applied, and there is no need for the training to be specific to the user of the electronic device 30 and the server device 60. A general-purpose trained model, etc., may be acquired from an external device and updated periodically. On the other hand, if it is necessary to identify a specific individual pet owned by a user, or to identify a specific behavior of the individual, machine learning is required to identify these individuals (e.g., size, color, coat, collar, and other detailed features). The user can prepare training data indicating individual identification information for images captured in advance and use it for training. Training of the machine learning model can be performed according to well-known techniques, so a detailed explanation will be omitted.

When the desired scene is detected, the server device 60 requests the photographing device 80 and/or the support mechanism 70 to perform an adjustment operation to photograph the scene with a photographing setting according to the scene. If an image with the desired photographing setting cannot be obtained only by the operation of the photographing device 80 or the support mechanism 70, the server device 60 may perform image processing. For example, the server device 60 performs image processing (extraction processing and enlargement processing) to trim and enlarge a part of the acquired image to match the above-mentioned photographing setting. The server device obtains an image of the scene specified with the specified photographing setting by these processes. The server device 60 stores and holds the photographing data of the scene with this photographing setting. At the same time, the server device 60 notifies the electronic device 30 that the desired scene has been detected. The notification may be performed by a dedicated application program or may be performed via a general SNS (Social Networking Service) or push mail. The electronic device 30 performs a notification operation to the user of the device upon receiving the received notification information. The user can request the server device 60 to send an image in response to the notification operation. Upon receiving a request to transmit an image, the server device 60 transmits the image being captured to the electronic device 30 in approximately real time. The electronic device 30 can also have the server device 60 transmit images (stored images) of scenes that were captured and saved (stored) in the past, so that the electronic device 30 can view them.

Figure 3 is a sequence diagram that explains the flow of communication and operations between the electronic device 30, the server device 60, the support mechanism 70, and the imaging device 80.

The electronic device 30 sets a request for the desired shooting scene and transmits the setting to the server device 60. The server device 60 stores and holds the setting related to the request. Meanwhile, the photographing device 80 and the support mechanism 70 are set to shoot with the basic composition, and shooting by the photographing device 80 is started. The captured image is transmitted to the server device 60.

The server device 60 starts the detection operation of the specified scene according to the stored request settings. Here, it is assumed that a machine learning model or the like has already been trained to be able to detect the request content. The server device 60 may erase (delete) the captured image immediately or after a short period of time when the specified scene is not detected by the detection operation. When the specified scene is detected, the server device 60 transmits the capture settings such as a composition change according to the specified scene to the support mechanism 70 and/or the photographing equipment 80. The server device 60 stores (records) the acquired captured image in the storage unit 63. At this time, the server device 60 may further edit the captured image as necessary. Editing may include cropping, zooming, etc.

On the other hand, the server device 60 notifies the electronic device 30 that an image corresponding to the requested setting has been detected. Upon receiving this notification, the electronic device 30 performs a notification operation using the notification operation unit 35 and the display unit 36.

When the operation reception unit 37 of the electronic device 30 receives an operation related to an image viewing request from a user or the like, the electronic device 30 transmits a transmission request for the image being captured to the server device 60. When the server device 60 receives the transmission request, it delivers the image being captured (or the edited image if it has been edited) to the electronic device 30.

The server device 60 continues to detect the specified scene, and if the subject is moving, transmits a control signal to the photographing equipment 80 and/or the support mechanism 70 as appropriate to change the composition. When detection of the specified scene is no longer (ended), the server device 60 transmits a signal to the photographing equipment 80 and/or the support mechanism 70 to cause them to return to the basic composition. The server device 60 ends the storage (recording) of the image, and stores and saves it in the edited image data 633 as archive data (stored data) together with an appropriate name or information on the detected specified scene. Image transmission from the server device 60 to the electronic device 30 may also end.

Even if the electronic device 30 has not received notification of the detection of a specified scene, the electronic device 30 can cause the server device 60 to distribute any data stored in the edited image data 633. When the server device 60 receives a transmission request specifying data to be called, the server device 60 reads the data to be called from the edited image data 633 and distributes it to the electronic device 30.

Figure 4 is a chart showing an example of requested image information 632 relating to a specified scene set and stored in electronic device 30. For example, in the first setting, a scene in which pet A (e.g., a dog) is biting something (e.g., a toy to chew, a doll that should not be chewed, a chair leg, etc.) is set as one of the detection targets. The shooting setting in this case is set to enlarge the face area including the object being bitten. In other words, since the image enlargement ratio differs individually depending on various conditions such as the subject and its position, orientation, and posture, server device 60 sets the enlargement ratio as needed depending on the detection result.

In addition, in the second setting, the detection target is a scene in which pet A is running (including moving at a certain speed or faster). In this case, the shooting setting is determined so that space is secured in the direction in which pet A is running (e.g., about half the screen), and the magnification is adjusted so that pet A is included in the remaining range.

In addition, in the third setting, for example, a scene in which a pet B (e.g., a cat) is scratching (scratching) a wall R is detected. When this scene is detected, the image is edited and stored at a magnification that includes not only the pet B but also the entire width of the wall R.

As such, the designated scene does not have to be limited to one. The server device 60 may notify the electronic device 30 of which designated scene it is. In response, the electronic device 30 may perform a different notification operation depending on the detected designated scene.

5 and 6 are diagrams for explaining examples of detection of a specified scene and shooting settings.
5A, in the basic state, a wide range Z0 can be captured so that the subject pet P1 and the like are included in the field of view as much as possible. Here, the pet P1 is sleeping, and does not fall under the designated scene.

As shown in FIG. 5(b), when the pet P1 wakes up and begins to bite the bone-shaped toy B, the server device 60 detects the designated scene 1 from the captured image. The server device 60 transmits a control signal (request) to the support mechanism 70 and/or the image capture device 80 to enlarge the range Z1 and capture the image.

As shown in FIG. 6(a), when the pet P1 starts walking, the server device 60 detects the designated scene 2 from the captured image. The server device 60 transmits a control signal (request) to the support mechanism 70 and/or the photographing device 80 to change the composition so that the enlarged range Z2, which has a width in the direction of movement of the pet P1, becomes the field of view.

As shown in FIG. 6(b), when pet P2 starts scratching wall R, server device 60 detects designated scene 3 from the captured image. Server device 60 transmits a control signal (request) for changing the composition to support mechanism 70 and/or image capture device 80 so that enlarged range Z3 including pet P2 and wall R that pet P2 is scratching is in the field of view.

Figure 7 is a flowchart showing the control procedure by the CPU 61 of the image output control process executed by the server device 60 of this embodiment. This image output control process is started in response to, for example, an input operation to the operation reception unit 67, and is executed continuously.

When the image output control process is started, the CPU 61 acquires the requested settings related to the specified scene to be detected (step S601; acquisition means). If the requested settings 332 have already been acquired from the electronic device 30, the CPU 61 reads out the requested image information 632. Alternatively, the CPU 61 receives new requested settings 332 from the electronic device 30 and stores them in the requested image information 632. The CPU 61 starts receiving images from the photographing device 80, and starts the process of detecting the specified scene included in the requested settings from the received images (step S602).

The CPU 61 determines whether or not the designated scene has been detected from the captured image (step S603). If it is determined that the designated scene has not been detected (step S603: NO), the CPU 61 proceeds to step S615.

If it is determined that the designated scene has been detected from the captured image ("YES" in step S603), the CPU 61 determines whether the detection of the designated scene is a continuation from the previous detection (step S604). If it is determined that the detection is a continuation from the previous detection ("YES" in step S604), the processing of the CPU 61 proceeds to step S609.

If it is determined that the detection of the designated scene is not a continuation from the previous detection (detection has started) ("NO" in step S604), the CPU 61 transmits the shooting settings corresponding to the detected designated scene to the shooting device 80 and/or the support mechanism 70 (step S605).

The CPU 61 determines whether or not editing of the received photographed image is necessary (step S606). For example, the CPU 61 determines whether or not the subject cannot be captured in a sufficient size by the optical zoom of the photographing device 80 alone, and whether or not trimming and partial enlargement (optical zoom) are necessary. If it is determined that editing of the photographed image is necessary ("YES" in step S606), the CPU 61 starts editing of the photographed image (step S607). Then, the processing of the CPU 61 proceeds to step S608. If it is determined that editing of the photographed image is not necessary ("NO" in step S606), the processing of the CPU 61 proceeds to step S608.
The processes in steps S602 to S607 constitute the processing means of this embodiment.

When the process proceeds to step S608, the CPU 61 notifies the electronic device 30 of the detection of the specified scene (step S608). Then, the process proceeds to step S609.

When the process proceeds to step S609, the CPU 61 determines whether or not an image transmission request has been received from the electronic device 30 (step S609). If it is determined that a transmission request has been received (step S609: NO), the CPU 61 starts transmitting (delivering) the image to the electronic device (step S610). Then, the process proceeds to step S611. If it is determined that a transmission request has not been received (including the case where a reception request has already been received and image delivery to the electronic device 30 has already started) (step S610: NO), the process proceeds to step S611.

When the process proceeds to step S611, the CPU 61 determines whether or not detection of the designated scene has ended (step S611). The CPU 61 may determine that detection has ended when the designated scene has not been detected continuously for a reference time or longer, rather than only detecting an image in which the designated scene has not been detected momentarily. If it is determined that detection of the designated scene has not ended ("NO" in step S611), the process proceeds to step S615.

When it is determined that the detection of the specified scene has ended ("YES" in step S611), the CPU 61 stops sending (delivering) images to the electronic device 30 (step S612). The CPU 61 ends editing of the received images, and stores the images captured while the specified scene was being detected as archive images in the edited image data 633 (step S613). The CPU 61 transmits a command to the photographing device 80 and/or the support mechanism 70 to return to the basic composition (step S614). Then, the processing of the CPU 61 proceeds to step S615.

When the process proceeds to step S615, the CPU 61 determines whether or not a request to send an archive image stored in the edited image data 633 has been received from the electronic device 30 (step S615). If it is determined that a request to send any archive image has been received ("YES" in step S615), the CPU 61 reads the specified image data from the edited image data 633 and starts sending it to the electronic device 30 (step S616). Then, the process of the CPU 61 returns to step S603. If it is determined that a request to send an archive image has not been received (including the case where sending is already in progress) ("NO" in step S615), the process of the CPU 61 returns to step S603.

Figure 8 is a flowchart showing the control procedure by the CPU 31 of the image display control process executed by the electronic device 30. This image display control process is started in response to an input operation to the operation reception unit 67. When the notification operation unit 35 or the display unit 36 is performing a notification operation in response to a notification from the server device 60, the CPU 31 may start the image display control process by a simple shortcut operation, for example, by simply pressing a specific push button switch once.

The CPU 31 determines whether this process has been started in response to a notification action related to the detection of a specified scene (step S301). If it is determined that this process has been started in response to a notification action ("YES" in step S301), the CPU 31 sets a real-time image of the notification content as the display request target (step S311). Then, the process of the CPU 31 proceeds to step S306.

If it is determined that the notification is not the start of processing corresponding to the notification operation (step S301: NO), the CPU 31 requests the list of archive images stored in the edited image data 633 from the server device 60 (step S302). The CPU 31 receives and acquires the list of archive images from the server device 60 and causes the display unit 36 to display it (step S303). The CPU 31 may also acquire update data for the list of archive images periodically or each time a notification related to a specified scene is issued. In this case, the CPU 31 may read out the acquired list of archive images from the storage unit 33 and cause the display unit 36 to display it.

The CPU 31 determines whether an operation to select any archive image has been accepted (step S304). If it is determined that any archive image has been selected ("YES" in step S304), the CPU 31 sets the selected archive image as the target for which a display request is requested (step S305). Then, the processing of the CPU 31 proceeds to step S306.

When the process proceeds to step S306, the CPU 31 determines whether or not an operation to send a transmission request for the image of the set request target has been accepted (step S306). If it is determined that an operation to send a transmission request has not been accepted (step S306: NO), the CPU 31 repeats the process of step S306.

When it is determined that the operation to send a transmission request has been accepted ("YES" in step S306), the CPU 31 sends a transmission request for the image requested to be displayed to the server device 60 (step S307). The CPU 31 receives the image from the server device 60 and starts displaying it on the display unit 36 (step S308). Note that the CPU 31 may perform adjustment processing on the image data as necessary to properly display the received data. Then, the CPU 31 ends the image display control processing.

As described above, the server device 60 serving as an image output control device in the image distribution system 100 of this embodiment includes the CPU 61 and the communication unit 65. The CPU 61 acquires desired requested image information relating to a subject photographed by the photographing device 80 from the electronic device 30 via the communication unit 65. The CPU 61 detects a scene specified in the requested image information from the photographed image acquired from the photographing device 80, and performs processing for obtaining an image of the scene with the photographing settings specified in the requested image information.
As a result, the server device 60 appropriately operates the photographing equipment 80 and/or the support mechanism 70, and also appropriately edits the photographed images, so that images of desired scenes can be easily obtained without missing any. The user only needs to determine the request settings 332 in advance, so the processing is efficient. In particular, the user does not need to keep watching all the time, and does not need to operate remotely while worrying about the communication environment, so it is not time-consuming. Therefore, the server device 60 can obtain images of desired situations more efficiently.

The shooting settings also include settings related to the composition of the captured image. The CPU 61 performs processing to output a request for adjusting the composition (shooting position and field of view range) to at least one of the photographing equipment 80 and the support mechanism 70 of the photographing equipment 80. In other words, since the server device 60 automatically and closely controls the photographing equipment 80, the composition can be appropriately controlled with a smaller time lag. In addition, since the user does not need to make direct adjustments, there is less concern about oversights and operational errors, and the desired image can be obtained more reliably. In particular, by adjusting the shooting range itself, an image with an appropriate resolution according to the specifications of the photographing equipment 80 can be obtained.

When a specified scene is detected, the CPU 61 performs processing to extract a portion of the captured image that corresponds to the shooting settings. That is, in addition to or instead of adjusting the photographing equipment 80 and the support mechanism 70, an image of the desired scene may be obtained by processing the image data. By performing such processing, the server device 60 can obtain an image of the user's desired scene that corresponds to the desired shooting settings.

The CPU 61 may also enlarge the captured image according to the size of the extracted image portion. By keeping the image size roughly the same, an image that is easy for the user to view can be obtained.

When the CPU 61 detects a specified scene, it outputs a signal to the electronic device 30 to notify the electronic device 30 of the detection of the scene. This allows the user of the electronic device 30 to quickly know that the desired scene has occurred even if the user is not viewing the captured image in real time.

Furthermore, when the specified scene is detected and a request to transmit a captured image is received from the electronic device 30, the CPU 61 outputs an image corresponding to the above processing to the electronic device 30. When the above conditions are satisfied, this also includes a case where the specified scene is detected after a request to transmit an archive image has been made from the electronic device 30 and the corresponding archive image has been transmitted from the server device 60. In other words, in response to the detection of the specified scene, the image transmitted from the server device 60 may be automatically switched from an archive image to a real-time image. In other words, when a request to view a desired scene is made from the electronic device 30, an image of the scene that has been captured and edited with a capture setting corresponding to the scene can be quickly provided to the user. Therefore, the user can efficiently view the desired image.

The server device 60 also includes a storage unit 63. The CPU 61 stores the image corresponding to the above processing in edited image data 633 of the storage unit 63 as an archive image. When a transmission request for an archive image is received from the electronic device 30, the CPU 61 reads the archive image from the storage unit 63 and outputs it to the electronic device 30. In other words, even if the user is unable to view a desired image in real time, the user can have the image distributed from the server device 60 and view it at any time of their choice. Furthermore, even if the user has viewed an image once in real time, the user can repeatedly view a favorite archive image without having to search for it among a large amount of data.

In addition, the image output control method of this embodiment is a control operation by the CPU 61, which obtains desired requested image information relating to a subject to be photographed by the photographing equipment 80 from the electronic device 30, detects a scene specified in the requested image information from the obtained photographed image, and performs processing to obtain an image of the scene with the photographing settings specified in the requested image information.
This allows the user to easily obtain an image of a desired scene without having to wait for the occurrence of the scene while viewing the captured image, simply by predetermining the required settings 332. Therefore, according to this image output control method, an image of a desired situation can be obtained more efficiently.

In addition, by installing and executing the program 631 relating to the image output control method described above on a computer (server device 60), it is possible to easily detect a specified scene from a captured image and perform change control to capture the detected specified scene in accordance with the capture settings. Therefore, according to the program 631, an image of a desired situation can be efficiently obtained.

The image delivery system 100, which is the image output control system of this embodiment, includes the server device 60 and the electronic device 30. With this image delivery system 100, the user can easily specify a desired shooting scene from the electronic device 30 and obtain an image of the user's desired situation.

In addition, the electronic device 30 (or the terminal device 10 as described below), which is the external device in this embodiment, outputs requested image information to the server device 60. This electronic device 30 makes it easy to remotely set information for obtaining a desired shooting scene.

The present invention is not limited to the above-described embodiment, but may be modified in various ways.
For example, if it is possible to identify a specified scene without using a machine learning model, for example, if edge detection and color classification within the edge are sufficient, then it is not necessarily necessary to use a machine learning model.

In addition, detection of whether or not a scene is a specified scene does not have to be performed only by image processing. For example, a collar worn by a pet may be equipped with a measurement unit, a notification unit, and a communication unit. The measurement unit measures the pet's vital signs, and the measurement results of the vital signs are transmitted to another information processing device by the communication unit. The other information processing device judges the pet's physical condition, activity state, emotions, etc. based on the measurement results. The other information processing device transmits a control signal to the communication unit to cause the notification unit to perform a notification operation according to the judgment result. The notification unit performs a notification operation according to the control signal, for example, a light emission operation in a pattern or color. The photographing device 80 may photograph this light emission operation, and the server device 60 may decode the contents. Note that the light emission needs to be performed so as not to cause stress or harm to the pet. Therefore, the wavelength of the light emission may be in a frequency range that the pet cannot sense (for example, infrared light).

In the above embodiment, the electronic device 30 is a portable device such as a smartphone, to which the terminal device 10 may be further connected to perform notification operations, but this is not limited to the above. The terminal device 10 capable of displaying images may be directly connected to the server device 60 via a communication line. In this case, the terminal device 10 may also have the above functions of the electronic device 30. Furthermore, the terminal device 10 may switch between sending settings and selections related to requested image information to the electronic device 30 or directly to the server device 60 depending on whether it is connected to the electronic device 30.

Also, as mentioned above, audio data may be included with the captured images, but this may be limited to only the necessary period.

In addition, in the above embodiment, when a request to transmit a captured image is received from a user while a specified scene is occurring, the captured image at that time is transmitted in real time, but this is not limited to the above. It may be possible to transmit images from the time the specified scene occurs with a time delay.

In addition, in the above embodiment, the captured images are stored from the time when the designated scene is detected, but this is not limited to the above. The first time of the captured images to be stored may be a time a specified time before the first detection. The server device 60 holds those captured images in which the designated scene is not detected until a specified time has elapsed, and when the designated scene is detected, can be included in the archive images going back a certain time.

In addition, the photographing device 80 may be configured to switch the magnification (zoom) of the photographed image, select the optimal photographed image from multiple photographing devices 80, or switch the photographing position, field of view, or range of the photographing device 80 according to the operation of the support mechanism 70, or some or all of these operations may be impossible. In this case, a control signal for an impossible operation is not output. The server device 60 may obtain a photographed image with the desired photographing settings by editing the image only. On the other hand, if the photographing device 80 and/or the support mechanism 70 can be adjusted, the server device 60 does not need to perform any editing operations other than setting the image period between specified scenes.

In addition, in the above embodiment, the subject to be photographed (the object) and the designated scene are set in a one-to-one correspondence, but this is not limited to this. For example, multiple objects may be associated with a certain designated scene.

In addition, when multiple designated scenes are set in the photography request information 633 and multiple scenes occur simultaneously, photography may be performed using the photography settings for the designated scenes with higher priority according to the priority, or the photography settings may be changed to include all the designated scenes. In addition, when multiple photographing devices 80 are provided, the most suitable photographing device 80 may be assigned in order of priority, and all captured images may be acquired and saved. In this case, the designated scenes with lower priority may be adjusted so that they are photographed within the composition range that can be set by the remaining photographing devices 80 that were not selected to photograph the designated scenes with higher priority.

In addition, in the above embodiment, the occurrence of a specified scene is notified to the electronic device 30 in real time, but real-time notification is not necessarily required. The user may simply obtain information at an appropriate time, for example by fetch mail, and be able to view archived images.

On the other hand, if an image of the specified scene is not delivered in real time from the electronic device 30, or if an instruction to save the image is not received, the image obtained according to the shooting settings may be deleted in a short period of time without being archived.

The above processes do not have to be controlled by a single server device 60. For example, image data editing processes may be performed by another information processing device (computer) connected to the server device 60. Archive images may also be stored and distributed by another information processing device (computer). Alternatively, the server device 60 may be integrated with the imaging device 80 rather than being independent of it. In other words, the imaging device 80 may also have the above functions as the server device 60.

In addition, in the above embodiment, the purpose is to watch over or monitor pets indoors, but the present invention is not limited to this. Basically, it is sufficient if an image of a desired scene cannot be obtained satisfactorily using a fixed pin of a fixed camera or periodic changes in composition, and the subject may be a small child. Alternatively, the present invention may be used to observe wild birds and animals outdoors, such as in a garden.

In the above description, the storage unit 63 is exemplified by a non-volatile memory such as a HDD or a flash memory as a computer-readable medium for storing the program 631 related to the image output control of the present invention, but is not limited thereto. As other computer-readable media, other non-volatile memories such as MRAM and portable recording media such as CD-ROMs and DVD disks can be applied. In addition, a carrier wave can be applied to the present invention as a medium for providing the data of the program related to the present invention via a communication line.
In addition, the specific configurations, contents and procedures of the processing operations, etc. shown in the above embodiments can be modified as appropriate without departing from the spirit of the present invention. The scope of the present invention includes the scope of the invention described in the claims and its equivalents.

10 Terminal device 30 Electronic device 31 CPU
32 RAM
33 Storage unit 331 Program 332 Request setting 34 Communication unit 35 Notification operation unit 36 Display unit 37 Operation reception unit 50 Access point 60 Server device 61 CPU
62 RAM
63 Storage unit 631 Program 632 Requested image information 633 Edited image data 65 Communication unit 66 Display unit 67 Operation reception unit 70 Support mechanism 80 Photographing device 100 Image distribution system

Claims (11)

an acquisition unit that acquires desired requested image information related to a subject photographed by the photographing device from an external device;
a control unit that detects a scene specified by the requested image information from the acquired photographed image and performs processing to obtain an image of the scene with a photographing setting specified by the requested image information;
An image output control device comprising: The photographing setting includes a setting related to a composition of the photographed image,
The image output control device according to claim 1 , wherein the control unit performs the process of outputting a request for an adjustment operation of the composition to at least one of the photographing device and a support mechanism of the photographing device. The image output control device according to claim 1, wherein the control unit performs the process of extracting a portion corresponding to the shooting settings from the acquired captured image when the scene is detected. The image output control device according to claim 3, wherein the control unit performs enlargement processing of the captured image according to the extracted size. The image output control device according to claim 1, wherein the control unit outputs a signal to the external device when the scene is detected, notifying the external device of the detection of the scene. The image output control device according to claim 5, wherein the control unit outputs an image corresponding to the processing to the external device when the scene is detected and a request to transmit the captured image is received from the external device. A memory unit is provided,
The control unit is
storing an image corresponding to the processing in the storage unit as a saved image;
6. The image output control device according to claim 5, wherein, when a request to transmit the stored image is received from the external device, the stored image is read out from the storage unit and output to the external device. An image output control method by a control unit, comprising:
Obtaining desired requested image information relating to a subject to be photographed by the photographing device from an external device;
a process for detecting a scene specified by the requested image information from the acquired photographed image and obtaining an image of the scene with a photographing setting specified by the requested image information;
Image output control method. Computer,
An acquisition means for acquiring desired requested image information relating to a subject photographed by the photographing device from an external device;
a processing means for detecting a scene specified by the requested image information from the acquired photographed image and performing processing for obtaining an image of the scene with a photographing setting specified by the requested image information;
A program that functions as a an acquisition unit that acquires desired requested image information related to a subject photographed by the photographing device from an external device;
a control unit that detects a scene specified by the requested image information from the acquired photographed image and performs processing to obtain an image of the scene with a photographing setting specified by the requested image information;
An image output control device comprising:
an external device that transmits the requested image information to the image output control device;
An image output control system comprising: An electronic device that outputs the requested image information to an image output control device that includes an acquisition unit that acquires desired requested image information related to a subject photographed by a photographing device from an electronic device, and a control unit that detects a scene specified in the requested image information from the acquired photographed image and performs processing to obtain an image of the scene with the photographing settings specified in the requested image information.

Images