WO2022004353A1 - Imaging device, transmission method, transmission device, cloud server, and imaging system - Google Patents

Imaging device, transmission method, transmission device, cloud server, and imaging system Download PDF

Info

Publication number
WO2022004353A1
WO2022004353A1 PCT/JP2021/022663 JP2021022663W WO2022004353A1 WO 2022004353 A1 WO2022004353 A1 WO 2022004353A1 JP 2021022663 W JP2021022663 W JP 2021022663W WO 2022004353 A1 WO2022004353 A1 WO 2022004353A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
unit
captured image
transmission
processing
Prior art date
Application number
PCT/JP2021/022663
Other languages
French (fr)
Japanese (ja)
Inventor
元宏 中筋
Original Assignee
ソニーグループ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニーグループ株式会社 filed Critical ソニーグループ株式会社
Publication of WO2022004353A1 publication Critical patent/WO2022004353A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules

Definitions

  • the present disclosure relates to an image pickup device, a transmission method, a transmission device, a cloud server, and an image pickup system.
  • a technique for calculating parameters used by an image pickup device by a device other than the image pickup device is known.
  • the parameters calculated by the server that received the image captured by the image pickup device are transmitted to the image pickup device, and the image pickup device performs image processing using the parameters received from the server (for example, Patent Document 1).
  • the prior art aims to generate high quality and high definition images even if the user has no knowledge or skills regarding settings or the performance of the camera is low, and is between the image pickup device and the server. No consideration is given to the amount of traffic. Therefore, in the prior art, the amount of communication between the image pickup apparatus and the server increases as the amount of image data increases. Therefore, it is desired to suppress the amount of communication when calculating parameters with a device other than the image pickup device.
  • the present disclosure proposes an image pickup device, a transmission method, a transmission device, a cloud server, and an image pickup system that can suppress an increase in the amount of communication required for parameter calculation by a device other than the image pickup device.
  • parameters related to the processing of the image pickup image are calculated for a part of the image pickup unit that performs image pickup and the image pickup image captured by the image pickup unit. It is provided with a sending unit for sending to an external device.
  • FIG. 1 is a diagram showing an example of an imaging system according to the first embodiment of the present disclosure.
  • the image pickup system 1 includes a camera 100, a cloud server 200, and a server device 300.
  • the image pickup system 1 shown in FIG. 1 may include a plurality of cameras 100, a plurality of cloud servers 200, and a plurality of server devices 300.
  • the configuration and processing of each device will be described.
  • the camera 100 is an imaging device that performs imaging.
  • the camera 100 sends a part of the captured image to the cloud server 200 that calculates the image processing parameters (hereinafter, also simply referred to as “parameters”) used by the camera 100.
  • the camera 100 performs image processing using the parameters received from the cloud server 200.
  • the captured image captured by the camera 100 may be either a moving image or a still image, but in the following, when the camera 100 is a video camera and the captured image captured by the camera 100 is a moving image. Will be described as an example.
  • the camera 100 includes an image pickup unit 110, an image processing unit 120, a transmission determination unit 130, and a communication unit 140.
  • the imaging unit 110 performs imaging.
  • a CMOS (Complementary Metal Oxide Semiconductor) image sensor is used for the image pickup unit 110.
  • the image pickup unit 110 is not limited to a CMOS image sensor, and various image sensors such as a CCD (Charge Coupled Device) image sensor may be used.
  • the image pickup unit 110 may have an optical member such as a lens and an adjustment mechanism for adjusting the focus, zoom, and aperture of the optical member.
  • the image pickup unit 110 passes the captured captured image to the image processing unit 120.
  • a program for example, an image processing program, a transmission program, etc.
  • a CPU Central Processing Unit
  • an MPU Micro Processing Unit
  • RAM Random Access Memory
  • the image processing unit 120 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).
  • the image processing unit 120 performs image processing of the captured image captured by the image pickup unit 110.
  • the image processing unit 120 performs processing using the parameters received from the cloud server 200.
  • the image processing unit 120 performs processing using parameters related to brightness and color tone.
  • the image processing unit 120 performs processing for adjusting the brightness of the captured image by using the gain parameter.
  • the image processing unit 120 performs processing for adjusting the brightness and contrast of the captured image by using the tone parameters.
  • the image processing unit 120 performs processing using parameters related to hue and saturation.
  • the image processing unit 120 performs processing for emphasizing the high frequency component of the captured image by using the parameter related to the intensity of high frequency enhancement.
  • the image processing unit 120 performs processing for removing noise in the captured image by using a parameter related to the strength of noise removal.
  • image processing the image processing unit 120 performs a process of adjusting the brightness of the captured image, a process of adjusting the contrast of the captured image, a process of emphasizing a high frequency component of the captured image, or a noise of the captured image. Perform at least one of the removal processes.
  • the above is an example, and the image processing performed by the image processing unit 120 is not limited to the above.
  • the image processing unit 120 passes the captured image that has undergone image processing to the transmission determination unit 130.
  • the image processing unit 120 may pass the captured image before image processing to the transmission determination unit 130.
  • the image processing unit 120 passes the captured image to the determination data preprocessing unit 131 of the transmission determination unit 130.
  • the image processing unit 120 selects a part of the captured image, which is a moving image, as a transmission image. For example, the image processing unit 120 selects a predetermined number (for example, one or the like) of still images among the moving images as the transmission image.
  • the predetermined number of still images referred to here also includes moving images cut out in a predetermined section (predetermined frame) in the moving image. That is, when the captured image is a moving image, a part of the captured image may be a moving image obtained by cutting out a predetermined section (predetermined frame) in the moving image.
  • the image processing unit 120 may randomly select a predetermined number of still images as the transmission image, or may select a predetermined number of still images as the transmission image based on a predetermined reference.
  • the image processing unit 120 may select a still image corresponding to the start of the moving image, a still image corresponding to the middle of the moving image, or a still image corresponding to the end of the moving image as the transmission image.
  • the image processing unit 120 may select any image as a transmission image as long as it is a part of the captured image. As shown in FIG. 2, the image processing unit 120 passes a part of the captured image as a transmission image to the transmission signal creation unit 133 of the transmission determination unit 130.
  • the image processing unit 120 passes the metadata related to the captured image to the transmission signal creation unit 133 of the transmission determination unit 130.
  • the metadata is, for example, various settings of the camera 100 at the time of capturing an captured image, the number of pixels of the camera 100, a frame rate, a color gamut, a lens type, a focus position, an F value, a zoom ratio, and the like. Further, the metadata may include the orientation of the camera 100 and the position of the camera 100.
  • the transmission determination unit 130 may acquire the metadata from the storage unit that stores the metadata.
  • the transmission determination unit 130 determines transmission to the cloud server 200 and creates a transmission signal to be transmitted to the cloud server 200.
  • a program stored inside the camera 100 for example, a determination data generation program, a transmission determination program, a transmission signal creation program, etc.
  • the transmission determination unit 130 may be realized by an integrated circuit such as an ASIC or FPGA.
  • the transmission determination unit 130 includes a determination data preprocessing unit 131, a determination unit 132, and a transmission signal creation unit 133.
  • FIG. 2 is a diagram showing an example of the configuration of the transmission determination unit.
  • Judgment data preprocessing unit 131 generates judgment data used for judgment as to whether or not to send.
  • the judgment data preprocessing unit 131 generates judgment data by processing the image captured by the image pickup unit 110.
  • the judgment data preprocessing unit 131 passes the generated judgment data to the judgment unit 132.
  • the judgment data pre-processing unit 131 processes the image according to the judgment target in the judgment unit 132.
  • the judgment data preprocessing unit 131 generates judgment data as a judgment criterion for whether or not to recalculate the parameters.
  • the judgment data preprocessing unit 131 calculates the feature amount of the captured image and outputs the calculated feature amount as the judgment data.
  • the judgment data preprocessing unit 131 calculates the average of the luminance values of the entire captured image, and outputs the average of the calculated luminance values as the determination data.
  • the judgment data preprocessing unit 131 calculates the average of the luminance values of a part (specific portion) of the captured image, and outputs the average of the calculated luminance values as the determination data.
  • the judgment data preprocessing unit 131 may divide the captured image into a plurality of regions within a certain range and output the integration result in each region as judgment data.
  • the judgment data preprocessing unit 131 may detect a high frequency component in the captured image and output the integration result as judgment data.
  • the judgment data pre-processing unit 131 passes the judgment data generated based on the captured image at the time of judgment to the judgment unit 132 as transmission judgment target data.
  • the judgment data preprocessing unit 131 sets an initial value in the reference judgment data by the initialization processing. Further, the judgment data preprocessing unit 131 replaces the reference judgment data with the transmission judgment target data when the judgment unit 132 determines that the transmission is to be performed.
  • the judgment data preprocessing unit 131 passes the set standard judgment data to the judgment unit 132.
  • the determination unit 132 may acquire the reference determination data from the storage unit that stores the reference determination data.
  • the determination unit 132 determines whether or not the transmission condition is satisfied.
  • the transmission conditions may be set by the operator of the camera 100 or the like, or may be stored in the storage unit of the camera 100.
  • the determination unit 132 determines whether or not the transmission condition is satisfied by using the determination data generated by the determination data preprocessing unit 131.
  • the determination unit 132 determines whether or not the parameter needs to be recalculated by using the determination data sent from the determination data preprocessing unit 131.
  • the determination unit 132 determines whether or not the transmission condition is satisfied based on the comparison between the reference determination data and the transmission determination target data. The determination unit 132 determines that the transmission condition is satisfied when the difference between the reference determination data and the transmission determination target data is equal to or greater than the threshold value. The determination unit 132 determines whether or not the difference from the transmission determination target data, which is the current determination data, is equal to or greater than the threshold value, using the reference determination data which is the determination data when the parameter was recalculated last time. For example, the determination unit 132 determines that the transmission condition is satisfied when it is determined that the brightness of the entire captured image has changed by the threshold value or more as a result of comparison between the reference determination data and the transmission determination target data.
  • the determination unit 132 may acquire operation information indicating the operation of the camera 100 operator with respect to the camera 100, and may determine whether or not the transmission condition is satisfied based on the acquired operation information. The determination unit 132 determines that the transmission condition is satisfied when the operator of the camera 100 performs a predetermined operation. The determination unit 132 determines that the transmission condition is satisfied when the power to the camera 100 is turned on. When the determination unit 132 determines that the transmission condition is satisfied, it issues a transmission trigger and transmits the transmission trigger to the transmission signal creation unit 133.
  • the transmission signal creation unit 133 receives a part of the captured image from the image processing unit 120.
  • the transmission signal creation unit 133 receives a part of the captured image, which is a moving image, as the transmission image.
  • the transmission signal creation unit 133 creates a transmission signal including a transmission image and metadata. For example, the transmission signal creation unit 133 creates a transmission signal by packing the transmission image and the metadata. When the transmission trigger is applied, the transmission signal creation unit 133 transmits the transmission signal to the communication unit 140.
  • the communication unit 140 is realized by, for example, a NIC (Network Interface Card), a communication circuit, or the like.
  • the communication unit 140 is connected to a predetermined network wirelessly or by wire, and communicates with the cloud server 200 or the like via the predetermined network.
  • the communication unit 140 sends a part of the image captured by the image pickup unit 110 to the cloud server 200.
  • the communication unit 140 transmits the transmission signal transmitted from the transmission signal creation unit 133 to the cloud server 200. That is, when the transmission unit 140 determines that the transmission determination unit 130 transmits to the cloud server 200, the communication unit 140 transmits the transmission signal created by the transmission signal creation unit 133 to the cloud server 200.
  • the communication unit 140 sends the transmission signal created by the transmission determination unit 130 to the cloud server 200. As a result, the communication unit 140 sends a part of the captured image (sending image) and the metadata related to the captured image to the cloud server 200. The communication unit 140 may separately send a part of the captured image and the metadata related to the captured image to the cloud server 200.
  • the camera 100 monitors the brightness of the entire image, the brightness of each area in the image, the change in color, and the like, and sends data to the cloud server 200 when a certain change is observed. Perform the processing for. As a result, the camera 100 can suppress the number of images to be transmitted to a small number, and can reduce the transmission band.
  • the communication unit 140 receives the parameters from the cloud server 200.
  • the communication unit 140 passes the received parameter to the image processing unit 120.
  • the camera 100 outputs an image (also referred to as an “output image”) image-processed by the image processing unit 120 to the server device 300.
  • the camera 100 is wiredly connected to the server device 300 by a cable or the like, and outputs an output image to the server device 300.
  • the camera 100 may be wirelessly connected to the server device 300 as long as the output image to the server device 300 can be output.
  • the camera 100 outputs an output image (main line image), which is a moving image to be output on the main line, to the server device 300.
  • the cloud server 200 which is an example of the external device for calculating the parameters, will be described.
  • the cloud server 200 has a calculation unit 210 and a communication unit 220.
  • the cloud server 200 is a large-scale arithmetic unit provided outside the camera 100.
  • the cloud server 200 communicates with the camera 100 by, for example, a communication unit 220 such as a NIC or a communication circuit.
  • the communication unit 220 receives a part of the captured image captured by the camera 100 from the camera 100.
  • the communication unit 220 receives the transmission signal from the camera 100.
  • the calculation unit 210 is realized by, for example, a CPU, an MPU, or the like executing a program (for example, a parameter calculation program) stored inside the cloud server 200 with a RAM or the like as a work area. Further, the arithmetic unit 210 may be realized by an integrated circuit such as an ASIC or FPGA.
  • the calculation unit 210 calculates parameters related to the processing of the captured image by using a part of the captured image received by the communication unit 220.
  • the calculation unit 210 calculates parameters related to processing of the captured image captured by the camera 100.
  • the calculation unit 210 performs image analysis based on the image and metadata included in the transmission signal transmitted from the camera 100, and calculates parameters according to the characteristics and situations of the image.
  • the calculation unit 210 calculates parameters related to brightness and color tone.
  • the calculation unit 210 calculates the gain parameter.
  • the calculation unit 210 calculates the tone parameters.
  • the calculation unit 210 calculates parameters related to hue and saturation.
  • the calculation unit 210 calculates a parameter related to the strength of high frequency enhancement.
  • the calculation unit 210 calculates a parameter related to the strength of noise removal.
  • the calculation unit 210 identifies the main subject from the image and calculates parameters that give brightness and color tones suitable for the subject.
  • the calculation unit 210 recognizes the types of imaging objects such as humans, animals, and plants, and calculates parameters corresponding to the imaging objects.
  • the communication unit 220 transmits the calculation result of the calculation unit 210 to the external device.
  • the communication unit 220 transmits the parameters calculated by the calculation unit 210 to the camera 100.
  • the server device 300 shown in FIG. 1 is a device that receives an output image from the camera 100.
  • the server device 300 stores the received output image in the storage unit.
  • the server device 300 receives an output image (main line image) which is a moving image from the camera 100.
  • the server device 300 may be connected to the camera 100 by wire or wirelessly as long as it can receive the output image from the camera 100.
  • FIG. 3 is a flowchart showing an example of the transmission determination process.
  • the camera 100 performs a standard determination data initialization process (step S101).
  • the judgment data preprocessing unit 131 of the camera 100 clears the reference judgment data as the initialization process and sets the initial value in the reference judgment data.
  • the camera 100 generates transmission determination target data (step S102).
  • the judgment data preprocessing unit 131 of the camera 100 generates the transmission judgment target data using the captured image.
  • the camera 100 calculates the difference from the reference determination data (step S103). For example, the judgment data preprocessing unit 131 of the camera 100 calculates the difference between the reference judgment data and the transmission judgment target data.
  • the camera 100 determines whether the difference is equal to or greater than the threshold value (step S104). For example, the determination unit 132 of the camera 100 determines whether the difference between the reference determination data and the transmission determination target data is equal to or greater than the threshold value.
  • step S104 When the difference is equal to or greater than the threshold value (step S104: Yes), the camera 100 replaces the reference determination data with the transmission determination target data (step S105).
  • the judgment data preprocessing unit 131 of the camera 100 sets the transmission judgment target data at that time as the reference judgment data.
  • the camera 100 issues a transmission trigger (step S106).
  • the determination unit 132 of the camera 100 transmits the issued transmission trigger to the transmission signal creation unit 133, and the transmission signal creation unit 133 that receives the transmission trigger transmits the transmission signal including the transmission image and the metadata to the communication unit 140.
  • the camera 100 sends the transmission signal to the cloud server 200. After that, the camera 100 returns to step S102 and repeats the process.
  • step S104 No
  • the camera 100 returns to step S102 and repeats the process.
  • the configuration of the image pickup apparatus is not limited to the configuration of the camera 100.
  • the transmission determination not only the image but also the sensor data detected by the sensor may be used as the transmission determination material. This point will be described with reference to FIG.
  • FIG. 4 is a diagram showing an example of an imaging system according to the second embodiment of the present disclosure. The same points as in the first embodiment will be appropriately described by adding the same reference numerals.
  • the image pickup system 1A includes a camera 100A, a cloud server 200, and a server device 300.
  • the camera 100A includes an image pickup unit 110, an image processing unit 120, a transmission determination unit 130, a communication unit 140, and a sensor unit 150.
  • the sensor unit 150 has a position sensor that detects the position of the camera 100A such as a GPS (Global Positioning System) sensor, and a posture sensor that detects the direction (posture) of the camera 100A such as a gyro sensor.
  • the sensor included in the sensor unit 150 is not limited to the above, and any sensor may be included as long as it is a sensor that detects sensor data that can be used for transmission determination.
  • the sensor unit 150 may have a sensor such as a temperature sensor, a humidity sensor, or an illuminance sensor.
  • the transmission determination unit 130 of the camera 100A determines transmission using the sensor data detected by the sensor unit 150.
  • the judgment data preprocessing unit 131 generates judgment data by processing the sensor data detected by the sensor unit 150.
  • the judgment data pre-processing unit 131 processes the sensor data according to the judgment target in the judgment unit 132.
  • the judgment data preprocessing unit 131 calculates the feature amount of the sensor data and outputs the calculated feature amount as the judgment data.
  • the judgment data preprocessing unit 131 passes the judgment data generated based on the sensor data at the time of judgment to the judgment unit 132 as transmission judgment target data.
  • the judgment data preprocessing unit 131 passes the judgment data generated based on the sensor data detected by the position sensor to the judgment unit 132 as transmission judgment target data.
  • the judgment data preprocessing unit 131 passes the judgment data indicating the position of the camera 100A to the judgment unit 132 as the transmission judgment target data.
  • the judgment data preprocessing unit 131 passes the judgment data generated based on the sensor data detected by the attitude sensor that detects the direction of the camera 100A to the judgment unit 132 as transmission judgment target data.
  • the determination unit 132 of the camera 100A determines whether or not the transmission condition is satisfied by using the determination data generated based on the sensor data. The determination unit 132 determines that the transmission condition is satisfied when the position of the camera 100A moves by using the position information of the camera 100A. When the difference between the position of the camera 100A indicated by the reference determination data and the position of the camera 100A indicated by the transmission determination target data is equal to or greater than the threshold value, the determination unit 132 determines that the position of the camera 100A moves and satisfies the transmission condition. do.
  • the determination unit 132 determines that the transmission condition is satisfied when it is detected that the direction of the camera 100A has changed.
  • the determination unit 132 changes the orientation of the camera 100A and satisfies the transmission condition. to decide.
  • the sensor is a temperature sensor, a humidity sensor, or an illuminance sensor
  • the determination unit 132 makes a determination using the temperature, humidity, or illuminance information.
  • the determination unit 132 determines that the transmission condition is satisfied when the difference between the temperature, humidity, or illuminance indicated by the reference determination data and the temperature, humidity, or illuminance indicated by the transmission determination target data is equal to or greater than the threshold value.
  • the communication unit 140 of the camera 100A transmits a transmission signal including the sensor data detected by the sensor unit 150 to the cloud server 200.
  • the communication unit 140 sends a transmission signal including sensor data indicating the direction of the camera to the cloud server 200.
  • the system configuration of the imaging system is not limited to the first embodiment and the second embodiment described above, and may be various system configurations.
  • the image pickup device for taking an image and the sending device for sending may be separate bodies. This point will be described with reference to FIG.
  • FIG. 5 is a diagram showing an example of an imaging system according to a third embodiment of the present disclosure. The same points as those in the first embodiment or the second embodiment will be appropriately described by adding the same reference numerals.
  • the image pickup system 1B includes a camera 100B, a cloud server 200, a server device 300, and a transmission device 400.
  • the configuration of the camera 100B will be described. As shown in FIG. 5, the camera 100B has an image pickup unit 110, an image processing unit 120, and a communication unit 140. As described above, the camera 100B differs from the camera 100A in that it does not have the transmission determination unit 130 and the sensor unit 150.
  • a transmission device 400 which is a separate housing, is attached to the camera 100B, and an image is transmitted from the image processing unit 120 of the camera 100B to the transmission determination unit 130 of the transmission device 400.
  • the connection mode between the camera 100B and the transmission device 400 may be any mode.
  • the camera 100B and the transmission device 400 may be communicably connected by wire or wirelessly, or the camera 100B and the transmission device 400 may be arranged at separate positions.
  • the transmission device 400 includes a transmission determination unit 130, a sensor unit 150, and a communication unit 440.
  • the transmission device 400 does not have to have the sensor unit 150.
  • the transmission determination unit 130 of the transmission device 400 makes a transmission determination using the image captured by the camera 100B. Since the transmission determination unit 130 of the transmission device 400 is the same as the transmission determination unit 130 of the camera 100 except that an image captured by the camera 100B, which is another device, is used, the description thereof will be omitted.
  • the communication unit 440 sends a part of the captured image captured by the camera 100B to the cloud server 200 that calculates the parameters related to the processing of the captured image.
  • the communication unit 440 transmits the transmission signal transmitted from the transmission signal creation unit 133 to the cloud server 200.
  • the cloud server 200 receives a transmission signal from the transmission device 400.
  • the cloud server 200 transmits the parameters calculated by the calculation unit 210 to the camera 100B.
  • the cameras 100, 100A, 100B, and the transmission device 400 described above may switch the processing according to the communication environment. Although this point will be described by taking the camera 100 of the image pickup system 1 as an example, the same processing may be applied to the camera 100A of the image pickup system 1A, the camera 100B of the image pickup system 1B, and the transmission device 400.
  • the camera 100 is a terminal device that can use 4G (4th generation mobile communication standard), LTE (Long Term Evolution), and 5G (5th generation mobile communication standard).
  • the camera 100 can use both the first communication by 4G or LTE and the second communication by 5G by the communication unit 140.
  • the camera 100 communicates with the cloud server 200 by the second communication in the case of a communication environment in which the second communication by 5G can be used, and by the first communication in the case of the communication environment in which the second communication cannot be used. Communicates with the cloud server 200.
  • the camera 100 switches the transmission mode to the cloud server 200 according to the communication environment.
  • the camera 100 transmits a part of the captured image to the cloud server 200 by the first communication. That is, when the captured image is transmitted to the cloud server 200 in a communication environment where only the first communication can be used, the camera 100 transmits a part of the captured image to the cloud server 200 as described above.
  • the camera 100 transmits the entire captured image to the cloud server 200 by the second communication.
  • the camera 100 transmits the entire moving image to the cloud server 200. That is, when the captured image is transmitted to the cloud server 200 in a communication environment where the second communication is available, the camera 100 transmits the entire captured image to the cloud server 200. In this way, the camera 100 can appropriately switch the transmission mode to the cloud server 200 according to the communication environment.
  • the image pickup device captures not only a moving image but also a still image.
  • the processing in this case will be described by taking the camera 100 as an example.
  • the camera 100 may be a so-called digital camera.
  • the same processing as the captured image is a moving image will be omitted as appropriate.
  • the image processing unit 120 of the camera 100 selects a part of the still image as the transmission image. For example, the image processing unit 120 selects a predetermined ratio (for example, 10% or the like) of a still image as a transmission image.
  • the image processing unit 120 may randomly select a predetermined ratio area as a transmission image, or may select a predetermined ratio area as a transmission image based on a predetermined reference. For example, the image processing unit 120 may select a central region in one still image or an edge region in one still image as a transmission image.
  • the transmission signal creation unit 133 of the camera 100 receives an image of a part of the still image as a transmission image.
  • the transmission signal creation unit 133 transmits the transmission signal including the transmission image and the metadata, which are images of a part of the still image, to the communication unit 140.
  • the parameters may be calculated for a plurality of image pickup devices. This point will be described by taking the imaging system 1A as an example.
  • the cloud server 200 receives a part of the captured image from each of the plurality of cameras 100A, performs a color matching calculation based on a part of the captured image from each of the received plurality of cameras 100A, and calculates a parameter. Then, the calculated parameters may be transmitted to each of the plurality of cameras 100A.
  • Each of the plurality of cameras 100A may transmit orientation information to the cloud server 200 together with a part of the captured image.
  • the cloud server 200 may calculate parameters for each group of cameras 100A corresponding to the orientation. For example, the cloud server 200 may calculate a parameter (first parameter) according to the captured image of the sun, targeting the group of the cameras 100A facing the sun (first group). The cloud server 200 transmits the first parameter to the cameras 100A of the first group. Further, the cloud server 200 may calculate a parameter (second parameter) according to the captured image for capturing the shade for the group (second group) of the camera 100A facing the shade. The cloud server 200 transmits the second parameter to the camera 100A of the second group.
  • the above-mentioned group (classification) of the camera 100A is an example, and desired grouping may be performed based on various conditions.
  • each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or part of them may be functionally or physically distributed / physically in arbitrary units according to various loads and usage conditions. Can be integrated and configured.
  • the cameras 100 and 100A (imaging apparatus) according to the embodiment include an imaging unit 110 and a communication unit 140 (transmitting unit).
  • the imaging unit 110 performs imaging.
  • the communication unit 140 sends a part of the captured image captured by the imaging unit 110 to the cloud server 200 (external device) that calculates parameters related to the processing of the captured image.
  • the cameras 100 and 100A according to the embodiment are operated by devices other than the cameras 100 and 100A by sending only a part of the captured images to the cloud server 200 that calculates the parameters related to the processing of the captured images. It is possible to suppress an increase in the amount of communication required for parameter calculation.
  • the communication unit 140 sends a part of the captured image to the cloud server 200 when the condition for sending to the cloud server 200 is satisfied.
  • the cameras 100 and 100A can suppress an increase in the number of transmissions to the cloud server 200 by transmitting to the cloud server 200 when the transmission conditions are satisfied. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
  • the cameras 100 and 100A have a determination unit 132.
  • the determination unit 132 determines whether or not the transmission condition is satisfied.
  • the communication unit 140 transmits a part of the captured image to the cloud server 200.
  • the cameras 100 and 100A have a configuration for determining the transmission condition, and when it is determined that the transmission condition is satisfied, the camera 100 and 100A transmit to the cloud server 200 to increase the number of transmissions to the cloud server 200. Can be suppressed. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
  • the cameras 100 and 100A have a judgment data preprocessing unit 131.
  • the judgment data preprocessing unit 131 generates judgment data used for judging the transmission condition.
  • the determination unit 132 determines whether or not the transmission condition is satisfied by using the determination data generated by the determination data preprocessing unit 131.
  • the cameras 100 and 100A have a configuration for generating data used for determining the transmission conditions, determine transmission using the generated data, and transmit the data to the cloud server 200, thereby transmitting to the cloud server. It is possible to suppress an increase in the number of transmissions to 200. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
  • the judgment data preprocessing unit 131 generates judgment data by processing the image or the sensor data detected by the sensor.
  • the cameras 100 and 100A make a determination of transmission using the determination data (judgment signal) generated by processing the image (image signal) or the sensor data (sensor signal), and transmit the data to the cloud server 200.
  • the determination data judgment signal
  • the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
  • the sensor is a position sensor, an attitude sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
  • the cameras 100 and 100A are transmitted using the judgment data (judgment signal) generated by processing the data (sensor signal) detected by the position sensor, the attitude sensor, the temperature sensor, the humidity sensor, or the illuminance sensor.
  • the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
  • the judgment unit 132 compares the first judgment data (standard judgment data) set as the judgment standard with the second judgment data (sending judgment target data) generated after the setting of the first judgment data. Based on this, it is determined whether or not the transmission condition is satisfied.
  • the cameras 100 and 100A determine that the transmission condition is satisfied based on the determination criteria, they can transmit to the cloud server 200 to suppress an increase in the number of transmissions to the cloud server 200. can. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
  • the determination unit 132 determines that the transmission condition is satisfied when the difference between the first determination data and the second determination data is equal to or greater than the threshold value.
  • the cameras 100 and 100A increase the number of transmissions to the cloud server 200 by transmitting the data to the cloud server 200 when the difference between the first determination data and the second determination data is equal to or greater than the threshold value. It can be suppressed. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
  • the communication unit 140 sends a part of the captured image to the cloud server 200 when the operation to the cameras 100 and 100A satisfies the sending condition.
  • the cameras 100 and 100A are likely to need to recalculate the parameters by transmitting to the cloud server 200. Can be sent to the cloud server 200 only. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
  • the communication unit 140 sends a part of the captured image to the cloud server 200.
  • the parameters of the cameras 100 and 100A need to be recalculated by sending the cameras 100 and 100A to the cloud server 200 when the operator of the cameras 100 and 100A performs a predetermined operation. Only in this case can the transmission to the cloud server 200 be performed. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
  • the communication unit 140 sends a part of the captured image to the cloud server 200.
  • the cameras 100 and 100A need to recalculate the parameters due to the change of the image pickup target by sending to the cloud server 200. It is possible to send to the cloud server 200 only when there is a high possibility. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
  • the communication unit 140 sends a part of the captured image to the cloud server 200.
  • the cameras 100 and 100A send out to the cloud server 200 when the power to the cameras 100 and 100A is turned on, so that the cloud server 200 is available only when there is a high possibility that the parameters need to be recalculated. Can be sent to. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
  • the captured image is a moving image, and a part of the captured image is a part of the moving image.
  • the cameras 100 and 100A send only a part of the moving image (for example, a still image or several frames of the moving image) to the cloud server 200, so that the parameters by the devices other than the cameras 100 and 100A are used. It is possible to suppress an increase in the amount of communication required for calculation.
  • the captured image is one still image, and a part of the captured image is a part of a region in one still image.
  • the cameras 100 and 100A are based on devices other than the cameras 100 and 100A by sending only a part of one still image (for example, a part of the area of one still image) to the cloud server 200. It is possible to suppress an increase in the amount of communication required for parameter calculation.
  • the communication unit 140 sends metadata related to the captured image to the cloud server 200.
  • the cameras 100 and 100A can send the metadata related to the captured image to the cloud server 200, thereby enabling the calculation of appropriate parameters in the cloud server 200.
  • the communication unit 140 sends metadata indicating the state of the cameras 100 and 100A at the time of capturing the captured image, or the specifications of the cameras 100 and 100A.
  • the cameras 100 and 100A send metadata related to the state (position, orientation, etc.) and specifications (number of pixels, frame rate, etc.) image at the time of imaging to the cloud server 200, thereby causing the cloud server 200. It is possible to calculate appropriate parameters.
  • the cameras 100 and 100A have a transmission signal creating unit 133.
  • the transmission signal creation unit 133 creates a transmission signal including the transmission image and the metadata which are a part of the captured image.
  • the communication unit 140 sends the transmission signal created by the transmission signal creation unit 133 to the cloud server 200.
  • the cameras 100 and 100A can send a part of the captured image to the cloud server 200 together with the corresponding metadata by sending the transmission signal including the transmission image and the metadata to the cloud server 200. ..
  • the cameras 100 and 100A can suppress an increase in the number of transmissions to the cloud server 200 and enable calculation of appropriate parameters in the cloud server 200.
  • the cameras 100 and 100A have an image processing unit 120.
  • the image processing unit 120 performs image processing using the parameters received from the cloud server 200.
  • the cameras 100 and 100A can perform appropriate image processing by performing pixel processing using the parameters calculated by the cloud server 200.
  • the image processing unit 120 has a process of adjusting the brightness of the captured image, a process of adjusting the contrast of the captured image, a process of emphasizing a high frequency component of the captured image, or a process of removing noise of the captured image. Do at least one of them.
  • the cameras 100 and 100A are appropriate by performing pixel processing such as brightness adjustment, contrast adjustment, high frequency component enhancement, and noise removal on the captured image using the parameters calculated by the cloud server 200. Image processing can be performed.
  • a cloud such as a cloud server 200 of a moving image captured by an image pickup device such as a camera 100 or 100A
  • advanced image processing becomes possible by utilizing abundant processing capacity on the cloud. Since image processing is performed after transmission, it is desirable to avoid image deterioration due to compression. Therefore, it is necessary to send all the raw data, which has a large amount of data, from the image pickup device to the cloud, which requires high transmission capacity. Due to such transmission, a delay may occur and an image may not be obtained in real time.
  • the real-time image output can be ensured by incorporating the processing engine (image processing unit 120) into the cameras 100 and 100A. Further, in the imaging systems 1 and 1A, limited information of a part of the captured image (still image, etc.) is transmitted from the cameras 100 and 100A to the cloud server 200, and the optimum parameters are calculated on the cloud server 200. , The parameters are sent back to the cameras 100 and 100A. As a result, in the imaging systems 1 and 1A, the transmission band can be reduced.
  • the transmission from the cameras 100 and 100A is a specific trigger condition such as when the power is turned on, when the shooting target changes such as shaking the camera greatly, or when the operator of the cameras 100 and 100A performs a specific menu operation. Only if it matches. As a result, the cameras 100 and 100A can immediately follow the situation where the processing parameters need to be changed while narrowing down the transmission information and reducing the band.
  • the transmission device 400 includes a communication unit 440 (sending unit).
  • the communication unit 440 sends a part of the captured image to the cloud server 200 (external device) that calculates the parameters related to the processing of the captured image.
  • the transmission device 400 is a device other than the camera 100B that captures the captured image by transmitting only a part of the captured image to the cloud server 200 that calculates the parameters related to the processing of the captured image. It is possible to suppress an increase in the amount of communication required for parameter calculation.
  • the cloud server 200 has a communication unit 220 that receives a part of an image captured by the cameras 100 and 100A (imaging device) from an external device, and an image pickup received by the communication unit 220.
  • a calculation unit 210 for calculating parameters related to processing of a captured image by using a part of an image is provided.
  • the cloud server 200 receives only a part of the captured image captured by the cameras 100 and 100A, and calculates the parameters related to the processing of the captured image by the device other than the cameras 100 and 100A. It is possible to suppress an increase in the amount of communication required for parameter calculation.
  • the imaging systems 1 and 1A capture images with the cameras 100 and 100A (imaging devices) that perform imaging and send a part of the captured images to an external device that calculates parameters related to the processing of the captured images. It has a cloud server 200 that receives a part of an image from an image pickup apparatus and calculates parameters related to processing of the captured image using a part of the received captured image.
  • the imaging systems 1 and 1A receive only a part of the captured image captured by the cameras 100 and 100A, and calculate the parameters related to the processing of the captured image to obtain the parameters other than the cameras 100 and 100A. It is possible to suppress an increase in the amount of communication required for parameter calculation by the device.
  • FIG. 6 is a hardware configuration diagram showing an example of a computer that realizes the functions of each device.
  • the functions of the cameras 100, 100A, and 100B as information devices may be realized by the computer 1000 shown in FIG.
  • the transmission device 400 will be described as an example.
  • the computer 1000 has a CPU 1100, a RAM 1200, a ROM (Read Only Memory) 1300, an HDD (Hard Disk Drive) 1400, a communication interface 1500, and an input / output interface 1600.
  • Each part of the computer 1000 is connected by a bus 1050.
  • the CPU 1100 operates based on the program stored in the ROM 1300 or the HDD 1400, and controls each part. For example, the CPU 1100 expands the program stored in the ROM 1300 or the HDD 1400 into the RAM 1200, and executes processing corresponding to various programs.
  • the ROM 1300 stores a boot program such as a BIOS (Basic Input Output System) executed by the CPU 1100 when the computer 1000 is started, a program depending on the hardware of the computer 1000, and the like.
  • BIOS Basic Input Output System
  • the HDD 1400 is a computer-readable recording medium that non-temporarily records a program executed by the CPU 1100 and data used by such a program.
  • the HDD 1400 is a recording medium for recording an information processing program such as a signal processing program according to the present disclosure, which is an example of program data 1450.
  • the communication interface 1500 is an interface for the computer 1000 to connect to an external network 1550 (for example, the Internet).
  • the CPU 1100 receives data from another device or transmits data generated by the CPU 1100 to another device via the communication interface 1500.
  • the input / output interface 1600 is an interface for connecting the input / output device 1650 and the computer 1000.
  • the CPU 1100 receives data from an input device such as a keyboard or mouse via the input / output interface 1600. Further, the CPU 1100 transmits data to an output device such as a display, a speaker, or a printer via the input / output interface 1600. Further, the input / output interface 1600 may function as a media interface for reading a program or the like recorded on a predetermined recording medium (media).
  • the media is, for example, an optical recording medium such as DVD (Digital Versatile Disc) or PD (Phase change rewritable Disk), a magneto-optical recording medium such as MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.
  • an optical recording medium such as DVD (Digital Versatile Disc) or PD (Phase change rewritable Disk)
  • a magneto-optical recording medium such as MO (Magneto-Optical disk)
  • tape medium such as DVD (Digital Versatile Disc) or PD (Phase change rewritable Disk)
  • MO Magneto-optical disk
  • the CPU 1100 of the computer 1000 realizes the functions of the transmission determination unit 130 and the like by executing the information processing program loaded on the RAM 1200.
  • the information processing program according to the present disclosure and the data in the storage unit of the cloud server 200 are stored in the HDD 1400.
  • the CPU 1100 reads the program data 1450 from the HDD 1400 and executes the program, but as another example, these programs may be acquired from another device via the external network 1550.
  • the present technology can also have the following configurations.
  • the sending unit The imaging device according to (1), wherein a part of the captured image is transmitted to the external device when the conditions for sending to the external device are satisfied.
  • Judgment data pre-processing unit that generates judgment data used to judge the transmission condition, Further prepare The judgment unit The image pickup apparatus according to (3), wherein it is determined whether or not the transmission condition is satisfied by using the determination data generated by the determination data preprocessing unit.
  • the judgment data pre-processing unit The image pickup apparatus according to (4), wherein the judgment data is generated by processing an image or sensor data detected by a sensor.
  • the sensor is The image pickup apparatus according to (5), which is a position sensor, a posture sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
  • the judgment unit Based on the comparison between the first judgment data set as the judgment criterion and the second judgment data generated after the setting of the first judgment data, it is judged whether or not the transmission condition is satisfied (4) to.
  • the imaging device according to any one of (6).
  • the judgment unit The image pickup apparatus according to (7), wherein it is determined that the transmission condition is satisfied when the difference between the first determination data and the second determination data is equal to or greater than a threshold value.
  • the sending unit The image pickup device according to any one of (2) to (8), wherein a part of the captured image is sent to the external device when the operation to the image pickup device satisfies the transmission condition.
  • the sending unit The imaging device according to (9), wherein a part of the captured image is sent to the external device when the operator of the imaging device performs a predetermined operation.
  • the sending unit The imaging device according to (9) or (10), wherein a part of the captured image is sent to the external device when the position or posture of the imaging device is changed.
  • the sending unit The image pickup device according to any one of (9) to (11), wherein a part of the captured image is sent to the external device when the power to the image pickup device is turned on.
  • the captured image is a moving image and is The image pickup apparatus according to any one of (1) to (12), wherein a part of the captured image is a part of the image in the moving image.
  • the captured image is one still image, and is The image pickup apparatus according to any one of (1) to (12), wherein a part of the captured image is a part of a region in the one still image.
  • the sending unit The imaging device according to any one of (1) to (14), which sends metadata related to the captured image to the external device.
  • the sending unit The imaging device according to (15), which sends out the metadata indicating the state of the imaging device at the time of capturing the captured image or the specifications of the imaging device.
  • a transmission signal creating unit that creates a transmission signal including a transmission image that is a part of the captured image and the metadata. Further prepare The sending unit The image pickup apparatus according to (15) or (16), wherein the transmission signal created by the transmission signal creation unit is transmitted to the external device.
  • the image processing unit that performs image processing using the parameters received from the external device.
  • the image pickup apparatus according to any one of (1) to (17).
  • the image processing unit The image processing includes a process of adjusting the brightness of the captured image, a process of adjusting the contrast of the captured image, a process of emphasizing a high frequency component of the captured image, and a process of removing noise of the captured image.
  • (20) Take an image and A transmission method for executing a process of transmitting a part of an captured image to an external device that calculates parameters related to the processing of the captured image.
  • (21) Take an image and A transmission program that executes a process of transmitting a part of the captured image to an external device that calculates parameters related to the processing of the captured image.
  • (22) A transmission unit that sends a part of the captured image to an external device that calculates parameters related to the processing of the captured image.
  • (23) A communication unit that receives a part of the captured image captured by the image pickup device from an external device, An arithmetic unit that calculates parameters related to the processing of the captured image using a part of the captured image received by the communication unit, and a calculation unit.
  • An imaging device that performs imaging and sends a part of the captured image to an external device that calculates parameters related to the processing of the captured image.
  • a cloud server that receives a part of the captured image from the image pickup device and calculates parameters related to the processing of the captured image by using a part of the received image. Imaging system with.
  • Imaging system 100 camera (imaging device) 110 Imaging unit 120 Image processing unit 130 Transmission judgment unit 131 Judgment data preprocessing unit 132 Judgment unit 133 Transmission signal creation unit 140 Communication unit (transmission unit) 200 Cloud server (external device) 210 Calculation unit 220 Communication unit 300 Server device

Abstract

An imaging device according to the present disclosure comprises an imaging unit that captures images, and a transmission unit that transmits a part of a captured image captured by the imaging unit to an external device that calculates a parameter relating to the processing of the captured image.

Description

撮像装置、送出方法、送出装置、クラウドサーバ及び撮像システムImaging device, transmission method, transmission device, cloud server and imaging system
 本開示は、撮像装置、送出方法、送出装置、クラウドサーバ及び撮像システムに関する。 The present disclosure relates to an image pickup device, a transmission method, a transmission device, a cloud server, and an image pickup system.
 撮像装置が用いるパラメータを撮像装置以外の装置により算出する技術が知られている。例えば、撮像装置が撮影した画像を受信したサーバが算出したパラメータを撮像装置へ送信し、撮像装置がサーバから受信したパラメータを用いて画像処理を行う(例えば特許文献1)。 A technique for calculating parameters used by an image pickup device by a device other than the image pickup device is known. For example, the parameters calculated by the server that received the image captured by the image pickup device are transmitted to the image pickup device, and the image pickup device performs image processing using the parameters received from the server (for example, Patent Document 1).
特開2013-239861号公報Japanese Unexamined Patent Publication No. 2013-239861
 しかしながら、従来技術においては、ユーザに設定に関する知識や技術がない場合やカメラの性能が低い場合でも、高品質かつ高精細な画像を生成することを目的としており、撮像装置とサーバとの間の通信量については考慮されていない。そのため、従来技術においては、画像のデータ量の増大に伴い、撮像装置とサーバとの間の通信量が増大する。そのため、撮像装置以外の装置でパラメータを算出する際の通信量を抑制することが望まれている。 However, the prior art aims to generate high quality and high definition images even if the user has no knowledge or skills regarding settings or the performance of the camera is low, and is between the image pickup device and the server. No consideration is given to the amount of traffic. Therefore, in the prior art, the amount of communication between the image pickup apparatus and the server increases as the amount of image data increases. Therefore, it is desired to suppress the amount of communication when calculating parameters with a device other than the image pickup device.
 そこで、本開示では、撮像装置以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる撮像装置、送出方法、送出装置、クラウドサーバ及び撮像システムを提案する。 Therefore, the present disclosure proposes an image pickup device, a transmission method, a transmission device, a cloud server, and an image pickup system that can suppress an increase in the amount of communication required for parameter calculation by a device other than the image pickup device.
 上記の課題を解決するために、本開示に係る一形態の撮像装置は、撮像を行う撮像部と、前記撮像部により撮像された撮像画像の一部を、前記撮像画像の処理に関するパラメータを算出する外部装置に送出する送出部と、を備える。 In order to solve the above-mentioned problems, in one embodiment of the image pickup apparatus according to the present disclosure, parameters related to the processing of the image pickup image are calculated for a part of the image pickup unit that performs image pickup and the image pickup image captured by the image pickup unit. It is provided with a sending unit for sending to an external device.
本開示の第1の実施形態に係る撮像システムの一例を示す図である。It is a figure which shows an example of the image pickup system which concerns on 1st Embodiment of this disclosure. 送出判断部の構成の一例を示す図である。It is a figure which shows an example of the structure of a transmission determination part. 送出判断の処理の一例を示すフローチャートである。It is a flowchart which shows an example of the process of transmission determination. 本開示の第2の実施形態に係る撮像システムの一例を示す図である。It is a figure which shows an example of the image pickup system which concerns on the 2nd Embodiment of this disclosure. 本開示の第3の実施形態に係る撮像システムの一例を示す図である。It is a figure which shows an example of the image pickup system which concerns on 3rd Embodiment of this disclosure. 各装置の機能を実現するコンピュータの一例を示すハードウェア構成図である。It is a hardware block diagram which shows an example of the computer which realizes the function of each device.
 以下に、本開示の実施形態について図面に基づいて詳細に説明する。なお、この実施形態により本願にかかる撮像装置、送出方法、送出装置、クラウドサーバ及び撮像システムが限定されるものではない。また、以下の各実施形態において、同一の部位には同一の符号を付することにより重複する説明を省略する。 Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. It should be noted that this embodiment does not limit the image pickup device, the transmission method, the transmission device, the cloud server, and the image pickup system according to the present application. Further, in each of the following embodiments, duplicate description will be omitted by assigning the same reference numerals to the same parts.
 以下に示す項目順序に従って本開示を説明する。
  1.第1の実施形態
   1-1.本開示の第1の実施形態に係る撮像システムの構成及び処理
   1-2.送出判断の手順
  2.第2の実施形態
   2-1.本開示の第2の実施形態に係る撮像システムの構成及び処理
  3.第3の実施形態
   3-1.本開示の第3の実施形態に係る撮像システムの構成及び処理
  4.通信環境に応じた処理
  5.その他の実施形態
   5-1.静止画像の例
   5-2.その他の処理例
   5-3.その他
  6.実施形態に係る効果
  7.ハードウェア構成
The present disclosure will be described according to the order of items shown below.
1. 1. First Embodiment 1-1. Configuration and processing of the imaging system according to the first embodiment of the present disclosure 1-2. Sending judgment procedure 2. Second Embodiment 2-1. 2. Configuration and processing of the imaging system according to the second embodiment of the present disclosure. Third Embodiment 3-1. 3. Configuration and processing of the imaging system according to the third embodiment of the present disclosure. Processing according to the communication environment 5. Other Embodiments 5-1. Example of still image 5-2. Other processing examples 5-3. Others 6. Effect of embodiment 7. Hardware configuration
[1.第1の実施形態]
[1-1.本開示の第1の実施形態に係る撮像システムの構成及び処理]
 図1に示す撮像システム1について説明する。図1は、本開示の第1の実施形態に係る撮像システムの一例を示す図である。図1に示すように、撮像システム1は、カメラ100と、クラウドサーバ200と、サーバ装置300とが含まれる。なお、図1に示した撮像システム1には、複数のカメラ100や、複数のクラウドサーバ200や、複数のサーバ装置300が含まれてもよい。以下、各装置の構成及び処理について説明する。
[1. First Embodiment]
[1-1. Configuration and processing of the imaging system according to the first embodiment of the present disclosure]
The image pickup system 1 shown in FIG. 1 will be described. FIG. 1 is a diagram showing an example of an imaging system according to the first embodiment of the present disclosure. As shown in FIG. 1, the image pickup system 1 includes a camera 100, a cloud server 200, and a server device 300. The image pickup system 1 shown in FIG. 1 may include a plurality of cameras 100, a plurality of cloud servers 200, and a plurality of server devices 300. Hereinafter, the configuration and processing of each device will be described.
 (撮像装置の構成説明)
 カメラ100は、撮像を行う撮像装置である。カメラ100は、撮像した撮像画像の一部を、カメラ100が用いる画像処理パラメータ(以下単に「パラメータ」ともいう)を算出するクラウドサーバ200に送出する。カメラ100は、クラウドサーバ200から受信したパラメータを用いて画像処理を行う。なお、カメラ100により撮像される撮像画像は、動画像または静止画像のいずれであってもよいが、以下ではカメラ100がビデオカメラであり、カメラ100により撮像される撮像画像が動画像である場合を一例として説明する。
(Explanation of the configuration of the image pickup device)
The camera 100 is an imaging device that performs imaging. The camera 100 sends a part of the captured image to the cloud server 200 that calculates the image processing parameters (hereinafter, also simply referred to as “parameters”) used by the camera 100. The camera 100 performs image processing using the parameters received from the cloud server 200. The captured image captured by the camera 100 may be either a moving image or a still image, but in the following, when the camera 100 is a video camera and the captured image captured by the camera 100 is a moving image. Will be described as an example.
 以下、カメラ100の構成及び各構成の処理について詳細に説明する。図1に示すように、カメラ100は、撮像部110と、画像処理部120と、送出判断部130と、通信部140とを有する。 Hereinafter, the configuration of the camera 100 and the processing of each configuration will be described in detail. As shown in FIG. 1, the camera 100 includes an image pickup unit 110, an image processing unit 120, a transmission determination unit 130, and a communication unit 140.
 撮像部110は、撮像を行う。例えば、撮像部110には、CMOS(Complementary Metal Oxide Semiconductor:相補型金属酸化膜半導体)イメージセンサが用いられる。なお、撮像部110には、CMOSイメージセンサに限らず、CCD(Charge Coupled Device:電荷結合素子)イメージセンサ等、種々のイメージセンサが用いられてもよい。なお、撮像部110は、レンズ等の光学部材やその光学部材のフォーカス、ズーム、絞りに関する調整を行う調整機構等を有してもよい。撮像部110は、撮像した撮像画像を画像処理部120へ渡す。 The imaging unit 110 performs imaging. For example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor is used for the image pickup unit 110. The image pickup unit 110 is not limited to a CMOS image sensor, and various image sensors such as a CCD (Charge Coupled Device) image sensor may be used. The image pickup unit 110 may have an optical member such as a lens and an adjustment mechanism for adjusting the focus, zoom, and aperture of the optical member. The image pickup unit 110 passes the captured captured image to the image processing unit 120.
 画像処理部120は、例えば、CPU(Central Processing Unit)やMPU(Micro Processing Unit)等によって、カメラ100内部に記憶されたプログラム(例えば、画像処理プログラムや送出プログラム等)がRAM(Random Access Memory)等を作業領域として実行されることにより実現される。また、画像処理部120は、例えば、ASIC(Application Specific Integrated Circuit)やFPGA(Field Programmable Gate Array)等の集積回路により実現されてもよい。 In the image processing unit 120, for example, a program (for example, an image processing program, a transmission program, etc.) stored inside the camera 100 by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like is a RAM (Random Access Memory). It is realized by executing such as as a work area. Further, the image processing unit 120 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).
 画像処理部120は、撮像部110により撮像された撮像画像の画像処理を行う。画像処理部120は、クラウドサーバ200から受信したパラメータを用いて処理を行う。画像処理部120は、明るさや色調に関するパラメータを用いて処理を行う。画像処理部120は、ゲインのパラメータを用いて、撮像画像の明るさを調整する処理を行う。画像処理部120は、トーンのパラメータを用いて、撮像画像の明るさやコントラストを調整する処理を行う。 The image processing unit 120 performs image processing of the captured image captured by the image pickup unit 110. The image processing unit 120 performs processing using the parameters received from the cloud server 200. The image processing unit 120 performs processing using parameters related to brightness and color tone. The image processing unit 120 performs processing for adjusting the brightness of the captured image by using the gain parameter. The image processing unit 120 performs processing for adjusting the brightness and contrast of the captured image by using the tone parameters.
 画像処理部120は、色相や彩度に関するパラメータを用いて処理を行う。画像処理部120は、高周波強調の強さに関するパラメータを用いて、撮像画像の高周波成分を強調する処理を行う。画像処理部120は、ノイズ除去の強さに関するパラメータを用いて、撮像画像のノイズを除去する処理を行う。上記のように、画像処理部120は、画像処理として、撮像画像の明るさを調整する処理、撮像画像のコントラストを調整する処理、撮像画像の高周波成分を強調する処理、または撮像画像のノイズを除去する処理のうち、少なくとも1つを行う。なお、上記は一例であり、画像処理部120が行う画像処理は上記に限られない。 The image processing unit 120 performs processing using parameters related to hue and saturation. The image processing unit 120 performs processing for emphasizing the high frequency component of the captured image by using the parameter related to the intensity of high frequency enhancement. The image processing unit 120 performs processing for removing noise in the captured image by using a parameter related to the strength of noise removal. As described above, as image processing, the image processing unit 120 performs a process of adjusting the brightness of the captured image, a process of adjusting the contrast of the captured image, a process of emphasizing a high frequency component of the captured image, or a noise of the captured image. Perform at least one of the removal processes. The above is an example, and the image processing performed by the image processing unit 120 is not limited to the above.
 画像処理部120は、画像処理を行った撮像画像を送出判断部130へ渡す。画像処理部120は、画像処理前の撮像画像を送出判断部130へ渡してもよい。画像処理部120は、図2に示すように、送出判断部130の判断データ前処理部131に、撮像画像を渡す。 The image processing unit 120 passes the captured image that has undergone image processing to the transmission determination unit 130. The image processing unit 120 may pass the captured image before image processing to the transmission determination unit 130. As shown in FIG. 2, the image processing unit 120 passes the captured image to the determination data preprocessing unit 131 of the transmission determination unit 130.
 画像処理部120は、動画像である撮像画像中の一部を送出画像として選択する。例えば、画像処理部120は、動画像のうち所定数(例えば一つ等)の静止画像を送出画像として選択する。ここでいう所定数の静止画像には、動画像中の所定区間(所定フレーム)切り出した動画像も含まれる。すなわち、撮像画像が動画像である場合、撮像画像の一部は、動画像中の所定区間(所定フレーム)を切り出した動画像であってもよい。画像処理部120は、ランダムに所定数の静止画像を送出画像として選択してもよいし、所定の基準を基に所定数の静止画像を送出画像として選択してもよい。 The image processing unit 120 selects a part of the captured image, which is a moving image, as a transmission image. For example, the image processing unit 120 selects a predetermined number (for example, one or the like) of still images among the moving images as the transmission image. The predetermined number of still images referred to here also includes moving images cut out in a predetermined section (predetermined frame) in the moving image. That is, when the captured image is a moving image, a part of the captured image may be a moving image obtained by cutting out a predetermined section (predetermined frame) in the moving image. The image processing unit 120 may randomly select a predetermined number of still images as the transmission image, or may select a predetermined number of still images as the transmission image based on a predetermined reference.
 例えば、画像処理部120は、動画像の開始時に対応する静止画像や、動画像の途中に対応する静止画像や、動画像の終了時に対応する静止画像を送出画像として選択してもよい。なお、上記は一例であり、画像処理部120は、撮像画像の一部であれば、どのような画像を送出画像として選択してもよい。画像処理部120は、図2に示すように、送出判断部130の送出信号作成部133に、撮像画像の一部を送出画像として渡す。 For example, the image processing unit 120 may select a still image corresponding to the start of the moving image, a still image corresponding to the middle of the moving image, or a still image corresponding to the end of the moving image as the transmission image. The above is an example, and the image processing unit 120 may select any image as a transmission image as long as it is a part of the captured image. As shown in FIG. 2, the image processing unit 120 passes a part of the captured image as a transmission image to the transmission signal creation unit 133 of the transmission determination unit 130.
 画像処理部120は、送出判断部130の送出信号作成部133に、撮像画像に関連するメタデータを渡す。メタデータは、例えば撮像画像の撮像時のカメラ100の各種設定、カメラ100の画素数、フレームレート、色域、レンズの種類、フォーカスポジション、F値、またはズーム比率等である。また、メタデータは、カメラ100の向き、カメラ100の位置が含まれてもよい。なお、送出判断部130は、メタデータを記憶する記憶部からメタデータを取得してもよい。 The image processing unit 120 passes the metadata related to the captured image to the transmission signal creation unit 133 of the transmission determination unit 130. The metadata is, for example, various settings of the camera 100 at the time of capturing an captured image, the number of pixels of the camera 100, a frame rate, a color gamut, a lens type, a focus position, an F value, a zoom ratio, and the like. Further, the metadata may include the orientation of the camera 100 and the position of the camera 100. The transmission determination unit 130 may acquire the metadata from the storage unit that stores the metadata.
 送出判断部130は、クラウドサーバ200への送出の判断や、クラウドサーバ200へ送出する送出信号の作成を行う。送出判断部130は、例えば、CPUやMPU等によって、カメラ100内部に記憶されたプログラム(例えば、判断データ生成プログラムや送出判断プログラムや送出信号作成プログラム等)がRAM等を作業領域として実行されることにより実現される。また、送出判断部130は、例えば、ASICやFPGA等の集積回路により実現されてもよい。 The transmission determination unit 130 determines transmission to the cloud server 200 and creates a transmission signal to be transmitted to the cloud server 200. In the transmission determination unit 130, for example, a program stored inside the camera 100 (for example, a determination data generation program, a transmission determination program, a transmission signal creation program, etc.) is executed by a CPU, MPU, or the like using the RAM or the like as a work area. It will be realized by. Further, the transmission determination unit 130 may be realized by an integrated circuit such as an ASIC or FPGA.
 図2に示すように、送出判断部130は、判断データ前処理部131と、判断部132と、送出信号作成部133とを有する。図2は、送出判断部の構成の一例を示す図である。 As shown in FIG. 2, the transmission determination unit 130 includes a determination data preprocessing unit 131, a determination unit 132, and a transmission signal creation unit 133. FIG. 2 is a diagram showing an example of the configuration of the transmission determination unit.
 判断データ前処理部131は、送出を行うかどうか判断に用いる判断データを生成する。判断データ前処理部131は、撮像部110により撮像された撮像画像を加工することにより判断データを生成する。判断データ前処理部131は、生成した判断データを判断部132に渡す。 Judgment data preprocessing unit 131 generates judgment data used for judgment as to whether or not to send. The judgment data preprocessing unit 131 generates judgment data by processing the image captured by the image pickup unit 110. The judgment data preprocessing unit 131 passes the generated judgment data to the judgment unit 132.
 判断データ前処理部131は、判断部132での判断対象に応じて、画像を加工する。判断データ前処理部131は、パラメータを再計算するかどうかの判断基準とする判断データを生成する。判断データ前処理部131は、撮像画像の特徴量を計算し、計算した特徴量を判断データとして出力する。判断データ前処理部131は、撮像画像全体の輝度値の平均を計算し、計算した輝度値の平均を判断データとして出力する。判断データ前処理部131は、撮像画像のうち一部(特定部位)の輝度値の平均を計算し、計算した輝度値の平均を判断データとして出力する。例えば、判断データ前処理部131は、撮像画像を一定の範囲で複数の領域に分割して、各領域内の積分結果を判断データとして出力してもよい。例えば、判断データ前処理部131は、撮像画像内の高周波成分を検出し、積分結果を判断データとして出力してもよい。 The judgment data pre-processing unit 131 processes the image according to the judgment target in the judgment unit 132. The judgment data preprocessing unit 131 generates judgment data as a judgment criterion for whether or not to recalculate the parameters. The judgment data preprocessing unit 131 calculates the feature amount of the captured image and outputs the calculated feature amount as the judgment data. The judgment data preprocessing unit 131 calculates the average of the luminance values of the entire captured image, and outputs the average of the calculated luminance values as the determination data. The judgment data preprocessing unit 131 calculates the average of the luminance values of a part (specific portion) of the captured image, and outputs the average of the calculated luminance values as the determination data. For example, the judgment data preprocessing unit 131 may divide the captured image into a plurality of regions within a certain range and output the integration result in each region as judgment data. For example, the judgment data preprocessing unit 131 may detect a high frequency component in the captured image and output the integration result as judgment data.
 判断データ前処理部131は、判断時の撮像画像を基に生成した判断データを送出判断対象データとして判断部132に渡す。判断データ前処理部131は、初期化処理により基準判断データに初期値を設定する。また、判断データ前処理部131は、判断部132により送出を行うと判断された場合、基準判断データを送出判断対象データに差し替える。判断データ前処理部131は、設定した基準判断データを判断部132に渡す。なお、判断部132は、基準判断データを記憶する記憶部から基準判断データを取得してもよい。 The judgment data pre-processing unit 131 passes the judgment data generated based on the captured image at the time of judgment to the judgment unit 132 as transmission judgment target data. The judgment data preprocessing unit 131 sets an initial value in the reference judgment data by the initialization processing. Further, the judgment data preprocessing unit 131 replaces the reference judgment data with the transmission judgment target data when the judgment unit 132 determines that the transmission is to be performed. The judgment data preprocessing unit 131 passes the set standard judgment data to the judgment unit 132. The determination unit 132 may acquire the reference determination data from the storage unit that stores the reference determination data.
 判断部132は、送出条件を満たすかどうかを判定する。送出条件は、カメラ100の操作者等により設定されてもよいし、カメラ100の記憶部に記憶されてもよい。判断部132は、判断データ前処理部131により生成された判断データを用いて、送出条件を満たすかどうかを判断する。判断部132は、判断データ前処理部131から送られてくる判断データを用いて、パラメータの再計算が必要かどうかを判断する。 The determination unit 132 determines whether or not the transmission condition is satisfied. The transmission conditions may be set by the operator of the camera 100 or the like, or may be stored in the storage unit of the camera 100. The determination unit 132 determines whether or not the transmission condition is satisfied by using the determination data generated by the determination data preprocessing unit 131. The determination unit 132 determines whether or not the parameter needs to be recalculated by using the determination data sent from the determination data preprocessing unit 131.
 判断部132は、基準判断データと、送出判断対象データとの比較に基づいて、送出条件を満たすかどうかを判断する。判断部132は、基準判断データと送出判断対象データとの差分が閾値以上の場合、送出条件を満たすと判断する。判断部132は、前回パラメータの再計算を行った時の判断データである基準判断データを用いて、現在の判断データである送出判断対象データとの差分が閾値以上となったかどうかで判断する。例えば、判断部132は、基準判断データと送出判断対象データとの比較の結果、撮像画像全体の輝度が閾値以上変化したと判断した場合、送出条件を満たすと判断する。 The determination unit 132 determines whether or not the transmission condition is satisfied based on the comparison between the reference determination data and the transmission determination target data. The determination unit 132 determines that the transmission condition is satisfied when the difference between the reference determination data and the transmission determination target data is equal to or greater than the threshold value. The determination unit 132 determines whether or not the difference from the transmission determination target data, which is the current determination data, is equal to or greater than the threshold value, using the reference determination data which is the determination data when the parameter was recalculated last time. For example, the determination unit 132 determines that the transmission condition is satisfied when it is determined that the brightness of the entire captured image has changed by the threshold value or more as a result of comparison between the reference determination data and the transmission determination target data.
 また、判断部132は、カメラ100の操作者のカメラ100に対する操作を示す操作情報を取得し、取得した操作情報を基に、送出条件を満たすかを判断してもよい。判断部132は、カメラ100の操作者が所定の操作を行った場合、送出条件を満たすと判断する。判断部132は、カメラ100への電源が投入された場合、送出条件を満たすと判断する。判断部132は、送出条件を満たすと判断した場合、送出トリガを発行し、送出トリガを送出信号作成部133に伝送する。 Further, the determination unit 132 may acquire operation information indicating the operation of the camera 100 operator with respect to the camera 100, and may determine whether or not the transmission condition is satisfied based on the acquired operation information. The determination unit 132 determines that the transmission condition is satisfied when the operator of the camera 100 performs a predetermined operation. The determination unit 132 determines that the transmission condition is satisfied when the power to the camera 100 is turned on. When the determination unit 132 determines that the transmission condition is satisfied, it issues a transmission trigger and transmits the transmission trigger to the transmission signal creation unit 133.
 送出信号作成部133は、画像処理部120から撮像画像の一部を受け取る。送出信号作成部133は、動画像である撮像画像の一部の画像を送出画像として受け取る。 The transmission signal creation unit 133 receives a part of the captured image from the image processing unit 120. The transmission signal creation unit 133 receives a part of the captured image, which is a moving image, as the transmission image.
 送出信号作成部133は、送出画像とメタデータとを含む送出信号を作成する。例えば、送出信号作成部133は、送出画像とメタデータとをパッキングすることにより送出信号を作成する。送出信号作成部133は、送出トリガが印可された場合、送出信号を通信部140に伝送する。 The transmission signal creation unit 133 creates a transmission signal including a transmission image and metadata. For example, the transmission signal creation unit 133 creates a transmission signal by packing the transmission image and the metadata. When the transmission trigger is applied, the transmission signal creation unit 133 transmits the transmission signal to the communication unit 140.
 通信部140は、例えば、NIC(Network Interface Card)や通信回路等によって実現される。通信部140は、所定のネットワークと無線又は有線で接続され、所定のネットワークを介して、クラウドサーバ200等との間で通信を行う。 The communication unit 140 is realized by, for example, a NIC (Network Interface Card), a communication circuit, or the like. The communication unit 140 is connected to a predetermined network wirelessly or by wire, and communicates with the cloud server 200 or the like via the predetermined network.
 通信部140は、撮像部110により撮像された撮像画像の一部をクラウドサーバ200に送出する。通信部140は、送出信号作成部133から伝送された送出信号をクラウドサーバ200に送出する。すなわち、通信部140は、送出判断部130がクラウドサーバ200への送出を行うと判断した場合、クラウドサーバ200に送出信号作成部133により作成された送出信号を送出する。 The communication unit 140 sends a part of the image captured by the image pickup unit 110 to the cloud server 200. The communication unit 140 transmits the transmission signal transmitted from the transmission signal creation unit 133 to the cloud server 200. That is, when the transmission unit 140 determines that the transmission determination unit 130 transmits to the cloud server 200, the communication unit 140 transmits the transmission signal created by the transmission signal creation unit 133 to the cloud server 200.
 通信部140は、送出判断部130により作成された送出信号をクラウドサーバ200に送出する。これにより、通信部140は、撮像画像の一部(送出画像)と撮像画像に関連するメタデータとをクラウドサーバ200に送出する。なお、通信部140は、撮像画像の一部と撮像画像に関連するメタデータとを個別にクラウドサーバ200に送出してもよい。 The communication unit 140 sends the transmission signal created by the transmission determination unit 130 to the cloud server 200. As a result, the communication unit 140 sends a part of the captured image (sending image) and the metadata related to the captured image to the cloud server 200. The communication unit 140 may separately send a part of the captured image and the metadata related to the captured image to the cloud server 200.
 上記のように、カメラ100は、画像全体の明るさ、画像内の領域ごとの明るさ、色の変化等を監視し、一定の変化が認められた場合にクラウドサーバ200へのデータを送出するための処理を実行する。これにより、カメラ100は、送出する画像を少なく抑えることができ、伝送帯域を削減することができる。 As described above, the camera 100 monitors the brightness of the entire image, the brightness of each area in the image, the change in color, and the like, and sends data to the cloud server 200 when a certain change is observed. Perform the processing for. As a result, the camera 100 can suppress the number of images to be transmitted to a small number, and can reduce the transmission band.
 また、通信部140は、クラウドサーバ200からパラメータを受信する。通信部140は、受信したパラメータを画像処理部120へ渡す。 Further, the communication unit 140 receives the parameters from the cloud server 200. The communication unit 140 passes the received parameter to the image processing unit 120.
 また、カメラ100は、画像処理部120により画像処理が行われた画像(「出力画像」ともいう)をサーバ装置300へ出力する。例えば、カメラ100は、ケーブル等により、サーバ装置300との間を有線接続され、出力画像をサーバ装置300へ出力する。なお、カメラ100は、サーバ装置300への出力画像を出力可能であれば、サーバ装置300と無線で接続されてもよい。例えば、カメラ100は、本線出力となる動画像である出力画像(本線映像)をサーバ装置300へ出力する。 Further, the camera 100 outputs an image (also referred to as an “output image”) image-processed by the image processing unit 120 to the server device 300. For example, the camera 100 is wiredly connected to the server device 300 by a cable or the like, and outputs an output image to the server device 300. The camera 100 may be wirelessly connected to the server device 300 as long as the output image to the server device 300 can be output. For example, the camera 100 outputs an output image (main line image), which is a moving image to be output on the main line, to the server device 300.
 (クラウドサーバの構成説明)
 次に、パラメータを算出する外部装置の一例であるクラウドサーバ200の構成について説明する。図1に示すように、クラウドサーバ200は、演算部210と、通信部220とを有する。例えば、クラウドサーバ200は、カメラ100外部に設けられる大規模演算装置である。
(Cloud server configuration explanation)
Next, the configuration of the cloud server 200, which is an example of the external device for calculating the parameters, will be described. As shown in FIG. 1, the cloud server 200 has a calculation unit 210 and a communication unit 220. For example, the cloud server 200 is a large-scale arithmetic unit provided outside the camera 100.
 クラウドサーバ200は、例えばNICや通信回路等の通信部220によりカメラ100との間で通信を行う。通信部220は、カメラ100により撮像された撮像画像の一部をカメラ100から受信する。通信部220は、カメラ100からの送出信号を受信する。 The cloud server 200 communicates with the camera 100 by, for example, a communication unit 220 such as a NIC or a communication circuit. The communication unit 220 receives a part of the captured image captured by the camera 100 from the camera 100. The communication unit 220 receives the transmission signal from the camera 100.
 演算部210は、例えば、CPUやMPU等によって、クラウドサーバ200内部に記憶されたプログラム(例えば、パラメータ算出プログラム)がRAM等を作業領域として実行されることにより実現される。また、演算部210は、例えば、ASICやFPGA等の集積回路により実現されてもよい。 The calculation unit 210 is realized by, for example, a CPU, an MPU, or the like executing a program (for example, a parameter calculation program) stored inside the cloud server 200 with a RAM or the like as a work area. Further, the arithmetic unit 210 may be realized by an integrated circuit such as an ASIC or FPGA.
 演算部210は、通信部220により受信された撮像画像の一部を用いて、撮像画像の処理に関するパラメータを算出する。演算部210は、カメラ100が撮像する撮像画像の処理に関するパラメータを算出する。演算部210は、カメラ100から送出された送出信号に含まれる画像やメタデータを基に画像解析を行い、画像の特徴や状況に合わせたパラメータを算出する。 The calculation unit 210 calculates parameters related to the processing of the captured image by using a part of the captured image received by the communication unit 220. The calculation unit 210 calculates parameters related to processing of the captured image captured by the camera 100. The calculation unit 210 performs image analysis based on the image and metadata included in the transmission signal transmitted from the camera 100, and calculates parameters according to the characteristics and situations of the image.
 演算部210は、明るさや色調に関するパラメータを算出する。演算部210は、ゲインのパラメータを算出する。演算部210は、トーンのパラメータを算出する。演算部210は、色相や彩度に関するパラメータを算出する。演算部210は、高周波強調の強さに関するパラメータを算出する。演算部210は、ノイズ除去の強さに関するパラメータを算出する。 The calculation unit 210 calculates parameters related to brightness and color tone. The calculation unit 210 calculates the gain parameter. The calculation unit 210 calculates the tone parameters. The calculation unit 210 calculates parameters related to hue and saturation. The calculation unit 210 calculates a parameter related to the strength of high frequency enhancement. The calculation unit 210 calculates a parameter related to the strength of noise removal.
 演算部210は、画像からメインの被写体を特定し、その被写体に適した明るさや色味になるパラメータを算出する。演算部210は、人、動物、植物等の撮像対象の種類を認識し、撮像対象に対応するパラメータを算出する。 The calculation unit 210 identifies the main subject from the image and calculates parameters that give brightness and color tones suitable for the subject. The calculation unit 210 recognizes the types of imaging objects such as humans, animals, and plants, and calculates parameters corresponding to the imaging objects.
 通信部220は、演算部210による演算結果を外部装置に送信する。通信部220は、演算部210により算出したパラメータをカメラ100に送信する。 The communication unit 220 transmits the calculation result of the calculation unit 210 to the external device. The communication unit 220 transmits the parameters calculated by the calculation unit 210 to the camera 100.
 (サーバ装置の説明)
 図1に示すサーバ装置300は、カメラ100からの出力画像を受信する装置である。サーバ装置300は、受信した出力画像を記憶部に記憶する。例えば、サーバ装置300は、カメラ100から動画像である出力画像(本線映像)を受信する。なお、サーバ装置300は、カメラ100からの出力画像を受信可能であれば、カメラ100と有線で接続されてもよいし、無線で接続されてもよい。
(Explanation of server device)
The server device 300 shown in FIG. 1 is a device that receives an output image from the camera 100. The server device 300 stores the received output image in the storage unit. For example, the server device 300 receives an output image (main line image) which is a moving image from the camera 100. The server device 300 may be connected to the camera 100 by wire or wirelessly as long as it can receive the output image from the camera 100.
[1-2.送出判断の手順]
 次に、図3を用いて、送出判断の処理の流れについて説明する。図3は、送出判断の処理の一例を示すフローチャートである。
[1-2. Sending judgment procedure]
Next, the flow of the transmission determination process will be described with reference to FIG. FIG. 3 is a flowchart showing an example of the transmission determination process.
 図3に示すように、カメラ100は、基準判断データの初期化処理を行う(ステップS101)。例えば、カメラ100の判断データ前処理部131は、初期化処理として基準判断データをクリアして、基準判断データに初期値を設定する。 As shown in FIG. 3, the camera 100 performs a standard determination data initialization process (step S101). For example, the judgment data preprocessing unit 131 of the camera 100 clears the reference judgment data as the initialization process and sets the initial value in the reference judgment data.
 カメラ100は、送出判断対象データを生成する(ステップS102)。例えば、カメラ100の判断データ前処理部131は、撮像した撮像画像を用いて、送出判断対象データを生成する。 The camera 100 generates transmission determination target data (step S102). For example, the judgment data preprocessing unit 131 of the camera 100 generates the transmission judgment target data using the captured image.
 カメラ100は、基準判断データとの差分を算出する(ステップS103)。例えば、カメラ100の判断データ前処理部131は、基準判断データと送出判断対象データとの差分を算出する。 The camera 100 calculates the difference from the reference determination data (step S103). For example, the judgment data preprocessing unit 131 of the camera 100 calculates the difference between the reference judgment data and the transmission judgment target data.
 カメラ100は、差分が閾値以上であるかを判断する(ステップS104)。例えば、カメラ100の判断部132は、基準判断データと送出判断対象データとの差分が閾値以上であるかを判断する。 The camera 100 determines whether the difference is equal to or greater than the threshold value (step S104). For example, the determination unit 132 of the camera 100 determines whether the difference between the reference determination data and the transmission determination target data is equal to or greater than the threshold value.
 差分が閾値以上である場合(ステップS104:Yes)、カメラ100は、基準判断データを送出判断対象データに差し替える(ステップS105)。例えば、カメラ100の判断データ前処理部131は、その時点での送出判断対象データを基準判断データに設定する。 When the difference is equal to or greater than the threshold value (step S104: Yes), the camera 100 replaces the reference determination data with the transmission determination target data (step S105). For example, the judgment data preprocessing unit 131 of the camera 100 sets the transmission judgment target data at that time as the reference judgment data.
 そして、カメラ100は、送出トリガを発行する(ステップS106)。例えば、カメラ100の判断部132は、発行した送出トリガを送出信号作成部133に伝送し、送出トリガを受けた送出信号作成部133は、送出画像とメタデータとを含む送出信号を通信部140に伝送する。これにより、カメラ100は、送出信号をクラウドサーバ200に送出する。その後、カメラ100は、ステップS102に戻って処理を繰り返す。 Then, the camera 100 issues a transmission trigger (step S106). For example, the determination unit 132 of the camera 100 transmits the issued transmission trigger to the transmission signal creation unit 133, and the transmission signal creation unit 133 that receives the transmission trigger transmits the transmission signal including the transmission image and the metadata to the communication unit 140. To transmit to. As a result, the camera 100 sends the transmission signal to the cloud server 200. After that, the camera 100 returns to step S102 and repeats the process.
 一方、差分が閾値未満である場合(ステップS104:No)、カメラ100は、ステップS102に戻って処理を繰り返す。 On the other hand, when the difference is less than the threshold value (step S104: No), the camera 100 returns to step S102 and repeats the process.
[2.第2の実施形態]
 撮像装置の構成は、カメラ100の構成に限られない。送出判断では画像に限らず、センサにより検知されたセンサデータを送出判断材料として用いられてもよい。この点について図4を用いて説明する。図4は、本開示の第2の実施形態に係る撮像システムの一例を示す図である。なお、第1の実施形態と同様の点については、同じ符号を付すこと等により適宜説明を省略する。
[2. Second embodiment]
The configuration of the image pickup apparatus is not limited to the configuration of the camera 100. In the transmission determination, not only the image but also the sensor data detected by the sensor may be used as the transmission determination material. This point will be described with reference to FIG. FIG. 4 is a diagram showing an example of an imaging system according to the second embodiment of the present disclosure. The same points as in the first embodiment will be appropriately described by adding the same reference numerals.
[2-1.本開示の第2の実施形態に係る撮像システムの構成及び処理]
 図4に示すように、撮像システム1Aは、カメラ100Aと、クラウドサーバ200と、サーバ装置300とが含まれる。
[2-1. Configuration and processing of the imaging system according to the second embodiment of the present disclosure]
As shown in FIG. 4, the image pickup system 1A includes a camera 100A, a cloud server 200, and a server device 300.
 (撮像装置の構成説明)
 カメラ100Aの構成について説明する。図4に示すように、カメラ100Aは、撮像部110と、画像処理部120と、送出判断部130と、通信部140と、センサ部150とを有する。
(Explanation of the configuration of the image pickup device)
The configuration of the camera 100A will be described. As shown in FIG. 4, the camera 100A includes an image pickup unit 110, an image processing unit 120, a transmission determination unit 130, a communication unit 140, and a sensor unit 150.
 また、センサ部150は、GPS(Global Positioning System)センサ等のカメラ100Aの位置を検知する位置センサと、ジャイロセンサ等のカメラ100Aの向き(姿勢)を検知する姿勢センサとを有する。なお、センサ部150が有するセンサは上記に限られず、送出判断に利用可能なセンサデータを検知するセンサであれば、どのようなセンサが含まれてもよい。例えば、センサ部150は、温度センサ、湿度センサ、照度センサ等のセンサを有してもよい。 Further, the sensor unit 150 has a position sensor that detects the position of the camera 100A such as a GPS (Global Positioning System) sensor, and a posture sensor that detects the direction (posture) of the camera 100A such as a gyro sensor. The sensor included in the sensor unit 150 is not limited to the above, and any sensor may be included as long as it is a sensor that detects sensor data that can be used for transmission determination. For example, the sensor unit 150 may have a sensor such as a temperature sensor, a humidity sensor, or an illuminance sensor.
 カメラ100Aの送出判断部130は、センサ部150により検知されたセンサデータを用いて送出の判断を行う。例えば、判断データ前処理部131は、センサ部150により検知されたセンサデータを加工することにより判断データを生成する。 The transmission determination unit 130 of the camera 100A determines transmission using the sensor data detected by the sensor unit 150. For example, the judgment data preprocessing unit 131 generates judgment data by processing the sensor data detected by the sensor unit 150.
 判断データ前処理部131は、判断部132での判断対象に応じて、センサデータを加工する。判断データ前処理部131は、センサデータの特徴量を計算し、計算した特徴量を判断データとして出力する。 The judgment data pre-processing unit 131 processes the sensor data according to the judgment target in the judgment unit 132. The judgment data preprocessing unit 131 calculates the feature amount of the sensor data and outputs the calculated feature amount as the judgment data.
 判断データ前処理部131は、判断時のセンサデータを基に生成した判断データを送出判断対象データとして判断部132に渡す。判断データ前処理部131は、位置センサにより検知されたセンサデータを基に生成した判断データを送出判断対象データとして判断部132に渡す。例えば、判断データ前処理部131は、カメラ100Aの位置を示す判断データを送出判断対象データとして判断部132に渡す。判断データ前処理部131は、カメラ100Aの向きを検知する姿勢センサにより検知されたセンサデータを基に生成した判断データを送出判断対象データとして判断部132に渡す。 The judgment data preprocessing unit 131 passes the judgment data generated based on the sensor data at the time of judgment to the judgment unit 132 as transmission judgment target data. The judgment data preprocessing unit 131 passes the judgment data generated based on the sensor data detected by the position sensor to the judgment unit 132 as transmission judgment target data. For example, the judgment data preprocessing unit 131 passes the judgment data indicating the position of the camera 100A to the judgment unit 132 as the transmission judgment target data. The judgment data preprocessing unit 131 passes the judgment data generated based on the sensor data detected by the attitude sensor that detects the direction of the camera 100A to the judgment unit 132 as transmission judgment target data.
 カメラ100Aの判断部132は、センサデータを基に生成された判断データを用いて、送出条件を満たすかどうかを判断する。判断部132は、カメラ100Aの位置情報を用いて、カメラ100Aの位置が移動した場合、送出条件を満たすと判断する。判断部132は、基準判断データが示すカメラ100Aの位置と、送出判断対象データが示すカメラ100Aの位置との差が閾値以上である場合、カメラ100Aの位置が移動し、送出条件を満たすと判断する。 The determination unit 132 of the camera 100A determines whether or not the transmission condition is satisfied by using the determination data generated based on the sensor data. The determination unit 132 determines that the transmission condition is satisfied when the position of the camera 100A moves by using the position information of the camera 100A. When the difference between the position of the camera 100A indicated by the reference determination data and the position of the camera 100A indicated by the transmission determination target data is equal to or greater than the threshold value, the determination unit 132 determines that the position of the camera 100A moves and satisfies the transmission condition. do.
 また、判断部132は、カメラ100Aの向きが変わったことが検出された場合、送出条件を満たすと判断する。判断部132は、基準判断データが示すカメラ100Aの向きと、送出判断対象データが示すカメラ100Aの向きとの差が閾値以上である場合、カメラ100Aの向きが変わっており、送出条件を満たすと判断する。判断部132は、センサが温度センサ、湿度センサ、または照度センサである場合、温度、湿度、または照度の情報を用いて判断を行う。例えば、判断部132は、基準判断データが示す温度、湿度、または照度と、送出判断対象データが示す温度、湿度、または照度との差が閾値以上である場合、送出条件を満たすと判断する。 Further, the determination unit 132 determines that the transmission condition is satisfied when it is detected that the direction of the camera 100A has changed. When the difference between the orientation of the camera 100A indicated by the reference determination data and the orientation of the camera 100A indicated by the transmission determination target data is equal to or greater than the threshold value, the determination unit 132 changes the orientation of the camera 100A and satisfies the transmission condition. to decide. When the sensor is a temperature sensor, a humidity sensor, or an illuminance sensor, the determination unit 132 makes a determination using the temperature, humidity, or illuminance information. For example, the determination unit 132 determines that the transmission condition is satisfied when the difference between the temperature, humidity, or illuminance indicated by the reference determination data and the temperature, humidity, or illuminance indicated by the transmission determination target data is equal to or greater than the threshold value.
 カメラ100Aの通信部140は、センサ部150により検知されたセンサデータを含む送出信号をクラウドサーバ200に送出する。通信部140は、カメラの向きを示すセンサデータを含む送出信号をクラウドサーバ200に送出する。 The communication unit 140 of the camera 100A transmits a transmission signal including the sensor data detected by the sensor unit 150 to the cloud server 200. The communication unit 140 sends a transmission signal including sensor data indicating the direction of the camera to the cloud server 200.
[3.第3の実施形態]
 なお、撮像システムのシステム構成は、上記の第1の実施形態及び第2の実施形態に限らず、種々のシステム構成であってもよい。例えば、撮像を行う撮像装置と、送出を行う送出装置とは別体であってもよい。この点について、図5を用いて説明する。図5は、本開示の第3の実施形態に係る撮像システムの一例を示す図である。なお、第1の実施形態または第2の実施形態と同様の点については、同じ符号を付すこと等により適宜説明を省略する。
[3. Third Embodiment]
The system configuration of the imaging system is not limited to the first embodiment and the second embodiment described above, and may be various system configurations. For example, the image pickup device for taking an image and the sending device for sending may be separate bodies. This point will be described with reference to FIG. FIG. 5 is a diagram showing an example of an imaging system according to a third embodiment of the present disclosure. The same points as those in the first embodiment or the second embodiment will be appropriately described by adding the same reference numerals.
[3-1.本開示の第3の実施形態に係る撮像システムの構成及び処理]
 図5に示すように、撮像システム1Bは、カメラ100Bと、クラウドサーバ200と、サーバ装置300と、送出装置400とが含まれる。
[3-1. Configuration and processing of the imaging system according to the third embodiment of the present disclosure]
As shown in FIG. 5, the image pickup system 1B includes a camera 100B, a cloud server 200, a server device 300, and a transmission device 400.
 (撮像装置の構成説明)
 カメラ100Bの構成について説明する。図5に示すように、カメラ100Bは、撮像部110と、画像処理部120と、通信部140とを有する。このように、カメラ100Bは、送出判断部130及びセンサ部150を有しない点で、カメラ100Aと相違する。
(Explanation of the configuration of the image pickup device)
The configuration of the camera 100B will be described. As shown in FIG. 5, the camera 100B has an image pickup unit 110, an image processing unit 120, and a communication unit 140. As described above, the camera 100B differs from the camera 100A in that it does not have the transmission determination unit 130 and the sensor unit 150.
 例えば、カメラ100Bには、別筐体である送出装置400が取り付けられ、カメラ100Bの画像処理部120から画像が送出装置400の送出判断部130へ伝送される。カメラ100Bから送出装置400へ画像等が伝送可能であれば、カメラ100Bと送出装置400との接続態様はどのような態様であってもよい。例えば、カメラ100Bと送出装置400とは、有線又は無線により通信可能に接続されてもよいし、カメラ100Bと送出装置400とは離間した位置に配置されてもよい。 For example, a transmission device 400, which is a separate housing, is attached to the camera 100B, and an image is transmitted from the image processing unit 120 of the camera 100B to the transmission determination unit 130 of the transmission device 400. As long as an image or the like can be transmitted from the camera 100B to the transmission device 400, the connection mode between the camera 100B and the transmission device 400 may be any mode. For example, the camera 100B and the transmission device 400 may be communicably connected by wire or wirelessly, or the camera 100B and the transmission device 400 may be arranged at separate positions.
 (送出装置の構成説明)
 次に、送出装置400の構成について説明する。図5に示すように、送出装置400は、送出判断部130と、センサ部150と、通信部440とを有する。なお、センサデータを用いない場合、送出装置400は、センサ部150を有しなくてもよい。
(Explanation of the configuration of the sending device)
Next, the configuration of the transmission device 400 will be described. As shown in FIG. 5, the transmission device 400 includes a transmission determination unit 130, a sensor unit 150, and a communication unit 440. When the sensor data is not used, the transmission device 400 does not have to have the sensor unit 150.
 送出装置400の送出判断部130は、カメラ100Bにより撮像された画像を用いて送出判断を行う。なお、送出装置400の送出判断部130は、別装置であるカメラ100Bにより撮像された画像を用いる点以外は、カメラ100の送出判断部130と同様であるため説明を省略する。 The transmission determination unit 130 of the transmission device 400 makes a transmission determination using the image captured by the camera 100B. Since the transmission determination unit 130 of the transmission device 400 is the same as the transmission determination unit 130 of the camera 100 except that an image captured by the camera 100B, which is another device, is used, the description thereof will be omitted.
 通信部440は、カメラ100Bにより撮像された撮像画像の一部を、撮像画像の処理に関するパラメータを算出するクラウドサーバ200に送出する。通信部440は、送出信号作成部133から伝送された送出信号をクラウドサーバ200に送出する。 The communication unit 440 sends a part of the captured image captured by the camera 100B to the cloud server 200 that calculates the parameters related to the processing of the captured image. The communication unit 440 transmits the transmission signal transmitted from the transmission signal creation unit 133 to the cloud server 200.
 クラウドサーバ200は、送出装置400からの送出信号を受信する。クラウドサーバ200は、演算部210により算出したパラメータをカメラ100Bに送信する。 The cloud server 200 receives a transmission signal from the transmission device 400. The cloud server 200 transmits the parameters calculated by the calculation unit 210 to the camera 100B.
[4.通信環境に応じた処理]
 上述したカメラ100、100A、100B、及び送出装置400は、通信環境に応じて処理を切替えてもよい。この点について、撮像システム1のカメラ100を一例として説明するが、撮像システム1Aのカメラ100A、撮像システム1Bのカメラ100B、及び送出装置400についても同様の処理が適用されてもよい。
[4. Processing according to the communication environment]
The cameras 100, 100A, 100B, and the transmission device 400 described above may switch the processing according to the communication environment. Although this point will be described by taking the camera 100 of the image pickup system 1 as an example, the same processing may be applied to the camera 100A of the image pickup system 1A, the camera 100B of the image pickup system 1B, and the transmission device 400.
 カメラ100は、4G(第4世代移動通信規格)またはLTE(Long Term Evolution)、及び5G(第5世代移動通信規格)を利用可能な端末機器である。カメラ100は、通信部140により4GまたはLTEによる第1通信と、5Gによる第2通信との両方を利用可能である。例えば、カメラ100は、5Gによる第2通信が利用可能な通信環境の場合は、第2通信によりクラウドサーバ200と通信し、第2通信が利用不可能な通信環境の場合は、第1通信によりクラウドサーバ200と通信する。 The camera 100 is a terminal device that can use 4G (4th generation mobile communication standard), LTE (Long Term Evolution), and 5G (5th generation mobile communication standard). The camera 100 can use both the first communication by 4G or LTE and the second communication by 5G by the communication unit 140. For example, the camera 100 communicates with the cloud server 200 by the second communication in the case of a communication environment in which the second communication by 5G can be used, and by the first communication in the case of the communication environment in which the second communication cannot be used. Communicates with the cloud server 200.
 カメラ100は、通信環境に応じてクラウドサーバ200への送出態様を切り替える。カメラ100は、5Gによる第2通信が利用不可能な通信環境の場合は、第1通信により撮像画像の一部をクラウドサーバ200へ送信する。すなわち、第1通信のみが利用可能な通信環境下でクラウドサーバ200へ撮像画像を送出する場合、カメラ100は、上述したように撮像画像の一部をクラウドサーバ200へ送信する。 The camera 100 switches the transmission mode to the cloud server 200 according to the communication environment. When the second communication by 5G is not available, the camera 100 transmits a part of the captured image to the cloud server 200 by the first communication. That is, when the captured image is transmitted to the cloud server 200 in a communication environment where only the first communication can be used, the camera 100 transmits a part of the captured image to the cloud server 200 as described above.
 一方で、カメラ100は、5Gによる第2通信が利用可能な通信環境の場合は、第2通信により撮像画像全体をクラウドサーバ200へ送信する。例えば、撮像画像が動画像であり、5Gによる第2通信が利用可能な通信環境の場合、カメラ100は、動画像全部をクラウドサーバ200へ送信する。すなわち、第2通信が利用可能な通信環境下でクラウドサーバ200へ撮像画像を送出する場合、カメラ100は、撮像画像全体をクラウドサーバ200へ送信する。このように、カメラ100は、通信環境に応じてクラウドサーバ200への送出態様を適切に切り替えることができる。 On the other hand, in the case of a communication environment in which the second communication by 5G can be used, the camera 100 transmits the entire captured image to the cloud server 200 by the second communication. For example, when the captured image is a moving image and a second communication by 5G can be used, the camera 100 transmits the entire moving image to the cloud server 200. That is, when the captured image is transmitted to the cloud server 200 in a communication environment where the second communication is available, the camera 100 transmits the entire captured image to the cloud server 200. In this way, the camera 100 can appropriately switch the transmission mode to the cloud server 200 according to the communication environment.
[5.その他の実施形態]
 上述した各実施形態に係る処理は、上記各実施形態以外にも種々の異なる形態(変形例)にて実施されてよい。
[5. Other embodiments]
The processing according to each of the above-described embodiments may be carried out in various different forms (modifications) other than the above-mentioned embodiments.
[5-1.静止画像の例]
 上述したように撮像装置が撮像するのは動画像に限らず、静止画像であってもよい。この場合の処理について、カメラ100を一例として説明する。この場合、カメラ100は、いわゆるデジタルカメラであってもよい。なお、撮像画像が動画像であると同様の処理については適宜説明を省略する。
[5-1. Still image example]
As described above, the image pickup device captures not only a moving image but also a still image. The processing in this case will be described by taking the camera 100 as an example. In this case, the camera 100 may be a so-called digital camera. The same processing as the captured image is a moving image will be omitted as appropriate.
 撮像画像が一つの静止画像である場合、カメラ100の画像処理部120は、一つの静止画像のうち一部の領域を送出画像として選択する。例えば、画像処理部120は、一つの静止画像のうち所定割合(例えば10%等)の領域を送出画像として選択する。画像処理部120は、ランダムに所定割合の領域を送出画像として選択してもよいし、所定の基準を基に所定割合の領域を送出画像として選択してもよい。例えば、画像処理部120は、一つの静止画像中の中央部の領域や、一つの静止画像中の端部の領域を送出画像として選択してもよい。 When the captured image is one still image, the image processing unit 120 of the camera 100 selects a part of the still image as the transmission image. For example, the image processing unit 120 selects a predetermined ratio (for example, 10% or the like) of a still image as a transmission image. The image processing unit 120 may randomly select a predetermined ratio area as a transmission image, or may select a predetermined ratio area as a transmission image based on a predetermined reference. For example, the image processing unit 120 may select a central region in one still image or an edge region in one still image as a transmission image.
 撮像画像が一つの静止画像である場合、カメラ100の送出信号作成部133は、一つの静止画像中の一部領域の画像を送出画像として受け取る。送出信号作成部133は、送出トリガが印可された場合、静止画像中の一部領域の画像である送出画像及びメタデータを含む送出信号を通信部140に伝送する。 When the captured image is one still image, the transmission signal creation unit 133 of the camera 100 receives an image of a part of the still image as a transmission image. When the transmission trigger is applied, the transmission signal creation unit 133 transmits the transmission signal including the transmission image and the metadata, which are images of a part of the still image, to the communication unit 140.
[5-2.その他の処理例]
 例えば、複数の撮像装置を対象としてパラメータを算出してもよい。この点について、撮像システム1Aを一例として説明する。例えば、クラウドサーバ200は、複数のカメラ100Aの各々から撮像画像の一部を受信し、受信した複数のカメラ100Aの各々から撮像画像の一部を基に色を合わせる演算を行い、パラメータを算出し、算出したパラメータを複数のカメラ100Aの各々に送信してもよい。
[5-2. Other processing examples]
For example, the parameters may be calculated for a plurality of image pickup devices. This point will be described by taking the imaging system 1A as an example. For example, the cloud server 200 receives a part of the captured image from each of the plurality of cameras 100A, performs a color matching calculation based on a part of the captured image from each of the received plurality of cameras 100A, and calculates a parameter. Then, the calculated parameters may be transmitted to each of the plurality of cameras 100A.
 複数のカメラ100Aの各々は、撮像画像の一部とともに向き情報をクラウドサーバ200に送信してもよい。クラウドサーバ200は、向きが対応するカメラ100Aのグループごとにパラメータを算出してもよい。例えば、クラウドサーバ200は、日向を向いているカメラ100Aのグループ(第1グループ)を対象に、日向を撮像する撮像画像に合わせたパラメータ(第1パラメータ)を算出してもよい。クラウドサーバ200は、第1グループのカメラ100Aに第1パラメータを送信する。また、クラウドサーバ200は、日陰を向いているカメラ100Aのグループ(第2グループ)を対象に、日陰を撮像する撮像画像に合わせたパラメータ(第2パラメータ)を算出してもよい。クラウドサーバ200は、第2グループのカメラ100Aに第2パラメータを送信する。なお、上記のカメラ100Aのグループ(分類)は一例であり、種々の条件を基に所望のグルーピングを行ってもよい。 Each of the plurality of cameras 100A may transmit orientation information to the cloud server 200 together with a part of the captured image. The cloud server 200 may calculate parameters for each group of cameras 100A corresponding to the orientation. For example, the cloud server 200 may calculate a parameter (first parameter) according to the captured image of the sun, targeting the group of the cameras 100A facing the sun (first group). The cloud server 200 transmits the first parameter to the cameras 100A of the first group. Further, the cloud server 200 may calculate a parameter (second parameter) according to the captured image for capturing the shade for the group (second group) of the camera 100A facing the shade. The cloud server 200 transmits the second parameter to the camera 100A of the second group. The above-mentioned group (classification) of the camera 100A is an example, and desired grouping may be performed based on various conditions.
[5-3.その他]
 また、上記各実施形態において説明した各処理のうち、自動的に行われるものとして説明した処理の全部または一部を手動的に行うこともでき、あるいは、手動的に行われるものとして説明した処理の全部または一部を公知の方法で自動的に行うこともできる。この他、上記文書中や図面中で示した処理手順、具体的名称、各種のデータやパラメータを含む情報については、特記する場合を除いて任意に変更することができる。例えば、各図に示した各種情報は、図示した情報に限られない。
[5-3. others]
Further, among the processes described in each of the above embodiments, all or part of the processes described as being automatically performed can be manually performed, or the processes described as being manually performed. It is also possible to automatically perform all or part of the above by a known method. In addition, information including processing procedures, specific names, various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown in the figure.
 また、図示した各装置の各構成要素は機能概念的なものであり、必ずしも物理的に図示の如く構成されていることを要しない。すなわち、各装置の分散・統合の具体的形態は図示のものに限られず、その全部または一部を、各種の負荷や使用状況などに応じて、任意の単位で機能的または物理的に分散・統合して構成することができる。 Further, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or part of them may be functionally or physically distributed / physically in arbitrary units according to various loads and usage conditions. Can be integrated and configured.
 また、上述してきた各実施形態及び変形例は、処理内容を矛盾させない範囲で適宜組み合わせることが可能である。 Further, each of the above-described embodiments and modifications can be appropriately combined as long as the processing contents do not contradict each other.
 また、本明細書に記載された効果はあくまで例示であって限定されるものでは無く、他の効果があってもよい。 Further, the effects described in the present specification are merely examples and are not limited, and other effects may be obtained.
[6.実施形態に係る効果]
 上述のように、実施形態に係るカメラ100、100A(撮像装置)は、撮像部110と、通信部140(送出部)とを備える。撮像部110は、撮像を行う。通信部140は、撮像部110により撮像された撮像画像の一部を、撮像画像の処理に関するパラメータを算出するクラウドサーバ200(外部装置)に送出する。
[6. Effect of embodiment]
As described above, the cameras 100 and 100A (imaging apparatus) according to the embodiment include an imaging unit 110 and a communication unit 140 (transmitting unit). The imaging unit 110 performs imaging. The communication unit 140 sends a part of the captured image captured by the imaging unit 110 to the cloud server 200 (external device) that calculates parameters related to the processing of the captured image.
 このように、実施形態に係るカメラ100、100Aは、撮像画像の処理に関するパラメータを算出するクラウドサーバ200に、撮像した撮像画像の一部のみを送出することにより、カメラ100、100A以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 As described above, the cameras 100 and 100A according to the embodiment are operated by devices other than the cameras 100 and 100A by sending only a part of the captured images to the cloud server 200 that calculates the parameters related to the processing of the captured images. It is possible to suppress an increase in the amount of communication required for parameter calculation.
 また、通信部140は、クラウドサーバ200への送出条件を満たす場合、撮像画像の一部をクラウドサーバ200送出する。このように、カメラ100、100Aは、送出条件を満たした場合に、クラウドサーバ200への送出を行うことで、クラウドサーバ200への送出回数の増大を抑制することができる。したがって、カメラ100、100Aは、カメラ100、100A以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 Further, the communication unit 140 sends a part of the captured image to the cloud server 200 when the condition for sending to the cloud server 200 is satisfied. As described above, the cameras 100 and 100A can suppress an increase in the number of transmissions to the cloud server 200 by transmitting to the cloud server 200 when the transmission conditions are satisfied. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
 また、カメラ100、100Aは、判断部132を有する。判断部132は、送出条件を満たすかどうかを判断する。通信部140は、判断部132が送出条件を満たすと判断した場合、撮像画像の一部をクラウドサーバ200に送出する。このように、カメラ100、100Aは、送出条件を判断する構成を有し、送出条件を満たすと判断した場合に、クラウドサーバ200への送出を行うことで、クラウドサーバ200への送出回数の増大を抑制することができる。したがって、カメラ100、100Aは、カメラ100、100A以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 Further, the cameras 100 and 100A have a determination unit 132. The determination unit 132 determines whether or not the transmission condition is satisfied. When the determination unit 132 determines that the transmission condition is satisfied, the communication unit 140 transmits a part of the captured image to the cloud server 200. As described above, the cameras 100 and 100A have a configuration for determining the transmission condition, and when it is determined that the transmission condition is satisfied, the camera 100 and 100A transmit to the cloud server 200 to increase the number of transmissions to the cloud server 200. Can be suppressed. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
 また、カメラ100、100Aは、判断データ前処理部131を有する。判断データ前処理部131は、送出条件の判断に用いる判断データを生成する。判断部132は、判断データ前処理部131により生成された判断データを用いて、送出条件を満たすかどうかを判断する。このように、カメラ100、100Aは、送出条件の判断に用いるデータを生成する構成を有し、生成したデータを用いて送出の判断を行い、クラウドサーバ200への送出を行うことで、クラウドサーバ200への送出回数の増大を抑制することができる。したがって、カメラ100、100Aは、カメラ100、100A以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 Further, the cameras 100 and 100A have a judgment data preprocessing unit 131. The judgment data preprocessing unit 131 generates judgment data used for judging the transmission condition. The determination unit 132 determines whether or not the transmission condition is satisfied by using the determination data generated by the determination data preprocessing unit 131. As described above, the cameras 100 and 100A have a configuration for generating data used for determining the transmission conditions, determine transmission using the generated data, and transmit the data to the cloud server 200, thereby transmitting to the cloud server. It is possible to suppress an increase in the number of transmissions to 200. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
 また、判断データ前処理部131は、画像またはセンサにより検知されたセンサデータを加工することにより判断データを生成する。このように、カメラ100、100Aは、画像(画像信号)またはセンサデータ(センサ信号)を加工して生成した判断データ(判断信号)を用いて送出の判断を行い、クラウドサーバ200への送出を行うことで、クラウドサーバ200への送出回数の増大を抑制することができる。したがって、カメラ100、100Aは、カメラ100、100A以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 Further, the judgment data preprocessing unit 131 generates judgment data by processing the image or the sensor data detected by the sensor. In this way, the cameras 100 and 100A make a determination of transmission using the determination data (judgment signal) generated by processing the image (image signal) or the sensor data (sensor signal), and transmit the data to the cloud server 200. By doing so, it is possible to suppress an increase in the number of transmissions to the cloud server 200. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
 また、センサは、位置センサ、姿勢センサ、温度センサ、湿度センサ、または照度センサである。このように、カメラ100、100Aは、位置センサ、姿勢センサ、温度センサ、湿度センサ、または照度センサの検知したデータ(センサ信号)を加工して生成した判断データ(判断信号)を用いて送出の判断を行い、クラウドサーバ200への送出を行うことで、クラウドサーバ200への送出回数の増大を抑制することができる。したがって、カメラ100、100Aは、カメラ100、100A以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 The sensor is a position sensor, an attitude sensor, a temperature sensor, a humidity sensor, or an illuminance sensor. In this way, the cameras 100 and 100A are transmitted using the judgment data (judgment signal) generated by processing the data (sensor signal) detected by the position sensor, the attitude sensor, the temperature sensor, the humidity sensor, or the illuminance sensor. By making a judgment and sending the data to the cloud server 200, it is possible to suppress an increase in the number of times the data is sent to the cloud server 200. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
 また、判断部132は、判断基準として設定された第1判断データ(基準判断データ)と、第1判断データの設定よりも後に生成された第2判断データ(送出判断対象データ)との比較に基づいて、送出条件を満たすかどうかを判断する。このように、カメラ100、100Aは、判断基準を基に送出条件を満たすと判断した場合に、クラウドサーバ200への送出を行うことで、クラウドサーバ200への送出回数の増大を抑制することができる。したがって、カメラ100、100Aは、カメラ100、100A以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 Further, the judgment unit 132 compares the first judgment data (standard judgment data) set as the judgment standard with the second judgment data (sending judgment target data) generated after the setting of the first judgment data. Based on this, it is determined whether or not the transmission condition is satisfied. As described above, when the cameras 100 and 100A determine that the transmission condition is satisfied based on the determination criteria, they can transmit to the cloud server 200 to suppress an increase in the number of transmissions to the cloud server 200. can. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
 また、判断部132は、第1判断データと第2判断データとの差分が閾値以上の場合、送出条件を満たすと判断する。このように、カメラ100、100Aは、第1判断データと第2判断データとの差分が閾値以上の場合に、クラウドサーバ200への送出を行うことで、クラウドサーバ200への送出回数の増大を抑制することができる。したがって、カメラ100、100Aは、カメラ100、100A以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 Further, the determination unit 132 determines that the transmission condition is satisfied when the difference between the first determination data and the second determination data is equal to or greater than the threshold value. As described above, the cameras 100 and 100A increase the number of transmissions to the cloud server 200 by transmitting the data to the cloud server 200 when the difference between the first determination data and the second determination data is equal to or greater than the threshold value. It can be suppressed. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
 また、通信部140は、カメラ100、100Aへの操作が送出条件を満たす場合、撮像画像の一部をクラウドサーバ200に送出する。このように、カメラ100、100Aは、カメラ100、100Aへの操作が送出条件を満たした場合に、クラウドサーバ200への送出を行うことで、パラメータの再計算が必要である可能性が高い場合にのみクラウドサーバ200への送出を行うことができる。したがって、カメラ100、100Aは、カメラ100、100A以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 Further, the communication unit 140 sends a part of the captured image to the cloud server 200 when the operation to the cameras 100 and 100A satisfies the sending condition. As described above, when the operations to the cameras 100 and 100A satisfy the transmission conditions, the cameras 100 and 100A are likely to need to recalculate the parameters by transmitting to the cloud server 200. Can be sent to the cloud server 200 only. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
 また、通信部140は、カメラ100、100Aの操作者が所定の操作を行った場合、撮像画像の一部をクラウドサーバ200に送出する。このように、カメラ100、100Aは、カメラ100、100Aの操作者が所定の操作を行った場合に、クラウドサーバ200への送出を行うことで、パラメータの再計算が必要である可能性が高い場合にのみクラウドサーバ200への送出を行うことができる。したがって、カメラ100、100Aは、カメラ100、100A以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 Further, when the operator of the cameras 100 and 100A performs a predetermined operation, the communication unit 140 sends a part of the captured image to the cloud server 200. As described above, it is highly possible that the parameters of the cameras 100 and 100A need to be recalculated by sending the cameras 100 and 100A to the cloud server 200 when the operator of the cameras 100 and 100A performs a predetermined operation. Only in this case can the transmission to the cloud server 200 be performed. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
 また、通信部140は、カメラ100、100Aの位置または姿勢が変更された場合、撮像画像の一部をクラウドサーバ200に送出する。このように、カメラ100、100Aは、カメラ100、100Aの位置または姿勢が変更された場合に、クラウドサーバ200への送出を行うことで、撮像対象が変わる等によりパラメータの再計算が必要である可能性が高い場合にのみクラウドサーバ200への送出を行うことができる。したがって、カメラ100、100Aは、カメラ100、100A以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 Further, when the position or posture of the cameras 100 and 100A is changed, the communication unit 140 sends a part of the captured image to the cloud server 200. As described above, when the positions or postures of the cameras 100 and 100A are changed, the cameras 100 and 100A need to recalculate the parameters due to the change of the image pickup target by sending to the cloud server 200. It is possible to send to the cloud server 200 only when there is a high possibility. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
 また、通信部140は、カメラ100、100Aへの電源が投入された場合、撮像画像の一部をクラウドサーバ200に送出する。このように、カメラ100、100Aは、カメラ100、100Aへの電源が投入時に、クラウドサーバ200への送出を行うことで、パラメータの再計算が必要である可能性が高い場合にのみクラウドサーバ200への送出を行うことができる。したがって、カメラ100、100Aは、カメラ100、100A以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 Further, when the power to the cameras 100 and 100A is turned on, the communication unit 140 sends a part of the captured image to the cloud server 200. As described above, the cameras 100 and 100A send out to the cloud server 200 when the power to the cameras 100 and 100A is turned on, so that the cloud server 200 is available only when there is a high possibility that the parameters need to be recalculated. Can be sent to. Therefore, the cameras 100 and 100A can suppress an increase in the amount of communication required for parameter calculation by a device other than the cameras 100 and 100A.
 また、撮像画像は、動画像であり、撮像画像の一部は、動画像中の一部の画像である。このように、カメラ100、100Aは、動画像の一部(例えば動画像のうち一つの静止画像や数フレーム等)のみをクラウドサーバ200に送出することにより、カメラ100、100A以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 Further, the captured image is a moving image, and a part of the captured image is a part of the moving image. In this way, the cameras 100 and 100A send only a part of the moving image (for example, a still image or several frames of the moving image) to the cloud server 200, so that the parameters by the devices other than the cameras 100 and 100A are used. It is possible to suppress an increase in the amount of communication required for calculation.
 また、撮像画像は、一つの静止画像であり、撮像画像の一部は、一つの静止画像中の一部の領域である。このように、カメラ100、100Aは、一つの静止画像の一部(例えば一つの静止画像のうち一部の領域等)のみをクラウドサーバ200に送出することにより、カメラ100、100A以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 Further, the captured image is one still image, and a part of the captured image is a part of a region in one still image. As described above, the cameras 100 and 100A are based on devices other than the cameras 100 and 100A by sending only a part of one still image (for example, a part of the area of one still image) to the cloud server 200. It is possible to suppress an increase in the amount of communication required for parameter calculation.
 また、通信部140は、撮像画像に関連するメタデータをクラウドサーバ200に送出する。このように、カメラ100、100Aは、撮像画像に関連するメタデータをクラウドサーバ200に送出することで、クラウドサーバ200における適切なパラメータの算出を可能にすることができる。 Further, the communication unit 140 sends metadata related to the captured image to the cloud server 200. As described above, the cameras 100 and 100A can send the metadata related to the captured image to the cloud server 200, thereby enabling the calculation of appropriate parameters in the cloud server 200.
 また、通信部140は、撮像画像の撮像時のカメラ100、100Aの状態、またはカメラ100、100Aのスペックを示すメタデータを送出する。このように、カメラ100、100Aは、撮像時の状態(位置や向き等)やスペック(画素数やフレームレート等)画像に関連するメタデータをクラウドサーバ200に送出することで、クラウドサーバ200における適切なパラメータの算出を可能にすることができる。 Further, the communication unit 140 sends metadata indicating the state of the cameras 100 and 100A at the time of capturing the captured image, or the specifications of the cameras 100 and 100A. In this way, the cameras 100 and 100A send metadata related to the state (position, orientation, etc.) and specifications (number of pixels, frame rate, etc.) image at the time of imaging to the cloud server 200, thereby causing the cloud server 200. It is possible to calculate appropriate parameters.
 また、カメラ100、100Aは、送出信号作成部133を有する。送出信号作成部133は、撮像画像の一部である送出画像とメタデータとを含む送出信号を作成する。通信部140は、送出信号作成部133により作成された送出信号をクラウドサーバ200に送出する。このように、カメラ100、100Aは、送出画像とメタデータとを含む送出信号をクラウドサーバ200へ送出することで、撮像画像の一部を対応するメタデータとともにクラウドサーバ200へ送出することができる。これにより、カメラ100、100Aは、クラウドサーバ200への送出回数の増大を抑制するとともに、クラウドサーバ200における適切なパラメータの算出を可能にすることができる。 Further, the cameras 100 and 100A have a transmission signal creating unit 133. The transmission signal creation unit 133 creates a transmission signal including the transmission image and the metadata which are a part of the captured image. The communication unit 140 sends the transmission signal created by the transmission signal creation unit 133 to the cloud server 200. As described above, the cameras 100 and 100A can send a part of the captured image to the cloud server 200 together with the corresponding metadata by sending the transmission signal including the transmission image and the metadata to the cloud server 200. .. As a result, the cameras 100 and 100A can suppress an increase in the number of transmissions to the cloud server 200 and enable calculation of appropriate parameters in the cloud server 200.
 また、カメラ100、100Aは、画像処理部120を有する。画像処理部120は、クラウドサーバ200から受信したパラメータを用いて画像処理を行う。このように、カメラ100、100Aは、クラウドサーバ200が算出したパラメータを用いて画素処理を行うことにより、適切な画像処理を行うことができる。 Further, the cameras 100 and 100A have an image processing unit 120. The image processing unit 120 performs image processing using the parameters received from the cloud server 200. As described above, the cameras 100 and 100A can perform appropriate image processing by performing pixel processing using the parameters calculated by the cloud server 200.
 また、画像処理部120は、画像処理として、撮像画像の明るさを調整する処理、撮像画像のコントラストを調整する処理、撮像画像の高周波成分を強調する処理、または撮像画像のノイズを除去する処理のうち、少なくとも1つを行う。このように、カメラ100、100Aは、クラウドサーバ200が算出したパラメータを用いて、撮像画像に対して明るさ調整、コントラスト調整、高周波成分強調、またはノイズ除去等の画素処理を行うことにより、適切な画像処理を行うことができる。 Further, as image processing, the image processing unit 120 has a process of adjusting the brightness of the captured image, a process of adjusting the contrast of the captured image, a process of emphasizing a high frequency component of the captured image, or a process of removing noise of the captured image. Do at least one of them. As described above, the cameras 100 and 100A are appropriate by performing pixel processing such as brightness adjustment, contrast adjustment, high frequency component enhancement, and noise removal on the captured image using the parameters calculated by the cloud server 200. Image processing can be performed.
 例えば、カメラ100、100A等の撮像装置により撮像された動画像のクラウドサーバ200等のクラウドによる処理を考えた場合、クラウド上の潤沢な処理能力を利用して高度な画像処理が可能となるが、伝送後に画像処理を行うため、圧縮による画像劣化は避けることが望まれる。このため、データ量の多くなる生データを撮像装置からクラウドへ全て送付する必要があり、高い伝送能力が必要となる。このような伝送を伴う事により遅延が発生し、リアルタイムで画像が得られない場合がある。 For example, when considering processing by a cloud such as a cloud server 200 of a moving image captured by an image pickup device such as a camera 100 or 100A, advanced image processing becomes possible by utilizing abundant processing capacity on the cloud. Since image processing is performed after transmission, it is desirable to avoid image deterioration due to compression. Therefore, it is necessary to send all the raw data, which has a large amount of data, from the image pickup device to the cloud, which requires high transmission capacity. Due to such transmission, a delay may occur and an image may not be obtained in real time.
 一方で、上述した撮像システム1、1Aでは、処理エンジン(画像処理部120)をカメラ100、100A側に内蔵することで、画像出力のリアルタイム性を確保することができる。また、撮像システム1、1Aでは、カメラ100、100Aからクラウドサーバ200へは、撮像画像の一部(静止画像等)の限られた情報を送出し、クラウドサーバ200上で最適なパラメータを演算し、パラメータをカメラ100、100Aに送り返す。これにより、撮像システム1、1Aでは、伝送帯域が少なくて済む。 On the other hand, in the above-mentioned imaging systems 1 and 1A, the real-time image output can be ensured by incorporating the processing engine (image processing unit 120) into the cameras 100 and 100A. Further, in the imaging systems 1 and 1A, limited information of a part of the captured image (still image, etc.) is transmitted from the cameras 100 and 100A to the cloud server 200, and the optimum parameters are calculated on the cloud server 200. , The parameters are sent back to the cameras 100 and 100A. As a result, in the imaging systems 1 and 1A, the transmission band can be reduced.
 また、カメラ100、100Aからの伝送は、例えば電源投入時や、カメラを大きく振るなど撮影対象が変わった時、カメラ100、100Aの操作者が特定のメニュー操作をした場合など、特定のトリガ条件に合致した場合のみとする。これにより、カメラ100、100Aは、伝送情報を絞り、帯域を少なくしつつ、処理パラメータの変更が必要な状況には即時に追従することができる。 Further, the transmission from the cameras 100 and 100A is a specific trigger condition such as when the power is turned on, when the shooting target changes such as shaking the camera greatly, or when the operator of the cameras 100 and 100A performs a specific menu operation. Only if it matches. As a result, the cameras 100 and 100A can immediately follow the situation where the processing parameters need to be changed while narrowing down the transmission information and reducing the band.
 上述のように、実施形態に係る送出装置400は、通信部440(送出部)を備える。通信部440は、撮像された撮像画像の一部を、撮像画像の処理に関するパラメータを算出するクラウドサーバ200(外部装置)に送出する。 As described above, the transmission device 400 according to the embodiment includes a communication unit 440 (sending unit). The communication unit 440 sends a part of the captured image to the cloud server 200 (external device) that calculates the parameters related to the processing of the captured image.
 このように、実施形態に係る送出装置400は、撮像画像の処理に関するパラメータを算出するクラウドサーバ200に、撮像画像の一部のみを送出することにより、撮像画像を撮像するカメラ100B以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 As described above, the transmission device 400 according to the embodiment is a device other than the camera 100B that captures the captured image by transmitting only a part of the captured image to the cloud server 200 that calculates the parameters related to the processing of the captured image. It is possible to suppress an increase in the amount of communication required for parameter calculation.
 上述のように、実施形態に係るクラウドサーバ200は、カメラ100、100A(撮像装置)により撮像された撮像画像の一部を外部装置から受信する通信部220と、通信部220により受信された撮像画像の一部を用いて、撮像画像の処理に関するパラメータを算出する演算部210と、を備える。 As described above, the cloud server 200 according to the embodiment has a communication unit 220 that receives a part of an image captured by the cameras 100 and 100A (imaging device) from an external device, and an image pickup received by the communication unit 220. A calculation unit 210 for calculating parameters related to processing of a captured image by using a part of an image is provided.
 このように、実施形態に係るクラウドサーバ200は、カメラ100、100Aが撮像した撮像画像の一部のみを受信し、撮像画像の処理に関するパラメータを算出することにより、カメラ100、100A以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 As described above, the cloud server 200 according to the embodiment receives only a part of the captured image captured by the cameras 100 and 100A, and calculates the parameters related to the processing of the captured image by the device other than the cameras 100 and 100A. It is possible to suppress an increase in the amount of communication required for parameter calculation.
 上述のように、撮像システム1、1Aは、撮像を行い、撮像した撮像画像の一部を、撮像画像の処理に関するパラメータを算出する外部装置に送出するカメラ100、100A(撮像装置)と、撮像画像の一部を撮像装置から受信し、受信した撮像画像の一部を用いて、撮像画像の処理に関するパラメータを算出するクラウドサーバ200と、を有する。 As described above, the imaging systems 1 and 1A capture images with the cameras 100 and 100A (imaging devices) that perform imaging and send a part of the captured images to an external device that calculates parameters related to the processing of the captured images. It has a cloud server 200 that receives a part of an image from an image pickup apparatus and calculates parameters related to processing of the captured image using a part of the received captured image.
 このように、実施形態に係る撮像システム1、1Aは、カメラ100、100Aが撮像した撮像画像の一部のみを受信し、撮像画像の処理に関するパラメータを算出することにより、カメラ100、100A以外の装置によるパラメータ算出に要する通信量の増大を抑制することができる。 As described above, the imaging systems 1 and 1A according to the embodiment receive only a part of the captured image captured by the cameras 100 and 100A, and calculate the parameters related to the processing of the captured image to obtain the parameters other than the cameras 100 and 100A. It is possible to suppress an increase in the amount of communication required for parameter calculation by the device.
[7.ハードウェア構成]
 上述してきた各実施形態に係るクラウドサーバ200やサーバ装置300や送出装置400等の各装置(情報機器)は、例えば図6に示すような構成のコンピュータ1000によって実現される。図6は、各装置の機能を実現するコンピュータの一例を示すハードウェア構成図である。なお、カメラ100、100A、100Bの情報機器としての機能は、図6に示すコンピュータ1000により実現されてもよい。以下、送出装置400を例に挙げて説明する。コンピュータ1000は、CPU1100、RAM1200、ROM(Read Only Memory)1300、HDD(Hard Disk Drive)1400、通信インターフェイス1500、及び入出力インターフェイス1600を有する。コンピュータ1000の各部は、バス1050によって接続される。
[7. Hardware configuration]
Each device (information device) such as the cloud server 200, the server device 300, and the transmission device 400 according to each of the above-described embodiments is realized by, for example, a computer 1000 having a configuration as shown in FIG. FIG. 6 is a hardware configuration diagram showing an example of a computer that realizes the functions of each device. The functions of the cameras 100, 100A, and 100B as information devices may be realized by the computer 1000 shown in FIG. Hereinafter, the transmission device 400 will be described as an example. The computer 1000 has a CPU 1100, a RAM 1200, a ROM (Read Only Memory) 1300, an HDD (Hard Disk Drive) 1400, a communication interface 1500, and an input / output interface 1600. Each part of the computer 1000 is connected by a bus 1050.
 CPU1100は、ROM1300又はHDD1400に格納されたプログラムに基づいて動作し、各部の制御を行う。例えば、CPU1100は、ROM1300又はHDD1400に格納されたプログラムをRAM1200に展開し、各種プログラムに対応した処理を実行する。 The CPU 1100 operates based on the program stored in the ROM 1300 or the HDD 1400, and controls each part. For example, the CPU 1100 expands the program stored in the ROM 1300 or the HDD 1400 into the RAM 1200, and executes processing corresponding to various programs.
 ROM1300は、コンピュータ1000の起動時にCPU1100によって実行されるBIOS(Basic Input Output System)等のブートプログラムや、コンピュータ1000のハードウェアに依存するプログラム等を格納する。 The ROM 1300 stores a boot program such as a BIOS (Basic Input Output System) executed by the CPU 1100 when the computer 1000 is started, a program depending on the hardware of the computer 1000, and the like.
 HDD1400は、CPU1100によって実行されるプログラム、及び、かかるプログラムによって使用されるデータ等を非一時的に記録する、コンピュータが読み取り可能な記録媒体である。具体的には、HDD1400は、プログラムデータ1450の一例である本開示に係る信号処理プログラム等の情報処理プログラムを記録する記録媒体である。 The HDD 1400 is a computer-readable recording medium that non-temporarily records a program executed by the CPU 1100 and data used by such a program. Specifically, the HDD 1400 is a recording medium for recording an information processing program such as a signal processing program according to the present disclosure, which is an example of program data 1450.
 通信インターフェイス1500は、コンピュータ1000が外部ネットワーク1550(例えばインターネット)と接続するためのインターフェイスである。例えば、CPU1100は、通信インターフェイス1500を介して、他の機器からデータを受信したり、CPU1100が生成したデータを他の機器へ送信したりする。 The communication interface 1500 is an interface for the computer 1000 to connect to an external network 1550 (for example, the Internet). For example, the CPU 1100 receives data from another device or transmits data generated by the CPU 1100 to another device via the communication interface 1500.
 入出力インターフェイス1600は、入出力デバイス1650とコンピュータ1000とを接続するためのインターフェイスである。例えば、CPU1100は、入出力インターフェイス1600を介して、キーボードやマウス等の入力デバイスからデータを受信する。また、CPU1100は、入出力インターフェイス1600を介して、ディスプレイやスピーカーやプリンタ等の出力デバイスにデータを送信する。また、入出力インターフェイス1600は、所定の記録媒体(メディア)に記録されたプログラム等を読み取るメディアインターフェイスとして機能してもよい。メディアとは、例えばDVD(Digital Versatile Disc)、PD(Phase change rewritable Disk)等の光学記録媒体、MO(Magneto-Optical disk)等の光磁気記録媒体、テープ媒体、磁気記録媒体、または半導体メモリ等である。 The input / output interface 1600 is an interface for connecting the input / output device 1650 and the computer 1000. For example, the CPU 1100 receives data from an input device such as a keyboard or mouse via the input / output interface 1600. Further, the CPU 1100 transmits data to an output device such as a display, a speaker, or a printer via the input / output interface 1600. Further, the input / output interface 1600 may function as a media interface for reading a program or the like recorded on a predetermined recording medium (media). The media is, for example, an optical recording medium such as DVD (Digital Versatile Disc) or PD (Phase change rewritable Disk), a magneto-optical recording medium such as MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. Is.
 例えば、コンピュータ1000が実施形態に係る送出装置400として機能する場合、コンピュータ1000のCPU1100は、RAM1200上にロードされた情報処理プログラムを実行することにより、送出判断部130等の機能を実現する。また、HDD1400には、本開示に係る情報処理プログラムや、クラウドサーバ200の記憶部内のデータが格納される。なお、CPU1100は、プログラムデータ1450をHDD1400から読み取って実行するが、他の例として、外部ネットワーク1550を介して、他の装置からこれらのプログラムを取得してもよい。 For example, when the computer 1000 functions as the transmission device 400 according to the embodiment, the CPU 1100 of the computer 1000 realizes the functions of the transmission determination unit 130 and the like by executing the information processing program loaded on the RAM 1200. Further, the information processing program according to the present disclosure and the data in the storage unit of the cloud server 200 are stored in the HDD 1400. The CPU 1100 reads the program data 1450 from the HDD 1400 and executes the program, but as another example, these programs may be acquired from another device via the external network 1550.
 なお、本技術は以下のような構成も取ることができる。
(1)
 撮像を行う撮像部と、
 前記撮像部により撮像された撮像画像の一部を、前記撮像画像の処理に関するパラメータを算出する外部装置に送出する送出部と、
 を備える撮像装置。
(2)
 前記送出部は、
 前記外部装置への送出条件を満たす場合、前記撮像画像の一部を前記外部装置に送出する
 (1)に記載の撮像装置。
(3)
 前記送出条件を満たすかどうかを判断する判断部、
 をさらに備え、
 前記送出部は、
 前記判断部が前記送出条件を満たすと判断した場合、前記撮像画像の一部を前記外部装置に送出する
 (2)に記載の撮像装置。
(4)
 前記送出条件の判断に用いる判断データを生成する判断データ前処理部、
 をさらに備え、
 前記判断部は、
 前記判断データ前処理部により生成された前記判断データを用いて、前記送出条件を満たすかどうかを判断する
 (3)に記載の撮像装置。
(5)
 前記判断データ前処理部は、
 画像またはセンサにより検知されたセンサデータを加工することにより前記判断データを生成する
 (4)に記載の撮像装置。
(6)
 前記センサは、
 位置センサ、姿勢センサ、温度センサ、湿度センサ、または照度センサである
 (5)に記載の撮像装置。
(7)
 前記判断部は、
 判断基準として設定された第1判断データと、前記第1判断データの設定よりも後に生成された第2判断データとの比較に基づいて、前記送出条件を満たすかどうかを判断する
 (4)~(6)のいずれか1つに記載の撮像装置。
(8)
 前記判断部は、
 前記第1判断データと前記第2判断データとの差分が閾値以上の場合、前記送出条件を満たすと判断する
 (7)に記載の撮像装置。
(9)
 前記送出部は、
 前記撮像装置への操作が前記送出条件を満たす場合、前記撮像画像の一部を前記外部装置に送出する
 (2)~(8)のいずれか1つに記載の撮像装置。
(10)
 前記送出部は、
 前記撮像装置の操作者が所定の操作を行った場合、前記撮像画像の一部を前記外部装置に送出する
 (9)に記載の撮像装置。
(11)
 前記送出部は、
 前記撮像装置の位置または姿勢が変更された場合、前記撮像画像の一部を前記外部装置に送出する
 (9)または(10)に記載の撮像装置。
(12)
 前記送出部は、
 前記撮像装置への電源が投入された場合、前記撮像画像の一部を前記外部装置に送出する
 (9)~(11)のいずれか1つに記載の撮像装置。
(13)
 前記撮像画像は、動画像であり、
 前記撮像画像の一部は、当該動画像中の一部の画像である
 (1)~(12)のいずれか1つに記載の撮像装置。
(14)
 前記撮像画像は、一つの静止画像であり、
 前記撮像画像の一部は、当該一つの静止画像中の一部の領域である
 (1)~(12)のいずれか1つに記載の撮像装置。
(15)
 前記送出部は、
 前記撮像画像に関連するメタデータを前記外部装置に送出する
 (1)~(14)のいずれか1つに記載の撮像装置。
(16)
 前記送出部は、
 前記撮像画像の撮像時の前記撮像装置の状態、または前記撮像装置のスペックを示す前記メタデータを送出する
 (15)に記載の撮像装置。
(17)
 前記撮像画像の一部である送出画像と前記メタデータとを含む送出信号を作成する送出信号作成部、
 をさらに備え、
 前記送出部は、
 前記送出信号作成部により作成された前記送出信号を前記外部装置に送出する
 (15)または(16)に記載の撮像装置。
(18)
 前記外部装置から受信した前記パラメータを用いて画像処理を行う画像処理部、
 をさらに備える
 (1)~(17)のいずれか1つに記載の撮像装置。
(19)
 前記画像処理部は、
 前記画像処理として、前記撮像画像の明るさを調整する処理、前記撮像画像のコントラストを調整する処理、前記撮像画像の高周波成分を強調する処理、または前記撮像画像のノイズを除去する処理のうち、少なくとも1つを行う
 (18)に記載の撮像装置。
(20)
 撮像を行い、
 撮像した撮像画像の一部を、前記撮像画像の処理に関するパラメータを算出する外部装置に送出する
 処理を実行する送出方法。
(21)
 撮像を行い、
 撮像した撮像画像の一部を、前記撮像画像の処理に関するパラメータを算出する外部装置に送出する
 処理を実行させる送出プログラム。
(22)
 撮像された撮像画像の一部を、前記撮像画像の処理に関するパラメータを算出する外部装置に送出する送出部、
 を備えた送出装置。
(23)
 撮像装置により撮像された撮像画像の一部を外部装置から受信する通信部と、
 前記通信部により受信された前記撮像画像の一部を用いて、前記撮像画像の処理に関するパラメータを算出する演算部と、
 を備えたクラウドサーバ。
(24)
 撮像を行い、撮像した撮像画像の一部を、前記撮像画像の処理に関するパラメータを算出する外部装置に送出する撮像装置と、
 前記撮像画像の一部を前記撮像装置から受信し、受信した前記撮像画像の一部を用いて、前記撮像画像の処理に関するパラメータを算出するクラウドサーバと、
 を有する撮像システム。
The present technology can also have the following configurations.
(1)
An imaging unit that performs imaging and
A transmission unit that sends a part of the captured image captured by the image pickup unit to an external device that calculates parameters related to the processing of the captured image.
An image pickup device equipped with.
(2)
The sending unit
The imaging device according to (1), wherein a part of the captured image is transmitted to the external device when the conditions for sending to the external device are satisfied.
(3)
Judgment unit for determining whether or not the transmission condition is satisfied,
Further prepare
The sending unit
The imaging device according to (2), wherein when the determination unit determines that the transmission condition is satisfied, a part of the captured image is transmitted to the external device.
(4)
Judgment data pre-processing unit that generates judgment data used to judge the transmission condition,
Further prepare
The judgment unit
The image pickup apparatus according to (3), wherein it is determined whether or not the transmission condition is satisfied by using the determination data generated by the determination data preprocessing unit.
(5)
The judgment data pre-processing unit
The image pickup apparatus according to (4), wherein the judgment data is generated by processing an image or sensor data detected by a sensor.
(6)
The sensor is
The image pickup apparatus according to (5), which is a position sensor, a posture sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
(7)
The judgment unit
Based on the comparison between the first judgment data set as the judgment criterion and the second judgment data generated after the setting of the first judgment data, it is judged whether or not the transmission condition is satisfied (4) to. The imaging device according to any one of (6).
(8)
The judgment unit
The image pickup apparatus according to (7), wherein it is determined that the transmission condition is satisfied when the difference between the first determination data and the second determination data is equal to or greater than a threshold value.
(9)
The sending unit
The image pickup device according to any one of (2) to (8), wherein a part of the captured image is sent to the external device when the operation to the image pickup device satisfies the transmission condition.
(10)
The sending unit
The imaging device according to (9), wherein a part of the captured image is sent to the external device when the operator of the imaging device performs a predetermined operation.
(11)
The sending unit
The imaging device according to (9) or (10), wherein a part of the captured image is sent to the external device when the position or posture of the imaging device is changed.
(12)
The sending unit
The image pickup device according to any one of (9) to (11), wherein a part of the captured image is sent to the external device when the power to the image pickup device is turned on.
(13)
The captured image is a moving image and is
The image pickup apparatus according to any one of (1) to (12), wherein a part of the captured image is a part of the image in the moving image.
(14)
The captured image is one still image, and is
The image pickup apparatus according to any one of (1) to (12), wherein a part of the captured image is a part of a region in the one still image.
(15)
The sending unit
The imaging device according to any one of (1) to (14), which sends metadata related to the captured image to the external device.
(16)
The sending unit
The imaging device according to (15), which sends out the metadata indicating the state of the imaging device at the time of capturing the captured image or the specifications of the imaging device.
(17)
A transmission signal creating unit that creates a transmission signal including a transmission image that is a part of the captured image and the metadata.
Further prepare
The sending unit
The image pickup apparatus according to (15) or (16), wherein the transmission signal created by the transmission signal creation unit is transmitted to the external device.
(18)
An image processing unit that performs image processing using the parameters received from the external device.
The image pickup apparatus according to any one of (1) to (17).
(19)
The image processing unit
The image processing includes a process of adjusting the brightness of the captured image, a process of adjusting the contrast of the captured image, a process of emphasizing a high frequency component of the captured image, and a process of removing noise of the captured image. The image pickup apparatus according to (18), wherein at least one is performed.
(20)
Take an image and
A transmission method for executing a process of transmitting a part of an captured image to an external device that calculates parameters related to the processing of the captured image.
(21)
Take an image and
A transmission program that executes a process of transmitting a part of the captured image to an external device that calculates parameters related to the processing of the captured image.
(22)
A transmission unit that sends a part of the captured image to an external device that calculates parameters related to the processing of the captured image.
A sending device equipped with.
(23)
A communication unit that receives a part of the captured image captured by the image pickup device from an external device,
An arithmetic unit that calculates parameters related to the processing of the captured image using a part of the captured image received by the communication unit, and a calculation unit.
Cloud server with.
(24)
An imaging device that performs imaging and sends a part of the captured image to an external device that calculates parameters related to the processing of the captured image.
A cloud server that receives a part of the captured image from the image pickup device and calculates parameters related to the processing of the captured image by using a part of the received image.
Imaging system with.
 1 撮像システム
 100 カメラ(撮像装置)
 110 撮像部
 120 画像処理部
 130 送出判断部
 131 判断データ前処理部
 132 判断部
 133 送出信号作成部
 140 通信部(送出部)
 200 クラウドサーバ(外部装置)
 210 演算部
 220 通信部
 300 サーバ装置
1 Imaging system 100 camera (imaging device)
110 Imaging unit 120 Image processing unit 130 Transmission judgment unit 131 Judgment data preprocessing unit 132 Judgment unit 133 Transmission signal creation unit 140 Communication unit (transmission unit)
200 Cloud server (external device)
210 Calculation unit 220 Communication unit 300 Server device

Claims (23)

  1.  撮像を行う撮像部と、
     前記撮像部により撮像された撮像画像の一部を、前記撮像画像の処理に関するパラメータを算出する外部装置に送出する送出部と、
     を備える撮像装置。
    An imaging unit that performs imaging and
    A transmission unit that sends a part of the captured image captured by the image pickup unit to an external device that calculates parameters related to the processing of the captured image.
    An image pickup device equipped with.
  2.  前記送出部は、
     前記外部装置への送出条件を満たす場合、前記撮像画像の一部を前記外部装置に送出する
     請求項1に記載の撮像装置。
    The sending unit
    The imaging device according to claim 1, wherein a part of the captured image is transmitted to the external device when the conditions for sending to the external device are satisfied.
  3.  前記送出条件を満たすかどうかを判断する判断部、
     をさらに備え、
     前記送出部は、
     前記判断部が前記送出条件を満たすと判断した場合、前記撮像画像の一部を前記外部装置に送出する
     請求項2に記載の撮像装置。
    Judgment unit for determining whether or not the transmission condition is satisfied,
    Further prepare
    The sending unit
    The imaging device according to claim 2, wherein when the determination unit determines that the transmission condition is satisfied, a part of the captured image is transmitted to the external device.
  4.  前記送出条件の判断に用いる判断データを生成する判断データ前処理部、
     をさらに備え、
     前記判断部は、
     前記判断データ前処理部により生成された前記判断データを用いて、前記送出条件を満たすかどうかを判断する
     請求項3に記載の撮像装置。
    Judgment data pre-processing unit that generates judgment data used to judge the transmission condition,
    Further prepare
    The judgment unit
    The imaging device according to claim 3, wherein the determination data generated by the determination data preprocessing unit is used to determine whether or not the transmission condition is satisfied.
  5.  前記判断データ前処理部は、
     画像またはセンサにより検知されたセンサデータに基づき前記判断データを生成する
     請求項4に記載の撮像装置。
    The judgment data pre-processing unit
    The image pickup apparatus according to claim 4, wherein the judgment data is generated based on the image or the sensor data detected by the sensor.
  6.  前記センサは、
     位置センサ、姿勢センサ、温度センサ、湿度センサ、または照度センサである
     請求項5に記載の撮像装置。
    The sensor is
    The image pickup apparatus according to claim 5, which is a position sensor, a posture sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
  7.  前記判断部は、
     判断基準として設定された第1判断データと、前記第1判断データの設定よりも後に生成された第2判断データとの比較に基づいて、前記送出条件を満たすかどうかを判断する
     請求項4に記載の撮像装置。
    The judgment unit
    According to claim 4, it is determined whether or not the transmission condition is satisfied based on the comparison between the first judgment data set as the judgment criterion and the second judgment data generated after the setting of the first judgment data. The imaging device described.
  8.  前記判断部は、
     前記第1判断データと前記第2判断データとの差分が閾値以上の場合、前記送出条件を満たすと判断する
     請求項7に記載の撮像装置。
    The judgment unit
    The imaging device according to claim 7, wherein when the difference between the first determination data and the second determination data is equal to or greater than a threshold value, it is determined that the transmission condition is satisfied.
  9.  前記送出部は、
     前記撮像装置への操作が前記送出条件を満たす場合、前記撮像画像の一部を前記外部装置に送出する
     請求項2に記載の撮像装置。
    The sending unit
    The imaging device according to claim 2, wherein when the operation to the imaging device satisfies the transmission condition, a part of the captured image is transmitted to the external device.
  10.  前記送出部は、
     前記撮像装置の操作者が所定の操作を行った場合、前記撮像画像の一部を前記外部装置に送出する
     請求項9に記載の撮像装置。
    The sending unit
    The imaging device according to claim 9, wherein when the operator of the imaging device performs a predetermined operation, a part of the captured image is sent to the external device.
  11.  前記送出部は、
     前記撮像装置の位置または姿勢が変更された場合、前記撮像画像の一部を前記外部装置に送出する
     請求項9に記載の撮像装置。
    The sending unit
    The imaging device according to claim 9, wherein when the position or posture of the imaging device is changed, a part of the captured image is sent to the external device.
  12.  前記送出部は、
     前記撮像装置への電源が投入された場合、前記撮像画像の一部を前記外部装置に送出する
     請求項9に記載の撮像装置。
    The sending unit
    The imaging device according to claim 9, wherein when the power to the imaging device is turned on, a part of the captured image is sent to the external device.
  13.  前記撮像画像は、動画像であり、
     前記撮像画像の一部は、当該動画像中の一部の画像である
     請求項1に記載の撮像装置。
    The captured image is a moving image and is
    The image pickup apparatus according to claim 1, wherein a part of the captured image is a part of the image in the moving image.
  14.  前記撮像画像は、一つの静止画像であり、
     前記撮像画像の一部は、当該一つの静止画像中の一部の領域である
     請求項1に記載の撮像装置。
    The captured image is one still image, and is
    The imaging device according to claim 1, wherein a part of the captured image is a part of a region in the one still image.
  15.  前記送出部は、
     前記撮像画像に関連するメタデータを前記外部装置に送出する
     請求項1に記載の撮像装置。
    The sending unit
    The imaging device according to claim 1, wherein metadata related to the captured image is transmitted to the external device.
  16.  前記送出部は、
     前記撮像画像の撮像時の前記撮像装置の状態、または前記撮像装置のスペックを示す前記メタデータを送出する
     請求項15に記載の撮像装置。
    The sending unit
    The imaging device according to claim 15, which sends out the metadata indicating the state of the imaging device at the time of capturing the captured image or the specifications of the imaging device.
  17.  前記撮像画像の一部である送出画像と前記メタデータとを含む送出信号を作成する送出信号作成部、
     をさらに備え、
     前記送出部は、
     前記送出信号作成部により作成された前記送出信号を前記外部装置に送出する
     請求項15に記載の撮像装置。
    A transmission signal creating unit that creates a transmission signal including a transmission image that is a part of the captured image and the metadata.
    Further prepare
    The sending unit
    The image pickup apparatus according to claim 15, wherein the transmission signal created by the transmission signal creation unit is transmitted to the external device.
  18.  前記外部装置から受信した前記パラメータを用いて画像処理を行う画像処理部、
     をさらに備える
     請求項1に記載の撮像装置。
    An image processing unit that performs image processing using the parameters received from the external device.
    The image pickup apparatus according to claim 1.
  19.  前記画像処理部は、
     前記画像処理として、前記撮像画像の明るさを調整する処理、前記撮像画像のコントラストを調整する処理、前記撮像画像の高周波成分を強調する処理、または前記撮像画像のノイズを除去する処理のうち、少なくとも1つを行う
     請求項18に記載の撮像装置。
    The image processing unit
    The image processing includes a process of adjusting the brightness of the captured image, a process of adjusting the contrast of the captured image, a process of emphasizing a high frequency component of the captured image, and a process of removing noise of the captured image. The imaging apparatus according to claim 18, wherein at least one is performed.
  20.  撮像を行い、
     撮像した撮像画像の一部を、前記撮像画像の処理に関するパラメータを算出する外部装置に送出する
     処理を実行する送出方法。
    Take an image and
    A transmission method for executing a process of transmitting a part of an captured image to an external device that calculates parameters related to the processing of the captured image.
  21.  撮像された撮像画像の一部を、前記撮像画像の処理に関するパラメータを算出する外部装置に送出する送出部、
     を備えた送出装置。
    A transmission unit that sends a part of the captured image to an external device that calculates parameters related to the processing of the captured image.
    A sending device equipped with.
  22.  撮像装置により撮像された撮像画像の一部を外部装置から受信する通信部と、
     前記通信部により受信された前記撮像画像の一部を用いて、前記撮像画像の処理に関するパラメータを算出する演算部と、
     を備えたクラウドサーバ。
    A communication unit that receives a part of the captured image captured by the image pickup device from an external device,
    An arithmetic unit that calculates parameters related to the processing of the captured image using a part of the captured image received by the communication unit, and a calculation unit.
    Cloud server with.
  23.  撮像を行い、撮像した撮像画像の一部を、前記撮像画像の処理に関するパラメータを算出する外部装置に送出する撮像装置と、
     前記撮像画像の一部を前記撮像装置から受信し、受信した前記撮像画像の一部を用いて、前記撮像画像の処理に関するパラメータを算出するクラウドサーバと、
     を有する撮像システム。
    An imaging device that performs imaging and sends a part of the captured image to an external device that calculates parameters related to the processing of the captured image.
    A cloud server that receives a part of the captured image from the image pickup device and calculates parameters related to the processing of the captured image by using the part of the received image.
    Imaging system with.
PCT/JP2021/022663 2020-06-30 2021-06-15 Imaging device, transmission method, transmission device, cloud server, and imaging system WO2022004353A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020113404 2020-06-30
JP2020-113404 2020-06-30

Publications (1)

Publication Number Publication Date
WO2022004353A1 true WO2022004353A1 (en) 2022-01-06

Family

ID=79316028

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/022663 WO2022004353A1 (en) 2020-06-30 2021-06-15 Imaging device, transmission method, transmission device, cloud server, and imaging system

Country Status (1)

Country Link
WO (1) WO2022004353A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016048911A (en) * 2014-08-25 2016-04-07 キヤノン株式会社 Information processing device, control method thereof, and control program
JP2017126914A (en) * 2016-01-15 2017-07-20 キヤノン株式会社 Image processing system
WO2017212958A1 (en) * 2016-06-10 2017-12-14 ソニー株式会社 Information processing device, information processing method, and program
JP2018006958A (en) * 2016-06-30 2018-01-11 キヤノン株式会社 Image processing device, image processing method, and program

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016048911A (en) * 2014-08-25 2016-04-07 キヤノン株式会社 Information processing device, control method thereof, and control program
JP2017126914A (en) * 2016-01-15 2017-07-20 キヤノン株式会社 Image processing system
WO2017212958A1 (en) * 2016-06-10 2017-12-14 ソニー株式会社 Information processing device, information processing method, and program
JP2018006958A (en) * 2016-06-30 2018-01-11 キヤノン株式会社 Image processing device, image processing method, and program

Similar Documents

Publication Publication Date Title
CN111698434B (en) Image processing apparatus, control method thereof, and computer-readable storage medium
US9769377B2 (en) Imaging apparatus and control method for handling a raw image of a moving image or a still image
US10366465B2 (en) Image capturing apparatus, method of controlling same, and storage medium
JP6396397B2 (en) Bit rate controller and output bit rate limiting method
US10600170B2 (en) Method and device for producing a digital image
US8731328B2 (en) Image processing apparatus, method and recording medium for generating a composite image
US20210176430A1 (en) Image capturing apparatus using learned model, information processing apparatus, methods of controlling respective apparatuses, learned model selection system, and storage medium
US20190082092A1 (en) Imaging apparatus, image processing apparatus, imaging method, image processing method, and storage medium
US10482580B2 (en) Image processing apparatus, image processing method, and program
WO2022151852A1 (en) Image processing method, apparatus, and system, electronic device, and storage medium
JP6831493B2 (en) Imaging equipment, imaging methods, and programs
TWI655865B (en) A method for configuration of video stream output from a digital video camera
KR20160135826A (en) Image processing apparatus, method for controlling image processing apparatus, image pickup apparatus, method for controlling image pickup apparatus, and recording medium
JP4561649B2 (en) Image compression apparatus, image compression program and image compression method, HDR image generation apparatus, HDR image generation program and HDR image generation method, image processing system, image processing program and image processing method
US10447969B2 (en) Image processing device, image processing method, and picture transmission and reception system
WO2022004353A1 (en) Imaging device, transmission method, transmission device, cloud server, and imaging system
WO2020158509A1 (en) Image capturing apparatus, image capturing method, and carrier means
JP6786273B2 (en) Image processing equipment, image processing methods, and programs
CN110072050B (en) Self-adaptive adjustment method and device of exposure parameters and shooting equipment
JP6904838B2 (en) Image processing device, its control method and program
JP6826472B2 (en) Image processing device and its control method
US11283938B2 (en) Communication apparatus communicating with another communication apparatus based on performance, control method, and storage medium
JP6971589B2 (en) Imaging device, imaging system, its control method and program
WO2022172640A1 (en) Information processing apparatus, information processing method, and program
WO2022219985A1 (en) Information processing method, information processing device, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21834273

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21834273

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP