JP2014150487A - Imaging device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make it possible to immediately share photographed image data with an external apparatus with a low transfer load.SOLUTION: In video recording, a digital camera 1 records image data (D1) with a first resolution based on an output image signal of an image sensor 30 in a non-volatile recording medium 16 via an encoder 33 or the like. Meanwhile, in parallel with the video recording, image data (D2) with a second resolution lower than that of the image data with the first resolution is generated, and streaming distribution of the image data with the second distribution to an external apparatus is performed via an encoder 42 or the like.

Description

  The present invention relates to an imaging apparatus.

  In an imaging device having a moving image shooting function, shot image data of a moving image is recorded on a non-volatile recording medium by recording. On the other hand, portable electronic devices (such as smartphones) having a communication function are rapidly spreading. In addition, image utilization forms such as sharing a photographed image among a plurality of people or making it viewable through uploading to a website are actively performed.

  In streaming delivery, a technique has been proposed for changing the resolution of an image to be transmitted according to network conditions (see Patent Document 1 below).

JP 2009-290691 A

  When sharing an image captured by an imaging device with another electronic device (such as a smartphone), first, the captured image data held by the imaging device is transferred to a personal computer, and the data is transferred to the other electronic device via the personal computer. Generally, a method such as copying is used. However, this method is time consuming and inferior to the user.

  Therefore, a method of streaming the captured image data to other electronic devices in parallel with the recording is also studied with the aim of reducing the burden on the user and improving immediacy. However, the image pickup apparatus is required to record high-quality image data, and if the high-quality image data acquired and recorded by the image pickup apparatus is simply streamed, the data transfer load becomes too heavy. There is a case. It is convenient if the captured image data can be shared with an external device immediately with a low transfer load. The technique described in Patent Document 1 is a simple streaming distribution technique that does not involve recording, and the technique cannot be simply used for an imaging apparatus that is required to acquire and record high-quality image data.

  SUMMARY An advantage of some aspects of the invention is that it provides an imaging apparatus that can immediately share captured image data with an external device with a low transfer load.

  An imaging apparatus according to the present invention includes an imaging element that outputs an image signal of an input image corresponding to incident light, a nonvolatile recording medium, and first resolution image data based on the output image signal of the imaging element. In parallel with recording by recording on a recording medium, image data having a second resolution lower than the first resolution is generated from an output image signal of the image sensor, and the image data having the second resolution is transmitted to an external device. The transmission processing unit is provided.

  This makes it possible to share the captured image data with an external device immediately with a low transfer load.

  At this time, it is preferable that a transmission control unit for controlling the execution of the transmission based on the output image signal of the imaging element is further provided in the imaging device.

  This makes it possible to stop transmission of image data in parallel with recording when it is considered that transmission should be refrained from the viewpoint of privacy protection.

  Specifically, for example, the transmission control unit includes a face detection unit that detects whether or not a human face is present in the input image, and the transmission control unit performs the transmission according to a detection result of the face detection unit. Whether to execute or not may be controlled.

  At this time, for example, when a face of a person exists in the input image, the face detection unit identifies whether or not the face in the input image matches the face of a predetermined registered person, The execution of the transmission may be controlled according to the identification result.

  Alternatively, for example, a transmission control unit that controls whether or not the transmission is performed in response to an input of a predetermined instruction during the recording period may be provided in the imaging apparatus.

  Thereby, transmission stop / permission considering privacy protection and the like can be realized at the operator's discretion.

  Further, for example, when the transmission is executed by the execution control of the transmission, the transmission processing unit outputs the second resolution image data that changes in real time in response to the real time change of the input image together with the audio data. It may be transmitted to the external device. On the other hand, when the transmission is stopped by the transmission execution control, the transmission processing unit may transmit only the audio data to the external device without transmitting the second resolution image data. Alternatively, certain image data may be transmitted to the external device.

  Further, for example, the transmission processing unit performs a predetermined processing process on the image portion of the human face image data included in the second resolution image data, and then the second resolution image data for the external device. May be sent.

  Thereby, privacy protection is achieved.

  Also, for example, when playing back the recorded content, the transmission processing unit generates the second resolution image data from the first resolution image data recorded on the nonvolatile recording medium and transmits the image data to the external device. May be.

  ADVANTAGE OF THE INVENTION According to this invention, it is possible to provide the imaging device which can share a picked-up image data with an external apparatus immediately with a low transfer load.

1 is a configuration block diagram of a digital camera according to an embodiment of the present invention. It is a figure which shows that the digital camera and electronic device which concern on embodiment of this invention can communicate. 1 is a block diagram of a digital camera according to an embodiment of the present invention, focusing on recording, playback and communication functions. FIG. It is the figure which showed a mode that the face detection part was contained in the transmission control part of FIG. It is a figure which shows the structure of a picked-up moving image. It is the figure which showed a mode that the face detection period and the face non-detection period were set during the recording period or the reproduction | regeneration period.

  Hereinafter, an example of an embodiment of the present invention will be specifically described with reference to the drawings. In each of the drawings to be referred to, the same part is denoted by the same reference numeral, and redundant description regarding the same part is omitted in principle. In this specification, for simplification of description, a symbol or reference that refers to information, signal, physical quantity, state quantity, member, or the like is written to indicate information, signal, physical quantity, state quantity or Names of members and the like may be omitted or abbreviated.

  FIG. 1 is a configuration block diagram of a digital camera (imaging apparatus) 1 according to an embodiment of the present invention. A digital camera (hereinafter may be abbreviated as “camera”) 1 includes each part referred to by reference numerals 11 to 20.

  The imaging unit 11 includes an optical system formed of a plurality of lenses and an imaging device (solid imaging device) including a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The imaging element generates and outputs an image signal of the subject by photoelectrically converting light according to the subject that is incident through the optical system. That is, the imaging unit 11 generates and outputs an image signal of a subject by photographing the subject (photographing target) using the image sensor. Hereinafter, a captured image of the subject based on the output image signal of the image sensor 30 is referred to as an input image.

  The image processing unit 12 performs predetermined image signal processing on the output signal of the imaging unit 11. The microphone unit 13 is composed of one or more microphones, and converts ambient sound of the camera 1 into an audio signal (acoustic signal) and outputs it. The audio processing unit 14 performs predetermined audio signal processing on the output audio signal of the microphone unit 13. The display unit 15 is a display screen composed of a liquid crystal display panel or the like, and displays an arbitrary video. The recording medium 16 is a non-volatile recording medium formed by a semiconductor memory, a magnetic disk, or the like, and records arbitrary signals and data. The speaker unit 17 reproduces and outputs an arbitrary audio signal based on the output audio signal of the microphone unit 13 or the audio signal recorded on the recording medium 16 as sound. The operation unit 18 is formed by a mechanical operation member such as a mechanical push button switch or a dial, and / or a touch panel that can be provided on the display unit 15, and receives various instructions and operations from a photographer (user).

  As shown in FIG. 2, the camera 1 can wirelessly communicate with an electronic device (external device) 2 provided outside the camera 1. However, the communication between the camera 1 and the electronic device 2 may be wired communication. The electronic device 2 is an arbitrary electronic device that can reproduce, process, or process arbitrary data. For example, a mobile phone, a personal digital assistant, a personal computer, an electronic book reader, an electronic dictionary, a digital camera, a game device, It is a navigation device. Communication between the camera 1 and the electronic device 2 follows an arbitrary communication standard (for example, a Wi-Fi (registered trademark) or Bluetooth (registered trademark) communication standard). The camera 1 and the electronic device 2 may be connected to an arbitrary network, and communication between the camera 1 and the electronic device 2 may be realized via the network. The electronic device 2 may be a WWW (World Wide Web) server device to which a predetermined IP address is assigned on the Internet. The server device as the electronic device 2 may operate a website such as an SNS (social networking service) or a so-called blog.

  The communication processing unit 19 of the camera 1 executes communication processing for performing arbitrary data and signal communication with the electronic device 2. The main control unit 20 is formed by a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and follows various instructions and operations input to the operation unit 18 while in the camera 1. Centrally control the operation of each part.

  FIG. 3 shows another block diagram of the camera 1 focusing on the recording, playback, and communication functions. In FIG. 3, reference numeral 30 represents the imaging element provided in the imaging unit 11. Each part referred to by reference numerals 31 to 36 and 40 is provided in the camera 1. The transmission processing unit 40 includes each part referred to by reference numerals 41 to 45. For example, each part referred to by reference numerals 31 to 33, 35, 41 and 42 in FIG. 3 can be included in the image processing unit 12 in FIG. 1, and the transmission control unit 36 in FIG. Each part that can be included in the unit 20 and that is referred to by reference numerals 43 to 45 in FIG. 3 can be included in the communication processing unit 19 in FIG.

  The output image signal of the image sensor 30 is supplied to the preprocessing unit 31. The preprocessing unit 31 performs predetermined signal processing (A / D conversion, signal amplification, noise reduction processing, demosaicing processing, etc.) on the output image signal of the image sensor 30, and the size adjustment unit 32 performs the signal processing. Image data D1 of the input image is generated by performing a first size adjustment process on the output image signal of the subsequent image sensor 30. The first size adjustment process is realized using known resolution conversion.

  The image size of an image to be recorded on the storage medium 16 is called a recording size. Prior to recording, the recording size is determined in advance. The image size of an arbitrary input image is represented by the product of the number of pixels in the horizontal direction and the number of pixels in the vertical direction that form the input image. The size adjustment unit 32 performs a first size adjustment process so that the image size of the input image based on the image data D1 matches the recording size. As an example, consider a case where the recording size is (1920 × 1080) pixels. In this case, the size adjustment unit 32 performs resolution conversion for converting the number of pixels of the input image from a number of pixels different from (1920 × 1080) pixels to (1920 × 1080), thereby (1920 × 1080) pixels. The image data D1 composed of the image data is generated. Note that when the image size of the output image signal of the image sensor 30 matches the recording size, the first resolution conversion is unnecessary. The resolution of the image data D1 corresponding to the number of pixels of the input image based on the image data D1 (in this example, (1920 × 1080)) is referred to as a first resolution.

  The encoder 33 performs a predetermined image compression process on the image data D1 to generate compressed image data D1 'which is the compressed image data D1. The image compression processing in the encoder 33 follows an arbitrary moving image compression method (for example, a compression method based on MPEG (Moving Picture Experts Group)) (the same applies to the encoder 42 described later). The compressed image data D1 'also has the first resolution. In the example of FIG. 3, it is assumed that the recording medium 16 is a memory card such as an SD (Secure Digital) card. The card controller 34 writes the compressed image data D1 'to a memory card as the recording medium 16. Compressed image data D1 'of a plurality of input images that are sequentially photographed at a predetermined frame rate (for example, 60 fps (frame per second)) is written to the recording medium 16 as image data of a photographed moving image. Note that the image data D1 can be written to the recording medium 16 without going through compression processing. The process of recording the first resolution image data (D1 or D1 ') on the recording medium 16 based on the output image signal of the image sensor 30 is referred to as recording or recording process. In response to an input of a predetermined recording instruction to the operation unit 18, the main control unit 20 executes a recording process.

  Although not apparent from FIG. 3, in the recording process, the audio data during the recording period is recorded on the recording medium 16 in synchronization with the image data. In other words, during the recording period, the audio data based on the output of the microphone unit 13 is compressed by the encoder 33 by a predetermined audio compression method (for example, AAC (Advanced Audio Coding)), and the compressed audio data and the compressed image data D1 ′. AV data for recording is recorded on the recording medium 16. The recording period refers to a period during which a recording process is executed in the camera 1.

  When recording is performed, the transmission processing unit 40 performs streaming distribution in parallel with the recording processing under the control of the transmission control unit 36. In the streaming distribution, the transmission processing unit 40 generates second resolution image data based on the output image signal of the image sensor 30 and transmits the generated second resolution image data to the electronic device 2. Here, the second resolution is lower than the first resolution.

  A specific configuration of the transmission processing unit 40 will be described. The size adjustment unit 41 performs the second size adjustment process on the image data D1 supplied from the size adjustment unit 32 to generate image data D2 of the input image. An image size of an input image to be transmitted to the electronic device 2 in streaming distribution is called a distribution size. The distribution size can be determined in advance, but the distribution size is smaller than the recording size. The size adjustment unit 41 performs the second size adjustment process so that the image size of the input image based on the image data D2 matches the distribution size. As an example, let us consider a case where the recording size is (1920 × 1080) pixels and the distribution size is (320 × 180). In this case, the size adjustment unit 41 performs resolution conversion for converting the number of pixels of the input image from (1920 × 1080) pixels to (320 × 180) pixels, thereby obtaining (320 × 180) pixel image data. The image data D <b> 2 is generated. The resolution of the image data D2 corresponding to the number of pixels of the input image based on the image data D2 ((320 × 180 in this example)) is the above-described second resolution.

  The encoder 42 performs a predetermined image compression process on the image data D2 to generate compressed image data D2 'that is the compressed image data D2. The compressed image data D2 'also has the second resolution. Although it is not clear from FIG. 3, during the recording period, audio data based on the output of the microphone unit 13 is compressed by the encoder 42 by a predetermined audio compression method (for example, AAC (Advanced Audio Coding)). The AV data for distribution including the compressed audio data and the compressed image data D2 ′ is output.

  The recording AV data and the distribution AV data described above are expressed in a PS (program stream) format suitable for storage in the recording medium 16. The PS / TS converter 43 converts the distribution AV data expressed in the PS format into TS data that is the distribution AV data in the TS (transport stream) format suitable for transmission. TS data is temporarily stored in the buffer memory 44 as much as necessary, and the transmission unit 45 transmits the TS data stored in the buffer memory 44 to the electronic device 2. Streaming distribution includes processing from generation of TS data from image data D1 and audio data to transmission of the TS data to the electronic device 2.

  The electronic device 2 that has received the TS data decompresses the TS data to restore the image data D2 and the audio data synchronized with the image data D2, and the restored image data D2 and the audio data are transferred to the display device in the electronic device 2 and It can be reproduced by an audio output device (both not shown) or a display device and an audio output device (both not shown) connected to the electronic device 2. The electronic device 2 can store the image data D2 and audio data based on the TS data in a recording medium (not shown) that the electronic device 2 has, or can post it on a website. The number of electronic devices 2 to which the camera 1 transmits TS data may be two or more.

  According to the present embodiment, a moving image captured by the camera 1 can be shared in real time among a plurality of devices including the camera 1, for example, a moving image captured on a device other than the camera 1 can be viewed in real time simultaneously with recording. Is possible. More specifically, for example, while recording a moving image captured by the camera 1, viewing the captured moving image in real time on a portable information terminal (a type of electronic device 2) owned by the photographer's family or friend Is possible. A use form in which image data D2 and audio data are posted on a website by transmitting image data D2 and audio data based on distribution AV data from the portable information terminal to a server device is also beneficial.

  In the camera 1, it is desired to record a captured moving image with high image quality such as full high-definition image quality. On the other hand, when sharing a captured moving image with a portable information terminal (smartphone or the like) as a kind of the electronic device 2 or considering posting on a website, a high image quality is often not desired. Also, high-quality image data transmission has a heavy transfer load. Further, when an image is stored in the electronic device 2, an image quality that is too high is often avoided because the required recording capacity increases. In consideration of these, in the camera 1, the resolution (second resolution) of the image data transmitted by streaming distribution is set lower than the resolution (first resolution) of the recorded image data. This makes it possible to share a captured moving image without increasing the transfer load more than necessary.

  Note that the frame rate of the moving image in the recording AV data and the frame rate of the moving image in the distribution AV data may or may not match. In order to further reduce the transfer load, the moving image frame rate (for example, 30 fps) in the distribution AV data may be set lower than the moving image frame rate (for example, 60 fps) in the recording AV data.

  In the camera 1, after recording the AV data for recording on the recording medium 16, the AV data for recording can be reproduced at an arbitrary timing. When playing back a captured moving image, the recording AV data read from the recording medium 16 via the card controller 34 is decoded by the decoder 35 (data compression is expanded), and the image data D1 and the audio data are stored. Restored. The resolution of the image data D <b> 1 restored by the decoder 35 is converted into a display resolution corresponding to the display size of the display unit 15, and image data having the display resolution is supplied to the display unit 15, thereby causing the display unit 15 to display the display data. The captured moving image is played back. In the example of FIG. 3, the conversion to the display resolution is also realized by the size adjustment unit 41. In addition, in synchronization with the reproduction of the captured moving image on the display unit 15, the audio data restored by the decoder 35 is reproduced by the speaker unit 17.

  When the recorded content is reproduced by the camera 1 (that is, when the recording AV data recorded on the recording medium 16 is reproduced by the display unit 15 and the speaker unit 17), the transmission processing unit 40 is connected to the transmission control unit 36. The streaming delivery may be executed under control. That is, when the recorded content is reproduced by the camera 1, the transmission processing unit 40, in parallel with the reproduction, from the recording AV data including the first resolution image data recorded on the recording medium 16 to the second resolution. AV data for distribution including image data may be generated and transmitted to the electronic device 2. During the reproduction period, image data D1 and audio data are supplied from the decoder 35 to the transmission processing unit 40. The playback period refers to a period during which the recorded content is played back by the camera 1.

  The transmission control unit 36 controls the transmission processing unit 40 so as to perform execution timing control of streaming distribution and control execution / non-execution of streaming distribution during the recording period. Hereinafter, detailed operation examples or configuration examples regarding the transmission control unit 36 or other related technologies will be described in a plurality of embodiments. As long as there is no contradiction, one of the embodiments described below can be combined with any other embodiment.

<< First Example >>
A first embodiment will be described. The transmission control unit 36 according to the first embodiment controls the execution / non-execution of streaming distribution based on the output image signal of the image sensor 30 during the recording period.

  Specifically, for example, as shown in FIG. 4, a face detection unit 51 is provided in the transmission control unit 36. The face detection unit 51 executes face detection processing for detecting whether or not a human face (hereinafter simply referred to as a face) exists in an input image based on an output image signal of the image sensor 30. The face detection unit 51 can execute face detection processing on each input image forming a captured moving image. The face detection unit 51 can perform face detection processing based on image data of an input image having an arbitrary resolution (for example, based on image data D1 or D2).

  Then, the transmission control unit 36 can control whether or not the streaming delivery is performed according to the result of the face detection process by the face detection unit 51. As shown in FIG. 5, the captured moving image is formed by a plurality of input images F [1] to F [n] arranged in time series (n is an integer of 2 or more). In the recording period, the image data D1 of the input images F [1] to F [n] are sequentially recorded on the recording medium 16 through the image compression process, and in the reproduction period, the input image F [ 1] to F [n] are sequentially reproduced on the display unit 15 in a moving image format. Each input image forming a captured moving image may be called a frame.

  The transmission control unit 36 uses the result of the face detection process, and the entire recording period or the entire reproduction period is divided into a face detection period in which a face exists in the input image and a face non-existence in which no face exists in the input image. And a detection period. The entire recording period or the entire reproduction period is a synthesis period of the face detection period and the face non-detection period. For example, as shown in FIG. 6, when the face exists only in the input images F [i] to F [n] among the input images F [1] to F [n], the entire recording period or the reproduction period Of the input image F [i] to F [n] is a face detection period, and the input image F [1] to F [i-1] is a face detection period. It is a non-detection period (i is an integer).

  For example, the transmission control unit 36 stops streaming distribution during the face detection period and executes streaming distribution during the face non-detection period. In some cases, it is necessary to protect the privacy of a person with respect to distribution. In such a case, it is beneficial to stop streaming distribution during the face detection period.

  Conversely, the transmission control unit 36 may stop streaming distribution during the face non-detection period and execute streaming distribution during the face detection period. For example, when recording the state of a child's presentation, the child may want to distribute the state of the child to the family. In such a case, it can be said that it is unnecessary to distribute a video (such as a mere landscape video) in which the child is not shown. In this case, it is beneficial to stop streaming distribution during the face non-detection period.

  The face detection unit 51, when a face exists in the input image, identifies whether or not the face in the input image matches a face of a predetermined registered person (hereinafter referred to as a registered face). May be executed. The face detection unit 51 can execute face identification processing on each input image forming a captured moving image. The face detection unit 51 can perform face identification processing based on image data of an input image having an arbitrary resolution (for example, based on image data D1 or D2). For the face identification processing, the image data or feature amount of the registered face is stored in the face detection unit 51 in advance as registered face data. The face detection unit 51 can realize face identification processing from a comparison between image data of an input image and registered face data.

  When a face is present in the input image, the transmission control unit 36 may control whether or not the streaming distribution is performed according to the result of the face identification process performed by the face detection unit 51. The transmission control unit 36 uses the results of the face detection process and the face identification process, and performs the entire recording period or the entire reproduction period for the registered face detection period in which the registered face exists in the input image and the registered face in the input image. Can be classified into a registered face non-detection period in which no exists. The entire recording period or the entire reproduction period is a combined period of the registered face detection period and the registered face non-detection period. For example, when the registered face exists only in the input images F [i] to F [n] among the input images F [1] to F [n], the entire recording period or the entire reproduction period The recording period or playback period of the input images F [i] to F [n] is a registered face detection period, and the recording period or playback period of the input images F [1] to F [i-1] is a registered face non-detection period. (I is an integer).

  For example, the transmission control unit 36 stops the streaming delivery in the registered face detection period and executes the streaming delivery in the registered face non-detection period. In some cases, it is necessary to protect the privacy of registered persons with respect to distribution. In such a case, it is beneficial to stop streaming distribution during the registered face detection period.

  Conversely, the transmission control unit 36 may stop streaming distribution during the registered face non-detection period and execute streaming distribution during the registered face detection period. For example, when recording a state of a photographer's child's presentation, there may be a case where the state of the photographer's child is distributed to the photographer's family. In such a case, it can be said that it is not necessary to distribute a video in which the child (registered person) of the photographer is not shown (scenery video or other child video). In this case, it is beneficial to stop streaming distribution during the registered face non-detection period.

  Not limited to the method of using the face detection process or the face recognition process, the transmission control unit 36 stops streaming delivery when the output image signal of the image sensor 30 satisfies a predetermined condition, and the output image signal of the image sensor 30 is predetermined. Streaming delivery should be executed when the conditions are not met. The photographer can set a predetermined condition related to the stop of streaming distribution via the operation unit 18.

<< Second Example >>
A second embodiment will be described. The transmission control unit 36 according to the second embodiment controls whether or not the streaming distribution is executed in response to an input of a predetermined transmission stop instruction or transmission permission instruction during the recording period. The operation unit 18 receives an input of a transmission stop instruction or a transmission permission instruction from the photographer. A dedicated button or the like that receives an input of a transmission stop instruction or a transmission permission instruction may be provided as a mechanical button or a button on the touch panel.

  In the recording period or the playback period, the transmission control unit 36 performs streaming distribution in principle, and stops streaming distribution only when a transmission stop instruction is input. Alternatively, during the recording period or the playback period, the transmission control unit 36 stops streaming distribution in principle, and executes streaming distribution only when a transmission permission instruction is input. With this configuration, it is possible to realize distribution stop / permission considering privacy protection or the like at the photographer's discretion.

<< Third Example >>
A third embodiment will be described. The target of streaming distribution is a moving image. Therefore, as a matter of course, when streaming delivery is executed, the transmission processing unit 40 has a second resolution that changes in real time in response to a real-time change of an input image to be recorded or reproduced (real-time change of image data of a captured moving image) The image data (D2 ′) is transmitted to the electronic device 2 together with the audio data.

  When streaming delivery is stopped using the method of the first or second embodiment, the transmission processing unit 40 may stop any data transmission to the electronic device 2, but the following first or second Transmission processing may be executed.

  In the first transmission process, the transmission processing unit 40 does not transmit the image data of the second resolution, and only the audio data based on the output of the microphone unit 13 (audio data associated with the captured moving image) is sent to the electronic device 2. Output. As a result, it is possible to distribute only the sound of the recording environment while realizing privacy protection by stopping the distribution of the video.

  In the second transmission process, the transmission processing unit 40 transmits certain image data J to the electronic device 2. The transmission of the constant image data J is continued until the execution of streaming distribution is resumed. Image data J is still image (freeze image) image data. Accordingly, when the second transmission process is used, image data of a certain still image is continuously transmitted to the electronic device 2. For example, any one of the input images F [1] to F [n] can be set as the image data J. More specifically, for example, when a transition is made from a period in which streaming distribution is being performed to a period in which streaming distribution is stopped, the second resolution image data for the frame immediately before the end of the former period is converted into image data J. Can be set. Accordingly, in the example of FIG. 6, when the stream distribution is stopped during the face detection period, the second resolution image data for the input image F [i-1] and the input image F [i-2] is used as the image data J. Set it. Or, for example, the image data J is preset image data regardless of the input images F [1] to F [n] (for example, image data expressing the characters “Distribution is suspended. Please wait”). It may be.

<< 4th Example >>
A fourth embodiment will be described. Although the processing for stopping streaming delivery during the face detection period has been described in the first embodiment, the transmission processing unit 40 according to the fourth embodiment does not stop streaming delivery during the face detection period, After performing predetermined processing on the image portion of the face image data included in the image data D2, the distribution AV data including the image data of the second resolution is transmitted to the electronic device 2.

  As processing, for example, glass processing, negative-positive processing, XOR0x80 processing, RGB switching processing, Win mask processing, Meko mask processing, Q0 mask processing, FL mask processing, CP mask processing, and the like can be adopted. These processes are all a kind of mask process, but a part of those processes is also classified as a mosaic process. In the mosaic processing, for example, the region to be processed is divided at predetermined pixel intervals in the vertical and horizontal directions, and the regions obtained by the division are rearranged at random. The processing target area is an image area in which face image data detected by the face detection process of the face detection unit 51 exists. The processing may be reversible or irreversible. Further, a blurring process (smoothing process or the like) for blurring the image in the processing target area may be included in the processing process.

  As shown in the example of FIG. 6, when face image data exists in the input image F [i], the processing unit (not shown) in the transmission processing unit 40 displays the face in the input image F [i]. Processing is performed on an image area where image data exists. Then, the transmission processing unit 40 transmits the image data of the second resolution of the input image F [i] that has undergone the processing process to the electronic device 2 by including it in the distribution AV data. The same applies to other input images (F [i + 1] etc.) in which face image data exists. According to the fourth embodiment, privacy protection can be achieved without stopping streaming delivery. The “face” described in the fourth embodiment may be a “registered face”.

<< Deformation, etc. >>
The embodiment of the present invention can be appropriately modified in various ways within the scope of the technical idea shown in the claims. The above embodiment is merely an example of the embodiment of the present invention, and the meaning of the term of the present invention or each constituent element is not limited to that described in the above embodiment. The specific numerical values shown in the above description are merely examples, and as a matter of course, they can be changed to various numerical values.

  The camera 1 can be configured by hardware such as an integrated circuit or a combination of hardware and software. Arbitrary specific functions that are all or part of the functions realized by the camera 1 are described as a program, the program is stored in a flash memory that can be mounted on the camera 1, and the program is executed by a program execution device. The specific function may be realized by executing on the microcomputer (for example, a microcomputer that can be mounted on the camera 1). The program can be stored and fixed on an arbitrary recording medium. The recording medium for storing and fixing the program may be mounted on or connected to a device (server device or the like) different from the camera 1.

1 Digital camera 2 Electronic equipment (external equipment)
16 Recording medium (nonvolatile recording medium)
30 Image sensor 36 Transmission control unit 40 Transmission processing unit 51 Face detection unit

Claims (8)

An image sensor that outputs an image signal of an input image according to incident light;
A non-volatile recording medium;
In parallel with recording by recording image data of the first resolution based on the output image signal of the image sensor on the nonvolatile recording medium, a second resolution lower than the first resolution from the output image signal of the image sensor An image pickup apparatus comprising: a transmission processing unit that generates the image data of the second resolution and transmits the image data of the second resolution to an external device. The imaging apparatus according to claim 1, further comprising a transmission control unit that controls whether or not the transmission is performed based on an output image signal of the imaging element. The transmission control unit includes a face detection unit that detects whether or not a human face exists in the input image, and controls whether or not the transmission is performed according to a detection result of the face detection unit. The imaging apparatus according to claim 2. When a face of a person is present in the input image, the face detection unit identifies whether the face in the input image matches a face of a predetermined registered person, and according to the identification result The imaging apparatus according to claim 3, wherein execution of the transmission is controlled. The imaging apparatus according to claim 1, further comprising a transmission control unit that controls whether or not the transmission is performed in response to an input of a predetermined instruction during a recording period. When the transmission is executed by the execution control of the transmission,
The transmission processing unit transmits the image data of the second resolution that changes in real time in response to a change in real time of the input image to the external device together with audio data,
When the transmission is stopped by the execution control of the transmission,
The transmission processing unit transmits only the audio data to the external device without transmitting the image data of the second resolution, or transmits certain image data to the external device. The imaging device according to any one of 1 to 5. The transmission processing unit performs predetermined processing on the image portion of the human face image data included in the second resolution image data, and then transmits the second resolution image data to the external device. The imaging apparatus according to claim 1, wherein the imaging apparatus is performed. When reproducing the recorded content, the transmission processing unit generates the second resolution image data from the first resolution image data recorded on the nonvolatile recording medium and transmits the image data to the external device. The imaging apparatus according to claim 1.

Images