JP5958219B2 - Moving picture coding apparatus, moving picture coding method, moving picture coding program, moving picture decoding apparatus, moving picture decoding method, moving picture decoding program, and moving picture processing apparatus - Google Patents

Description

  The disclosed technology relates to a moving image encoding device, a moving image encoding method, a moving image encoding program, a moving image decoding device, a moving image decoding method, a moving image decoding program, and a moving image processing device.

  In recent years, with the advancement of camera technology, in particular, moving image encoding and decoding technology, it has become possible for surveillance cameras and the like to record very high-definition images for monitoring. On the other hand, from the viewpoint of privacy protection, it is not preferable that anyone can access an image in which a general person is captured in high definition.

  On the other hand, if recording is performed with an image having a low resolution for privacy protection, or if a mosaic is applied to a human face, the monitoring capability is deteriorated because the image is not a high-resolution image.

  There is also a method of encrypting the image so that no one can access it, but if you encrypt the entire image, even if you want to restore only the image of a specific individual's face, The image of the person in the picture will also be restored. This is not preferable from the viewpoint of privacy protection.

JP 2007-251605 A International Publication No. 2009/144796

  In addition, there is a technique for encrypting a part of an image. However, when this is applied to a surveillance camera, it is necessary to extract a personal face included in the image and encrypt it, and the process becomes complicated.

  One aspect of the disclosed technique is to obtain a higher-resolution image for a designated region-of-interest image among regions-of-interest images included in a moving image than other region-of-interest images.

In the disclosed technique, the region-of-interest image extraction unit extracts a plurality of region-of-interest images from sequentially input images. The region-of-interest image encoding unit differs from the region-of-interest image selected from the plurality of region-of-interest images in the previous encryption-target image for a plurality of region-of-interest images extracted from the input image input as the encryption-target image. The region-of-interest image is selected as the selected region-of-interest image. The region-of-interest image encoding unit encodes the selected region-of-interest image using the first encoding method. The region-of-interest image encoding unit encodes a non-selected region-of-interest image other than the selected region-of-interest image by a second encoding method different from the first encoding method. In addition, the region-of-interest image encoding unit, for the plurality of region-of-interest images extracted from the input image input as a non-encryption target image other than the encryption target image, the first encoding method and Encoding is performed by a third encoding method different from the second encoding method. The encryption unit converts a frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as each of the encryption target images into the selected interest in each of the encryption target images. Encrypt with the encryption key corresponding to the area image.
Further, the region-of-interest image encoding unit intra-codes the selected region-of-interest image as the first encoding method, and the frame image encoded as the previous non-encryption target image as the second encoding method. The non-selected region-of-interest image is inter-coded as a reference image. The region-of-interest image encoding unit performs the following encoding as the third encoding method. That is, the region-of-interest image corresponding to the selected region-of-interest image among a plurality of regions-of-interest images extracted from the input image input as the next non-encryption target image of the encryption target image is encoded as the encryption target image. The encoded frame image is inter-coded as a reference image. For a region of interest image corresponding to a non-selected region of interest image among a plurality of region of interest images, a frame image encoded as a non-encryption target image before the encryption target image is inter-coded as a reference image. . A plurality of region-of-interest images extracted from the input image input as a non-encryption target image after the next non-encryption target image of the encryption target image are encoded as the immediately preceding non-encryption target image. The encoded frame image is inter-coded as a reference image.

  The disclosed technology has an effect that, as one aspect, a higher-resolution image can be obtained for a specified region-of-interest image included in a moving image than other region-of-interest images. .

It is a functional block diagram of a moving image encoding device. It is a figure for demonstrating the case where a main image and a sub image are produced | generated from an input image. It is a figure for demonstrating the other example in the case of producing | generating a main image and a sub image from an input image. It is a figure for demonstrating the encryption object image and reference relationship at the time of encoding a sub image. FIG. 11 is a block diagram of a computer that functions as a moving image encoding apparatus. FIG. 25 is a block diagram of a computer that functions as a moving picture decoding apparatus. It is a flowchart which shows the flow of a moving image encoding process. It is a figure for demonstrating an example of multiplexing. It is a flowchart which shows the flow of a moving image decoding process. It is a figure for demonstrating the decoding object image and reference relationship at the time of decoding a sub image. It is a figure for demonstrating the case where a sub image is encoded using inter-view prediction.

  Hereinafter, an example of an embodiment of the disclosed technology will be described in detail with reference to the drawings.

  FIG. 1 shows a moving image processing apparatus 10 according to the present embodiment. The moving image processing device 10 includes a photographing device 12, a moving image encoding device 14, a storage device 16, a moving image decoding device 18, and a display device 20. The moving image processing apparatus 10 is mounted on an apparatus having a moving image shooting function, such as a digital camera, a video camera, and a mobile phone with a camera function.

  The imaging device 12 includes an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). When the imaging device 12 is instructed to capture a moving image, the imaging device 12 outputs the image captured by the imaging element to the moving image encoding device 14 at a predetermined frame rate. As a result, images captured by the imaging element are sequentially input to the moving image encoding device 14.

  The moving image encoding device 14 includes an image processing unit 30, an input image encoding unit 32, a region of interest image extraction unit 34, a region of interest image encoding unit 36, an encryption unit 38, and a multiplexing unit 40.

  The image processing unit 30 performs predetermined image processing on the input image input from the imaging device 12. In this embodiment, for example, as illustrated in FIG. 2, the image processing unit 30 performs a process of reducing the input image 42 including the region-of-interest images A to C, generates a reduced image 44, and sets it as a main image. As illustrated in FIG. 3, the image processing unit 30 extracts the region-of-interest images A to C included in the input image 42 and generates a mosaic image 46 in which only the extracted region-of-interest images A to C are mosaicked. Processing may be executed and used as the main image.

  The input image encoding unit 32 compresses and encodes the main image. In the present embodiment, a compression encoding method using inter-frame prediction, for example, MPEG (Moving Picture Experts Group) and ITU-T recommendation H.264. The main image is encoded by an encoding method such as H.264.

  The region-of-interest image extraction unit 34 extracts a region-of-interest image that is a predetermined region-of-interest image from the input images sequentially input from the imaging device 12. In the present embodiment, the region-of-interest image is, for example, an image of a human face, but is not limited thereto. In the case of the input image 42 shown in FIG. Further, as shown in FIGS. 2 and 3, the region-of-interest image extraction unit 34 generates a group image 48 in which the extracted region-of-interest images A to C are collected as sub-images.

  The region-of-interest image encoding unit 36 encodes the selected region-of-interest image selected from the plurality of region-of-interest images extracted from the input image input by the first encoding method.

  The first encoding method is, for example, a method of intra-encoding a selected region of interest image. Here, the intra coding is a method of coding only from an input image to be coded, rather than coding by predicting an inter-frame with reference to a past coded frame image. Therefore, when decoding (decompressing), decoding can be performed without referring to past frame images.

  The encryption target image is set every time an input image is input N times, for example. FIG. 4 shows an example in which N = 3 in an image sequence configuration in which the input order of images is the same as the encoding order and all images can be reference images. In the drawing, regions of interest region image areas 50A to 50C obtained by encoding the region of interest images A to C included in the sub-images P0 to P8 are shown. In addition, the arrows in FIG. In the case of the example shown in the figure, the group images of the region-of-interest images A to C encoded in P0, P3, and P6 are encrypted. That is, every time the input image is input three times, the collective image of the region-of-interest images A to C is encrypted.

  The region-of-interest image encoding unit 36 selects a region-of-interest image different from the region-of-interest image selected from the plurality of region-of-interest images in the previous encryption target image as the selected region-of-interest image. For example, as shown in FIG. 4, when the region-of-interest image A is selected as the selected region-of-interest image 52A and is intra-encoded at P0, the region-of-interest image B is selected as the selected region of interest at P3 which is the next encryption target image. Selected as image 52B. Then, in the next encryption target image P6, the region-of-interest image C is selected as the selected region-of-interest image 52C. Thus, each time an encryption target image is set, a region of interest image different from the selected region of interest image of the previous encryption target image is selected.

  The region-of-interest image encoding unit 36 encodes non-selected region-of-interest images other than the selected region-of-interest image using a second encoding method different from the first encoding method. The second encoding method is, for example, a method in which a non-selected region-of-interest image is inter-coded using a frame image encoded as the previous non-encryption target image as a reference image (so-called P picture). Here, inter-coding is a method of generating a predicted image by performing inter-frame prediction using a past frame image as a reference image, and encoding a difference between the input image and the predicted image. Therefore, when decoding (expanding), a past frame image is decoded as a reference image.

  For example, as shown in FIG. 4, the region-of-interest image A which is the non-selected region-of-interest image 54A of P3 is the region of interest encoded by P2, which is the non-encryption target image immediately before P3, as indicated by the arrow A1. The image A is inter-coded as a reference image. Similarly, the region-of-interest image C which is the non-selected region-of-interest image 54C in P3 is the reference image of the region-of-interest image C encoded by P2, which is the non-encryption target image immediately before P3, as indicated by the arrow C1. Is inter-coded.

  Moreover, the region-of-interest image encoding unit 36 encodes a plurality of region-of-interest images included in the sub-image generated as the non-encryption target image by the third encoding method. In the third encoding method, the region-of-interest image corresponding to the selected region-of-interest image among the plurality of region-of-interest images extracted from the input image input as the next non-encryption target image of the encryption target image is encrypted. A frame image encoded as an encoding target image is inter-coded as a reference image. For example, as shown in FIG. 4, the region of interest image B of P4, which is a non-encryption target image, is inter-coded using the selected region of interest image 52B of P3, which is an encryption target image, as a reference image, as indicated by an arrow B1. Turn into.

  In the third encoding method, the region of interest image corresponding to the non-selected region of interest image is inter-coded using a frame image encoded as a non-encryption target image before the encryption target image as a reference image. To do. For example, as shown in FIG. 4, the P4 region-of-interest image A of the non-encryption target image uses the non-selected region-of-interest image 54A of P3, which is the encryption target image, as a reference image, as indicated by an arrow A2. Instead, the region-of-interest image A of P2 before P3 is inter-coded as a reference image. Similarly, the P4 region-of-interest image C is also inter-coded with the P2 region-of-interest image C before P3 as a reference image, as indicated by the arrow C2.

  Further, the third encoding method is that the plurality of region-of-interest images extracted from the input image input as the non-encryption target image after the next non-encryption target image of the encryption target image A frame image encoded as a non-encryption target image is inter-coded as a reference image. For example, as shown in FIG. 4, the region-of-interest image A of P5 that is a non-encryption target image after P4 that is the next non-encryption target image of P3 that is the encryption target image is indicated by an arrow A3. Then, the region-of-interest image A of P4 immediately before P5 is inter-coded as a reference image. The same applies to the region-of-interest images B and C.

  The encryption unit 38 encrypts a frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as the encryption target image with an encryption key corresponding to the selected region-of-interest image. For example, as illustrated in FIG. 4, the collective image of the region-of-interest images AC of P0 in which the region-of-interest image A is selected as the selected region-of-interest image is encrypted with the encryption key KeyA corresponding to the region-of-interest image A. Similarly, the collective image of the region-of-interest images A to C of P3 in which the region-of-interest image B is selected as the selected region-of-interest image is encrypted with the encryption key KeyB corresponding to the region-of-interest image B. Similarly, the collective image of the region-of-interest images A to C of P6 in which the region-of-interest image C is selected as the selected region-of-interest image is encrypted with the encryption key KeyC corresponding to the region-of-interest image C.

  The multiplexing unit 40 includes: main image encoded data obtained by encoding the main image by the input image encoding unit 32; and sub image encoded data obtained by encoding the sub image by the region-of-interest image encoding unit 36. Multiplexed and stored in the storage device 16 as moving image encoded data. When multiplexing, each encryption key is also multiplexed.

  The moving image decoding apparatus 18 includes a separation unit 60, an input image expansion unit 62, an image processing unit 64, a decoding unit 66, a region of interest image expansion unit 68, a region of interest image cutout unit 70, and a synthesis unit 72. Yes.

  When the decoding of the moving image is instructed, the separating unit 60 reads the moving image encoded data stored in the storage device 16, and the read moving image encoded data is converted into the main image encoded data and the sub image encoded data. , Separated.

  The input image expansion unit 62 decodes (expands) the main image encoded data.

  The image processing unit 64 performs predetermined image processing on the main image expanded by the input image expansion unit 62. The predetermined image processing is image processing corresponding to the image processing performed by the image processing unit 30 of the moving image encoding device 14. In the present embodiment, the image processing unit 30 of the moving image encoding device 14 generates a main image by performing a reduction process for reducing the input image. Therefore, the input image expansion unit 62 enlarges the main image. Processing, that is, processing for returning the size of the main image to the original size is performed. Note that when the image processing unit 30 of the moving image encoding device 14 performs processing for mosaicking the input image, the image processing unit 64 outputs the decompressed image as it is.

  The decryption unit 66 decrypts the frame image of the selected region-of-interest image encoded as the encryption target image with the decryption key corresponding to the region-of-interest image instructed to be decrypted.

  The region-of-interest image decompression unit 68, among the plurality of region-of-interest images represented by the sub-image encoded data, when decoding (decompression) of a specific region-of-interest image is instructed by the user. The region-of-interest image instructed for decoding is expanded.

  The region-of-interest image cutout unit 70 cuts out a frame image of the region-of-interest image instructed to be decoded from the sub-image and outputs the frame image to the combining unit 72.

  The combining unit 72 combines the region-of-interest image cut out by the region-of-interest image cutting unit 70 with the input image returned by the image processing unit 64 and outputs the combined image to the display device 20.

  The moving image encoding device 14 can be realized by a computer 80 shown in FIG. 5, for example. The computer 80 includes a CPU 82, a memory 84, and a nonvolatile storage unit 86, which are connected to each other via a bus 88.

  The storage unit 86 can be realized by an HDD (Hard Disk Drive), a flash memory, or the like. A storage unit 86 as a recording medium stores a moving image encoding program 90 for causing the computer 80 to function as the moving image encoding device 14. The CPU 82 reads out the moving image encoding program 90 from the storage unit 86 and develops it in the memory 84, and sequentially executes processes included in the moving image encoding program 90.

  The moving image encoding program 90 includes an image processing process 92, an input image encoding process 94, a region of interest image extraction process 96, a region of interest image encoding process 98, an encryption process 100, and a multiplexing process 102.

  The CPU 82 operates as the image processing unit 30 illustrated in FIG. 1 by executing the image processing process 92. The CPU 82 operates as the input image encoding unit 32 illustrated in FIG. 1 by executing the input image encoding process 94. Further, the CPU 82 operates as the region-of-interest image extraction unit 34 illustrated in FIG. 1 by executing the region-of-interest image extraction process 96. The CPU 82 operates as the region-of-interest image encoding unit 36 shown in FIG. 1 by executing the region-of-interest image encoding process 98. The CPU 82 operates as the encryption unit 38 shown in FIG. 1 by executing the encryption process 100. The CPU 82 operates as the multiplexing unit 40 illustrated in FIG. 1 by executing the multiplexing process 102.

  As a result, the computer 80 that has executed the moving picture coding program 90 functions as the moving picture coding apparatus 14. The moving image encoding program 90 is an example of a moving image encoding program in the disclosed technology.

  Note that the moving image encoding device 14 can be realized by, for example, a semiconductor integrated circuit, more specifically, an ASIC (Application Specific Integrated Circuit) or the like.

  The moving picture decoding apparatus 18 can be realized by, for example, the computer 110 shown in FIG. The computer 110 includes a CPU 112, a memory 114, and a nonvolatile storage unit 116, which are connected to each other via a bus 118.

  The storage unit 116 can be realized by an HDD (Hard Disk Drive), a flash memory, or the like. The storage unit 116 as a recording medium stores a moving picture decoding program 120 for causing the computer 110 to function as the moving picture decoding apparatus 18. The CPU 112 reads out the moving picture decoding program 120 from the storage unit 116 and develops it in the memory 114, and sequentially executes processes included in the moving picture decoding program 120.

  The moving image decoding program 120 includes a separation process 122, an input image expansion process 124, an image processing process 126, a decoding process 128, a region of interest image expansion process 130, a region of interest image extraction process 132, and a synthesis process 134.

  The CPU 112 operates as the separation unit 60 illustrated in FIG. 1 by executing the separation process 122. Further, the CPU 112 operates as the input image expansion unit 62 illustrated in FIG. 1 by executing the input image expansion process 124. Further, the CPU 112 operates as the image processing unit 64 illustrated in FIG. 1 by executing the image processing process 126. Further, the CPU 112 operates as the decryption unit 66 shown in FIG. 1 by executing the decryption process 128. The CPU 112 operates as the region-of-interest image expansion unit 68 shown in FIG. 1 by executing the region-of-interest image expansion process 130. Further, the CPU 112 operates as the region-of-interest image cutting unit 70 shown in FIG. 1 by executing the region-of-interest image cutting process 132. The CPU 112 operates as the synthesis unit 72 illustrated in FIG. 1 by executing the synthesis process 134.

  As a result, the computer 110 that has executed the moving picture decoding program 120 functions as the moving picture decoding apparatus 18. The moving picture decoding program 120 is an example of a moving picture decoding program in the disclosed technology.

  Note that the moving picture decoding apparatus 18 can be realized by, for example, a semiconductor integrated circuit, more specifically, an ASIC (Application Specific Integrated Circuit) or the like.

Next, the operation of this embodiment will be described. First, the video encoding process executed by the video encoding device 14 will be described with reference to the flowchart shown in FIG. Note that the moving image encoding process shown in FIG. 7 is executed when shooting of a moving image is started by the shooting device 12. When shooting of moving images is started by the shooting device 12, images shot by the shooting device 12 are sequentially input to the moving image encoding device 14 at a predetermined frame rate.

  In step 200 of the moving image encoding process, the image processing unit 30 performs predetermined image processing on the input image input from the imaging device 12. As shown in FIG. 2, the image processing unit 30 executes a process of generating a reduced image 44 obtained by reducing the input image 42 input from the imaging device 12.

  In step 202, the input image encoding unit 32 encodes the main image subjected to the image processing in step 204 using an inter-frame prediction, such as MPEG (Moving Picture Experts Group) or ITU-T Recommendation H.264. It is encoded by an encoding method such as H.264.

  In parallel with the processing in steps 200 and 202, in step 204, the region-of-interest image extraction unit 34 extracts, for example, a human face image as the region-of-interest image from the input image 42, as shown in FIG. As a method for extracting a human face image, a known method such as feature extraction processing or pattern matching is used.

  In step 206, the region-of-interest image extraction unit 34 generates a collective image in which the region-of-interest images extracted in step 204 are collected. Thereby, as shown in FIG. 2, a collective image 48 in which the region-of-interest images are gathered is generated.

  In step 208, the region-of-interest image encoding unit 36 determines whether or not the input image is an encryption target. In the present embodiment, the encryption target image is set every time the input image is input three times. Therefore, in the example shown in FIG. 4, step 208 is affirmatively determined at P0, P3, and P6, and step 208 is negatively determined otherwise.

  In step 210, the region-of-interest image encoding unit 36 selects, as the selected region-of-interest image, the region-of-interest image to be encoded by the first encoding method from the plurality of region-of-interest images included in the collective image 48. The selected region-of-interest image is encoded by the first encoding method. In the present embodiment, the first encoding method is a method of intra-encoding a selected region of interest image. Non-selected region-of-interest images other than the selected region-of-interest image are encoded by a second encoding method different from the first encoding method. In the present embodiment, the second encoding method is a method of inter-encoding a non-selected region-of-interest image using a frame image encoded as the immediately preceding non-encryption target image as a reference image. For example, as shown by an arrow A1 in FIG. 4, the region-of-interest image A that is the non-selected region-of-interest image 54A in P3 is inter-coded using the region-of-interest image A of P2 that is the non-encryption target image immediately before P3 as a reference image. Turn into. Similarly, the region-of-interest image C which is the non-selected region-of-interest image 54C in P3 is inter-coded using the region-of-interest image C of P2 which is the non-encryption target image immediately before P3 as a reference image.

  The region-of-interest image encoding unit 36 selects a region-of-interest image that is different from the selected region-of-interest image of the previous encryption-target image every time an encryption-target image is set. For example, in the example of FIG. 4, the region of interest image A is selected as the selected region of interest image 52A at P0. In the next encryption target image P3, the region-of-interest image B is selected as the selected region-of-interest image 52B. Further, in the next encryption target image P6, the region-of-interest image C is selected as the selected region-of-interest image 52C.

  In step 214, the encryption unit 38 encrypts a frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as the encryption target image with an encryption key corresponding to the selected region-of-interest image. Turn into. For example, as shown in FIG. 4, the collective image of the region-of-interest images A to C of P0 in which the region-of-interest image A is selected as the selected region-of-interest image 52A is encrypted with the encryption key KeyA corresponding to the region-of-interest image A. . Similarly, the collective image of the region-of-interest images A to C of P3 in which the region-of-interest image B is selected as the selected region-of-interest image 52B is encrypted with the encryption key KeyB corresponding to the region-of-interest image B. Similarly, the collective image of the region-of-interest images A to C of P6 in which the region-of-interest image C is selected as the selected region-of-interest image 52C is encrypted with the encryption key KeyC corresponding to the region-of-interest image C.

  On the other hand, if it is determined in step 208 that the input image is not an encryption target, that is, if it is determined that the input image is a non-encryption target image, the process proceeds to step 216.

  In step 216, it is determined whether or not the immediately preceding reference image is to be encrypted. If the immediately preceding reference image is to be encrypted, the process proceeds to step 218. In the example of FIG. 4, with respect to the input images P1, P4, and P7, P0, P3, and P6 immediately before P1, P4, and P7, which are reference image candidates for P1, P4, and P7, are to be encrypted. In step 216, an affirmative determination is made. On the other hand, for the input images of P2, P5, and P8, P1, P4, and P7 immediately before P2, P5, and P8, which are reference image candidates for P2, P5, and P8, are not encryption targets. Negative determination is made.

  In step 218, the region-of-interest image encoding unit 36 encodes the plurality of region-of-interest images included in the collective image 48 using the third encoding method. In the third encoding method, the region-of-interest image corresponding to the selected region-of-interest image among the plurality of region-of-interest images extracted from the input image input as the next non-encryption target image of the encryption target image is encrypted. A frame image encoded as an encoding target image is inter-coded as a reference image. For example, as illustrated in FIG. 4, the region of interest image B of P4 that is a non-encryption target image is inter-coded using the selected region of interest image B of P3 that is an encryption target image as a reference image.

  In the third encoding method, the region of interest image corresponding to the non-selected region of interest image is inter-coded using a frame image encoded as a non-encryption target image immediately before the encryption target image as a reference image. To do. For example, as indicated by an arrow A2 in FIG. 4, the region-of-interest image A of P4 that is a non-encryption target image does not use the non-selection region-of-interest image A of P3 that is an encryption target image as a reference image. The region-of-interest image A in P2 before P3 is inter-coded as a reference image. The same applies to the region-of-interest image C of P4.

  On the other hand, if a negative determination is made in step 216, that is, if the non-encryption target image is subsequent to the non-encryption target image next to the encryption target image, the process proceeds to step 220.

In step 220, the region-of-interest image encoding unit 36 inter-codes a plurality of region-of-interest images included in the collective image 48 using a frame image encoded as the immediately preceding non-encryption target image as a reference image.
For example, as indicated by an arrow A3 in FIG. 4, a region-of-interest image A of P5 that is a non-encryption target image after P4 that is a non-encryption target image is P4 that is a non-encryption target image immediately before P5. The region-of-interest image A is inter-coded as a reference image. The same applies to the region-of-interest images B and C.

  In step 222, the multiplexing unit 40 multiplexes the main image encoded data in which the main image is encoded and the sub image encoded data in which the sub image is encoded, and stores it as moving image encoded data. 16 is stored. When multiplexing, each encryption key is also multiplexed.

  Hereinafter, a specific multiplexing method will be described. In the present embodiment, as an example, a case will be described in which multiplexing processing is performed in the Transport Stream (TS) format, which is one of the formats when audio and video encoded in digital broadcasting or the like are multiplexed and transmitted.

  FIG. 8 shows an image diagram of TS format packet data. Here, in the figure, only the packet for sub image encoded data and the packet including the encryption key are shown. The TS packet 140 includes a header unit 140A and a data unit 140B. By referring to information included in the header unit 140A, it is possible to grasp whether or not the packet is in an encrypted state. it can.

  Here, when the value of the transport_scrambling_control field, which is a parameter relating to encryption, is “00”, the data part 140B is not encrypted, when “01”, it is encrypted with the Odd key, and when it is “10”. It is defined as being encrypted with an Even key. Here, the information of the Odd key and the Even key is included in a TS packet (key packet) including the key. The key packet always includes the Odd key and the Even key, and only one of the keys is changed in time series. For example, as shown in FIG. 8, in the key packet 142 provided before P0, the Odd key is defined as the encryption key KeyA, and the Even key is defined as the encryption key KeyB. In addition, in the key packet 144 provided before P3, only the odd key is changed to the encryption key KeyC as compared with the previous key packet 142. Further, the key packet 146 provided before P6 is changed only to the Even key to the encryption key KeyA as compared with the previous key packet 144.

  In the example of FIG. 8, since the packet of P0 is encrypted with the encryption key KeyA, transport_scrambling_control is defined as “01” so that the Odd key is used. Since the packet of P3 is encrypted with the encryption key KeyB, transport_scrambling_control is defined as “10” so that the Even key is used. Further, since the packet of P6 is encrypted with the encryption key KeyC, transport_scrambling_control is defined as “01” so that the Odd key is used.

  Further, as shown in FIG. 8, the encryption keys KeyA, KeyB, and KeyC are encrypted with work keys A, B, and C, which are higher-order keys corresponding to the keys.

  Therefore, only a specific administrator who holds the master key can decrypt the work key corresponding to the encryption key necessary for decrypting the packet to be encrypted. Then, using the decrypted work key, the corresponding encryption key is decrypted, and the encrypted packet is decrypted using the decrypted encryption key.

  Next, the video decoding process executed by the video decoding device 18 will be described with reference to the flowchart shown in FIG. Note that the moving picture decoding process shown in FIG. 9 is executed when the user gives an instruction to play a moving picture. When the user gives an instruction to play a moving image, the moving image encoded data stored in the storage device 16 is read out and input to the moving image decoding device 18.

  In step 300 of the moving image decoding process, the separation unit 60 separates the encoded moving image data stored in the storage device 16 into main image encoded data and sub image encoded data.

  In step 302, the input image expansion unit 62 decodes (expands) the main image encoded data.

  In step 304, the image processing unit 64 performs predetermined image processing on the input image expanded by the input image expansion unit 62. The predetermined image processing is image processing corresponding to the image processing performed by the image processing unit 30 of the moving image encoding device 14. In this embodiment, since the image processing unit 30 of the moving image encoding device 14 performs a reduction process for reducing the input image, the input image expansion unit 62 performs an enlargement process for enlarging the input image, that is, the input image. The process of returning the size of the file to the original size is performed.

  In parallel with the processing in steps 302 and 304, in step 306, the decoding unit 66 determines whether or not decoding of a specific region-of-interest image has been instructed. When the administrator decrypts a specific region-of-interest image, the administrator inputs a work key corresponding to the specific region-of-interest image decrypted using the master key to the moving image decryption apparatus 18. If an affirmative determination is made in step 306, the process proceeds to step 308, and if a negative determination is made, the process proceeds to step 320. As described above, when the decoding of the specific region-of-interest image is not instructed, the sub-image is not decoded, so that the region-of-interest image is not displayed with high definition and privacy is protected. When decoding a plurality of region-of-interest images, a work key corresponding to each region-of-interest image may be input.

  In step 308, the decryption unit 66 acquires an encryption key corresponding to the region-of-interest image instructed to decrypt. Specifically, the encryption key corresponding to the region-of-interest image instructed to be decrypted is decrypted using the input work key. For example, when the region-of-interest image instructed to be decrypted is the region-of-interest image A, the encryption key KeyA is decrypted using the work key A corresponding thereto.

  In step 310, the decryption unit 66 determines whether or not the input frame image is an encrypted frame image. If it is an encrypted frame image, the process proceeds to step 312, and if it is an unencrypted frame image, the process proceeds to step 316.

  For example, as shown in FIG. 10, since the sub-images of P0, P3, and P6 are encrypted with the encryption keys KeyA, KeyB, and KeyC, respectively, step 310 is affirmed, and the other sub-images are encrypted. In step 310, a negative determination is made.

  In step 312, the decryption unit 66 determines whether or not the input frame image is a frame image encrypted with an encryption key corresponding to a specific region-of-interest image. If the input frame image is a frame image encrypted with the encryption key corresponding to the specific region-of-interest image, the process proceeds to step 314 and encrypted with the encryption key corresponding to the specific region-of-interest image. If it is not a frame image, the process proceeds to step 320.

  For example, when the work key corresponding to the region-of-interest image B is input and the encryption key KeyB is acquired in step 308, the sub-images of P0 and P6 are respectively encrypted with the encryption keys KeyA and KeyC as shown in FIG. Therefore, a negative determination is made in step 312. On the other hand, since the sub-image of P3 is encrypted with the encryption key KeyB, the determination at step 312 is affirmative.

  In step 314, the encrypted encoded data of the frame image input with the encryption key corresponding to the specific region-of-interest image instructed to be decoded is decoded. As shown in FIG. 10, when decryption of the region-of-interest image B is instructed, the encrypted encoded data of the sub-image of P3 is decrypted with the encryption key KeyB.

  In step 316, the region-of-interest image decompression unit 68 decompresses the input frame image. As shown in FIG. 10, when the decryption of the region-of-interest image B is instructed, the sub-image of P3 is decrypted with the encryption key KeyB, and the region-of-interest image B of P3 is intra-coded. Therefore, the region-of-interest image B is normally expanded.

  On the other hand, the region-of-interest images A and C for which decryption is not instructed are the region-of-interest images for which P0 and P6 encrypted sub-images are not decrypted and are not normally expanded but are not instructed to be decrypted. There is no particular problem.

  In step 318, the region-of-interest image cutout unit 70 cuts out the frame image of the region-of-interest image instructed to be decoded from the decoded frame image and outputs the frame image to the synthesis unit 72. As shown in FIG. 10, when the decoding of the region of interest image B is instructed, only the region of interest image B is cut out from the sub image and output to the combining unit 72.

  In step 320, the combining unit 72 combines the region-of-interest image cut out by the region-of-interest image cutting unit 70 with the main image expanded by the input image expansion unit 62 and outputs the combined image to the display device 20. Thereby, a moving image is displayed on the display device 20. In step 320, if a negative determination is made in steps 306 and 312, the composition process is not executed and the main image is output as it is. Thereby, the region of interest image is not displayed with high definition, and privacy is protected.

  Thus, in the present embodiment, any selected region-of-interest image among a plurality of region-of-interest images included in the sub-image in the encryption target image is intra-coded, and the others are inter-coded. Each time an encryption target image is set, the selected region-of-interest image is differentiated and encrypted with an encryption key corresponding to the selected region-of-interest image. For this reason, since only a specific region-of-interest image is normally decoded when decoding, an image in which only a specific region-of-interest image is increased in resolution can be obtained. Therefore, when the disclosed technology is applied to surveillance cameras, etc., a low-resolution image that takes privacy into consideration or a mosaic image of only the person's face is displayed in normal times, and only when a crime occurs, the face of the criminal Etc. can be decoded and displayed with fine images.

  In the present embodiment, as the second encoding method, the case where the non-selected region-of-interest image is inter-encoded using the frame image encoded as the immediately preceding non-encryption target image as a reference image has been described. Not limited to. For example, as a second encoding method, intra-encoding may be performed by replacing a non-selected region-of-interest image with a dummy image. In this case, in step 210 of FIG. 7, the non-selected region-of-interest image may be replaced with a dummy image, and intra coding may be performed using only the dummy image.

  Further, in the present embodiment, a case has been described in which any selected region-of-interest image among a plurality of regions-of-interest images included in the sub-image in the encryption target image is intra-coded and the others are inter-coded. Not limited.

  For example, ITU-T Recommendation H.264. Multi-view coding (MVC) standardized in H.264 may be applied. In MVC, video captured at a plurality of start points (multi-view) is encoded as a base view (Base View) and a non-base view (Non Base View). The base view is an original image that is referred to from a non-base view, and the non-base view is an image that is encoded by inter-view prediction using the image of the base view as a reference image.

  Therefore, for example, as shown in FIG. 11, the main image is a base view and the sub-image is a non-base view. In step 210 of FIG. 7, at P0 that is the encryption target image, the selected region-of-interest image 52A is encoded using inter-view prediction with the region-of-interest image A of the corresponding base view as a reference image. Further, the region-of-interest images B and C are inter-coded in step 210 of FIG. 7 using the region-of-interest images B and C of the past sub-image as reference images. Then, the sub-image of P0 is encrypted with the encryption key KeyA. Similarly, in P3 that is the encryption target image, the selected region-of-interest image 52B is encoded using inter-view prediction with the region-of-interest image B of the corresponding base view as a reference image. The region-of-interest images A and C are inter-coded using the region-of-interest images A and C of the past sub-image as reference images. Then, the sub-image of P3 is encrypted with the encryption key KeyB. In P6, which is an encryption target image, the selected region-of-interest image 52C is encoded using inter-view prediction using the region-of-interest image C of the corresponding base view as a reference image. The region-of-interest images A and B are inter-coded using the region-of-interest images A and C of the past sub-images as reference images. Then, the sub-image of P6 is encrypted with the encryption key KeyC.

  As described above, the selected region-of-interest image is also inter-coded using the corresponding region-of-interest image of the base view as a reference image, so that the data amount of the sub-image is reduced compared to the case where the selected region-of-interest image is intra-encoded. It becomes possible.

  In the present embodiment, the moving image processing device 10 including the moving image encoding device 14 and the moving image decoding device 18 has been described. However, the moving image encoding device 14 and the moving image decoding device 18 are separate devices. It may be installed.

  Moreover, although the moving image encoding program 90 which is an example of the moving image encoding program which concerns on the technique of the indication demonstrated above the aspect pre-stored (installed) in the memory | storage part 86, it is not limited to this Absent. The moving image encoding program according to the disclosed technology can be provided in a form recorded on a recording medium such as a CD-ROM or a DVD-ROM. Also, the moving picture decoding program can be provided in a form recorded on a recording medium such as a CD-ROM or a DVD-ROM, similarly to the moving picture encoding program.

  All documents, patent applications and technical standards mentioned in this specification are to the same extent as if each individual document, patent application and technical standard were specifically and individually stated to be incorporated by reference. Incorporated by reference in the book.

  Regarding the above embodiment, the following additional notes are disclosed.

(Appendix 1)
A region-of-interest image extraction unit that extracts a plurality of region-of-interest images from sequentially input images;
Regarding the plurality of region-of-interest images extracted from the input image input as the encryption target image, a region-of-interest image different from the region-of-interest image selected from the plurality of region-of-interest images in the previous encryption target image is used. The selected region of interest image is selected and encoded by the first encoding method, and the non-selected region of interest image other than the selected region of interest image is encoded by a second encoding method different from the first encoding method. For the plurality of region-of-interest images extracted from the input image input as a non-encryption target image other than the encryption target image, the first encoding method and the second encoding method A region-of-interest image encoding unit for encoding with a different third encoding method;
A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as each of the encryption target images corresponds to the selected region-of-interest image in each of the encryption target images. An encryption unit for encrypting with an encryption key;
A video encoding apparatus including:

(Appendix 2)
The first encoding method is an encoding method for encoding without referring to other frame images, and the second encoding method and the third encoding method refer to other frame images. The moving image encoding apparatus according to appendix 1, wherein the encoding method is encoded by performing the encoding process.

(Appendix 3)
The region-of-interest image encoding unit performs intra encoding on the selected region-of-interest image as the first encoding method, and encodes it as the previous non-encryption target image as the second encoding method. The non-selected region-of-interest image is inter-coded using a frame image as a reference image, and extracted as the third encoding method from the input image input as a non-encryption target image next to the encryption target image. Of the plurality of region-of-interest images, the region-of-interest image corresponding to the selected region-of-interest image is inter-coded as a reference image using a frame image encoded as the encryption target image, and among the plurality of region-of-interest images Regarding the region of interest image corresponding to the non-selected region of interest image, a frame image encoded as a non-encryption target image prior to the encryption target image For the plurality of region-of-interest images extracted from the input image input as a non-encryption target image subsequent to the next non-encryption target image of the encryption target image, The moving image encoding device according to attachment 2, wherein a frame image encoded as the immediately preceding non-encryption target image is inter-encoded as a reference image.

(Appendix 4)
The region-of-interest image encoding unit intra-codes the selected region-of-interest image as the first encoding method, and replaces the non-selected region-of-interest image with a dummy image as the second encoding method. As the third encoding method, the selected region-of-interest image is selected from among the plurality of region-of-interest images extracted from the input image input as a non-encryption target image next to the encryption target image. For the corresponding region-of-interest image, the frame image encoded as the encryption target image is inter-coded as a reference image, and the region-of-interest image corresponding to the non-selected region-of-interest image among the plurality of region-of-interest images. A frame image encoded as a non-encryption target image before the encryption target image is inter-coded as a reference image, and the encryption target The plurality of region-of-interest images extracted from the input image input as a non-encryption target image after the next non-encryption target image of the image were encoded as the immediately preceding non-encryption target image The moving image coding apparatus according to attachment 2, wherein the frame image is inter-coded as a reference image.

(Appendix 5)
An image processing unit that performs predetermined image processing on the input image;
An input image encoding unit that encodes the input image subjected to the image processing;
The moving picture encoding device according to any one of supplementary notes 1 to 4, comprising:

(Appendix 6)
An image processing unit that performs predetermined image processing on the input image;
An input image encoding unit that encodes the input image subjected to the image processing;
With
The region-of-interest image encoding unit, as the first encoding method, inter-codes the selected region-of-interest image using the frame image encoded by the input image encoding unit as a reference image, and the second code As the encoding method, the non-selected region-of-interest image is inter-coded using the frame image encoded as the immediately preceding non-encryption target image as a reference image, and as the third encoding method, A region of interest image corresponding to the selected region of interest image among the plurality of region of interest images extracted from the input image input as a non-encryption target image of the frame encoded as the encryption target image The image is inter-coded as a reference image, and the region-of-interest image corresponding to the non-selected region-of-interest image among the plurality of region-of-interest images is A frame image encoded as a non-encryption target image before the encoding target image is inter-encoded as a reference image, and a non-encryption target image subsequent to the non-encryption target image next to the encryption target image The moving picture encoding apparatus according to claim 1, wherein the plurality of region-of-interest images extracted from the input image that is input is inter-encoded as a reference image using a frame image encoded as the immediately preceding non-encryption target image. .

(Appendix 7)
The moving image encoding apparatus according to appendix 5 or appendix 6, wherein the predetermined image processing is a process of reducing the input image or a process of mosaicing only the region-of-interest image included in the input image.

(Appendix 8)
Extract multiple region-of-interest images from sequentially input images,
Regarding the plurality of region-of-interest images extracted from the input image input as the encryption target image, a region-of-interest image different from the region-of-interest image selected from the plurality of region-of-interest images in the previous encryption target image is used. The selected region of interest image is selected and encoded by the first encoding method, and the non-selected region of interest image other than the selected region of interest image is encoded by a second encoding method different from the first encoding method. For the plurality of region-of-interest images extracted from the input image input as a non-encryption target image other than the encryption target image, the first encoding method and the second encoding method Encoding with a different third encoding method,
A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as each of the encryption target images corresponds to the selected region-of-interest image in each of the encryption target images. A moving image encoding method including encryption with an encryption key.

(Appendix 9)
The first encoding method is an encoding method for encoding without referring to other frame images, and the second encoding method and the third encoding method refer to other frame images. The moving picture coding method according to claim 8, wherein the moving picture coding method is a coding method.

(Appendix 10)
As the first encoding method, the selected region-of-interest image is intra-coded, and as the second encoding method, the frame image encoded as the previous non-encryption target image is used as the non-selected image as a reference image. The region-of-interest image is inter-coded, and as the third encoding method, among the plurality of region-of-interest images extracted from the input image input as a non-encryption target image next to the encryption target image, Regarding the region of interest image corresponding to the selected region of interest image, the frame image encoded as the encryption target image is inter-coded as a reference image, and corresponds to the non-selected region of interest image among the plurality of region of interest images. Regarding the region-of-interest image, a frame image encoded as a non-encryption target image before the encryption target image is used as a reference image. The plurality of region-of-interest images extracted from the input image input as a non-encryption target image after the next non-encryption target image of the encryption target image, and the previous non-encryption target The moving image encoding method according to appendix 9, wherein a frame image encoded as an image is inter-encoded as a reference image.

(Appendix 11)
As the first encoding method, the selected region-of-interest image is intra-coded, and as the second encoding method, the non-selected region-of-interest image is replaced with a dummy image and intra-coded, and the third encoding is performed. As a method, for the region-of-interest image corresponding to the selected region-of-interest image among the plurality of region-of-interest images extracted from the input image input as the next non-encryption target image of the encryption target image, A frame image encoded as an encryption target image is inter-coded as a reference image, and a region of interest image corresponding to the non-selected region of interest image among the plurality of region of interest images is preceded by the encryption target image. The frame image encoded as the non-encryption target image is inter-coded as a reference image, and the next non-encryption target image of the encryption target image For the plurality of region-of-interest images extracted from the input image input as the subsequent non-encryption target image, the frame image encoded as the previous non-encryption target image is inter-coded as a reference image. The moving image encoding method according to appendix 9.

(Appendix 12)
Apply predetermined image processing to the input image,
The moving image encoding method according to any one of appendix 9 to appendix 11, further comprising: encoding the input image subjected to the image processing.

(Appendix 13)
Apply predetermined image processing to the input image,
Encode the input image subjected to the image processing,
As the first encoding method, the selected region-of-interest image is inter-coded using the frame image encoded by the input image encoding unit as a reference image, and as the second encoding method, the previous non-encryption is performed. The non-selected region-of-interest image is inter-coded using a frame image encoded as an encoding target image as a reference image, and is input as a non-encrypting target image next to the encryption target image as the third encoding method. For the region-of-interest image corresponding to the selected region-of-interest image among the plurality of region-of-interest images extracted from the input image, the frame image encoded as the encryption target image is inter-coded as a reference image, Of the plurality of region-of-interest images, the region-of-interest image corresponding to the non-selected region-of-interest image is a non-encrypted image prior to the encryption target image. A frame image encoded as a target image is inter-coded as a reference image, and extracted from the input image input as a non-encryption target image subsequent to the non-encryption target image next to the encryption target image 9. The moving image encoding method according to claim 8, wherein the plurality of region-of-interest images are inter-encoded using a frame image encoded as the immediately preceding non-encryption target image as a reference image.

(Appendix 14)
The moving image encoding method according to Supplementary Note 12 or Supplementary Note 13, wherein the predetermined image processing is processing to reduce the input image or mosaic processing only the region-of-interest image included in the input image.

(Appendix 15)
On the computer,
Extract multiple region-of-interest images from sequentially input images,
Regarding the plurality of region-of-interest images extracted from the input image input as the encryption target image, a region-of-interest image different from the region-of-interest image selected from the plurality of region-of-interest images in the previous encryption target image is used. The selected region of interest image is selected and encoded by the first encoding method, and the non-selected region of interest image other than the selected region of interest image is encoded by a second encoding method different from the first encoding method. For the plurality of region-of-interest images extracted from the input image input as a non-encryption target image other than the encryption target image, the first encoding method and the second encoding method Encoding with a different third encoding method,
A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as each of the encryption target images corresponds to the selected region-of-interest image in each of the encryption target images. A moving image encoding program for executing processing including encryption with an encryption key.

(Appendix 16)
A region-of-interest image extraction unit that extracts a plurality of region-of-interest images from input images that are sequentially input, and the plurality of region-of-interest images extracted from the input image that is input as an encryption target image A region-of-interest image that is different from the region-of-interest image selected from the plurality of region-of-interest images is selected as the selected region-of-interest image and encoded by the first encoding method. The selected region-of-interest image is encoded by a second encoding method different from the first encoding method, and the plurality of extracted images are extracted from the input image input as a non-encryption target image other than the encryption target image. The region-of-interest image is encoded by a region-of-interest image encoding unit that performs encoding using a third encoding method different from the first encoding method and the second encoding method. A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as an encryption target image is encrypted with an encryption key corresponding to the selected region-of-interest image in each of the encryption target images. Of the plurality of region-of-interest image images encoded by the moving image encoding device, and encrypted with the encryption key corresponding to the region-of-interest image instructed to be decoded A decryption unit for decrypting a frame image of the selected region-of-interest image with the encryption key;
A region-of-interest image expansion unit that expands a frame image of the region-of-interest image instructed to be decoded;
A video decoding device comprising:

(Appendix 17)
A region-of-interest image extraction unit that extracts a plurality of region-of-interest images from input images that are sequentially input, and the plurality of region-of-interest images extracted from the input image that is input as an encryption target image A region-of-interest image that is different from the region-of-interest image selected from the plurality of region-of-interest images in the image to be converted is selected as the selected region-of-interest image and encoded by the first encoding method. The selected region-of-interest image is encoded by a second encoding method different from the first encoding method, and the plurality of extracted images are extracted from the input image input as a non-encryption target image other than the encryption target image. The region-of-interest image is encoded by a region-of-interest image encoding unit that performs encoding using a third encoding method different from the first encoding method and the second encoding method. A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as an encryption target image is encrypted with an encryption key corresponding to the selected region-of-interest image in each of the encryption target images. Of the plurality of region-of-interest image images encoded by the moving image encoding device, and encrypted with the encryption key corresponding to the region-of-interest image instructed to be decoded Decrypting the frame image of the selected region-of-interest image with the encryption key;
A moving picture decoding method comprising: expanding a frame image of a region of interest image instructed to be decoded.

(Appendix 18)
On the computer,
A region-of-interest image extraction unit that extracts a plurality of region-of-interest images from input images that are sequentially input, and the plurality of region-of-interest images extracted from the input image that is input as an encryption target image A region-of-interest image that is different from the region-of-interest image selected from the plurality of region-of-interest images in the image to be converted is selected as the selected region-of-interest image and encoded by the first encoding method. The selected region-of-interest image is encoded by a second encoding method different from the first encoding method, and the plurality of extracted images are extracted from the input image input as a non-encryption target image other than the encryption target image. The region-of-interest image is encoded by a region-of-interest image encoding unit that performs encoding using a third encoding method different from the first encoding method and the second encoding method. A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as an encryption target image is encrypted with an encryption key corresponding to the selected region-of-interest image in each of the encryption target images. A frame image of the region-of-interest image instructed to be decrypted among the frame images of the plurality of region-of-interest images encoded by the moving image encoding device including:
Decoding a frame image of the selected region-of-interest image encoded as the image to be encrypted with a decryption key corresponding to the region-of-interest image instructed to be decoded. program.

(Appendix 19)
A region-of-interest image extraction unit that extracts a plurality of region-of-interest images from input images that are sequentially input, and the plurality of region-of-interest images extracted from the input image that is input as an encryption target image A region-of-interest image that is different from the region-of-interest image selected from the plurality of region-of-interest images in the image to be converted is selected as the selected region-of-interest image and encoded by the first encoding method. The selected region-of-interest image is encoded by a second encoding method different from the first encoding method, and the plurality of extracted images are extracted from the input image input as a non-encryption target image other than the encryption target image. The region-of-interest image is encoded by a region-of-interest image encoding unit that performs encoding using a third encoding method different from the first encoding method and the second encoding method. A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as an encryption target image is encrypted with an encryption key corresponding to the selected region-of-interest image in each of the encryption target images. A moving image encoding device including:
The frame image of the selected region-of-interest image encrypted with the encryption key corresponding to the region-of-interest image instructed to be decoded among the frame images of the plurality of regions-of-interest images encoded by the moving image encoding device A video decoding device comprising: a decryption unit that decrypts the image with the encryption key; and a region-of-interest image decompression unit that decompresses a frame image of the region-of-interest image instructed to decrypt,
A moving image processing apparatus.

DESCRIPTION OF SYMBOLS 10 Moving image processing device 12 Image capturing device 14 Moving image encoding device 16 Storage device 18 Moving image decoding device 20 Display device 30 Image processing unit 32 Input image encoding unit 34 Region of interest image extraction unit 36 Region of interest image encoding unit 38 Encryption unit 40 Multiplexing unit 60 Separation unit 62 Input image decompression unit 64 Image processing unit 66 Decoding unit 68 Region-of-interest image decompression unit 70 Region-of-interest image cutout unit 72 Composition unit 80, 110 Computer 90 Video encoding program 120 Video decoding program

Claims (16)

A region-of-interest image extraction unit that extracts a plurality of region-of-interest images from sequentially input images;
Regarding the plurality of region-of-interest images extracted from the input image input as the encryption target image, a region-of-interest image different from the region-of-interest image selected from the plurality of region-of-interest images in the previous encryption target image is used. The selected region of interest image is selected and encoded by the first encoding method, and the non-selected region of interest image other than the selected region of interest image is encoded by a second encoding method different from the first encoding method. For the plurality of region-of-interest images extracted from the input image input as a non-encryption target image other than the encryption target image, the first encoding method and the second encoding method A region-of-interest image encoding unit for encoding with a different third encoding method;
A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as each of the encryption target images corresponds to the selected region-of-interest image in each of the encryption target images. An encryption unit for encrypting with an encryption key;
A video encoding device including :
The region-of-interest image encoding unit performs intra encoding on the selected region-of-interest image as the first encoding method, and encodes it as the previous non-encryption target image as the second encoding method. The non-selected region-of-interest image is inter-coded using a frame image as a reference image, and extracted as the third encoding method from the input image input as a non-encryption target image next to the encryption target image. Of the plurality of region-of-interest images, the region-of-interest image corresponding to the selected region-of-interest image is inter-coded as a reference image using a frame image encoded as the encryption target image, and among the plurality of region-of-interest images Regarding the region of interest image corresponding to the non-selected region of interest image, a frame image encoded as a non-encryption target image prior to the encryption target image For the plurality of region-of-interest images extracted from the input image input as a non-encryption target image subsequent to the next non-encryption target image of the encryption target image, A moving image encoding apparatus that inter-encodes a frame image encoded as a preceding non-encryption target image as a reference image. A region-of-interest image extraction unit that extracts a plurality of region-of-interest images from sequentially input images;
Regarding the plurality of region-of-interest images extracted from the input image input as the encryption target image, a region-of-interest image different from the region-of-interest image selected from the plurality of region-of-interest images in the previous encryption target image is used. The selected region of interest image is selected and encoded by the first encoding method, and the non-selected region of interest image other than the selected region of interest image is encoded by a second encoding method different from the first encoding method. For the plurality of region-of-interest images extracted from the input image input as a non-encryption target image other than the encryption target image, the first encoding method and the second encoding method A region-of-interest image encoding unit for encoding with a different third encoding method;
A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as each of the encryption target images corresponds to the selected region-of-interest image in each of the encryption target images. An encryption unit for encrypting with an encryption key;
A video encoding device including:
The region-of-interest image encoding unit intra-codes the selected region-of-interest image as the first encoding method, and replaces the non-selected region-of-interest image with a dummy image as the second encoding method. As the third encoding method, the selected region-of-interest image is selected from among the plurality of region-of-interest images extracted from the input image input as a non-encryption target image next to the encryption target image. For the corresponding region-of-interest image, the frame image encoded as the encryption target image is inter-coded as a reference image, and the region-of-interest image corresponding to the non-selected region-of-interest image among the plurality of region-of-interest images. A frame image encoded as a non-encryption target image before the encryption target image is inter-coded as a reference image, and the encryption target The plurality of region-of-interest images extracted from the input image input as a non-encryption target image after the next non-encryption target image of the image were encoded as the immediately preceding non-encryption target image A moving image coding apparatus that inter-codes a frame image as a reference image . An image processing unit that performs predetermined image processing on the input image;
An input image encoding unit that encodes the input image subjected to the image processing;
The moving picture coding apparatus according to claim 1 or 2, further comprising: The predetermined image processing is processing for reducing the input image or processing for mosaicing only the region of interest image included in the input image.
The moving image encoding apparatus according to claim 3. Computer
Extract multiple region-of-interest images from sequentially input images,
Regarding the plurality of region-of-interest images extracted from the input image input as the encryption target image, a region-of-interest image different from the region-of-interest image selected from the plurality of region-of-interest images in the previous encryption target image is used. The selected region of interest image is selected and encoded by the first encoding method, and the non-selected region of interest image other than the selected region of interest image is encoded by a second encoding method different from the first encoding method. For the plurality of region-of-interest images extracted from the input image input as a non-encryption target image other than the encryption target image, the first encoding method and the second encoding method Encoding with a different third encoding method,
A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as each of the encryption target images corresponds to the selected region-of-interest image in each of the encryption target images. Encrypt with encryption key
A moving image encoding method for performing processing including:
As the first encoding method, the selected region-of-interest image is intra-coded, and as the second encoding method, the frame image encoded as the previous non-encryption target image is used as the non-selected image as a reference image. The region-of-interest image is inter-coded, and as the third encoding method, among the plurality of region-of-interest images extracted from the input image input as a non-encryption target image next to the encryption target image, Regarding the region of interest image corresponding to the selected region of interest image, the frame image encoded as the encryption target image is inter-coded as a reference image, and corresponds to the non-selected region of interest image among the plurality of region of interest images. Regarding the region-of-interest image, a frame image encoded as a non-encryption target image before the encryption target image is used as a reference image. The plurality of region-of-interest images extracted from the input image input as a non-encryption target image after the next non-encryption target image of the encryption target image, and the previous non-encryption target A moving image encoding method in which a frame image encoded as an image is inter-encoded as a reference image. Computer
Extract multiple region-of-interest images from sequentially input images,
Regarding the plurality of region-of-interest images extracted from the input image input as the encryption target image, a region-of-interest image different from the region-of-interest image selected from the plurality of region-of-interest images in the previous encryption target image is used. The selected region of interest image is selected and encoded by the first encoding method, and the non-selected region of interest image other than the selected region of interest image is encoded by a second encoding method different from the first encoding method. For the plurality of region-of-interest images extracted from the input image input as a non-encryption target image other than the encryption target image, the first encoding method and the second encoding method Encoding with a different third encoding method,
A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as each of the encryption target images corresponds to the selected region-of-interest image in each of the encryption target images. Encrypt with encryption key
A moving image encoding method for performing processing including:
As the first encoding method, the selected region-of-interest image is intra-coded, and as the second encoding method, the non-selected region-of-interest image is replaced with a dummy image and intra-coded, and the third encoding is performed. As a method, for the region-of-interest image corresponding to the selected region-of-interest image among the plurality of region-of-interest images extracted from the input image input as the next non-encryption target image of the encryption target image, A frame image encoded as an encryption target image is inter-coded as a reference image, and a region of interest image corresponding to the non-selected region of interest image among the plurality of region of interest images is preceded by the encryption target image. The frame image encoded as the non-encryption target image is inter-coded as a reference image, and the next non-encryption target image of the encryption target image For the plurality of region-of-interest images extracted from the input image input as the subsequent non-encryption target image, the frame image encoded as the previous non-encryption target image is inter-coded as a reference image. Video encoding method. On the computer,
Extract multiple region-of-interest images from sequentially input images,
Regarding the plurality of region-of-interest images extracted from the input image input as the encryption target image, a region-of-interest image different from the region-of-interest image selected from the plurality of region-of-interest images in the previous encryption target image is used. The selected region of interest image is selected and encoded by the first encoding method, and the non-selected region of interest image other than the selected region of interest image is encoded by a second encoding method different from the first encoding method. For the plurality of region-of-interest images extracted from the input image input as a non-encryption target image other than the encryption target image, the first encoding method and the second encoding method Encoding with a different third encoding method,
A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as each of the encryption target images corresponds to the selected region-of-interest image in each of the encryption target images. Encrypt with encryption key
A moving image encoding program for executing processing including:
As the first encoding method, the selected region-of-interest image is intra-coded, and as the second encoding method, the frame image encoded as the previous non-encryption target image is used as the non-selected image as a reference image. The region-of-interest image is inter-coded, and as the third encoding method, among the plurality of region-of-interest images extracted from the input image input as a non-encryption target image next to the encryption target image, Regarding the region of interest image corresponding to the selected region of interest image, the frame image encoded as the encryption target image is inter-coded as a reference image, and corresponds to the non-selected region of interest image among the plurality of region of interest images. Regarding the region-of-interest image, a frame image encoded as a non-encryption target image before the encryption target image is used as a reference image. The plurality of region-of-interest images extracted from the input image input as a non-encryption target image after the next non-encryption target image of the encryption target image, and the previous non-encryption target A moving image encoding program for inter-encoding a frame image encoded as an image as a reference image. On the computer,
Extract multiple region-of-interest images from sequentially input images,
Regarding the plurality of region-of-interest images extracted from the input image input as the encryption target image, a region-of-interest image different from the region-of-interest image selected from the plurality of region-of-interest images in the previous encryption target image is used. The selected region of interest image is selected and encoded by the first encoding method, and the non-selected region of interest image other than the selected region of interest image is encoded by a second encoding method different from the first encoding method. For the plurality of region-of-interest images extracted from the input image input as a non-encryption target image other than the encryption target image, the first encoding method and the second encoding method Encoding with a different third encoding method,
A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as each of the encryption target images corresponds to the selected region-of-interest image in each of the encryption target images. Encrypt with encryption key
A moving image encoding program for executing processing including:
As the first encoding method, the selected region-of-interest image is intra-coded, and as the second encoding method, the non-selected region-of-interest image is replaced with a dummy image and intra-coded, and the third encoding is performed. As a method, for the region-of-interest image corresponding to the selected region-of-interest image among the plurality of region-of-interest images extracted from the input image input as the next non-encryption target image of the encryption target image, A frame image encoded as an encryption target image is inter-coded as a reference image, and a region of interest image corresponding to the non-selected region of interest image among the plurality of region of interest images is preceded by the encryption target image. The frame image encoded as the non-encryption target image is inter-coded as a reference image, and the next non-encryption target image of the encryption target image For the plurality of region-of-interest images extracted from the input image input as the subsequent non-encryption target image, the frame image encoded as the previous non-encryption target image is inter-coded as a reference image. A video encoding program. A region-of-interest image extraction unit that extracts a plurality of region-of-interest images from input images that are sequentially input, and the plurality of region-of-interest images extracted from the input image that is input as an encryption target image A region-of-interest image that is different from the region-of-interest image selected from the plurality of region-of-interest images in the image to be converted is selected as the selected region-of-interest image and encoded by the first encoding method. The selected region-of-interest image is encoded by a second encoding method different from the first encoding method, and the plurality of extracted images are extracted from the input image input as a non-encryption target image other than the encryption target image. The region-of-interest image is encoded by a region-of-interest image encoding unit that performs encoding using a third encoding method different from the first encoding method and the second encoding method. A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as an encryption target image is encrypted with an encryption key corresponding to the selected region-of-interest image in each of the encryption target images. The region-of-interest image encoding unit, as the first encoding method, intra-codes the selected region-of-interest image, and as the second encoding method, The non-selected region-of-interest image is inter-coded using a frame image encoded as a non-encryption target image as a reference image, and as the third encoding method, as a non-encryption target image next to the encryption target image Of the plurality of region-of-interest images extracted from the input image, the region-of-interest image corresponding to the selected region-of-interest image is designated as the encryption target image. The encoded frame image is inter-coded as a reference image, and a region-of-interest image corresponding to the non-selected region-of-interest image among the plurality of region-of-interest images is used as a non-encryption target image before the encryption target image. The encoded frame image is inter-coded as a reference image, and the plurality of images extracted from the input image input as a non-encryption target image subsequent to the next non-encryption target image of the encryption target image For the region-of-interest image, among the frame images of the plurality of region-of-interest images encoded by the moving image encoding device that inter-encodes the frame image encoded as the previous non-encryption target image as a reference image, The frame image of the selected region-of-interest image encrypted with the encryption key corresponding to the region-of-interest image instructed to be decrypted is decrypted with the encryption key. A decryption unit to
A region-of-interest image expansion unit that expands a frame image of the region-of-interest image instructed to be decoded;
A video decoding device comprising: A region-of-interest image extraction unit that extracts a plurality of region-of-interest images from input images that are sequentially input, and the plurality of region-of-interest images extracted from the input image that is input as an encryption target image A region-of-interest image that is different from the region-of-interest image selected from the plurality of region-of-interest images in the image to be converted is selected as the selected region-of-interest image and encoded by the first encoding method. The selected region-of-interest image is encoded by a second encoding method different from the first encoding method, and the plurality of extracted images are extracted from the input image input as a non-encryption target image other than the encryption target image. The region-of-interest image is encoded by a region-of-interest image encoding unit that performs encoding using a third encoding method different from the first encoding method and the second encoding method. A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as an encryption target image is encrypted with an encryption key corresponding to the selected region-of-interest image in each of the encryption target images. And the region-of-interest image encoding unit performs intra-coding of the selected region-of-interest image as the first encoding method and the non-selection as the second encoding method. The region-of-interest image is replaced with a dummy image and intra-encoded, and as the third encoding method, the plurality of interests extracted from the input image input as a non-encryption target image next to the encryption target image Of the region images, the region of interest image corresponding to the selected region of interest image is inter-coded using the frame image encoded as the encryption target image as a reference image. For a region-of-interest image corresponding to the non-selected region-of-interest image among the plurality of region-of-interest images, a frame image encoded as a non-encryption target image before the encryption target image is used as a reference image. The plurality of region-of-interest images encoded and extracted from the input image input as a non-encryption target image after the next non-encryption target image of the encryption target image Corresponding to the region-of-interest image instructed to be decoded among the frame images of the plurality of region-of-interest images encoded by the moving image encoding device that inter-encodes the frame image encoded as the target image as a reference image A decryption unit for decrypting the frame image of the selected region-of-interest image encrypted with the encryption key with the encryption key;
A region-of-interest image expansion unit that expands a frame image of the region-of-interest image instructed to be decoded;
A video decoding device comprising: Computer
A region-of-interest image extraction unit that extracts a plurality of region-of-interest images from input images that are sequentially input, and the plurality of region-of-interest images extracted from the input image that is input as an encryption target image A region-of-interest image that is different from the region-of-interest image selected from the plurality of region-of-interest images in the image to be converted is selected as the selected region-of-interest image and encoded by the first encoding method. The selected region-of-interest image is encoded by a second encoding method different from the first encoding method, and the plurality of extracted images are extracted from the input image input as a non-encryption target image other than the encryption target image. The region-of-interest image is encoded by a region-of-interest image encoding unit that performs encoding using a third encoding method different from the first encoding method and the second encoding method. A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as an encryption target image is encrypted with an encryption key corresponding to the selected region-of-interest image in each of the encryption target images. The region-of-interest image encoding unit, as the first encoding method, intra-codes the selected region-of-interest image, and as the second encoding method, The non-selected region-of-interest image is inter-coded using a frame image encoded as a non-encryption target image as a reference image, and as the third encoding method, as a non-encryption target image next to the encryption target image Of the plurality of region-of-interest images extracted from the input image, the region-of-interest image corresponding to the selected region-of-interest image is designated as the encryption target image. The encoded frame image is inter-coded as a reference image, and a region-of-interest image corresponding to the non-selected region-of-interest image among the plurality of region-of-interest images is used as a non-encryption target image before the encryption target image. The encoded frame image is inter-coded as a reference image, and the plurality of images extracted from the input image input as a non-encryption target image subsequent to the next non-encryption target image of the encryption target image For the region-of-interest image, among the frame images of the plurality of region-of-interest images encoded by the moving image encoding device that inter-encodes the frame image encoded as the previous non-encryption target image as a reference image, The frame image of the selected region-of-interest image encrypted with the encryption key corresponding to the region-of-interest image instructed to be decrypted is decrypted with the encryption key. And
The frame image of the region-of-interest image instructed for decoding is expanded.
A video decoding method for performing processing including the above. Computer
A region-of-interest image extraction unit that extracts a plurality of region-of-interest images from input images that are sequentially input, and the plurality of region-of-interest images extracted from the input image that is input as an encryption target image A region-of-interest image that is different from the region-of-interest image selected from the plurality of region-of-interest images in the image to be converted is selected as the selected region-of-interest image and encoded by the first encoding method. The selected region-of-interest image is encoded by a second encoding method different from the first encoding method, and the plurality of extracted images are extracted from the input image input as a non-encryption target image other than the encryption target image. The region-of-interest image is encoded by a region-of-interest image encoding unit that performs encoding using a third encoding method different from the first encoding method and the second encoding method. A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as an encryption target image is encrypted with an encryption key corresponding to the selected region-of-interest image in each of the encryption target images. And the region-of-interest image encoding unit performs intra-coding of the selected region-of-interest image as the first encoding method and the non-selection as the second encoding method. The region-of-interest image is replaced with a dummy image and intra-encoded, and as the third encoding method, the plurality of interests extracted from the input image input as a non-encryption target image next to the encryption target image Of the region images, the region of interest image corresponding to the selected region of interest image is inter-coded using the frame image encoded as the encryption target image as a reference image. For a region-of-interest image corresponding to the non-selected region-of-interest image among the plurality of region-of-interest images, a frame image encoded as a non-encryption target image before the encryption target image is used as a reference image. The plurality of region-of-interest images encoded and extracted from the input image input as a non-encryption target image after the next non-encryption target image of the encryption target image Corresponding to the region-of-interest image instructed to be decoded among the frame images of the plurality of region-of-interest images encoded by the moving image encoding device that inter-encodes the frame image encoded as the target image as a reference image Decrypting the frame image of the selected region-of-interest image encrypted with the encryption key with the encryption key;
The frame image of the region-of-interest image instructed for decoding is expanded.
A video decoding method for performing processing including the above. On the computer,
A region-of-interest image extraction unit that extracts a plurality of region-of-interest images from input images that are sequentially input, and the plurality of region-of-interest images extracted from the input image that is input as an encryption target image A region-of-interest image that is different from the region-of-interest image selected from the plurality of region-of-interest images in the image to be converted is selected as the selected region-of-interest image and encoded by the first encoding method. The selected region-of-interest image is encoded by a second encoding method different from the first encoding method, and the plurality of extracted images are extracted from the input image input as a non-encryption target image other than the encryption target image. The region-of-interest image is encoded by a region-of-interest image encoding unit that performs encoding using a third encoding method different from the first encoding method and the second encoding method. A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as an encryption target image is encrypted with an encryption key corresponding to the selected region-of-interest image in each of the encryption target images. The region-of-interest image encoding unit, as the first encoding method, intra-codes the selected region-of-interest image, and as the second encoding method, The non-selected region-of-interest image is inter-coded using a frame image encoded as a non-encryption target image as a reference image, and as the third encoding method, as a non-encryption target image next to the encryption target image Of the plurality of region-of-interest images extracted from the input image, the region-of-interest image corresponding to the selected region-of-interest image is designated as the encryption target image. The encoded frame image is inter-coded as a reference image, and a region-of-interest image corresponding to the non-selected region-of-interest image among the plurality of region-of-interest images is used as a non-encryption target image before the encryption target image. The encoded frame image is inter-coded as a reference image, and the plurality of images extracted from the input image input as a non-encryption target image subsequent to the next non-encryption target image of the encryption target image For the region-of-interest image, among the frame images of the plurality of region-of-interest images encoded by the moving image encoding device that inter-encodes the frame image encoded as the previous non-encryption target image as a reference image, The frame image of the selected region-of-interest image encrypted with the encryption key corresponding to the region-of-interest image instructed to be decrypted is decrypted with the encryption key. And
The frame image of the region-of-interest image instructed for decoding is expanded.
A moving picture decoding program for executing processing including the above. On the computer,
A region-of-interest image extraction unit that extracts a plurality of region-of-interest images from input images that are sequentially input, and the plurality of region-of-interest images extracted from the input image that is input as an encryption target image A region-of-interest image that is different from the region-of-interest image selected from the plurality of region-of-interest images in the image to be converted is selected as the selected region-of-interest image and encoded by the first encoding method. The selected region-of-interest image is encoded by a second encoding method different from the first encoding method, and the plurality of extracted images are extracted from the input image input as a non-encryption target image other than the encryption target image. The region-of-interest image is encoded by a region-of-interest image encoding unit that performs encoding using a third encoding method different from the first encoding method and the second encoding method. A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as an encryption target image is encrypted with an encryption key corresponding to the selected region-of-interest image in each of the encryption target images. And the region-of-interest image encoding unit performs intra-coding of the selected region-of-interest image as the first encoding method and the non-selection as the second encoding method. The region-of-interest image is replaced with a dummy image and intra-encoded, and as the third encoding method, the plurality of interests extracted from the input image input as a non-encryption target image next to the encryption target image Of the region images, the region of interest image corresponding to the selected region of interest image is inter-coded using the frame image encoded as the encryption target image as a reference image. For a region-of-interest image corresponding to the non-selected region-of-interest image among the plurality of region-of-interest images, a frame image encoded as a non-encryption target image before the encryption target image is used as a reference image. The plurality of region-of-interest images encoded and extracted from the input image input as a non-encryption target image after the next non-encryption target image of the encryption target image Corresponding to the region-of-interest image instructed to be decoded among the frame images of the plurality of region-of-interest images encoded by the moving image encoding device that inter-encodes the frame image encoded as the target image as a reference image Decrypting the frame image of the selected region-of-interest image encrypted with the encryption key with the encryption key;
The frame image of the region-of-interest image instructed for decoding is expanded.
A moving picture decoding program for executing processing including the above. A region-of-interest image extraction unit that extracts a plurality of region-of-interest images from input images that are sequentially input, and the plurality of region-of-interest images extracted from the input image that is input as an encryption target image A region-of-interest image that is different from the region-of-interest image selected from the plurality of region-of-interest images in the image to be converted is selected as the selected region-of-interest image and encoded by the first encoding method. The selected region-of-interest image is encoded by a second encoding method different from the first encoding method, and the plurality of extracted images are extracted from the input image input as a non-encryption target image other than the encryption target image. The region-of-interest image is encoded by a region-of-interest image encoding unit that performs encoding using a third encoding method different from the first encoding method and the second encoding method. A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as an encryption target image is encrypted with an encryption key corresponding to the selected region-of-interest image in each of the encryption target images. The region-of-interest image encoding unit, as the first encoding method, intra-codes the selected region-of-interest image, and as the second encoding method, The non-selected region-of-interest image is inter-coded using a frame image encoded as a non-encryption target image as a reference image, and as the third encoding method, as a non-encryption target image next to the encryption target image Of the plurality of region-of-interest images extracted from the input image, the region-of-interest image corresponding to the selected region-of-interest image is designated as the encryption target image. The encoded frame image is inter-coded as a reference image, and the region-of-interest image corresponding to the non-selected region-of-interest image among the plurality of regions-of-interest images is a non-encryption target image before the encryption target image. The plurality of images extracted from the input image input as a non-encryption target image subsequent to the next non-encryption target image of the encryption target image. For the region-of-interest image, a video encoding device that inter-encodes a frame image encoded as the immediately preceding non-encryption target image as a reference image;
The frame image of the selected region-of-interest image encrypted with the encryption key corresponding to the region-of-interest image instructed to be decoded among the frame images of the plurality of regions-of-interest images encoded by the moving image encoding device A video decoding device comprising: a decryption unit that decrypts the image with the encryption key; and a region-of-interest image decompression unit that decompresses a frame image of the region-of-interest image instructed to decrypt,
A moving image processing apparatus. A region-of-interest image extraction unit that extracts a plurality of region-of-interest images from input images that are sequentially input, and the plurality of region-of-interest images extracted from the input image that is input as an encryption target image A region-of-interest image that is different from the region-of-interest image selected from the plurality of region-of-interest images in the image to be converted is selected as the selected region-of-interest image and encoded by the first encoding method. The selected region-of-interest image is encoded by a second encoding method different from the first encoding method, and the plurality of extracted images are extracted from the input image input as a non-encryption target image other than the encryption target image. The region-of-interest image is encoded by a region-of-interest image encoding unit that performs encoding using a third encoding method different from the first encoding method and the second encoding method. A frame image obtained by encoding each of the plurality of region-of-interest images extracted from the input image input as an encryption target image is encrypted with an encryption key corresponding to the selected region-of-interest image in each of the encryption target images. And the region-of-interest image encoding unit performs intra-coding of the selected region-of-interest image as the first encoding method and the non-selection as the second encoding method. The region-of-interest image is replaced with a dummy image and intra-encoded, and as the third encoding method, the plurality of interests extracted from the input image input as a non-encryption target image next to the encryption target image Of the region images, the region of interest image corresponding to the selected region of interest image is inter-coded using the frame image encoded as the encryption target image as a reference image. For a region-of-interest image corresponding to the non-selected region-of-interest image among the plurality of region-of-interest images, a frame image encoded as a non-encryption target image before the encryption target image is used as a reference image. The plurality of region-of-interest images encoded and extracted from the input image input as a non-encryption target image after the next non-encryption target image of the encryption target image A video encoding device that inter-codes a frame image encoded as a target image as a reference image;
The frame image of the selected region-of-interest image encrypted with the encryption key corresponding to the region-of-interest image instructed to be decoded among the frame images of the plurality of regions-of-interest images encoded by the moving image encoding device A video decoding device comprising: a decryption unit that decrypts the image with the encryption key; and a region-of-interest image decompression unit that decompresses a frame image of the region-of-interest image instructed to decrypt,
A moving image processing apparatus.